2024-04-23T09:59:51.272 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-23T09:59:51.273 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517 --owner scheduled_leonidus@teuthology --verbose --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} --name leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi -- /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517/orig.config.yaml 2024-04-23T09:59:51.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T09:59:51.429 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517 branch: wip-lusov-quiescer description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: null first_in_suite: false job_id: '7669517' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync rbytes: false syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 0a6c3ed699031b80a2b419e7e795368719871394 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5306 sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_0a6c3ed699031b80a2b419e7e795368719871394/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: 0a6c3ed699031b80a2b419e7e795368719871394 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0IMjmVHRAKX+C1rnZidLJWRViPaMSpuA0m/rGErEkWxmQEf9gPY+K59VJfbkbjHg9q8KNe9UdtDQlxi3F/LI8= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN+CQuaHaPSLGkpJWXiy2DKbIStS2hXQ6l0u0d+NfI0KT/AwOvHoD+55XzAxA/Ns3D2TlJzuHcN+Ms8JxQ71llQ= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKLhG3B8zOd9csQpDbdECjr4j0XyKVGpPdNCPwsWXWM35YAR+7JnzqkZhuMnTQ2Ull96EJzAXkxyRQg+GVlkdgk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_09:49:14 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-23T09:59:51.429 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_0a6c3ed699031b80a2b419e7e795368719871394/qa; will attempt to use it 2024-04-23T09:59:51.430 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_0a6c3ed699031b80a2b419e7e795368719871394/qa/tasks 2024-04-23T09:59:51.430 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-23T09:59:51.432 INFO:teuthology.task.internal:Checking packages... 2024-04-23T09:59:51.463 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd69f13d827952bb07bb9b7973bca14f97d764d6f' 2024-04-23T09:59:51.463 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T09:59:51.463 INFO:teuthology.packaging:ref: None 2024-04-23T09:59:51.463 INFO:teuthology.packaging:tag: None 2024-04-23T09:59:51.463 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-23T09:59:51.463 INFO:teuthology.packaging:sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T09:59:51.464 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer 2024-04-23T09:59:51.620 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156.gd69f13d8 2024-04-23T09:59:51.621 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-23T09:59:51.627 INFO:teuthology.task.internal:no buildpackages task found 2024-04-23T09:59:51.628 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-23T09:59:51.683 INFO:teuthology.task.internal:Saving configuration 2024-04-23T09:59:51.707 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-23T09:59:51.713 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-23T09:59:51.739 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 09:51:13.965142', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0IMjmVHRAKX+C1rnZidLJWRViPaMSpuA0m/rGErEkWxmQEf9gPY+K59VJfbkbjHg9q8KNe9UdtDQlxi3F/LI8='} 2024-04-23T09:59:51.764 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 09:51:13.966597', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN+CQuaHaPSLGkpJWXiy2DKbIStS2hXQ6l0u0d+NfI0KT/AwOvHoD+55XzAxA/Ns3D2TlJzuHcN+Ms8JxQ71llQ='} 2024-04-23T09:59:51.788 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 09:51:13.967723', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKLhG3B8zOd9csQpDbdECjr4j0XyKVGpPdNCPwsWXWM35YAR+7JnzqkZhuMnTQ2Ull96EJzAXkxyRQg+GVlkdgk='} 2024-04-23T09:59:51.789 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-23T09:59:51.796 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-23T09:59:51.796 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-23T09:59:51.796 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-23T09:59:51.797 INFO:teuthology.run_tasks:Running task console_log... 2024-04-23T09:59:51.909 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdedb0da0d0>, signals=[15]) 2024-04-23T09:59:51.910 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-23T09:59:51.916 INFO:teuthology.task.internal:Opening connections... 2024-04-23T09:59:51.916 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2024-04-23T09:59:51.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T09:59:52.000 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2024-04-23T09:59:52.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T09:59:52.120 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-04-23T09:59:52.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T09:59:52.198 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-23T09:59:52.205 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2024-04-23T09:59:52.225 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2024-04-23T09:59:52.225 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T09:59:52.284 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T09:59:52.285 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T09:59:52.285 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-04-23T09:59:52.308 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-04-23T09:59:52.326 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-04-23T09:59:52.326 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-04-23T09:59:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-04-23T09:59:52.383 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T09:59:52.384 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T09:59:52.385 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-04-23T09:59:52.408 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-04-23T09:59:52.426 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-04-23T09:59:52.426 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-04-23T09:59:52.484 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-04-23T09:59:52.484 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-04-23T09:59:52.484 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-04-23T09:59:52.485 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-04-23T09:59:52.485 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-04-23T09:59:52.485 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-04-23T09:59:52.485 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T09:59:52.485 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-04-23T09:59:52.486 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-04-23T09:59:52.486 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T09:59:52.486 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-04-23T09:59:52.486 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T09:59:52.486 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T09:59:52.486 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T09:59:52.487 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-04-23T09:59:52.508 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-23T09:59:52.519 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-23T09:59:52.525 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-23T09:59:52.525 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2024-04-23T09:59:52.528 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2024-04-23T09:59:52.530 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-04-23T09:59:52.546 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-23T09:59:52.554 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-23T09:59:52.554 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2024-04-23T09:59:52.586 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2024-04-23T09:59:52.588 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-04-23T09:59:52.687 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-23T09:59:52.763 INFO:teuthology.run_tasks:Running task kernel... 2024-04-23T09:59:52.777 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-23T09:59:52.777 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-23T09:59:52.777 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-23T09:59:52.778 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T09:59:52.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T09:59:52.795 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2024-04-23T09:59:52.853 INFO:teuthology.orchestra.run.smithi069.stdout:5.14.0-437.el9.x86_64 2024-04-23T09:59:52.853 INFO:teuthology.task.kernel:Running kernel on smithi069: 5.14.0-437.el9.x86_64 2024-04-23T09:59:52.853 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum install -y kernel 2024-04-23T09:59:55.736 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.0 MB 00:01 2024-04-23T10:00:00.561 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 19 MB 00:03 2024-04-23T10:00:04.596 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-23T10:00:06.873 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 16 kB 00:00 2024-04-23T10:00:08.216 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-23T10:00:13.264 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-23T10:00:15.162 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-23T10:00:15.162 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-23T10:00:15.248 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-23T10:00:15.249 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-23T10:00:15.249 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-23T10:00:15.353 DEBUG:teuthology.orchestra.run.smithi069:> echo no | sudo yum reinstall kernel || true 2024-04-23T10:00:15.887 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:02 ago on Tue 23 Apr 2024 10:00:13 AM UTC. 2024-04-23T10:00:16.011 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-23T10:00:16.027 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-23T10:00:16.027 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2024-04-23T10:00:16.027 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-23T10:00:16.027 INFO:teuthology.orchestra.run.smithi069.stdout:Reinstalling: 2024-04-23T10:00:16.027 INFO:teuthology.orchestra.run.smithi069.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T10:00:16.027 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:00:16.027 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-23T10:00:16.027 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-23T10:00:16.028 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:00:16.028 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 255 k 2024-04-23T10:00:16.028 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 0 2024-04-23T10:00:16.028 INFO:teuthology.orchestra.run.smithi069.stderr:Operation aborted. 2024-04-23T10:00:16.081 INFO:teuthology.orchestra.run.smithi069.stdout:Is this ok [y/N]: 2024-04-23T10:00:16.081 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum reinstall -y kernel || true 2024-04-23T10:00:16.574 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:03 ago on Tue 23 Apr 2024 10:00:13 AM UTC. 2024-04-23T10:00:16.689 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-23T10:00:16.690 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-23T10:00:16.690 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2024-04-23T10:00:16.690 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-23T10:00:16.690 INFO:teuthology.orchestra.run.smithi069.stdout:Reinstalling: 2024-04-23T10:00:16.691 INFO:teuthology.orchestra.run.smithi069.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T10:00:16.691 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:00:16.691 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-23T10:00:16.691 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-23T10:00:16.691 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:00:16.691 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 255 k 2024-04-23T10:00:16.691 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 0 2024-04-23T10:00:16.691 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-23T10:00:17.416 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-5.14.0-437.el9.x86_64.rpm 571 kB/s | 255 kB 00:00 2024-04-23T10:00:17.416 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-23T10:00:17.416 INFO:teuthology.orchestra.run.smithi069.stdout:Total 351 kB/s | 255 kB 00:00 2024-04-23T10:00:17.437 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-23T10:00:17.610 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-23T10:00:17.610 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-23T10:00:17.614 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-23T10:00:17.615 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-23T10:00:17.754 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-23T10:00:17.850 INFO:teuthology.orchestra.run.smithi069.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T10:00:17.850 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T10:00:18.618 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T10:00:18.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T10:00:19.308 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T10:00:19.308 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:00:19.308 INFO:teuthology.orchestra.run.smithi069.stdout:Reinstalled: 2024-04-23T10:00:19.308 INFO:teuthology.orchestra.run.smithi069.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-23T10:00:19.308 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:00:19.308 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-23T10:00:19.469 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q kernel | sort -rV | head -n 1 2024-04-23T10:00:19.516 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-23T10:00:19.517 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-23T10:00:19.517 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-23T10:00:19.517 DEBUG:teuthology.parallel:result is None 2024-04-23T10:00:19.517 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-23T10:00:19.526 INFO:teuthology.task.internal:Creating test directory... 2024-04-23T10:00:19.527 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T10:00:19.530 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T10:00:19.532 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T10:00:19.551 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-23T10:00:19.558 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-23T10:00:19.566 INFO:teuthology.task.internal:Creating archive directory... 2024-04-23T10:00:19.566 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T10:00:19.586 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T10:00:19.590 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T10:00:19.638 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-23T10:00:19.649 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-23T10:00:19.649 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T10:00:19.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:00:19.680 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T10:00:19.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:00:19.698 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T10:00:19.726 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T10:00:19.753 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:00:19.754 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:00:19.765 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:00:19.773 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:00:19.783 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:00:19.791 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:00:19.793 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-23T10:00:19.800 INFO:teuthology.task.internal:Configuring sudo... 2024-04-23T10:00:19.801 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T10:00:19.803 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T10:00:19.828 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T10:00:19.861 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-23T10:00:19.871 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-23T10:00:19.872 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T10:00:19.880 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T10:00:19.898 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T10:00:19.918 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T10:00:19.972 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T10:00:20.017 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T10:00:20.099 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T10:00:20.137 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:00:20.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T10:00:20.200 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T10:00:20.245 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T10:00:20.294 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T10:00:20.378 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T10:00:20.419 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-23T10:00:20.419 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T10:00:20.485 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T10:00:20.529 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T10:00:20.592 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T10:00:20.632 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T10:00:20.679 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-23T10:00:20.679 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T10:00:20.747 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2024-04-23T10:00:20.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2024-04-23T10:00:20.760 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-04-23T10:00:20.792 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T10:00:20.792 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T10:00:20.830 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T10:00:21.369 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-23T10:00:21.377 INFO:teuthology.task.internal:Starting timer... 2024-04-23T10:00:21.379 INFO:teuthology.run_tasks:Running task pcp... 2024-04-23T10:00:21.404 INFO:teuthology.run_tasks:Running task selinux... 2024-04-23T10:00:21.413 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-23T10:00:21.413 DEBUG:teuthology.orchestra.run.smithi069:> sudo service auditd rotate 2024-04-23T10:00:21.470 INFO:teuthology.orchestra.run.smithi069.stdout:Rotating logs: 2024-04-23T10:00:21.472 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2024-04-23T10:00:21.541 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2024-04-23T10:00:21.543 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2024-04-23T10:00:21.608 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2024-04-23T10:00:21.610 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-23T10:00:21.610 DEBUG:teuthology.orchestra.run.smithi069:> /usr/sbin/getenforce 2024-04-23T10:00:21.629 INFO:teuthology.orchestra.run.smithi069.stdout:Permissive 2024-04-23T10:00:21.629 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2024-04-23T10:00:21.659 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2024-04-23T10:00:21.659 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2024-04-23T10:00:21.684 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2024-04-23T10:00:21.685 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi069.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi146.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2024-04-23T10:00:21.685 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T10:00:21.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:00:21.709 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T10:00:21.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:00:21.737 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T10:00:21.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:00:21.766 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-23T10:00:21.766 DEBUG:teuthology.orchestra.run.smithi069:> sudo /usr/sbin/setenforce permissive 2024-04-23T10:00:21.792 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2024-04-23T10:00:21.818 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2024-04-23T10:00:21.847 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-23T10:00:21.857 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-23T10:00:21.876 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-23T10:00:21.878 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi069.front.sepia.ceph.com,smithi146.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-23T10:05:13.197 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi069.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2024-04-23T10:05:13.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-04-23T10:05:13.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:05:13.276 DEBUG:teuthology.orchestra.run.smithi069:> true 2024-04-23T10:05:13.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-04-23T10:05:13.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-04-23T10:05:13.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:05:13.431 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-04-23T10:05:13.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-04-23T10:05:13.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-23T10:05:13.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:05:13.589 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-04-23T10:05:13.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-23T10:05:13.670 INFO:teuthology.run_tasks:Running task clock... 2024-04-23T10:05:13.681 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-23T10:05:13.682 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T10:05:13.682 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:05:13.685 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T10:05:13.685 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:05:13.687 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T10:05:13.687 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:05:13.711 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T10:05:13.717 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T10:05:13.724 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T10:05:13.731 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T10:05:13.738 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T10:05:13.747 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: ntpd: command not found 2024-04-23T10:05:13.753 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T10:05:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2024-04-23T10:05:13.757 INFO:teuthology.orchestra.run.smithi069.stdout:506 Cannot talk to daemon 2024-04-23T10:05:13.767 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2024-04-23T10:05:13.770 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T10:05:13.776 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2024-04-23T10:05:13.780 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T10:05:13.783 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T10:05:13.787 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2024-04-23T10:05:13.794 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T10:05:13.800 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T10:05:13.813 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T10:05:13.835 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2024-04-23T10:05:13.838 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T10:05:13.838 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2024-04-23T10:05:13.838 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.838 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.838 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.839 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.849 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-04-23T10:05:13.853 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T10:05:13.853 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-04-23T10:05:13.853 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.853 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.854 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.854 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.864 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-04-23T10:05:13.868 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T10:05:13.868 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-04-23T10:05:13.868 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.868 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.868 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.868 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:05:13.868 INFO:teuthology.run_tasks:Running task install... 2024-04-23T10:05:13.876 DEBUG:teuthology.task.install:project ceph 2024-04-23T10:05:13.876 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}} 2024-04-23T10:05:13.876 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'} 2024-04-23T10:05:13.876 INFO:teuthology.task.install:Using flavor: default 2024-04-23T10:05:13.881 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-23T10:05:13.881 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-23T10:05:13.882 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-23T10:05:13.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:05:13.884 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-23T10:05:13.884 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:05:13.885 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-23T10:05:13.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:05:14.037 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-23T10:05:14.037 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-23T10:05:14.041 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-23T10:05:14.041 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-23T10:05:14.054 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-23T10:05:14.054 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-23T10:05:14.387 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T10:05:14.388 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-23T10:05:14.388 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T10:05:14.390 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T10:05:14.390 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:05:14.390 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T10:05:14.402 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T10:05:14.402 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-23T10:05:14.402 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T10:05:14.415 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-23T10:05:14.416 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T10:05:14.416 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-23T10:05:14.416 DEBUG:teuthology.orchestra.run.smithi069:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T10:05:14.430 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-23T10:05:14.430 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T10:05:14.480 DEBUG:teuthology.orchestra.run.smithi069:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T10:05:14.481 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T10:05:14.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T10:05:14.554 DEBUG:teuthology.orchestra.run.smithi069:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T10:05:14.555 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T10:05:14.573 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T10:05:14.617 INFO:teuthology.orchestra.run.smithi069.stdout:check_obsoletes = 1 2024-04-23T10:05:14.619 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum clean all 2024-04-23T10:05:14.619 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2024-04-23T10:05:14.620 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2024-04-23T10:05:14.636 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2024-04-23T10:05:14.638 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2024-04-23T10:05:14.843 INFO:teuthology.orchestra.run.smithi069.stdout:48 files removed 2024-04-23T10:05:14.845 INFO:teuthology.orchestra.run.smithi167.stdout:48 files removed 2024-04-23T10:05:14.864 INFO:teuthology.orchestra.run.smithi146.stdout:48 files removed 2024-04-23T10:05:14.870 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-23T10:05:14.872 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-23T10:05:14.890 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-23T10:05:16.330 INFO:teuthology.orchestra.run.smithi069.stdout:ceph packages for x86_64 69 kB/s | 83 kB 00:01 2024-04-23T10:05:16.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 63 kB/s | 83 kB 00:01 2024-04-23T10:05:17.229 INFO:teuthology.orchestra.run.smithi069.stdout:ceph noarch packages 14 kB/s | 12 kB 00:00 2024-04-23T10:05:17.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 14 kB/s | 12 kB 00:00 2024-04-23T10:05:18.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2024-04-23T10:05:18.155 INFO:teuthology.orchestra.run.smithi069.stdout:ceph source packages 2.1 kB/s | 1.9 kB 00:00 2024-04-23T10:05:18.638 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-04-23T10:05:18.683 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 24 kB/s | 83 kB 00:03 2024-04-23T10:05:19.413 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.0 MB 00:01 2024-04-23T10:05:19.759 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 11 kB/s | 12 kB 00:01 2024-04-23T10:05:20.592 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2024-04-23T10:05:21.723 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 19 MB 00:02 2024-04-23T10:05:22.500 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.0 MB 00:01 2024-04-23T10:05:29.881 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 1.3 MB/s | 6.2 MB 00:04 2024-04-23T10:05:31.398 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 16 kB 00:00 2024-04-23T10:05:32.583 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-04-23T10:05:37.151 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-04-23T10:05:37.608 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-23T10:05:39.708 INFO:teuthology.orchestra.run.smithi069.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T10:05:39.709 INFO:teuthology.orchestra.run.smithi069.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T10:05:39.719 INFO:teuthology.orchestra.run.smithi069.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-23T10:05:39.720 INFO:teuthology.orchestra.run.smithi069.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-23T10:05:39.721 INFO:teuthology.orchestra.run.smithi069.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-23T10:05:39.722 INFO:teuthology.orchestra.run.smithi069.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-23T10:05:39.723 INFO:teuthology.orchestra.run.smithi069.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-23T10:05:39.725 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-23T10:05:39.726 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-23T10:05:39.785 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-23T10:05:39.794 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================= 2024-04-23T10:05:39.794 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================= 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-23T10:05:39.795 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-23T10:05:39.796 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T10:05:39.797 INFO:teuthology.orchestra.run.smithi069.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T10:05:39.798 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T10:05:39.799 INFO:teuthology.orchestra.run.smithi069.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T10:05:39.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T10:05:39.801 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T10:05:39.802 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T10:05:39.803 INFO:teuthology.orchestra.run.smithi069.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout:Installing weak dependencies: 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-23T10:05:39.804 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================= 2024-04-23T10:05:39.805 INFO:teuthology.orchestra.run.smithi069.stdout:Install 148 Packages 2024-04-23T10:05:39.805 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 4 Packages 2024-04-23T10:05:39.805 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:05:39.805 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 222 M 2024-04-23T10:05:39.805 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-23T10:05:41.460 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.2 MB 00:00 2024-04-23T10:05:41.609 INFO:teuthology.orchestra.run.smithi069.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 5.9 kB/s | 6.6 kB 00:01 2024-04-23T10:05:43.062 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-04-23T10:05:44.097 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-04-23T10:05:45.307 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 895 kB/s | 19 MB 00:21 2024-04-23T10:05:47.617 INFO:teuthology.orchestra.run.smithi069.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 148 kB/s | 890 kB 00:06 2024-04-23T10:05:48.259 INFO:teuthology.orchestra.run.smithi069.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 226 kB/s | 145 kB 00:00 2024-04-23T10:05:49.130 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-23T10:05:50.266 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.2 MB 00:01 2024-04-23T10:05:51.248 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T10:05:51.249 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T10:05:51.259 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-23T10:05:51.260 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-23T10:05:51.261 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-23T10:05:51.262 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-23T10:05:51.263 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-23T10:05:51.266 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-23T10:05:51.267 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-23T10:05:51.326 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-04-23T10:05:51.342 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-04-23T10:05:51.342 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-04-23T10:05:51.342 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-04-23T10:05:51.342 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-23T10:05:51.343 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-23T10:05:51.344 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-23T10:05:51.345 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T10:05:51.346 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T10:05:51.347 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-23T10:05:51.348 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T10:05:51.349 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T10:05:51.350 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T10:05:51.351 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T10:05:51.352 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T10:05:51.353 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T10:05:51.353 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T10:05:51.353 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T10:05:51.353 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-23T10:05:51.353 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T10:05:51.353 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-23T10:05:51.353 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2024-04-23T10:05:51.353 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T10:05:51.353 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:05:51.353 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-04-23T10:05:51.354 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-04-23T10:05:51.354 INFO:teuthology.orchestra.run.smithi167.stdout:Install 148 Packages 2024-04-23T10:05:51.354 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 4 Packages 2024-04-23T10:05:51.354 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:05:51.354 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 222 M 2024-04-23T10:05:51.354 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-04-23T10:05:52.252 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 16 kB 00:00 2024-04-23T10:05:52.690 INFO:teuthology.orchestra.run.smithi167.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 14 kB/s | 6.6 kB 00:00 2024-04-23T10:05:53.202 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-04-23T10:05:56.407 INFO:teuthology.orchestra.run.smithi167.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 239 kB/s | 890 kB 00:03 2024-04-23T10:05:57.282 INFO:teuthology.orchestra.run.smithi167.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 165 kB/s | 145 kB 00:00 2024-04-23T10:05:58.310 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-04-23T10:05:59.950 INFO:teuthology.orchestra.run.smithi069.stdout:(4/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 207 kB/s | 2.4 MB 00:11 2024-04-23T10:06:00.420 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T10:06:00.421 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-23T10:06:00.431 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-23T10:06:00.432 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-23T10:06:00.433 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-23T10:06:00.434 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-23T10:06:00.435 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-23T10:06:00.437 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-23T10:06:00.438 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-23T10:06:00.499 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-04-23T10:06:00.524 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-23T10:06:00.525 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-23T10:06:00.526 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-23T10:06:00.527 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-23T10:06:00.528 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T10:06:00.529 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T10:06:00.530 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T10:06:00.531 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T10:06:00.532 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T10:06:00.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T10:06:00.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout:Installing weak dependencies: 2024-04-23T10:06:00.535 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T10:06:00.536 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:06:00.536 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-04-23T10:06:00.536 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-04-23T10:06:00.536 INFO:teuthology.orchestra.run.smithi146.stdout:Install 148 Packages 2024-04-23T10:06:00.536 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 4 Packages 2024-04-23T10:06:00.536 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:06:00.536 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 222 M 2024-04-23T10:06:00.537 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-04-23T10:06:01.479 INFO:teuthology.orchestra.run.smithi146.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 14 kB/s | 6.6 kB 00:00 2024-04-23T10:06:02.845 INFO:teuthology.orchestra.run.smithi146.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 651 kB/s | 890 kB 00:01 2024-04-23T10:06:03.529 INFO:teuthology.orchestra.run.smithi146.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 212 kB/s | 145 kB 00:00 2024-04-23T10:06:06.000 INFO:teuthology.orchestra.run.smithi069.stdout:(5/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 253 kB/s | 1.5 MB 00:06 2024-04-23T10:06:06.664 INFO:teuthology.orchestra.run.smithi167.stdout:(4/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 258 kB/s | 2.4 MB 00:09 2024-04-23T10:06:13.622 INFO:teuthology.orchestra.run.smithi167.stdout:(5/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 220 kB/s | 1.5 MB 00:06 2024-04-23T10:06:13.836 INFO:teuthology.orchestra.run.smithi146.stdout:(4/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 235 kB/s | 2.4 MB 00:10 2024-04-23T10:06:17.540 INFO:teuthology.orchestra.run.smithi069.stdout:(6/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 148 kB/s | 5.4 MB 00:37 2024-04-23T10:06:23.286 INFO:teuthology.orchestra.run.smithi146.stdout:(5/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 162 kB/s | 1.5 MB 00:09 2024-04-23T10:06:27.888 INFO:teuthology.orchestra.run.smithi167.stdout:(6/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 154 kB/s | 5.4 MB 00:35 2024-04-23T10:06:28.085 INFO:teuthology.orchestra.run.smithi146.stdout:(6/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 203 kB/s | 5.4 MB 00:27 2024-04-23T10:06:31.104 INFO:teuthology.orchestra.run.smithi167.stdout:(7/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 275 kB/s | 4.7 MB 00:17 2024-04-23T10:06:35.245 INFO:teuthology.orchestra.run.smithi069.stdout:(7/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 164 kB/s | 4.7 MB 00:29 2024-04-23T10:06:57.332 INFO:teuthology.orchestra.run.smithi146.stdout:(7/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 141 kB/s | 4.7 MB 00:34 2024-04-23T10:07:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:(8/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el7 232 kB/s | 11 MB 00:46 2024-04-23T10:07:17.949 INFO:teuthology.orchestra.run.smithi167.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 137 kB/s | 25 kB 00:00 2024-04-23T10:07:28.290 INFO:teuthology.orchestra.run.smithi069.stdout:(8/152): ceph-common-19.0.0-3156.gd69f13d8.el7. 201 kB/s | 21 MB 01:47 2024-04-23T10:07:28.706 INFO:teuthology.orchestra.run.smithi069.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 60 kB/s | 25 kB 00:00 2024-04-23T10:07:31.364 INFO:teuthology.orchestra.run.smithi069.stdout:(10/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 193 kB/s | 11 MB 00:56 2024-04-23T10:07:32.186 INFO:teuthology.orchestra.run.smithi146.stdout:(8/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x86 269 kB/s | 17 MB 01:04 2024-04-23T10:07:32.723 INFO:teuthology.orchestra.run.smithi069.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 165 kB/s | 225 kB 00:01 2024-04-23T10:07:32.936 INFO:teuthology.orchestra.run.smithi146.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 33 kB/s | 25 kB 00:00 2024-04-23T10:07:32.940 INFO:teuthology.orchestra.run.smithi069.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 125 kB/s | 27 kB 00:00 2024-04-23T10:07:33.332 INFO:teuthology.orchestra.run.smithi069.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 81 kB/s | 32 kB 00:00 2024-04-23T10:07:37.373 INFO:teuthology.orchestra.run.smithi069.stdout:(14/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 185 kB/s | 747 kB 00:04 2024-04-23T10:07:38.723 INFO:teuthology.orchestra.run.smithi069.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 121 kB/s | 163 kB 00:01 2024-04-23T10:07:39.498 INFO:teuthology.orchestra.run.smithi069.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 163 kB/s | 126 kB 00:00 2024-04-23T10:07:42.790 INFO:teuthology.orchestra.run.smithi069.stdout:(17/152): libradosstriper1-19.0.0-3156.gd69f13d 152 kB/s | 500 kB 00:03 2024-04-23T10:07:57.263 INFO:teuthology.orchestra.run.smithi069.stdout:(18/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x8 173 kB/s | 17 MB 01:39 2024-04-23T10:07:57.480 INFO:teuthology.orchestra.run.smithi069.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 208 kB/s | 45 kB 00:00 2024-04-23T10:07:57.549 INFO:teuthology.orchestra.run.smithi146.stdout:(10/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 180 kB/s | 11 MB 01:00 2024-04-23T10:07:58.014 INFO:teuthology.orchestra.run.smithi069.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 253 kB/s | 135 kB 00:00 2024-04-23T10:07:58.514 INFO:teuthology.orchestra.run.smithi069.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 323 kB/s | 161 kB 00:00 2024-04-23T10:07:58.924 INFO:teuthology.orchestra.run.smithi146.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 163 kB/s | 225 kB 00:01 2024-04-23T10:07:59.191 INFO:teuthology.orchestra.run.smithi146.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 101 kB/s | 27 kB 00:00 2024-04-23T10:07:59.424 INFO:teuthology.orchestra.run.smithi146.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 136 kB/s | 32 kB 00:00 2024-04-23T10:07:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 298 kB/s | 320 kB 00:01 2024-04-23T10:08:00.461 INFO:teuthology.orchestra.run.smithi167.stdout:(10/152): ceph-common-19.0.0-3156.gd69f13d8.el7 169 kB/s | 21 MB 02:08 2024-04-23T10:08:00.973 INFO:teuthology.orchestra.run.smithi069.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 215 kB/s | 298 kB 00:01 2024-04-23T10:08:01.473 INFO:teuthology.orchestra.run.smithi069.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 199 kB/s | 99 kB 00:00 2024-04-23T10:08:01.574 INFO:teuthology.orchestra.run.smithi146.stdout:(14/152): ceph-common-19.0.0-3156.gd69f13d8.el7 179 kB/s | 21 MB 02:00 2024-04-23T10:08:01.773 INFO:teuthology.orchestra.run.smithi069.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 284 kB/s | 85 kB 00:00 2024-04-23T10:08:01.794 INFO:teuthology.orchestra.run.smithi167.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 169 kB/s | 225 kB 00:01 2024-04-23T10:08:02.011 INFO:teuthology.orchestra.run.smithi167.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 125 kB/s | 27 kB 00:00 2024-04-23T10:08:02.166 INFO:teuthology.orchestra.run.smithi146.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 276 kB/s | 163 kB 00:00 2024-04-23T10:08:02.228 INFO:teuthology.orchestra.run.smithi167.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 146 kB/s | 32 kB 00:00 2024-04-23T10:08:02.792 INFO:teuthology.orchestra.run.smithi146.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 202 kB/s | 126 kB 00:00 2024-04-23T10:08:02.983 INFO:teuthology.orchestra.run.smithi146.stdout:(17/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 210 kB/s | 747 kB 00:03 2024-04-23T10:08:06.108 INFO:teuthology.orchestra.run.smithi146.stdout:(18/152): libradosstriper1-19.0.0-3156.gd69f13d 151 kB/s | 500 kB 00:03 2024-04-23T10:08:06.592 INFO:teuthology.orchestra.run.smithi146.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 93 kB/s | 45 kB 00:00 2024-04-23T10:08:07.428 INFO:teuthology.orchestra.run.smithi167.stdout:(14/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 144 kB/s | 747 kB 00:05 2024-04-23T10:08:07.458 INFO:teuthology.orchestra.run.smithi146.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 155 kB/s | 135 kB 00:00 2024-04-23T10:08:08.212 INFO:teuthology.orchestra.run.smithi167.stdout:(15/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x8 172 kB/s | 17 MB 01:40 2024-04-23T10:08:08.809 INFO:teuthology.orchestra.run.smithi146.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 120 kB/s | 161 kB 00:01 2024-04-23T10:08:09.553 INFO:teuthology.orchestra.run.smithi167.stdout:(16/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 77 kB/s | 163 kB 00:02 2024-04-23T10:08:09.579 INFO:teuthology.orchestra.run.smithi167.stdout:(17/152): librados-devel-19.0.0-3156.gd69f13d8. 93 kB/s | 126 kB 00:01 2024-04-23T10:08:10.758 INFO:teuthology.orchestra.run.smithi146.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 164 kB/s | 320 kB 00:01 2024-04-23T10:08:11.105 INFO:teuthology.orchestra.run.smithi069.stdout:(26/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 194 kB/s | 5.4 MB 00:28 2024-04-23T10:08:11.972 INFO:teuthology.orchestra.run.smithi069.stdout:(27/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 197 kB/s | 170 kB 00:00 2024-04-23T10:08:12.214 INFO:teuthology.orchestra.run.smithi069.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3156.g 141 kB/s | 34 kB 00:00 2024-04-23T10:08:12.293 INFO:teuthology.orchestra.run.smithi146.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 194 kB/s | 298 kB 00:01 2024-04-23T10:08:12.806 INFO:teuthology.orchestra.run.smithi069.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 240 kB/s | 142 kB 00:00 2024-04-23T10:08:12.884 INFO:teuthology.orchestra.run.smithi146.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 168 kB/s | 99 kB 00:00 2024-04-23T10:08:13.212 INFO:teuthology.orchestra.run.smithi167.stdout:(18/152): libradosstriper1-19.0.0-3156.gd69f13d 137 kB/s | 500 kB 00:03 2024-04-23T10:08:13.620 INFO:teuthology.orchestra.run.smithi167.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 110 kB/s | 45 kB 00:00 2024-04-23T10:08:13.631 INFO:teuthology.orchestra.run.smithi069.stdout:(30/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 267 kB/s | 3.1 MB 00:11 2024-04-23T10:08:13.876 INFO:teuthology.orchestra.run.smithi146.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 86 kB/s | 85 kB 00:00 2024-04-23T10:08:14.445 INFO:teuthology.orchestra.run.smithi167.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 163 kB/s | 135 kB 00:00 2024-04-23T10:08:15.271 INFO:teuthology.orchestra.run.smithi167.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 196 kB/s | 161 kB 00:00 2024-04-23T10:08:16.996 INFO:teuthology.orchestra.run.smithi167.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 186 kB/s | 320 kB 00:01 2024-04-23T10:08:18.421 INFO:teuthology.orchestra.run.smithi167.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 209 kB/s | 298 kB 00:01 2024-04-23T10:08:18.821 INFO:teuthology.orchestra.run.smithi167.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 248 kB/s | 99 kB 00:00 2024-04-23T10:08:19.146 INFO:teuthology.orchestra.run.smithi167.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 262 kB/s | 85 kB 00:00 2024-04-23T10:08:25.230 INFO:teuthology.orchestra.run.smithi069.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 292 kB/s | 3.5 MB 00:12 2024-04-23T10:08:26.197 INFO:teuthology.orchestra.run.smithi069.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3156.gd6 257 kB/s | 249 kB 00:00 2024-04-23T10:08:26.522 INFO:teuthology.orchestra.run.smithi069.stdout:(33/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 152 kB/s | 49 kB 00:00 2024-04-23T10:08:26.639 INFO:teuthology.orchestra.run.smithi069.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3156.gd 141 kB/s | 16 kB 00:00 2024-04-23T10:08:27.199 INFO:teuthology.orchestra.run.smithi146.stdout:(26/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 237 kB/s | 3.1 MB 00:13 2024-04-23T10:08:27.791 INFO:teuthology.orchestra.run.smithi146.stdout:(27/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 288 kB/s | 170 kB 00:00 2024-04-23T10:08:27.900 INFO:teuthology.orchestra.run.smithi146.stdout:(28/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 220 kB/s | 5.4 MB 00:24 2024-04-23T10:08:28.025 INFO:teuthology.orchestra.run.smithi146.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3156.g 146 kB/s | 34 kB 00:00 2024-04-23T10:08:28.247 INFO:teuthology.orchestra.run.smithi069.stdout:(35/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 170 kB/s | 273 kB 00:01 2024-04-23T10:08:28.334 INFO:teuthology.orchestra.run.smithi146.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 328 kB/s | 142 kB 00:00 2024-04-23T10:08:30.806 INFO:teuthology.orchestra.run.smithi069.stdout:(36/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 298 kB/s | 762 kB 00:02 2024-04-23T10:08:30.870 INFO:teuthology.orchestra.run.smithi167.stdout:(26/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 258 kB/s | 5.4 MB 00:21 2024-04-23T10:08:30.922 INFO:teuthology.orchestra.run.smithi069.stdout:(37/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 156 kB/s | 18 kB 00:00 2024-04-23T10:08:31.031 INFO:teuthology.orchestra.run.smithi069.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 742 kB/s | 80 kB 00:00 2024-04-23T10:08:31.156 INFO:teuthology.orchestra.run.smithi069.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-04-23T10:08:31.206 INFO:teuthology.orchestra.run.smithi069.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-04-23T10:08:31.273 INFO:teuthology.orchestra.run.smithi069.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-04-23T10:08:31.354 INFO:teuthology.orchestra.run.smithi167.stdout:(27/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 353 kB/s | 170 kB 00:00 2024-04-23T10:08:31.357 INFO:teuthology.orchestra.run.smithi069.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-04-23T10:08:31.399 INFO:teuthology.orchestra.run.smithi069.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-04-23T10:08:31.449 INFO:teuthology.orchestra.run.smithi069.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-04-23T10:08:31.499 INFO:teuthology.orchestra.run.smithi069.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-23T10:08:31.504 INFO:teuthology.orchestra.run.smithi167.stdout:(28/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 256 kB/s | 3.1 MB 00:12 2024-04-23T10:08:31.549 INFO:teuthology.orchestra.run.smithi069.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-23T10:08:31.608 INFO:teuthology.orchestra.run.smithi069.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 12 MB/s | 689 kB 00:00 2024-04-23T10:08:31.675 INFO:teuthology.orchestra.run.smithi069.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-04-23T10:08:31.725 INFO:teuthology.orchestra.run.smithi069.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-23T10:08:31.776 INFO:teuthology.orchestra.run.smithi069.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 431 kB/s | 21 kB 00:00 2024-04-23T10:08:31.826 INFO:teuthology.orchestra.run.smithi069.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-23T10:08:31.877 INFO:teuthology.orchestra.run.smithi069.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-04-23T10:08:31.987 INFO:teuthology.orchestra.run.smithi167.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3156.g 54 kB/s | 34 kB 00:00 2024-04-23T10:08:31.993 INFO:teuthology.orchestra.run.smithi069.stdout:(53/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-23T10:08:32.044 INFO:teuthology.orchestra.run.smithi069.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-04-23T10:08:32.094 INFO:teuthology.orchestra.run.smithi069.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-04-23T10:08:32.113 INFO:teuthology.orchestra.run.smithi167.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 233 kB/s | 142 kB 00:00 2024-04-23T10:08:32.144 INFO:teuthology.orchestra.run.smithi069.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-23T10:08:32.216 INFO:teuthology.orchestra.run.smithi069.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 637 kB/s | 45 kB 00:00 2024-04-23T10:08:32.287 INFO:teuthology.orchestra.run.smithi069.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 9.2 MB/s | 662 kB 00:00 2024-04-23T10:08:32.337 INFO:teuthology.orchestra.run.smithi069.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 582 kB 00:00 2024-04-23T10:08:32.379 INFO:teuthology.orchestra.run.smithi069.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 611 kB/s | 25 kB 00:00 2024-04-23T10:08:32.421 INFO:teuthology.orchestra.run.smithi069.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-23T10:08:32.496 INFO:teuthology.orchestra.run.smithi069.stdout:(62/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-23T10:08:32.546 INFO:teuthology.orchestra.run.smithi069.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-23T10:08:32.588 INFO:teuthology.orchestra.run.smithi069.stdout:(64/152): openblas-0.3.21-2.el9.x86_64.rpm 846 kB/s | 35 kB 00:00 2024-04-23T10:08:32.722 INFO:teuthology.orchestra.run.smithi069.stdout:(65/152): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-04-23T10:08:32.864 INFO:teuthology.orchestra.run.smithi069.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-04-23T10:08:32.939 INFO:teuthology.orchestra.run.smithi069.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-04-23T10:08:33.006 INFO:teuthology.orchestra.run.smithi069.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 13 MB/s | 911 kB 00:00 2024-04-23T10:08:33.056 INFO:teuthology.orchestra.run.smithi069.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.6 MB/s | 133 kB 00:00 2024-04-23T10:08:33.215 INFO:teuthology.orchestra.run.smithi069.stdout:(70/152): postgresql-server-13.14-1.el9.x86_64. 37 MB/s | 5.8 MB 00:00 2024-04-23T10:08:33.282 INFO:teuthology.orchestra.run.smithi069.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-04-23T10:08:33.332 INFO:teuthology.orchestra.run.smithi069.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-04-23T10:08:33.499 INFO:teuthology.orchestra.run.smithi069.stdout:(73/152): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-04-23T10:08:33.550 INFO:teuthology.orchestra.run.smithi069.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-04-23T10:08:33.600 INFO:teuthology.orchestra.run.smithi069.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-04-23T10:08:33.650 INFO:teuthology.orchestra.run.smithi069.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-04-23T10:08:33.692 INFO:teuthology.orchestra.run.smithi069.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-04-23T10:08:33.742 INFO:teuthology.orchestra.run.smithi069.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-23T10:08:33.793 INFO:teuthology.orchestra.run.smithi069.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-04-23T10:08:33.943 INFO:teuthology.orchestra.run.smithi069.stdout:(80/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-04-23T10:08:34.001 INFO:teuthology.orchestra.run.smithi069.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-23T10:08:34.052 INFO:teuthology.orchestra.run.smithi069.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-04-23T10:08:34.102 INFO:teuthology.orchestra.run.smithi069.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-23T10:08:34.153 INFO:teuthology.orchestra.run.smithi069.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-04-23T10:08:34.203 INFO:teuthology.orchestra.run.smithi069.stdout:(85/152): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-04-23T10:08:34.253 INFO:teuthology.orchestra.run.smithi069.stdout:(86/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-23T10:08:34.303 INFO:teuthology.orchestra.run.smithi069.stdout:(87/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-23T10:08:34.354 INFO:teuthology.orchestra.run.smithi069.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-23T10:08:34.404 INFO:teuthology.orchestra.run.smithi069.stdout:(89/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-23T10:08:34.771 INFO:teuthology.orchestra.run.smithi069.stdout:(90/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-04-23T10:08:34.813 INFO:teuthology.orchestra.run.smithi069.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-04-23T10:08:34.863 INFO:teuthology.orchestra.run.smithi069.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-04-23T10:08:34.913 INFO:teuthology.orchestra.run.smithi069.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-23T10:08:34.964 INFO:teuthology.orchestra.run.smithi069.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 720 kB/s | 36 kB 00:00 2024-04-23T10:08:35.014 INFO:teuthology.orchestra.run.smithi069.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-04-23T10:08:35.064 INFO:teuthology.orchestra.run.smithi069.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-23T10:08:35.106 INFO:teuthology.orchestra.run.smithi069.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-04-23T10:08:35.156 INFO:teuthology.orchestra.run.smithi069.stdout:(98/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-23T10:08:35.198 INFO:teuthology.orchestra.run.smithi069.stdout:(99/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-23T10:08:35.240 INFO:teuthology.orchestra.run.smithi069.stdout:(100/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-23T10:08:35.282 INFO:teuthology.orchestra.run.smithi069.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 534 kB/s | 22 kB 00:00 2024-04-23T10:08:35.383 INFO:teuthology.orchestra.run.smithi069.stdout:(102/152): protobuf-compiler-3.14.0-13.el9.x86_ 8.4 MB/s | 863 kB 00:00 2024-04-23T10:08:36.066 INFO:teuthology.orchestra.run.smithi069.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 802 kB/s | 548 kB 00:00 2024-04-23T10:08:36.158 INFO:teuthology.orchestra.run.smithi069.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-04-23T10:08:36.276 INFO:teuthology.orchestra.run.smithi069.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 165 kB/s | 19 kB 00:00 2024-04-23T10:08:36.567 INFO:teuthology.orchestra.run.smithi069.stdout:(106/152): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-23T10:08:36.642 INFO:teuthology.orchestra.run.smithi069.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-04-23T10:08:36.720 INFO:teuthology.orchestra.run.smithi069.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 630 kB/s | 49 kB 00:00 2024-04-23T10:08:36.787 INFO:teuthology.orchestra.run.smithi069.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-23T10:08:36.862 INFO:teuthology.orchestra.run.smithi069.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-04-23T10:08:36.954 INFO:teuthology.orchestra.run.smithi069.stdout:(111/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.0 MB/s | 838 kB 00:00 2024-04-23T10:08:37.029 INFO:teuthology.orchestra.run.smithi069.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-04-23T10:08:37.163 INFO:teuthology.orchestra.run.smithi069.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 326 kB/s | 43 kB 00:00 2024-04-23T10:08:37.230 INFO:teuthology.orchestra.run.smithi069.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 484 kB/s | 32 kB 00:00 2024-04-23T10:08:37.296 INFO:teuthology.orchestra.run.smithi069.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 225 kB/s | 15 kB 00:00 2024-04-23T10:08:37.380 INFO:teuthology.orchestra.run.smithi069.stdout:(116/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-23T10:08:37.455 INFO:teuthology.orchestra.run.smithi069.stdout:(117/152): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-04-23T10:08:37.531 INFO:teuthology.orchestra.run.smithi069.stdout:(118/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-04-23T10:08:37.597 INFO:teuthology.orchestra.run.smithi069.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 529 kB/s | 35 kB 00:00 2024-04-23T10:08:37.673 INFO:teuthology.orchestra.run.smithi069.stdout:(120/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-23T10:08:37.790 INFO:teuthology.orchestra.run.smithi069.stdout:(121/152): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-04-23T10:08:37.865 INFO:teuthology.orchestra.run.smithi069.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-04-23T10:08:37.932 INFO:teuthology.orchestra.run.smithi069.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 161 kB/s | 11 kB 00:00 2024-04-23T10:08:37.999 INFO:teuthology.orchestra.run.smithi069.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2024-04-23T10:08:38.083 INFO:teuthology.orchestra.run.smithi069.stdout:(125/152): ceph-mgr-diskprediction-local-19.0.0 309 kB/s | 7.4 MB 00:24 2024-04-23T10:08:38.099 INFO:teuthology.orchestra.run.smithi069.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-04-23T10:08:38.175 INFO:teuthology.orchestra.run.smithi069.stdout:(127/152): python3-jaraco-text-3.2.0-6.el9.noar 262 kB/s | 20 kB 00:00 2024-04-23T10:08:38.267 INFO:teuthology.orchestra.run.smithi069.stdout:(128/152): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-04-23T10:08:38.325 INFO:teuthology.orchestra.run.smithi069.stdout:(129/152): python3-jaraco-functools-3.5.0-2.el9 80 kB/s | 19 kB 00:00 2024-04-23T10:08:38.342 INFO:teuthology.orchestra.run.smithi069.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 616 kB/s | 46 kB 00:00 2024-04-23T10:08:38.401 INFO:teuthology.orchestra.run.smithi069.stdout:(131/152): python3-natsort-7.1.1-5.el9.noarch.r 991 kB/s | 58 kB 00:00 2024-04-23T10:08:38.466 INFO:teuthology.orchestra.run.smithi146.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 347 kB/s | 3.5 MB 00:10 2024-04-23T10:08:38.484 INFO:teuthology.orchestra.run.smithi069.stdout:(132/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-23T10:08:38.510 INFO:teuthology.orchestra.run.smithi069.stdout:(133/152): python3-more-itertools-8.12.0-2.el9. 428 kB/s | 79 kB 00:00 2024-04-23T10:08:38.551 INFO:teuthology.orchestra.run.smithi069.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-04-23T10:08:38.627 INFO:teuthology.orchestra.run.smithi069.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 770 kB/s | 90 kB 00:00 2024-04-23T10:08:38.643 INFO:teuthology.orchestra.run.smithi069.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-04-23T10:08:38.702 INFO:teuthology.orchestra.run.smithi069.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 410 kB/s | 31 kB 00:00 2024-04-23T10:08:38.727 INFO:teuthology.orchestra.run.smithi069.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-04-23T10:08:38.795 INFO:teuthology.orchestra.run.smithi069.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 641 kB/s | 59 kB 00:00 2024-04-23T10:08:38.820 INFO:teuthology.orchestra.run.smithi069.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-04-23T10:08:38.887 INFO:teuthology.orchestra.run.smithi069.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 555 kB/s | 51 kB 00:00 2024-04-23T10:08:38.912 INFO:teuthology.orchestra.run.smithi069.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-23T10:08:38.987 INFO:teuthology.orchestra.run.smithi069.stdout:(143/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-04-23T10:08:39.013 INFO:teuthology.orchestra.run.smithi069.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 715 kB/s | 90 kB 00:00 2024-04-23T10:08:39.055 INFO:teuthology.orchestra.run.smithi069.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-04-23T10:08:39.163 INFO:teuthology.orchestra.run.smithi069.stdout:(146/152): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-23T10:08:39.189 INFO:teuthology.orchestra.run.smithi069.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-04-23T10:08:39.241 INFO:teuthology.orchestra.run.smithi146.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3156.gd6 321 kB/s | 249 kB 00:00 2024-04-23T10:08:39.466 INFO:teuthology.orchestra.run.smithi146.stdout:(33/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 219 kB/s | 49 kB 00:00 2024-04-23T10:08:39.575 INFO:teuthology.orchestra.run.smithi146.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3156.gd 152 kB/s | 16 kB 00:00 2024-04-23T10:08:40.284 INFO:teuthology.orchestra.run.smithi146.stdout:(35/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 385 kB/s | 273 kB 00:00 2024-04-23T10:08:42.104 INFO:teuthology.orchestra.run.smithi167.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 358 kB/s | 3.5 MB 00:10 2024-04-23T10:08:42.467 INFO:teuthology.orchestra.run.smithi146.stdout:(36/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 349 kB/s | 762 kB 00:02 2024-04-23T10:08:42.584 INFO:teuthology.orchestra.run.smithi146.stdout:(37/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 156 kB/s | 18 kB 00:00 2024-04-23T10:08:42.721 INFO:teuthology.orchestra.run.smithi167.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3156.gd6 404 kB/s | 249 kB 00:00 2024-04-23T10:08:42.921 INFO:teuthology.orchestra.run.smithi167.stdout:(33/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 247 kB/s | 49 kB 00:00 2024-04-23T10:08:43.038 INFO:teuthology.orchestra.run.smithi167.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3156.gd 141 kB/s | 16 kB 00:00 2024-04-23T10:08:43.284 INFO:teuthology.orchestra.run.smithi146.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 115 kB/s | 80 kB 00:00 2024-04-23T10:08:43.722 INFO:teuthology.orchestra.run.smithi167.stdout:(35/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 400 kB/s | 273 kB 00:00 2024-04-23T10:08:44.984 INFO:teuthology.orchestra.run.smithi146.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 473 kB/s | 803 kB 00:01 2024-04-23T10:08:45.709 INFO:teuthology.orchestra.run.smithi146.stdout:(40/152): ceph-mgr-diskprediction-local-19.0.0- 435 kB/s | 7.4 MB 00:17 2024-04-23T10:08:45.822 INFO:teuthology.orchestra.run.smithi167.stdout:(36/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 363 kB/s | 762 kB 00:02 2024-04-23T10:08:45.851 INFO:teuthology.orchestra.run.smithi146.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 225 kB/s | 195 kB 00:00 2024-04-23T10:08:45.930 INFO:teuthology.orchestra.run.smithi167.stdout:(37/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 169 kB/s | 18 kB 00:00 2024-04-23T10:08:46.080 INFO:teuthology.orchestra.run.smithi167.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 537 kB/s | 80 kB 00:00 2024-04-23T10:08:46.314 INFO:teuthology.orchestra.run.smithi167.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-04-23T10:08:46.398 INFO:teuthology.orchestra.run.smithi167.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-23T10:08:46.404 INFO:teuthology.orchestra.run.smithi069.stdout:(148/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 446 kB/s | 3.1 MB 00:07 2024-04-23T10:08:46.523 INFO:teuthology.orchestra.run.smithi167.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-04-23T10:08:46.621 INFO:teuthology.orchestra.run.smithi069.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 6.3 MB/s | 1.3 MB 00:00 2024-04-23T10:08:46.637 INFO:teuthology.orchestra.run.smithi146.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 273 kB/s | 253 kB 00:00 2024-04-23T10:08:46.721 INFO:teuthology.orchestra.run.smithi069.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-04-23T10:08:46.840 INFO:teuthology.orchestra.run.smithi167.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 3.9 MB/s | 1.2 MB 00:00 2024-04-23T10:08:46.890 INFO:teuthology.orchestra.run.smithi167.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-23T10:08:46.949 INFO:teuthology.orchestra.run.smithi167.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-23T10:08:46.991 INFO:teuthology.orchestra.run.smithi167.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-04-23T10:08:47.074 INFO:teuthology.orchestra.run.smithi167.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-23T10:08:47.368 INFO:teuthology.orchestra.run.smithi146.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 146 kB/s | 106 kB 00:00 2024-04-23T10:08:47.708 INFO:teuthology.orchestra.run.smithi167.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-04-23T10:08:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 584 kB/s | 1.2 MB 00:02 2024-04-23T10:08:48.152 INFO:teuthology.orchestra.run.smithi146.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 172 kB/s | 135 kB 00:00 2024-04-23T10:08:48.810 INFO:teuthology.orchestra.run.smithi146.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 154 kB/s | 125 kB 00:00 2024-04-23T10:08:49.035 INFO:teuthology.orchestra.run.smithi146.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 243 kB/s | 215 kB 00:00 2024-04-23T10:08:49.050 INFO:teuthology.orchestra.run.smithi167.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 703 kB/s | 943 kB 00:01 2024-04-23T10:08:49.086 INFO:teuthology.orchestra.run.smithi146.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-04-23T10:08:49.178 INFO:teuthology.orchestra.run.smithi146.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-23T10:08:49.236 INFO:teuthology.orchestra.run.smithi146.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 369 kB/s | 21 kB 00:00 2024-04-23T10:08:49.303 INFO:teuthology.orchestra.run.smithi146.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-04-23T10:08:49.345 INFO:teuthology.orchestra.run.smithi146.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-04-23T10:08:49.387 INFO:teuthology.orchestra.run.smithi146.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 393 kB/s | 33 kB 00:00 2024-04-23T10:08:49.479 INFO:teuthology.orchestra.run.smithi146.stdout:(54/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-04-23T10:08:49.504 INFO:teuthology.orchestra.run.smithi146.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 155 kB/s | 18 kB 00:00 2024-04-23T10:08:49.546 INFO:teuthology.orchestra.run.smithi146.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-04-23T10:08:49.572 INFO:teuthology.orchestra.run.smithi146.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-04-23T10:08:49.613 INFO:teuthology.orchestra.run.smithi146.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 678 kB/s | 45 kB 00:00 2024-04-23T10:08:49.642 INFO:teuthology.orchestra.run.smithi167.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 181 kB/s | 107 kB 00:00 2024-04-23T10:08:49.646 INFO:teuthology.orchestra.run.smithi069.stdout:(151/152): librados2-19.0.0-3156.gd69f13d8.el7. 332 kB/s | 3.4 MB 00:10 2024-04-23T10:08:49.655 INFO:teuthology.orchestra.run.smithi146.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-04-23T10:08:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 582 kB 00:00 2024-04-23T10:08:49.731 INFO:teuthology.orchestra.run.smithi146.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 339 kB/s | 25 kB 00:00 2024-04-23T10:08:49.773 INFO:teuthology.orchestra.run.smithi146.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-04-23T10:08:49.798 INFO:teuthology.orchestra.run.smithi146.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-23T10:08:49.840 INFO:teuthology.orchestra.run.smithi146.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-23T10:08:49.880 INFO:teuthology.orchestra.run.smithi146.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 432 kB/s | 35 kB 00:00 2024-04-23T10:08:49.918 INFO:teuthology.orchestra.run.smithi146.stdout:[MIRROR] openssl-devel-3.2.1-1.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.1-1.el9.x86_64.rpm (IP: 216.158.133.254) 2024-04-23T10:08:49.942 INFO:teuthology.orchestra.run.smithi146.stdout:[MIRROR] openssl-devel-3.2.1-1.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.2.1-1.el9.x86_64.rpm (IP: 216.158.133.254) 2024-04-23T10:08:49.950 INFO:teuthology.orchestra.run.smithi167.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 70 kB/s | 21 kB 00:00 2024-04-23T10:08:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-04-23T10:08:50.108 INFO:teuthology.orchestra.run.smithi146.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-04-23T10:08:50.183 INFO:teuthology.orchestra.run.smithi146.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-04-23T10:08:50.250 INFO:teuthology.orchestra.run.smithi146.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-23T10:08:50.434 INFO:teuthology.orchestra.run.smithi146.stdout:(70/152): postgresql-server-13.14-1.el9.x86_64. 32 MB/s | 5.8 MB 00:00 2024-04-23T10:08:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:(71/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-04-23T10:08:50.559 INFO:teuthology.orchestra.run.smithi146.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-04-23T10:08:50.584 INFO:teuthology.orchestra.run.smithi146.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-04-23T10:08:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-04-23T10:08:50.760 INFO:teuthology.orchestra.run.smithi146.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2024-04-23T10:08:50.785 INFO:teuthology.orchestra.run.smithi146.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-04-23T10:08:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 383 kB/s | 26 kB 00:00 2024-04-23T10:08:50.852 INFO:teuthology.orchestra.run.smithi146.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-04-23T10:08:50.894 INFO:teuthology.orchestra.run.smithi146.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-23T10:08:50.917 INFO:teuthology.orchestra.run.smithi167.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 324 kB/s | 313 kB 00:00 2024-04-23T10:08:50.919 INFO:teuthology.orchestra.run.smithi146.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 520 kB/s | 35 kB 00:00 2024-04-23T10:08:50.995 INFO:teuthology.orchestra.run.smithi146.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-04-23T10:08:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:(82/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-04-23T10:08:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-04-23T10:08:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-04-23T10:08:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 42 kB 00:00 2024-04-23T10:08:51.201 INFO:teuthology.orchestra.run.smithi167.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 115 kB/s | 33 kB 00:00 2024-04-23T10:08:51.230 INFO:teuthology.orchestra.run.smithi146.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-04-23T10:08:51.280 INFO:teuthology.orchestra.run.smithi146.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-04-23T10:08:51.305 INFO:teuthology.orchestra.run.smithi146.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-23T10:08:51.347 INFO:teuthology.orchestra.run.smithi146.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 761 kB/s | 51 kB 00:00 2024-04-23T10:08:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 804 kB/s | 54 kB 00:00 2024-04-23T10:08:51.448 INFO:teuthology.orchestra.run.smithi146.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 557 kB/s | 42 kB 00:00 2024-04-23T10:08:51.523 INFO:teuthology.orchestra.run.smithi146.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 589 kB/s | 44 kB 00:00 2024-04-23T10:08:51.607 INFO:teuthology.orchestra.run.smithi146.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-04-23T10:08:51.765 INFO:teuthology.orchestra.run.smithi146.stdout:(94/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-04-23T10:08:51.807 INFO:teuthology.orchestra.run.smithi146.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 179 kB/s | 36 kB 00:00 2024-04-23T10:08:51.832 INFO:teuthology.orchestra.run.smithi146.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 713 kB/s | 47 kB 00:00 2024-04-23T10:08:51.883 INFO:teuthology.orchestra.run.smithi146.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-04-23T10:08:51.908 INFO:teuthology.orchestra.run.smithi146.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-04-23T10:08:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 934 kB/s | 94 kB 00:00 2024-04-23T10:08:52.058 INFO:teuthology.orchestra.run.smithi146.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 424 kB/s | 64 kB 00:00 2024-04-23T10:08:52.084 INFO:teuthology.orchestra.run.smithi146.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 446 kB/s | 45 kB 00:00 2024-04-23T10:08:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-04-23T10:08:52.218 INFO:teuthology.orchestra.run.smithi167.stdout:(53/152): ceph-mgr-diskprediction-local-19.0.0- 376 kB/s | 7.4 MB 00:20 2024-04-23T10:08:52.401 INFO:teuthology.orchestra.run.smithi146.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-04-23T10:08:52.418 INFO:teuthology.orchestra.run.smithi167.stdout:(54/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-04-23T10:08:52.485 INFO:teuthology.orchestra.run.smithi167.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 68 kB/s | 18 kB 00:00 2024-04-23T10:08:52.635 INFO:teuthology.orchestra.run.smithi167.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 51 kB/s | 11 kB 00:00 2024-04-23T10:08:52.668 INFO:teuthology.orchestra.run.smithi146.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-23T10:08:52.735 INFO:teuthology.orchestra.run.smithi146.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 292 kB/s | 19 kB 00:00 2024-04-23T10:08:52.818 INFO:teuthology.orchestra.run.smithi146.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 741 kB/s | 309 kB 00:00 2024-04-23T10:08:52.893 INFO:teuthology.orchestra.run.smithi146.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-04-23T10:08:52.977 INFO:teuthology.orchestra.run.smithi146.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 585 kB/s | 49 kB 00:00 2024-04-23T10:08:53.036 INFO:teuthology.orchestra.run.smithi146.stdout:(109/152): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-23T10:08:53.061 INFO:teuthology.orchestra.run.smithi146.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 806 kB/s | 67 kB 00:00 2024-04-23T10:08:53.102 INFO:teuthology.orchestra.run.smithi167.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 97 kB/s | 45 kB 00:00 2024-04-23T10:08:53.111 INFO:teuthology.orchestra.run.smithi146.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-04-23T10:08:53.195 INFO:teuthology.orchestra.run.smithi146.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-04-23T10:08:53.245 INFO:teuthology.orchestra.run.smithi146.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-04-23T10:08:53.287 INFO:teuthology.orchestra.run.smithi146.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-04-23T10:08:53.306 INFO:teuthology.orchestra.run.smithi146.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 529 kB/s | 32 kB 00:00 2024-04-23T10:08:53.348 INFO:teuthology.orchestra.run.smithi146.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 246 kB/s | 15 kB 00:00 2024-04-23T10:08:53.381 INFO:teuthology.orchestra.run.smithi146.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-23T10:08:53.423 INFO:teuthology.orchestra.run.smithi146.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-04-23T10:08:53.465 INFO:teuthology.orchestra.run.smithi146.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-04-23T10:08:53.482 INFO:teuthology.orchestra.run.smithi146.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 602 kB/s | 35 kB 00:00 2024-04-23T10:08:53.541 INFO:teuthology.orchestra.run.smithi146.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-23T10:08:53.561 INFO:teuthology.orchestra.run.smithi167.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 149 kB/s | 160 kB 00:01 2024-04-23T10:08:53.599 INFO:teuthology.orchestra.run.smithi146.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-04-23T10:08:53.625 INFO:teuthology.orchestra.run.smithi146.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-04-23T10:08:53.658 INFO:teuthology.orchestra.run.smithi146.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-04-23T10:08:53.683 INFO:teuthology.orchestra.run.smithi146.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-04-23T10:08:53.703 INFO:teuthology.orchestra.run.smithi167.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 1.1 MB/s | 662 kB 00:00 2024-04-23T10:08:53.717 INFO:teuthology.orchestra.run.smithi146.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 396 kB/s | 23 kB 00:00 2024-04-23T10:08:53.742 INFO:teuthology.orchestra.run.smithi146.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 333 kB/s | 19 kB 00:00 2024-04-23T10:08:53.776 INFO:teuthology.orchestra.run.smithi146.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 337 kB/s | 20 kB 00:00 2024-04-23T10:08:53.835 INFO:teuthology.orchestra.run.smithi146.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 793 kB/s | 46 kB 00:00 2024-04-23T10:08:53.868 INFO:teuthology.orchestra.run.smithi146.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-04-23T10:08:53.902 INFO:teuthology.orchestra.run.smithi146.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-04-23T10:08:53.944 INFO:teuthology.orchestra.run.smithi146.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-04-23T10:08:53.977 INFO:teuthology.orchestra.run.smithi146.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-23T10:08:53.978 INFO:teuthology.orchestra.run.smithi167.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 92 kB/s | 25 kB 00:00 2024-04-23T10:08:54.011 INFO:teuthology.orchestra.run.smithi146.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-04-23T10:08:54.044 INFO:teuthology.orchestra.run.smithi146.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-23T10:08:54.078 INFO:teuthology.orchestra.run.smithi146.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2024-04-23T10:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-04-23T10:08:54.153 INFO:teuthology.orchestra.run.smithi146.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-04-23T10:08:54.187 INFO:teuthology.orchestra.run.smithi146.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 788 kB/s | 59 kB 00:00 2024-04-23T10:08:54.221 INFO:teuthology.orchestra.run.smithi146.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 535 kB/s | 36 kB 00:00 2024-04-23T10:08:54.254 INFO:teuthology.orchestra.run.smithi146.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 763 kB/s | 51 kB 00:00 2024-04-23T10:08:54.286 INFO:teuthology.orchestra.run.smithi167.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 803 kB/s | 582 kB 00:00 2024-04-23T10:08:54.296 INFO:teuthology.orchestra.run.smithi146.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-23T10:08:54.320 INFO:teuthology.orchestra.run.smithi167.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-04-23T10:08:54.330 INFO:teuthology.orchestra.run.smithi146.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-23T10:08:54.388 INFO:teuthology.orchestra.run.smithi146.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-04-23T10:08:54.413 INFO:teuthology.orchestra.run.smithi146.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-04-23T10:08:54.464 INFO:teuthology.orchestra.run.smithi146.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-23T10:08:54.523 INFO:teuthology.orchestra.run.smithi146.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-23T10:08:54.837 INFO:teuthology.orchestra.run.smithi167.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 531 kB/s | 292 kB 00:00 2024-04-23T10:08:54.862 INFO:teuthology.orchestra.run.smithi167.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 348 kB/s | 188 kB 00:00 2024-04-23T10:08:55.096 INFO:teuthology.orchestra.run.smithi167.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 136 kB/s | 35 kB 00:00 2024-04-23T10:08:56.121 INFO:teuthology.orchestra.run.smithi167.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2024-04-23T10:08:56.272 INFO:teuthology.orchestra.run.smithi167.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 3.4 MB/s | 4.7 MB 00:01 2024-04-23T10:08:57.080 INFO:teuthology.orchestra.run.smithi167.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 1.1 MB/s | 911 kB 00:00 2024-04-23T10:08:57.514 INFO:teuthology.orchestra.run.smithi167.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 308 kB/s | 133 kB 00:00 2024-04-23T10:08:58.064 INFO:teuthology.orchestra.run.smithi167.stdout:(70/152): postgresql-13.14-1.el9.x86_64.rpm 837 kB/s | 1.6 MB 00:01 2024-04-23T10:08:59.072 INFO:teuthology.orchestra.run.smithi167.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-04-23T10:08:59.373 INFO:teuthology.orchestra.run.smithi167.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 3.1 MB/s | 5.8 MB 00:01 2024-04-23T10:08:59.498 INFO:teuthology.orchestra.run.smithi167.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 206 kB/s | 87 kB 00:00 2024-04-23T10:09:00.006 INFO:teuthology.orchestra.run.smithi167.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 480 kB/s | 244 kB 00:00 2024-04-23T10:09:00.815 INFO:teuthology.orchestra.run.smithi167.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 307 kB/s | 248 kB 00:00 2024-04-23T10:09:01.074 INFO:teuthology.orchestra.run.smithi167.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 99 kB/s | 26 kB 00:00 2024-04-23T10:09:01.391 INFO:teuthology.orchestra.run.smithi167.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 60 kB/s | 19 kB 00:00 2024-04-23T10:09:01.756 INFO:teuthology.orchestra.run.smithi146.stdout:(148/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 445 kB/s | 3.1 MB 00:07 2024-04-23T10:09:01.974 INFO:teuthology.orchestra.run.smithi167.stdout:(78/152): python3-babel-2.9.1-2.el9.noarch.rpm 2.3 MB/s | 6.0 MB 00:02 2024-04-23T10:09:02.083 INFO:teuthology.orchestra.run.smithi167.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 249 kB/s | 172 kB 00:00 2024-04-23T10:09:02.241 INFO:teuthology.orchestra.run.smithi167.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 130 kB/s | 35 kB 00:00 2024-04-23T10:09:02.883 INFO:teuthology.orchestra.run.smithi167.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 390 kB/s | 250 kB 00:00 2024-04-23T10:09:02.989 INFO:teuthology.orchestra.run.smithi146.stdout:(149/152): librados2-19.0.0-3156.gd69f13d8.el7. 408 kB/s | 3.4 MB 00:08 2024-04-23T10:09:03.742 INFO:teuthology.orchestra.run.smithi167.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 259 kB/s | 222 kB 00:00 2024-04-23T10:09:04.114 INFO:teuthology.orchestra.run.smithi146.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 587 kB/s | 1.3 MB 00:02 2024-04-23T10:09:04.150 INFO:teuthology.orchestra.run.smithi167.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 189 kB/s | 77 kB 00:00 2024-04-23T10:09:04.492 INFO:teuthology.orchestra.run.smithi167.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 124 kB/s | 42 kB 00:00 2024-04-23T10:09:05.176 INFO:teuthology.orchestra.run.smithi167.stdout:(85/152): python3-protobuf-3.14.0-13.el9.noarch 394 kB/s | 269 kB 00:00 2024-04-23T10:09:05.328 INFO:teuthology.orchestra.run.smithi069.stdout:(152/152): ceph-test-19.0.0-3156.gd69f13d8.el7. 520 kB/s | 49 MB 01:36 2024-04-23T10:09:05.331 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-23T10:09:05.332 INFO:teuthology.orchestra.run.smithi069.stdout:Total 1.1 MB/s | 222 MB 03:25 2024-04-23T10:09:05.476 INFO:teuthology.orchestra.run.smithi167.stdout:(86/152): ceph-test-19.0.0-3156.gd69f13d8.el7.x 467 kB/s | 49 MB 01:47 2024-04-23T10:09:05.902 INFO:teuthology.orchestra.run.smithi167.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 219 kB/s | 159 kB 00:00 2024-04-23T10:09:06.043 INFO:teuthology.orchestra.run.smithi167.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 492 kB/s | 279 kB 00:00 2024-04-23T10:09:06.244 INFO:teuthology.orchestra.run.smithi167.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 149 kB/s | 51 kB 00:00 2024-04-23T10:09:06.371 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-23T10:09:06.385 INFO:teuthology.orchestra.run.smithi167.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 157 kB/s | 54 kB 00:00 2024-04-23T10:09:06.513 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-23T10:09:06.513 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-23T10:09:06.652 INFO:teuthology.orchestra.run.smithi167.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.1 MB/s | 5.1 MB 00:04 2024-04-23T10:09:06.669 INFO:teuthology.orchestra.run.smithi167.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 147 kB/s | 42 kB 00:00 2024-04-23T10:09:06.672 INFO:teuthology.orchestra.run.smithi146.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 665 kB/s | 2.4 MB 00:03 2024-04-23T10:09:07.236 INFO:teuthology.orchestra.run.smithi167.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 390 kB/s | 221 kB 00:00 2024-04-23T10:09:07.270 INFO:teuthology.orchestra.run.smithi167.stdout:(94/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 71 kB/s | 44 kB 00:00 2024-04-23T10:09:07.512 INFO:teuthology.orchestra.run.smithi167.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 130 kB/s | 36 kB 00:00 2024-04-23T10:09:07.612 INFO:teuthology.orchestra.run.smithi167.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-04-23T10:09:07.954 INFO:teuthology.orchestra.run.smithi167.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 169 kB/s | 58 kB 00:00 2024-04-23T10:09:08.354 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-23T10:09:08.354 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-23T10:09:08.446 INFO:teuthology.orchestra.run.smithi167.stdout:(98/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 191 kB/s | 94 kB 00:00 2024-04-23T10:09:08.596 INFO:teuthology.orchestra.run.smithi167.stdout:(99/152): socat-1.7.4.1-5.el9.x86_64.rpm 281 kB/s | 305 kB 00:01 2024-04-23T10:09:08.664 INFO:teuthology.orchestra.run.smithi146.stdout:(152/152): ceph-test-19.0.0-3156.gd69f13d8.el7. 525 kB/s | 49 MB 01:35 2024-04-23T10:09:08.667 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-04-23T10:09:08.668 INFO:teuthology.orchestra.run.smithi146.stdout:Total 1.2 MB/s | 222 MB 03:08 2024-04-23T10:09:08.788 INFO:teuthology.orchestra.run.smithi167.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 186 kB/s | 64 kB 00:00 2024-04-23T10:09:08.839 INFO:teuthology.orchestra.run.smithi167.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 449 kB/s | 22 kB 00:00 2024-04-23T10:09:08.964 INFO:teuthology.orchestra.run.smithi167.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 122 kB/s | 45 kB 00:00 2024-04-23T10:09:09.022 INFO:teuthology.orchestra.run.smithi167.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-04-23T10:09:09.273 INFO:teuthology.orchestra.run.smithi167.stdout:(104/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.4 MB/s | 16 MB 00:03 2024-04-23T10:09:09.498 INFO:teuthology.orchestra.run.smithi167.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 87 kB/s | 19 kB 00:00 2024-04-23T10:09:09.540 INFO:teuthology.orchestra.run.smithi167.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 630 kB/s | 309 kB 00:00 2024-04-23T10:09:09.615 INFO:teuthology.orchestra.run.smithi167.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-04-23T10:09:09.657 INFO:teuthology.orchestra.run.smithi167.stdout:(108/152): abseil-cpp-20211102.0-3.el9.x86_64.r 791 kB/s | 548 kB 00:00 2024-04-23T10:09:09.691 INFO:teuthology.orchestra.run.smithi167.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 646 kB/s | 49 kB 00:00 2024-04-23T10:09:09.708 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-04-23T10:09:09.758 INFO:teuthology.orchestra.run.smithi167.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 673 kB/s | 67 kB 00:00 2024-04-23T10:09:09.783 INFO:teuthology.orchestra.run.smithi167.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-23T10:09:09.849 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-04-23T10:09:09.850 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-04-23T10:09:09.908 INFO:teuthology.orchestra.run.smithi167.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-23T10:09:09.984 INFO:teuthology.orchestra.run.smithi167.stdout:(113/152): libarrow-9.0.0-10.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-04-23T10:09:10.009 INFO:teuthology.orchestra.run.smithi167.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 433 kB/s | 43 kB 00:00 2024-04-23T10:09:10.051 INFO:teuthology.orchestra.run.smithi167.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 483 kB/s | 32 kB 00:00 2024-04-23T10:09:10.085 INFO:teuthology.orchestra.run.smithi167.stdout:(116/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.5 MB/s | 838 kB 00:00 2024-04-23T10:09:10.110 INFO:teuthology.orchestra.run.smithi167.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-04-23T10:09:10.135 INFO:teuthology.orchestra.run.smithi167.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-23T10:09:10.185 INFO:teuthology.orchestra.run.smithi167.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-04-23T10:09:10.210 INFO:teuthology.orchestra.run.smithi167.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 469 kB/s | 35 kB 00:00 2024-04-23T10:09:10.236 INFO:teuthology.orchestra.run.smithi167.stdout:(121/152): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-04-23T10:09:10.261 INFO:teuthology.orchestra.run.smithi167.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-23T10:09:10.320 INFO:teuthology.orchestra.run.smithi167.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-04-23T10:09:10.345 INFO:teuthology.orchestra.run.smithi167.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-04-23T10:09:10.370 INFO:teuthology.orchestra.run.smithi167.stdout:(125/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-23T10:09:10.396 INFO:teuthology.orchestra.run.smithi167.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 233 kB/s | 18 kB 00:00 2024-04-23T10:09:10.421 INFO:teuthology.orchestra.run.smithi167.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-04-23T10:09:10.446 INFO:teuthology.orchestra.run.smithi167.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-04-23T10:09:10.471 INFO:teuthology.orchestra.run.smithi167.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-23T10:09:10.505 INFO:teuthology.orchestra.run.smithi167.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-23T10:09:10.546 INFO:teuthology.orchestra.run.smithi167.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 466 kB/s | 46 kB 00:00 2024-04-23T10:09:10.572 INFO:teuthology.orchestra.run.smithi167.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 783 kB/s | 79 kB 00:00 2024-04-23T10:09:10.598 INFO:teuthology.orchestra.run.smithi167.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 626 kB/s | 58 kB 00:00 2024-04-23T10:09:10.639 INFO:teuthology.orchestra.run.smithi167.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-04-23T10:09:10.665 INFO:teuthology.orchestra.run.smithi167.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-23T10:09:10.690 INFO:teuthology.orchestra.run.smithi167.stdout:(136/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-04-23T10:09:10.707 INFO:teuthology.orchestra.run.smithi167.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 420 kB/s | 28 kB 00:00 2024-04-23T10:09:10.724 INFO:teuthology.orchestra.run.smithi167.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2024-04-23T10:09:10.766 INFO:teuthology.orchestra.run.smithi167.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-23T10:09:10.783 INFO:teuthology.orchestra.run.smithi167.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2024-04-23T10:09:10.817 INFO:teuthology.orchestra.run.smithi167.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-04-23T10:09:10.842 INFO:teuthology.orchestra.run.smithi167.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 673 kB/s | 51 kB 00:00 2024-04-23T10:09:10.876 INFO:teuthology.orchestra.run.smithi167.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-23T10:09:10.901 INFO:teuthology.orchestra.run.smithi167.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-23T10:09:10.926 INFO:teuthology.orchestra.run.smithi167.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-23T10:09:10.943 INFO:teuthology.orchestra.run.smithi167.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-04-23T10:09:11.010 INFO:teuthology.orchestra.run.smithi167.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-23T10:09:11.060 INFO:teuthology.orchestra.run.smithi167.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-23T10:09:11.436 INFO:teuthology.orchestra.run.smithi167.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 3.6 MB/s | 1.3 MB 00:00 2024-04-23T10:09:11.608 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-04-23T10:09:11.608 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-04-23T10:09:11.761 INFO:teuthology.orchestra.run.smithi167.stdout:(150/152): librados2-19.0.0-3156.gd69f13d8.el7. 4.2 MB/s | 3.4 MB 00:00 2024-04-23T10:09:11.836 INFO:teuthology.orchestra.run.smithi167.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 6.0 MB/s | 2.4 MB 00:00 2024-04-23T10:09:13.444 INFO:teuthology.orchestra.run.smithi167.stdout:(152/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 1.3 MB/s | 3.1 MB 00:02 2024-04-23T10:09:13.451 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-04-23T10:09:13.451 INFO:teuthology.orchestra.run.smithi167.stdout:Total 1.1 MB/s | 222 MB 03:22 2024-04-23T10:09:14.263 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-23T10:09:14.348 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-23T10:09:14.386 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-23T10:09:14.440 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-23T10:09:14.473 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-23T10:09:14.499 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-23T10:09:14.508 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-04-23T10:09:14.542 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-23T10:09:14.654 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-04-23T10:09:14.654 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-04-23T10:09:14.861 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-23T10:09:14.967 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-23T10:09:15.088 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-23T10:09:15.118 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-23T10:09:15.209 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-23T10:09:15.247 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-23T10:09:15.396 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-23T10:09:15.444 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-23T10:09:15.472 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-23T10:09:15.575 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-23T10:09:15.606 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-23T10:09:15.669 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-23T10:09:15.691 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T10:09:15.715 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T10:09:15.914 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T10:09:15.948 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T10:09:16.055 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-23T10:09:16.150 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-23T10:09:16.188 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-23T10:09:16.223 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-23T10:09:16.287 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-23T10:09:16.322 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-23T10:09:16.365 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-23T10:09:16.398 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-23T10:09:16.423 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-04-23T10:09:16.424 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-04-23T10:09:16.435 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-23T10:09:16.494 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-23T10:09:16.548 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-23T10:09:16.579 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-23T10:09:16.614 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-23T10:09:16.689 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-23T10:09:16.725 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-23T10:09:16.768 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-23T10:09:16.797 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-23T10:09:16.866 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-23T10:09:16.920 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-23T10:09:16.993 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-23T10:09:17.126 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-23T10:09:17.182 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-23T10:09:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-04-23T10:09:17.634 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-23T10:09:17.672 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-23T10:09:17.698 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-23T10:09:17.734 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-23T10:09:17.768 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-23T10:09:17.784 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-23T10:09:17.793 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-23T10:09:17.813 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-23T10:09:17.836 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-23T10:09:17.856 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-23T10:09:17.894 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-23T10:09:17.935 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-23T10:09:18.099 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-23T10:09:18.155 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-23T10:09:18.166 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-23T10:09:18.209 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-23T10:09:18.269 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-23T10:09:18.273 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-23T10:09:18.306 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-23T10:09:18.342 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-23T10:09:18.374 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-23T10:09:18.388 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-23T10:09:18.404 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-23T10:09:18.424 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-23T10:09:18.467 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-23T10:09:18.478 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-23T10:09:18.510 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-23T10:09:18.516 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-23T10:09:18.645 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-23T10:09:18.663 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-23T10:09:18.690 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-23T10:09:18.713 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-23T10:09:18.720 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-23T10:09:18.741 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-23T10:09:18.762 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-23T10:09:18.844 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-23T10:09:18.854 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-23T10:09:18.867 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-23T10:09:18.887 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-23T10:09:18.927 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-23T10:09:18.929 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-23T10:09:18.951 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T10:09:18.952 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-23T10:09:18.976 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T10:09:18.977 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-23T10:09:19.051 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-23T10:09:19.176 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T10:09:19.178 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-23T10:09:19.209 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T10:09:19.217 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-23T10:09:19.245 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-23T10:09:19.279 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-23T10:09:19.318 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-23T10:09:19.339 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-23T10:09:19.358 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-23T10:09:19.389 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-23T10:09:19.423 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-23T10:09:19.428 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-23T10:09:19.456 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-23T10:09:19.458 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-23T10:09:19.493 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-23T10:09:19.498 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-23T10:09:19.532 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-23T10:09:19.557 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-23T10:09:19.592 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-23T10:09:19.619 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-23T10:09:19.635 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-23T10:09:19.668 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-23T10:09:19.670 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-23T10:09:19.696 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-23T10:09:19.727 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-23T10:09:19.764 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-23T10:09:19.773 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-23T10:09:19.817 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-23T10:09:19.857 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-23T10:09:19.870 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-23T10:09:19.892 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-23T10:09:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-23T10:09:19.967 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-23T10:09:20.003 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-23T10:09:20.046 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-23T10:09:20.075 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-23T10:09:20.144 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-23T10:09:20.189 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-23T10:09:20.263 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-23T10:09:20.403 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-23T10:09:20.458 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-23T10:09:20.635 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-23T10:09:20.683 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-23T10:09:20.717 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-23T10:09:20.815 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-23T10:09:20.866 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-23T10:09:20.944 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-23T10:09:20.975 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-23T10:09:20.977 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-23T10:09:21.055 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-23T10:09:21.083 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-23T10:09:21.126 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-23T10:09:21.154 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-23T10:09:21.164 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-23T10:09:21.184 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-23T10:09:21.205 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-23T10:09:21.261 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-23T10:09:21.352 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-23T10:09:21.400 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-23T10:09:21.446 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-23T10:09:21.511 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-23T10:09:21.542 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-23T10:09:21.579 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-23T10:09:21.626 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-23T10:09:21.661 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-23T10:09:21.704 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-23T10:09:21.746 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-23T10:09:21.883 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-23T10:09:21.908 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-23T10:09:21.927 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-23T10:09:21.957 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-23T10:09:21.999 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-23T10:09:22.021 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-23T10:09:22.092 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-23T10:09:22.124 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-23T10:09:22.164 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-23T10:09:22.198 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-23T10:09:22.222 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-23T10:09:22.298 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-23T10:09:22.412 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-04-23T10:09:22.432 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-23T10:09:22.471 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-23T10:09:22.498 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-23T10:09:22.499 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-23T10:09:22.545 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-23T10:09:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-23T10:09:22.589 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-23T10:09:22.599 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-23T10:09:22.621 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-23T10:09:22.640 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-23T10:09:22.651 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-23T10:09:22.666 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-23T10:09:22.685 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-23T10:09:22.709 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-23T10:09:22.718 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-23T10:09:22.760 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-23T10:09:22.794 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-23T10:09:22.880 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-23T10:09:22.933 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-23T10:09:22.964 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-23T10:09:23.012 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-23T10:09:23.037 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-23T10:09:23.109 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-23T10:09:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-23T10:09:23.157 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-23T10:09:23.236 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-23T10:09:23.271 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-23T10:09:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-23T10:09:23.392 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-23T10:09:23.423 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-23T10:09:23.572 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-23T10:09:23.604 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-23T10:09:23.619 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-23T10:09:23.631 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-23T10:09:23.648 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-23T10:09:23.665 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-23T10:09:23.751 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-23T10:09:23.782 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-23T10:09:23.845 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-23T10:09:23.867 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T10:09:23.869 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-23T10:09:23.888 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-23T10:09:23.921 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-23T10:09:23.954 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-23T10:09:23.976 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-23T10:09:24.019 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-23T10:09:24.051 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-23T10:09:24.058 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T10:09:24.091 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-23T10:09:24.103 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-23T10:09:24.117 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-23T10:09:24.149 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-23T10:09:24.182 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-23T10:09:24.185 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-23T10:09:24.200 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-23T10:09:24.215 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-23T10:09:24.294 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-23T10:09:24.324 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-23T10:09:24.359 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-23T10:09:24.392 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-23T10:09:24.413 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-23T10:09:24.441 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-23T10:09:24.475 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-23T10:09:24.498 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-23T10:09:24.519 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-23T10:09:24.594 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-23T10:09:24.663 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-23T10:09:24.696 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-23T10:09:24.767 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-23T10:09:24.789 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-23T10:09:24.790 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-23T10:09:24.866 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-23T10:09:24.918 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-23T10:09:24.949 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-23T10:09:24.992 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-23T10:09:25.069 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-23T10:09:25.103 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-23T10:09:25.141 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-23T10:09:25.146 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-23T10:09:25.175 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-23T10:09:25.245 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-23T10:09:25.259 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-23T10:09:25.290 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-23T10:09:25.365 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-23T10:09:25.501 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-23T10:09:25.551 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-23T10:09:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-23T10:09:26.146 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-23T10:09:26.175 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-23T10:09:26.218 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-23T10:09:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-23T10:09:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-23T10:09:26.454 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-23T10:09:26.462 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-23T10:09:26.501 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-23T10:09:26.541 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-23T10:09:26.555 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-23T10:09:26.569 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-23T10:09:26.602 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-23T10:09:26.628 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-23T10:09:26.668 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-23T10:09:26.704 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-23T10:09:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-23T10:09:26.788 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-23T10:09:26.830 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-23T10:09:26.873 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-23T10:09:26.914 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-23T10:09:26.957 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-23T10:09:27.009 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-23T10:09:27.045 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-23T10:09:27.046 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-23T10:09:27.058 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-23T10:09:27.075 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-23T10:09:27.078 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-23T10:09:27.096 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-23T10:09:27.114 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-23T10:09:27.117 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-23T10:09:27.211 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-23T10:09:27.250 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-23T10:09:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-23T10:09:27.316 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-23T10:09:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-23T10:09:27.415 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-23T10:09:27.543 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-23T10:09:27.573 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-23T10:09:27.593 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-23T10:09:27.593 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-23T10:09:27.626 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-23T10:09:27.627 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-23T10:09:27.636 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-23T10:09:27.666 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-23T10:09:27.674 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-23T10:09:27.688 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-23T10:09:27.698 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-23T10:09:27.711 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-23T10:09:27.728 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-23T10:09:27.756 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-23T10:09:27.757 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T10:09:27.757 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T10:09:27.757 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:09:27.762 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-23T10:09:27.784 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-23T10:09:27.795 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-23T10:09:27.837 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-23T10:09:27.872 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-23T10:09:27.960 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-23T10:09:28.010 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-23T10:09:28.042 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-23T10:09:28.089 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-23T10:09:28.187 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-23T10:09:28.244 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-23T10:09:28.972 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-23T10:09:29.024 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-23T10:09:29.058 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-23T10:09:29.157 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-23T10:09:29.207 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-23T10:09:29.295 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-23T10:09:29.335 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-23T10:09:29.514 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-23T10:09:29.550 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-23T10:09:29.629 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-23T10:09:29.994 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-23T10:09:30.024 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-23T10:09:30.270 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-23T10:09:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-23T10:09:30.564 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-23T10:09:30.602 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-23T10:09:30.678 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-23T10:09:30.679 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T10:09:30.679 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T10:09:30.679 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:09:30.712 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-23T10:09:31.620 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-23T10:09:31.729 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-23T10:09:31.757 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-23T10:09:31.791 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-23T10:09:32.102 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-23T10:09:32.145 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-23T10:09:32.236 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-23T10:09:32.267 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-23T10:09:32.303 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-23T10:09:32.779 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-23T10:09:32.814 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-23T10:09:32.869 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-23T10:09:32.891 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-23T10:09:35.174 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-23T10:09:35.213 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-23T10:09:35.756 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-23T10:09:35.792 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-23T10:09:35.882 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-23T10:09:35.882 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T10:09:35.882 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T10:09:35.882 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:09:35.910 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-23T10:09:39.301 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-23T10:09:39.301 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /sys 2024-04-23T10:09:39.301 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /proc 2024-04-23T10:09:39.301 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /mnt 2024-04-23T10:09:39.301 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /var/tmp 2024-04-23T10:09:39.301 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /home 2024-04-23T10:09:39.301 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /root 2024-04-23T10:09:39.301 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /tmp 2024-04-23T10:09:39.301 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:09:39.486 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-23T10:09:39.500 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-23T10:09:39.501 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:39.501 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T10:09:39.501 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:09:40.980 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-23T10:09:41.005 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-23T10:09:41.005 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:41.005 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T10:09:41.005 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T10:09:41.005 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T10:09:41.005 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:09:41.222 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-23T10:09:41.244 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-23T10:09:41.244 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:41.244 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T10:09:41.244 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T10:09:41.244 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T10:09:41.244 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:09:41.690 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-23T10:09:41.712 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-23T10:09:41.713 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:41.713 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T10:09:41.713 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T10:09:41.713 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T10:09:41.713 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:09:41.811 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-23T10:09:41.859 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-23T10:09:41.914 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-23T10:09:42.098 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-23T10:09:42.148 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-23T10:09:42.171 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-23T10:09:42.171 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2024-04-23T10:09:42.171 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2024-04-23T10:09:42.171 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2024-04-23T10:09:42.171 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2024-04-23T10:09:42.171 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2024-04-23T10:09:42.171 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /root 2024-04-23T10:09:42.171 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2024-04-23T10:09:42.171 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:09:42.218 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-23T10:09:42.306 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T10:09:42.340 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-23T10:09:42.355 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-23T10:09:42.355 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:42.355 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T10:09:42.355 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:09:42.443 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T10:09:42.490 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-23T10:09:42.522 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-23T10:09:42.550 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-23T10:09:42.952 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-23T10:09:42.981 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-23T10:09:43.014 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-23T10:09:43.074 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-23T10:09:43.113 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-23T10:09:43.809 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-23T10:09:43.834 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-23T10:09:43.834 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:43.834 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T10:09:43.834 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T10:09:43.834 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T10:09:43.834 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:09:44.060 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-23T10:09:44.082 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-23T10:09:44.082 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:44.082 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T10:09:44.082 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T10:09:44.082 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T10:09:44.082 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:09:44.142 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-23T10:09:44.182 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-23T10:09:44.519 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-23T10:09:44.540 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-23T10:09:44.541 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:44.541 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T10:09:44.541 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T10:09:44.541 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T10:09:44.541 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:09:44.649 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-23T10:09:44.697 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-23T10:09:44.752 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-23T10:09:44.936 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-23T10:09:44.986 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-23T10:09:45.055 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-23T10:09:45.143 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T10:09:45.144 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-23T10:09:45.173 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-23T10:09:45.274 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-23T10:09:45.274 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T10:09:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-23T10:09:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-23T10:09:45.396 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-23T10:09:45.453 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-23T10:09:45.484 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-23T10:09:45.506 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-23T10:09:45.506 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:45.506 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T10:09:45.506 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T10:09:45.506 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T10:09:45.506 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:09:45.551 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-23T10:09:45.561 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-23T10:09:45.659 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-23T10:09:45.716 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-23T10:09:45.789 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-23T10:09:45.819 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-23T10:09:45.851 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-23T10:09:45.911 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-23T10:09:45.942 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-23T10:09:46.634 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-23T10:09:46.662 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-23T10:09:46.684 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-23T10:09:46.684 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:46.684 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T10:09:46.684 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:09:46.684 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:09:46.684 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:09:46.729 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-23T10:09:46.750 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-23T10:09:46.750 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:46.750 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T10:09:46.750 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:09:46.797 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-23T10:09:46.818 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-23T10:09:46.818 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:46.818 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-23T10:09:46.818 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:09:46.818 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:09:46.819 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:09:46.975 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-23T10:09:47.011 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-23T10:09:47.122 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-23T10:09:47.144 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-23T10:09:47.144 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:47.144 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T10:09:47.144 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T10:09:47.144 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T10:09:47.144 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:09:47.506 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-23T10:09:47.506 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2024-04-23T10:09:47.507 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2024-04-23T10:09:47.507 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2024-04-23T10:09:47.507 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2024-04-23T10:09:47.507 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2024-04-23T10:09:47.507 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2024-04-23T10:09:47.507 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2024-04-23T10:09:47.507 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:09:47.682 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-23T10:09:47.696 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-23T10:09:47.696 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:47.697 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T10:09:47.697 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:09:47.970 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-23T10:09:48.142 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-23T10:09:48.244 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-23T10:09:48.400 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-23T10:09:48.429 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-23T10:09:48.452 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-23T10:09:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T10:09:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T10:09:48.452 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T10:09:48.452 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:09:48.497 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-23T10:09:48.507 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-23T10:09:48.605 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-23T10:09:48.691 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-23T10:09:49.143 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-23T10:09:49.169 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-23T10:09:49.169 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:49.169 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T10:09:49.169 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T10:09:49.169 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T10:09:49.169 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:09:49.394 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-23T10:09:49.417 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-23T10:09:49.417 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:49.417 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T10:09:49.417 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T10:09:49.417 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T10:09:49.417 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:09:49.618 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-23T10:09:49.649 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-23T10:09:49.671 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-23T10:09:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:49.671 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T10:09:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:09:49.672 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:09:49.672 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:09:49.717 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-23T10:09:49.738 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-23T10:09:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:49.738 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T10:09:49.738 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:09:49.784 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-23T10:09:49.806 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-23T10:09:49.806 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:49.806 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-23T10:09:49.806 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:09:49.806 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:09:49.806 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:09:49.853 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-23T10:09:49.875 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-23T10:09:49.875 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:49.875 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T10:09:49.876 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T10:09:49.876 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T10:09:49.876 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:09:49.983 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-23T10:09:50.032 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-23T10:09:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-23T10:09:50.110 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-23T10:09:50.132 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-23T10:09:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T10:09:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T10:09:50.132 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T10:09:50.132 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:09:50.272 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-23T10:09:50.321 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-23T10:09:50.398 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-23T10:09:50.486 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T10:09:50.626 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T10:09:50.671 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-23T10:09:50.703 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-23T10:09:50.731 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-23T10:09:51.160 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-23T10:09:51.190 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-23T10:09:51.222 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-23T10:09:51.283 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-23T10:09:51.313 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-23T10:09:51.967 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-23T10:09:52.008 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-23T10:09:52.057 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-23T10:09:52.089 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-23T10:09:52.117 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-23T10:09:52.296 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-23T10:09:52.338 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-23T10:09:52.343 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-23T10:09:52.368 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-23T10:09:52.381 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-23T10:09:53.011 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T10:09:53.048 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T10:09:53.068 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T10:09:53.346 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-23T10:09:53.542 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-23T10:09:53.643 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-23T10:09:53.811 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-23T10:09:53.842 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-23T10:09:53.864 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-23T10:09:53.864 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:53.864 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T10:09:53.864 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T10:09:53.865 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T10:09:53.865 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:09:53.897 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-23T10:09:53.909 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-23T10:09:53.920 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-23T10:09:53.986 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-23T10:09:54.019 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-23T10:09:54.027 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-23T10:09:54.074 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-23T10:09:54.108 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-23T10:09:54.140 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-23T10:09:54.141 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T10:09:54.233 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T10:09:54.258 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T10:09:54.258 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T10:09:54.352 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T10:09:54.423 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T10:09:54.713 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-23T10:09:54.762 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-23T10:09:54.803 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-23T10:09:54.836 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-23T10:09:54.863 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-23T10:09:54.996 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-23T10:09:55.029 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-23T10:09:55.050 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-23T10:09:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-23T10:09:55.051 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:55.051 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T10:09:55.051 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:09:55.051 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:09:55.051 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:09:55.096 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-23T10:09:55.100 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-23T10:09:55.118 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-23T10:09:55.118 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:55.118 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T10:09:55.118 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:09:55.131 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-23T10:09:55.163 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-23T10:09:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-23T10:09:55.186 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:55.186 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-23T10:09:55.186 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:09:55.186 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:09:55.186 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:09:55.498 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-23T10:09:55.521 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-23T10:09:55.521 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T10:09:55.521 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T10:09:55.521 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T10:09:55.521 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T10:09:55.521 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:09:55.725 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T10:09:55.762 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T10:09:55.780 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T10:09:56.612 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-23T10:09:56.708 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-23T10:09:56.749 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-23T10:09:56.830 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-23T10:09:56.862 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-23T10:09:56.862 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T10:09:56.946 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T10:09:56.971 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T10:09:56.971 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T10:09:57.058 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T10:09:57.136 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T10:10:00.101 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-23T10:10:00.142 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-23T10:10:00.169 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T10:10:00.169 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-23T10:10:00.169 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-23T10:10:00.169 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-23T10:10:00.169 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-23T10:10:00.169 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-23T10:10:00.169 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-23T10:10:00.169 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-23T10:10:00.170 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-23T10:10:00.171 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-23T10:10:00.171 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-23T10:10:00.171 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-23T10:10:00.171 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-23T10:10:00.171 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-23T10:10:00.171 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-23T10:10:00.171 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-23T10:10:00.182 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-23T10:10:00.183 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-23T10:10:00.184 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-23T10:10:00.185 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-23T10:10:00.186 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-23T10:10:00.187 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-23T10:10:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-23T10:10:00.189 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-23T10:10:00.190 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T10:10:00.191 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-23T10:10:00.192 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-23T10:10:00.224 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-23T10:10:00.251 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-23T10:10:00.432 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-23T10:10:00.480 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-23T10:10:00.510 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-23T10:10:01.056 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T10:10:01.100 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T10:10:01.119 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-23T10:10:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-23T10:10:02.047 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-23T10:10:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-23T10:10:02.169 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-23T10:10:02.201 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-23T10:10:02.201 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T10:10:02.293 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-23T10:10:02.316 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: automake-1.16.2-8.el9.noarch 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: bison-3.7.4-5.el9.x86_64 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.317 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:02.318 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: flex-2.6.4-9.el9.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T10:10:02.319 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-23T10:10:02.320 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-13.14-1.el9.x86_64 2024-04-23T10:10:02.321 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T10:10:02.322 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T10:10:02.323 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T10:10:02.324 INFO:teuthology.orchestra.run.smithi069.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T10:10:02.325 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.326 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T10:10:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T10:10:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T10:10:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-23T10:10:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-23T10:10:02.327 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T10:10:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-23T10:10:02.328 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:10:02.328 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-23T10:10:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T10:10:02.328 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T10:10:02.413 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-23T10:10:02.482 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T10:10:02.715 DEBUG:teuthology.parallel:result is None 2024-04-23T10:10:02.850 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T10:10:02.850 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-23T10:10:02.850 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-23T10:10:02.850 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-23T10:10:02.850 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-23T10:10:02.850 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-23T10:10:02.850 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-23T10:10:02.850 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-23T10:10:02.850 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-23T10:10:02.851 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-23T10:10:02.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-23T10:10:02.853 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-23T10:10:02.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-23T10:10:02.855 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-23T10:10:02.856 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-23T10:10:02.857 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-23T10:10:02.858 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-23T10:10:02.859 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-23T10:10:02.860 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-23T10:10:02.860 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-23T10:10:02.860 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-23T10:10:02.860 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-23T10:10:02.860 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-23T10:10:02.860 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T10:10:02.860 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-23T10:10:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T10:10:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:10:05.027 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-04-23T10:10:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-23T10:10:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-23T10:10:05.027 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-04-23T10:10:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T10:10:05.027 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.2-8.el9.noarch 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.7.4-5.el9.x86_64 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:05.028 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-23T10:10:05.029 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.4-9.el9.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T10:10:05.030 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T10:10:05.031 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-13.14-1.el9.x86_64 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-23T10:10:05.032 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T10:10:05.033 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T10:10:05.034 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-23T10:10:05.036 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-23T10:10:05.037 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T10:10:05.038 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-23T10:10:05.038 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-04-23T10:10:05.038 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-04-23T10:10:05.427 DEBUG:teuthology.parallel:result is None 2024-04-23T10:10:08.506 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T10:10:08.506 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-23T10:10:08.506 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-23T10:10:08.506 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-23T10:10:08.506 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-23T10:10:08.506 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-23T10:10:08.506 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-23T10:10:08.506 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-23T10:10:08.507 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-23T10:10:08.508 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-23T10:10:08.508 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-23T10:10:08.508 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-23T10:10:08.508 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-23T10:10:08.519 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-23T10:10:08.520 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-23T10:10:08.521 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-23T10:10:08.522 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-23T10:10:08.523 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-23T10:10:08.524 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-23T10:10:08.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-23T10:10:08.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-23T10:10:08.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-23T10:10:08.528 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-23T10:10:08.528 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-23T10:10:10.626 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-23T10:10:10.626 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:10:10.626 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-04-23T10:10:10.626 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.626 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.2-8.el9.noarch 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.7.4-5.el9.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.627 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.628 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.4-9.el9.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T10:10:10.629 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T10:10:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-13.14-1.el9.x86_64 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T10:10:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T10:10:10.632 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T10:10:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T10:10:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T10:10:10.635 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:10:10.636 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-04-23T10:10:11.053 DEBUG:teuthology.parallel:result is None 2024-04-23T10:10:11.053 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:10:11.186 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T10:10:11.212 INFO:teuthology.orchestra.run.smithi069.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-23T10:10:11.213 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-23T10:10:11.213 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-23T10:10:11.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:10:11.425 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T10:10:11.450 INFO:teuthology.orchestra.run.smithi146.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-23T10:10:11.450 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-23T10:10:11.450 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-23T10:10:11.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:10:11.584 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T10:10:11.606 INFO:teuthology.orchestra.run.smithi167.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-23T10:10:11.607 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-23T10:10:11.607 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-23T10:10:11.608 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-23T10:10:11.608 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:10:11.608 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T10:10:11.639 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-23T10:10:11.639 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T10:10:11.670 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-23T10:10:11.670 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T10:10:11.696 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-23T10:10:11.696 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:10:11.697 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T10:10:11.724 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T10:10:11.789 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-23T10:10:11.789 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T10:10:11.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T10:10:11.884 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-23T10:10:11.885 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T10:10:11.909 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T10:10:11.973 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-23T10:10:11.973 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:10:11.973 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T10:10:11.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T10:10:12.062 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-23T10:10:12.063 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T10:10:12.090 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T10:10:12.159 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-23T10:10:12.160 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T10:10:12.183 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T10:10:12.247 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-23T10:10:12.247 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:10:12.247 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T10:10:12.273 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T10:10:12.339 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-23T10:10:12.339 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T10:10:12.368 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T10:10:12.435 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-23T10:10:12.435 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T10:10:12.458 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T10:10:12.522 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-23T10:10:12.616 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-23T10:10:12.616 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:10:12.616 INFO:tasks.cephadm:Cluster fsid is ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:10:12.617 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-23T10:10:12.617 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.69', 'mon.b': '172.21.15.146', 'mon.c': '172.21.15.167'} 2024-04-23T10:10:12.617 INFO:tasks.cephadm:First mon is mon.a on smithi069 2024-04-23T10:10:12.617 INFO:tasks.cephadm:First mgr is x 2024-04-23T10:10:12.617 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-23T10:10:12.617 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname $(hostname -s) 2024-04-23T10:10:12.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname $(hostname -s) 2024-04-23T10:10:12.666 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname $(hostname -s) 2024-04-23T10:10:12.691 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-23T10:10:12.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:10:12.828 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78795/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3156-gd69f13d8', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3156.gd69f13d8'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-22 12:00:06.590653', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-lusov-quiescer', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-04-23T10:10:13.048 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-lusov-quiescer, sha1 d69f13d827952bb07bb9b7973bca14f97d764d6f from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:10:13.049 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/x86_64/flavors/default/cephadm 2024-04-23T10:10:13.049 DEBUG:teuthology.orchestra.run.smithi069:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-23T10:10:13.533 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r--. 1 ubuntu ubuntu 781541 Apr 23 10:10 /home/ubuntu/cephtest/cephadm 2024-04-23T10:10:13.534 DEBUG:teuthology.orchestra.run.smithi146:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-23T10:10:14.011 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r--. 1 ubuntu ubuntu 781541 Apr 23 10:10 /home/ubuntu/cephtest/cephadm 2024-04-23T10:10:14.011 DEBUG:teuthology.orchestra.run.smithi167:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-23T10:10:14.743 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r--. 1 ubuntu ubuntu 781541 Apr 23 10:10 /home/ubuntu/cephtest/cephadm 2024-04-23T10:10:14.743 DEBUG:teuthology.orchestra.run.smithi069:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-23T10:10:14.762 DEBUG:teuthology.orchestra.run.smithi146:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-23T10:10:14.780 DEBUG:teuthology.orchestra.run.smithi167:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-23T10:10:14.811 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f on all hosts... 2024-04-23T10:10:14.811 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f pull 2024-04-23T10:10:14.814 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f pull 2024-04-23T10:10:14.823 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f pull 2024-04-23T10:10:16.429 INFO:teuthology.orchestra.run.smithi069.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f... 2024-04-23T10:10:16.456 INFO:teuthology.orchestra.run.smithi146.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f... 2024-04-23T10:10:16.481 INFO:teuthology.orchestra.run.smithi167.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f... 2024-04-23T10:13:47.811 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-04-23T10:13:47.811 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-23T10:13:47.811 INFO:teuthology.orchestra.run.smithi167.stdout: "image_id": "da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76", 2024-04-23T10:13:47.811 INFO:teuthology.orchestra.run.smithi167.stdout: "repo_digests": [ 2024-04-23T10:13:47.811 INFO:teuthology.orchestra.run.smithi167.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4" 2024-04-23T10:13:47.811 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-04-23T10:13:47.812 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-04-23T10:16:29.895 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:16:29.896 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-23T10:16:29.896 INFO:teuthology.orchestra.run.smithi069.stdout: "image_id": "da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76", 2024-04-23T10:16:29.896 INFO:teuthology.orchestra.run.smithi069.stdout: "repo_digests": [ 2024-04-23T10:16:29.896 INFO:teuthology.orchestra.run.smithi069.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4" 2024-04-23T10:16:29.896 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:16:29.896 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:16:52.007 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-23T10:16:52.007 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-23T10:16:52.007 INFO:teuthology.orchestra.run.smithi146.stdout: "image_id": "da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76", 2024-04-23T10:16:52.007 INFO:teuthology.orchestra.run.smithi146.stdout: "repo_digests": [ 2024-04-23T10:16:52.007 INFO:teuthology.orchestra.run.smithi146.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4" 2024-04-23T10:16:52.008 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-04-23T10:16:52.008 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-23T10:16:52.031 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph 2024-04-23T10:16:52.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph 2024-04-23T10:16:52.090 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph 2024-04-23T10:16:52.123 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /etc/ceph 2024-04-23T10:16:52.151 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /etc/ceph 2024-04-23T10:16:52.174 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /etc/ceph 2024-04-23T10:16:52.201 INFO:tasks.cephadm:Writing seed config... 2024-04-23T10:16:52.203 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-04-23T10:16:52.203 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-23T10:16:52.203 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-23T10:16:52.203 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-23T10:16:52.203 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-23T10:16:52.203 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-23T10:16:52.203 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-23T10:16:52.203 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-23T10:16:52.203 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-23T10:16:52.203 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-23T10:16:52.203 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-23T10:16:52.204 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-23T10:16:52.205 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-23T10:16:52.206 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-23T10:16:52.206 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-23T10:16:52.206 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-23T10:16:52.206 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-23T10:16:52.206 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-23T10:16:52.206 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-04-23T10:16:52.206 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:16:52.207 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-23T10:16:52.224 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ac4c3a2c-0159-11ef-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-23T10:16:52.224 DEBUG:teuthology.orchestra.run.smithi069:mon.a> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.a.service 2024-04-23T10:16:52.266 DEBUG:teuthology.orchestra.run.smithi069:mgr.x> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.x.service 2024-04-23T10:16:52.310 INFO:tasks.cephadm:Bootstrapping... 2024-04-23T10:16:52.310 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f -v bootstrap --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.69 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-23T10:16:52.504 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-23T10:16:52.504 INFO:teuthology.orchestra.run.smithi069.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f', '-v', 'bootstrap', '--fsid', 'ac4c3a2c-0159-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.69', '--skip-admin-label'] 2024-04-23T10:16:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-23T10:16:52.504 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying podman|docker is present... 2024-04-23T10:16:52.529 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-23T10:16:52.530 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying lvm2 is present... 2024-04-23T10:16:52.530 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying time synchronization is in place... 2024-04-23T10:16:52.538 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-23T10:16:52.538 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-23T10:16:52.543 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-23T10:16:52.544 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-04-23T10:16:52.550 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout enabled 2024-04-23T10:16:52.556 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout active 2024-04-23T10:16:52.556 INFO:teuthology.orchestra.run.smithi069.stdout:Unit chronyd.service is enabled and running 2024-04-23T10:16:52.556 INFO:teuthology.orchestra.run.smithi069.stdout:Repeating the final host check... 2024-04-23T10:16:52.581 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-23T10:16:52.581 INFO:teuthology.orchestra.run.smithi069.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-23T10:16:52.581 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl is present 2024-04-23T10:16:52.581 INFO:teuthology.orchestra.run.smithi069.stdout:lvcreate is present 2024-04-23T10:16:52.587 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-23T10:16:52.587 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-23T10:16:52.593 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-23T10:16:52.593 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-04-23T10:16:52.599 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout enabled 2024-04-23T10:16:52.605 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout active 2024-04-23T10:16:52.605 INFO:teuthology.orchestra.run.smithi069.stdout:Unit chronyd.service is enabled and running 2024-04-23T10:16:52.606 INFO:teuthology.orchestra.run.smithi069.stdout:Host looks OK 2024-04-23T10:16:52.606 INFO:teuthology.orchestra.run.smithi069.stdout:Cluster fsid: ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:16:52.606 INFO:teuthology.orchestra.run.smithi069.stdout:Acquiring lock 140112162913440 on /run/cephadm/ac4c3a2c-0159-11ef-bc93-c7b262605968.lock 2024-04-23T10:16:52.606 INFO:teuthology.orchestra.run.smithi069.stdout:Lock 140112162913440 acquired on /run/cephadm/ac4c3a2c-0159-11ef-bc93-c7b262605968.lock 2024-04-23T10:16:52.606 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying IP 172.21.15.69 port 3300 ... 2024-04-23T10:16:52.607 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying IP 172.21.15.69 port 6789 ... 2024-04-23T10:16:52.607 INFO:teuthology.orchestra.run.smithi069.stdout:Base mon IP(s) is [172.21.15.69:3300, 172.21.15.69:6789], mon addrv is [v2:172.21.15.69:3300,v1:172.21.15.69:6789] 2024-04-23T10:16:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.69 metric 100 2024-04-23T10:16:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.69 metric 100 2024-04-23T10:16:52.613 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-23T10:16:52.613 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-04-23T10:16:52.613 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-04-23T10:16:52.614 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-23T10:16:52.615 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-23T10:16:52.615 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-23T10:16:52.615 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-23T10:16:52.615 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout inet6 fe80::29da:7ec3:91cc:c1f0/64 scope link noprefixroute 2024-04-23T10:16:52.615 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-23T10:16:52.615 INFO:teuthology.orchestra.run.smithi069.stdout:Mon IP `172.21.15.69` is in CIDR network `172.21.0.0/20` 2024-04-23T10:16:52.616 INFO:teuthology.orchestra.run.smithi069.stdout:Mon IP `172.21.15.69` is in CIDR network `172.21.0.0/20` 2024-04-23T10:16:52.616 INFO:teuthology.orchestra.run.smithi069.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-23T10:16:52.616 INFO:teuthology.orchestra.run.smithi069.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-23T10:16:52.617 INFO:teuthology.orchestra.run.smithi069.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f... 2024-04-23T10:16:53.055 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 2024-04-23T10:16:53.055 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f... 2024-04-23T10:16:53.055 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Getting image source signatures 2024-04-23T10:16:53.055 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying blob sha256:7f03586bcf9c6a2b4d690c118c4aa5b771f9c6f252d75a20fb283dd07093a738 2024-04-23T10:16:53.055 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying blob sha256:426fede9fffa2c7dfe40a4f9322a34794b72405170134d54d2c30d9cc6c6a5be 2024-04-23T10:16:53.055 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying config sha256:da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 2024-04-23T10:16:53.055 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-23T10:16:54.087 INFO:teuthology.orchestra.run.smithi069.stdout:ceph: stdout ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev) 2024-04-23T10:16:54.087 INFO:teuthology.orchestra.run.smithi069.stdout:Ceph version: ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev) 2024-04-23T10:16:54.088 INFO:teuthology.orchestra.run.smithi069.stdout:Extracting ceph user uid/gid from container image... 2024-04-23T10:17:00.553 INFO:teuthology.orchestra.run.smithi069.stdout:stat: stdout 167 167 2024-04-23T10:17:00.553 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial keys... 2024-04-23T10:17:01.524 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQCciidmnDRoMxAAUfCwM2XpiyD6N/udrS1+gA== 2024-04-23T10:17:02.538 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQCdiidmQTq9MRAAqTTDzGT8IZ0E050qKx0eag== 2024-04-23T10:17:03.393 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQCeiidmlYGRNBAAJhhjc0hWmx87+4G7zEmACw== 2024-04-23T10:17:03.394 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial monmap... 2024-04-23T10:17:04.284 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-23T10:17:04.284 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-23T10:17:04.284 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:17:04.284 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-23T10:17:04.284 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool for a [v2:172.21.15.69:3300,v1:172.21.15.69:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-23T10:17:04.284 INFO:teuthology.orchestra.run.smithi069.stdout:setting min_mon_release = quincy 2024-04-23T10:17:04.284 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: set fsid to ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:17:04.284 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-23T10:17:04.284 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:17:04.284 INFO:teuthology.orchestra.run.smithi069.stdout:Creating mon... 2024-04-23T10:17:05.236 INFO:teuthology.orchestra.run.smithi069.stdout:create mon.a on 2024-04-23T10:17:05.447 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-23T10:17:05.584 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-23T10:17:05.751 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968.target. 2024-04-23T10:17:05.751 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968.target. 2024-04-23T10:17:05.994 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.a 2024-04-23T10:17:05.994 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-23T10:17:06.160 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968.target.wants/ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@.service. 2024-04-23T10:17:06.643 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T10:17:06.643 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2024-04-23T10:17:06.650 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T10:17:06.650 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-04-23T10:17:06.650 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2024-04-23T10:17:06.650 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to enable service . firewalld.service is not available 2024-04-23T10:17:06.650 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mon to start... 2024-04-23T10:17:06.650 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mon... 2024-04-23T10:17:06.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:06 smithi069 systemd[1]: Started Ceph mon.a for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:17:07.740 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-23T10:17:07.740 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: monmap epoch 1 2024-04-23T10:17:07.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:17:07.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: last_changed 2024-04-23T10:17:03.719203+0000 2024-04-23T10:17:07.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: created 2024-04-23T10:17:03.719203+0000 2024-04-23T10:17:07.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: min_mon_release 19 (squid) 2024-04-23T10:17:07.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: election_strategy: 1 2024-04-23T10:17:07.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-04-23T10:17:07.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: fsmap 2024-04-23T10:17:07.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: osdmap e1: 0 total, 0 up, 0 in 2024-04-23T10:17:07.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: mgrmap e1: no daemons active 2024-04-23T10:17:07.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:07 smithi069 ceph-mon[29219]: from='client.? 172.21.15.69:0/997243087' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-23T10:17:07.749 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout cluster: 2024-04-23T10:17:07.749 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout id: ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:17:07.749 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-23T10:17:07.749 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:07.749 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout services: 2024-04-23T10:17:07.749 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.544012s) 2024-04-23T10:17:07.749 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-23T10:17:07.749 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-23T10:17:07.749 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:07.749 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout data: 2024-04-23T10:17:07.749 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout pgs: 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.081+0000 7fc421673700 1 Processor -- start 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.081+0000 7fc421673700 1 -- start start 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.081+0000 7fc421673700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c1089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.081+0000 7fc421673700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c108fb0 con 0x7fc41c1085c0 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.082+0000 7fc41affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c1089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.082+0000 7fc41affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c1089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37090/0 (socket says 172.21.15.69:37090) 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.082+0000 7fc41affd700 1 -- 172.21.15.69:0/2520506815 learned_addr learned my addr 172.21.15.69:0/2520506815 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.082+0000 7fc41affd700 1 -- 172.21.15.69:0/2520506815 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c109770 con 0x7fc41c1085c0 2024-04-23T10:17:07.750 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.082+0000 7fc41affd700 1 --2- 172.21.15.69:0/2520506815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c1089e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0098a0 tx=0x7fc40c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd5bab9b457942f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.082+0000 7fc419ffb700 1 -- 172.21.15.69:0/2520506815 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc40c004160 con 0x7fc41c1085c0 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.082+0000 7fc419ffb700 1 -- 172.21.15.69:0/2520506815 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40c004300 con 0x7fc41c1085c0 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.082+0000 7fc419ffb700 1 -- 172.21.15.69:0/2520506815 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc40c0036a0 con 0x7fc41c1085c0 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.083+0000 7fc421673700 1 -- 172.21.15.69:0/2520506815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 msgr2=0x7fc41c1089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.083+0000 7fc421673700 1 --2- 172.21.15.69:0/2520506815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c1089e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0098a0 tx=0x7fc40c009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.083+0000 7fc421673700 1 -- 172.21.15.69:0/2520506815 shutdown_connections 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.083+0000 7fc421673700 1 --2- 172.21.15.69:0/2520506815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c1089e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.083+0000 7fc421673700 1 -- 172.21.15.69:0/2520506815 >> 172.21.15.69:0/2520506815 conn(0x7fc41c103be0 msgr2=0x7fc41c106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.083+0000 7fc421673700 1 -- 172.21.15.69:0/2520506815 shutdown_connections 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.083+0000 7fc421673700 1 -- 172.21.15.69:0/2520506815 wait complete. 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.084+0000 7fc421673700 1 Processor -- start 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.084+0000 7fc421673700 1 -- start start 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.084+0000 7fc421673700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.084+0000 7fc421673700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c109ca0 con 0x7fc41c1085c0 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.084+0000 7fc41affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.084+0000 7fc41affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c19bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37102/0 (socket says 172.21.15.69:37102) 2024-04-23T10:17:07.751 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.084+0000 7fc41affd700 1 -- 172.21.15.69:0/997243087 learned_addr learned my addr 172.21.15.69:0/997243087 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.084+0000 7fc41affd700 1 -- 172.21.15.69:0/997243087 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c19c0d0 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.085+0000 7fc41affd700 1 --2- 172.21.15.69:0/997243087 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c19bb90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc40c000c00 tx=0x7fc40c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.085+0000 7fc403fff700 1 -- 172.21.15.69:0/997243087 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc40c003db0 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.085+0000 7fc403fff700 1 -- 172.21.15.69:0/997243087 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40c011630 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.085+0000 7fc421673700 1 -- 172.21.15.69:0/997243087 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41c19c360 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.085+0000 7fc403fff700 1 -- 172.21.15.69:0/997243087 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc40c011950 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.085+0000 7fc421673700 1 -- 172.21.15.69:0/997243087 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc41c19f050 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.085+0000 7fc403fff700 1 -- 172.21.15.69:0/997243087 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc40c011af0 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.085+0000 7fc403fff700 1 -- 172.21.15.69:0/997243087 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc40c01c450 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.086+0000 7fc421673700 1 -- 172.21.15.69:0/997243087 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41c0640a0 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.088+0000 7fc403fff700 1 -- 172.21.15.69:0/997243087 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc40c032020 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.157+0000 7fc421673700 1 -- 172.21.15.69:0/997243087 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fc41c02e100 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.157+0000 7fc403fff700 1 -- 172.21.15.69:0/997243087 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fc40c004260 con 0x7fc41c1085c0 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.158+0000 7fc421673700 1 -- 172.21.15.69:0/997243087 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 msgr2=0x7fc41c19bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:07.752 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.158+0000 7fc421673700 1 --2- 172.21.15.69:0/997243087 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c19bb90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc40c000c00 tx=0x7fc40c004750 comp rx=0 tx=0).stop 2024-04-23T10:17:07.753 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.158+0000 7fc421673700 1 -- 172.21.15.69:0/997243087 shutdown_connections 2024-04-23T10:17:07.753 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.158+0000 7fc421673700 1 --2- 172.21.15.69:0/997243087 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc41c1085c0 0x7fc41c19bb90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:07.753 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.158+0000 7fc421673700 1 -- 172.21.15.69:0/997243087 >> 172.21.15.69:0/997243087 conn(0x7fc41c103be0 msgr2=0x7fc41c192820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:07.753 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.158+0000 7fc421673700 1 -- 172.21.15.69:0/997243087 shutdown_connections 2024-04-23T10:17:07.753 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:07.158+0000 7fc421673700 1 -- 172.21.15.69:0/997243087 wait complete. 2024-04-23T10:17:07.753 INFO:teuthology.orchestra.run.smithi069.stdout:mon is available 2024-04-23T10:17:07.753 INFO:teuthology.orchestra.run.smithi069.stdout:Assimilating anything we can from ceph.conf... 2024-04-23T10:17:08.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:08 smithi069 ceph-mon[29219]: from='client.? 172.21.15.69:0/2969684567' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-23T10:17:08.804 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:08 smithi069 ceph-mon[29219]: from='client.? 172.21.15.69:0/2969684567' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [global] 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout fsid = ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.69:3300,v1:172.21.15.69:6789] 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-23T10:17:08.813 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [osd] 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.122+0000 7f8ab6555700 1 Processor -- start 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.122+0000 7f8ab6555700 1 -- start start 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.122+0000 7f8ab6555700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab01089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.122+0000 7f8ab6555700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0108fb0 con 0x7f8ab01085c0 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.122+0000 7f8aaffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab01089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.123+0000 7f8aaffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab01089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37116/0 (socket says 172.21.15.69:37116) 2024-04-23T10:17:08.814 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.123+0000 7f8aaffff700 1 -- 172.21.15.69:0/315652086 learned_addr learned my addr 172.21.15.69:0/315652086 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.123+0000 7f8aaffff700 1 -- 172.21.15.69:0/315652086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab0109770 con 0x7f8ab01085c0 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.123+0000 7f8aaffff700 1 --2- 172.21.15.69:0/315652086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab01089e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00098a0 tx=0x7f8aa0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8971002d8dc3ae2d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.123+0000 7f8aaeffd700 1 -- 172.21.15.69:0/315652086 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa0004160 con 0x7f8ab01085c0 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.123+0000 7f8aaeffd700 1 -- 172.21.15.69:0/315652086 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa0004300 con 0x7f8ab01085c0 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.123+0000 7f8aaeffd700 1 -- 172.21.15.69:0/315652086 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa00036a0 con 0x7f8ab01085c0 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.124+0000 7f8ab6555700 1 -- 172.21.15.69:0/315652086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 msgr2=0x7f8ab01089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.124+0000 7f8ab6555700 1 --2- 172.21.15.69:0/315652086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab01089e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00098a0 tx=0x7f8aa0009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.124+0000 7f8ab6555700 1 -- 172.21.15.69:0/315652086 shutdown_connections 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.124+0000 7f8ab6555700 1 --2- 172.21.15.69:0/315652086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab01089e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.124+0000 7f8ab6555700 1 -- 172.21.15.69:0/315652086 >> 172.21.15.69:0/315652086 conn(0x7f8ab0103be0 msgr2=0x7f8ab0106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.124+0000 7f8ab6555700 1 -- 172.21.15.69:0/315652086 shutdown_connections 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.124+0000 7f8ab6555700 1 -- 172.21.15.69:0/315652086 wait complete. 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.124+0000 7f8ab6555700 1 Processor -- start 2024-04-23T10:17:08.815 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.124+0000 7f8ab6555700 1 -- start start 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8ab6555700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8ab6555700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0109ca0 con 0x7f8ab01085c0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8aaffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8aaffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab019bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37120/0 (socket says 172.21.15.69:37120) 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8aaffff700 1 -- 172.21.15.69:0/2969684567 learned_addr learned my addr 172.21.15.69:0/2969684567 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8aaffff700 1 -- 172.21.15.69:0/2969684567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab019c0f0 con 0x7f8ab01085c0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8aaffff700 1 --2- 172.21.15.69:0/2969684567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab019bbb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0000c00 tx=0x7f8aa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8aad7fa700 1 -- 172.21.15.69:0/2969684567 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa0003db0 con 0x7f8ab01085c0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8aad7fa700 1 -- 172.21.15.69:0/2969684567 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa0011630 con 0x7f8ab01085c0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8ab6555700 1 -- 172.21.15.69:0/2969684567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab019c380 con 0x7f8ab01085c0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8aad7fa700 1 -- 172.21.15.69:0/2969684567 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa0011950 con 0x7f8ab01085c0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.125+0000 7f8ab6555700 1 -- 172.21.15.69:0/2969684567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab019f070 con 0x7f8ab01085c0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.126+0000 7f8aad7fa700 1 -- 172.21.15.69:0/2969684567 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8aa0011af0 con 0x7f8ab01085c0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.126+0000 7f8aad7fa700 1 -- 172.21.15.69:0/2969684567 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8aa001c450 con 0x7f8ab01085c0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.126+0000 7f8ab6555700 1 -- 172.21.15.69:0/2969684567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab00640a0 con 0x7f8ab01085c0 2024-04-23T10:17:08.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.129+0000 7f8aad7fa700 1 -- 172.21.15.69:0/2969684567 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8aa0004260 con 0x7f8ab01085c0 2024-04-23T10:17:08.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.195+0000 7f8ab6555700 1 -- 172.21.15.69:0/2969684567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f8ab002e100 con 0x7f8ab01085c0 2024-04-23T10:17:08.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.198+0000 7f8aad7fa700 1 -- 172.21.15.69:0/2969684567 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f8aa001b450 con 0x7f8ab01085c0 2024-04-23T10:17:08.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.199+0000 7f8aad7fa700 1 -- 172.21.15.69:0/2969684567 <== mon.0 v2:172.21.15.69:3300/0 8 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8aa001b630 con 0x7f8ab01085c0 2024-04-23T10:17:08.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.200+0000 7f8ab6555700 1 -- 172.21.15.69:0/2969684567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 msgr2=0x7f8ab019bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:08.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.200+0000 7f8ab6555700 1 --2- 172.21.15.69:0/2969684567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab019bbb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0000c00 tx=0x7f8aa0004750 comp rx=0 tx=0).stop 2024-04-23T10:17:08.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.200+0000 7f8ab6555700 1 -- 172.21.15.69:0/2969684567 shutdown_connections 2024-04-23T10:17:08.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.200+0000 7f8ab6555700 1 --2- 172.21.15.69:0/2969684567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ab01085c0 0x7f8ab019bbb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:08.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.200+0000 7f8ab6555700 1 -- 172.21.15.69:0/2969684567 >> 172.21.15.69:0/2969684567 conn(0x7f8ab0103be0 msgr2=0x7f8ab01928d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:08.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.200+0000 7f8ab6555700 1 -- 172.21.15.69:0/2969684567 shutdown_connections 2024-04-23T10:17:08.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:08.200+0000 7f8ab6555700 1 -- 172.21.15.69:0/2969684567 wait complete. 2024-04-23T10:17:08.817 INFO:teuthology.orchestra.run.smithi069.stdout:Generating new minimal ceph.conf... 2024-04-23T10:17:09.816 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.228+0000 7f2b89387700 1 Processor -- start 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.228+0000 7f2b89387700 1 -- start start 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.228+0000 7f2b89387700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b84108a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.228+0000 7f2b89387700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2b84109000 con 0x7f2b84108610 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.229+0000 7f2b82ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b84108a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.229+0000 7f2b82ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b84108a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37134/0 (socket says 172.21.15.69:37134) 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.229+0000 7f2b82ffd700 1 -- 172.21.15.69:0/1352275250 learned_addr learned my addr 172.21.15.69:0/1352275250 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.229+0000 7f2b82ffd700 1 -- 172.21.15.69:0/1352275250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b841097c0 con 0x7f2b84108610 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.229+0000 7f2b82ffd700 1 --2- 172.21.15.69:0/1352275250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b84108a30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2b740098a0 tx=0x7f2b74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed3c7d0687a344a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.229+0000 7f2b81ffb700 1 -- 172.21.15.69:0/1352275250 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b74004160 con 0x7f2b84108610 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.229+0000 7f2b81ffb700 1 -- 172.21.15.69:0/1352275250 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f2b74004300 con 0x7f2b84108610 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.229+0000 7f2b81ffb700 1 -- 172.21.15.69:0/1352275250 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b74011b20 con 0x7f2b84108610 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.230+0000 7f2b89387700 1 -- 172.21.15.69:0/1352275250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 msgr2=0x7f2b84108a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:09.817 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.230+0000 7f2b89387700 1 --2- 172.21.15.69:0/1352275250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b84108a30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2b740098a0 tx=0x7f2b74009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.230+0000 7f2b89387700 1 -- 172.21.15.69:0/1352275250 shutdown_connections 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.230+0000 7f2b89387700 1 --2- 172.21.15.69:0/1352275250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b84108a30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.230+0000 7f2b89387700 1 -- 172.21.15.69:0/1352275250 >> 172.21.15.69:0/1352275250 conn(0x7f2b84103c10 msgr2=0x7f2b84106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.230+0000 7f2b89387700 1 -- 172.21.15.69:0/1352275250 shutdown_connections 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.230+0000 7f2b89387700 1 -- 172.21.15.69:0/1352275250 wait complete. 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.230+0000 7f2b89387700 1 Processor -- start 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.231+0000 7f2b89387700 1 -- start start 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.231+0000 7f2b89387700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b8419c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.231+0000 7f2b89387700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8410cb70 con 0x7f2b84108610 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.231+0000 7f2b82ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b8419c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.231+0000 7f2b82ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b8419c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37138/0 (socket says 172.21.15.69:37138) 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.231+0000 7f2b82ffd700 1 -- 172.21.15.69:0/3138350776 learned_addr learned my addr 172.21.15.69:0/3138350776 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.231+0000 7f2b82ffd700 1 -- 172.21.15.69:0/3138350776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8419c900 con 0x7f2b84108610 2024-04-23T10:17:09.818 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.231+0000 7f2b82ffd700 1 --2- 172.21.15.69:0/3138350776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b8419c3c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2b740117e0 tx=0x7f2b74011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.231+0000 7f2b6bfff700 1 -- 172.21.15.69:0/3138350776 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b74003b20 con 0x7f2b84108610 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.232+0000 7f2b89387700 1 -- 172.21.15.69:0/3138350776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8419cb90 con 0x7f2b84108610 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.232+0000 7f2b6bfff700 1 -- 172.21.15.69:0/3138350776 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f2b74003cc0 con 0x7f2b84108610 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.232+0000 7f2b6bfff700 1 -- 172.21.15.69:0/3138350776 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b74019870 con 0x7f2b84108610 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.232+0000 7f2b89387700 1 -- 172.21.15.69:0/3138350776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8419cff0 con 0x7f2b84108610 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.232+0000 7f2b6bfff700 1 -- 172.21.15.69:0/3138350776 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2b7402d430 con 0x7f2b84108610 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.232+0000 7f2b6bfff700 1 -- 172.21.15.69:0/3138350776 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2b74024820 con 0x7f2b84108610 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.232+0000 7f2b89387700 1 -- 172.21.15.69:0/3138350776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b840640a0 con 0x7f2b84108610 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.235+0000 7f2b6bfff700 1 -- 172.21.15.69:0/3138350776 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2b74011e20 con 0x7f2b84108610 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.301+0000 7f2b89387700 1 -- 172.21.15.69:0/3138350776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f2b8419fda0 con 0x7f2b84108610 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.302+0000 7f2b6bfff700 1 -- 172.21.15.69:0/3138350776 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f2b7401ac70 con 0x7f2b84108610 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.302+0000 7f2b89387700 1 -- 172.21.15.69:0/3138350776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 msgr2=0x7f2b8419c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.302+0000 7f2b89387700 1 --2- 172.21.15.69:0/3138350776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b8419c3c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2b740117e0 tx=0x7f2b74011ce0 comp rx=0 tx=0).stop 2024-04-23T10:17:09.819 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.302+0000 7f2b89387700 1 -- 172.21.15.69:0/3138350776 shutdown_connections 2024-04-23T10:17:09.820 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.302+0000 7f2b89387700 1 --2- 172.21.15.69:0/3138350776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b84108610 0x7f2b8419c3c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:09.820 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.302+0000 7f2b89387700 1 -- 172.21.15.69:0/3138350776 >> 172.21.15.69:0/3138350776 conn(0x7f2b84103c10 msgr2=0x7f2b84104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:09.820 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.303+0000 7f2b89387700 1 -- 172.21.15.69:0/3138350776 shutdown_connections 2024-04-23T10:17:09.820 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:09.303+0000 7f2b89387700 1 -- 172.21.15.69:0/3138350776 wait complete. 2024-04-23T10:17:09.820 INFO:teuthology.orchestra.run.smithi069.stdout:Restarting the monitor... 2024-04-23T10:17:09.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:09 smithi069 ceph-mon[29219]: from='client.? 172.21.15.69:0/3138350776' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:17:09.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:09 smithi069 systemd[1]: Stopping Ceph mon.a for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:17:10.380 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:10 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a[29215]: 2024-04-23T10:17:10.089+0000 7f13eb50e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:17:10.380 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:10 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a[29215]: 2024-04-23T10:17:10.089+0000 7f13eb50e700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-23T10:17:10.380 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:10 smithi069 podman[29465]: 2024-04-23 10:17:10.140989322 +0000 UTC m=+0.152126916 container died 41b38b043b2493d118719216e2ecf67cffa80536292706b12aee848f07b5f8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-23T10:17:10.646 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:10 smithi069 podman[29465]: 2024-04-23 10:17:10.455838896 +0000 UTC m=+0.466976477 container cleanup 41b38b043b2493d118719216e2ecf67cffa80536292706b12aee848f07b5f8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-23T10:17:10.646 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:10 smithi069 bash[29465]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a 2024-04-23T10:17:10.981 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:10 smithi069 podman[29479]: 2024-04-23 10:17:10.648244275 +0000 UTC m=+0.504952259 container remove 41b38b043b2493d118719216e2ecf67cffa80536292706b12aee848f07b5f8d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:17:10.981 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:10 smithi069 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-23T10:17:10.981 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:10 smithi069 systemd[1]: Stopped Ceph mon.a for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:17:10.981 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:10 smithi069 systemd[1]: Starting Ceph mon.a for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:10 smithi069 podman[29573]: 2024-04-23 10:17:10.982406883 +0000 UTC m=+0.114753270 container create ef0b3ec76fa3deeb524c29f1aa99aa76a261866d658507a91c4f03e3bd6485b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:10 smithi069 podman[29573]: 2024-04-23 10:17:10.885447604 +0000 UTC m=+0.017793971 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 podman[29573]: 2024-04-23 10:17:11.185451605 +0000 UTC m=+0.317797952 container init ef0b3ec76fa3deeb524c29f1aa99aa76a261866d658507a91c4f03e3bd6485b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 podman[29573]: 2024-04-23 10:17:11.188435357 +0000 UTC m=+0.320781702 container start ef0b3ec76fa3deeb524c29f1aa99aa76a261866d658507a91c4f03e3bd6485b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: set uid:gid to 167:167 (ceph:ceph) 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev), process ceph-mon, pid 2 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: pidfile_write: ignore empty --pid-file 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: load: jerasure load: lrc 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: RocksDB version: 7.9.2 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Git sha 0 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Compile date 2024-04-22 10:57:25 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: DB SUMMARY 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: DB Session ID: TD0EI4GAVF6ABWXBLNBC 2024-04-23T10:17:11.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: CURRENT file: CURRENT 2024-04-23T10:17:11.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: IDENTITY file: IDENTITY 2024-04-23T10:17:11.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-23T10:17:11.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-23T10:17:11.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105598 ; 2024-04-23T10:17:11.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.error_if_exists: 0 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.create_if_missing: 0 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.paranoid_checks: 1 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.env: 0x561322fcfcc0 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.fs: PosixFileSystem 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.info_log: 0x561325123be0 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_file_opening_threads: 16 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.statistics: (nil) 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.use_fsync: 0 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_log_file_size: 0 2024-04-23T10:17:11.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.keep_log_file_num: 1000 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.recycle_log_file_num: 0 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.allow_fallocate: 1 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.allow_mmap_reads: 0 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.allow_mmap_writes: 0 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.use_direct_reads: 0 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.create_missing_column_families: 0 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.db_log_dir: 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.wal_dir: 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-23T10:17:11.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.advise_random_on_open: 1 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.db_write_buffer_size: 0 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.write_buffer_manager: 0x5613250b70e0 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.rate_limiter: (nil) 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.wal_recovery_mode: 2 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.enable_thread_tracking: 0 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.enable_pipelined_write: 0 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.unordered_write: 0 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-23T10:17:11.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.row_cache: None 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.wal_filter: None 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.allow_ingest_behind: 0 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.two_write_queues: 0 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.manual_wal_flush: 0 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.wal_compression: 0 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.atomic_flush: 0 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.log_readahead_size: 0 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.best_efforts_recovery: 0 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-23T10:17:11.248 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.allow_data_in_errors: 0 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.db_host_id: __hostname__ 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_background_jobs: 2 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_background_compactions: -1 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_subcompactions: 1 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_total_wal_size: 0 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_open_files: -1 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bytes_per_sync: 0 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-23T10:17:11.249 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_readahead_size: 0 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_background_flushes: -1 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Compression algorithms supported: 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: kZSTD supported: 0 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: kXpressCompression supported: 0 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: kLZ4HCCompression supported: 1 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: kZlibCompression supported: 1 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: kSnappyCompression supported: 1 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: kLZ4Compression supported: 1 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: kBZip2Compression supported: 0 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-23T10:17:11.250 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.merge_operator: 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_filter: None 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_filter_factory: None 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.sst_partitioner_factory: None 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561325123dc0) 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout: cache_index_and_filter_blocks: 1 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout: pin_top_level_index_and_filter: 1 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_type: 0 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout: data_block_index_type: 0 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_shortening: 1 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout: checksum: 4 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout: no_block_cache: 0 2024-04-23T10:17:11.251 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache: 0x5613250e91f0 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_name: BinnedLRUCache 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_options: 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: capacity : 536870912 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: num_shard_bits : 4 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: strict_capacity_limit : 0 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: high_pri_pool_ratio: 0.000 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_compressed: (nil) 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: persistent_cache: (nil) 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_size: 4096 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_size_deviation: 10 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_restart_interval: 16 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_block_restart_interval: 1 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: metadata_block_size: 4096 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: partition_filters: 0 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: use_delta_encoding: 1 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: filter_policy: bloomfilter 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: whole_key_filtering: 1 2024-04-23T10:17:11.252 INFO:journalctl@ceph.mon.a.smithi069.stdout: verify_compression: 0 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout: read_amp_bytes_per_bit: 0 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout: format_version: 5 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout: enable_index_compression: 1 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_align: 0 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout: max_auto_readahead_size: 262144 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout: prepopulate_block_cache: 0 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout: initial_auto_readahead_size: 8192 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout: num_file_reads_for_auto_readahead: 2 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.write_buffer_size: 33554432 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_write_buffer_number: 2 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compression: NoCompression 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bottommost_compression: Disabled 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.prefix_extractor: nullptr 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.num_levels: 7 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-23T10:17:11.253 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compression_opts.level: 32767 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compression_opts.strategy: 0 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-23T10:17:11.254 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compression_opts.enabled: false 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.target_file_size_base: 67108864 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-23T10:17:11.255 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.arena_block_size: 1048576 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.disable_auto_compactions: 0 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-23T10:17:11.256 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-23T10:17:11.257 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.inplace_update_support: 0 2024-04-23T10:17:11.257 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-23T10:17:11.257 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-23T10:17:11.257 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-23T10:17:11.257 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-23T10:17:11.257 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.bloom_locality: 0 2024-04-23T10:17:11.257 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.max_successive_merges: 0 2024-04-23T10:17:11.257 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.paranoid_file_checks: 0 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.force_consistency_checks: 1 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.report_bg_io_stats: 0 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.ttl: 2592000 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.enable_blob_files: false 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.min_blob_size: 0 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.blob_file_size: 268435456 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-23T10:17:11.258 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.blob_file_starting_level: 0 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0cd508a2-7860-4e70-8a7c-9175efe67770 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713867431216917, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713867431217974, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100685, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98569, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14288, "raw_average_key_size": 49, "raw_value_size": 90825, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713867431, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0cd508a2-7860-4e70-8a7c-9175efe67770", "db_session_id": "TD0EI4GAVF6ABWXBLNBC", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713867431218054, "job": 1, "event": "recovery_finished"} 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5613251fe000 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: DB pointer 0x5613251e8000 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** DB Stats ** 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-23T10:17:11.259 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** Compaction Stats [default] ** 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: L0 2/0 100.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: Sum 2/0 100.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** Compaction Stats [default] ** 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 144.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-23T10:17:11.260 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative compaction: 0.00 GB write, 32.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval compaction: 0.00 GB write, 32.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: Block cache BinnedLRUCache@0x5613250e91f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: starting mon.a rank 0 at public addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] at bind addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: mon.a@-1(???) e1 preinit fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:17:11.261 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: mon.a@-1(???).mds e1 new map 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: mon.a@-1(???).mds e1 print_map 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout: e1 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout: legacy client fscid: -1 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout: No filesystems configured 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T10:17:11.262 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-23T10:17:11.265 INFO:teuthology.orchestra.run.smithi069.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 bash[29573]: ef0b3ec76fa3deeb524c29f1aa99aa76a261866d658507a91c4f03e3bd6485b7 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 systemd[1]: Started Ceph mon.a for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: monmap epoch 1 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: last_changed 2024-04-23T10:17:03.719203+0000 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: created 2024-04-23T10:17:03.719203+0000 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: min_mon_release 19 (squid) 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: election_strategy: 1 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: fsmap 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: osdmap e1: 0 total, 0 up, 0 in 2024-04-23T10:17:11.561 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:11 smithi069 ceph-mon[29593]: mgrmap e1: no daemons active 2024-04-23T10:17:12.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.663+0000 7f8faa10c700 1 Processor -- start 2024-04-23T10:17:12.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.663+0000 7f8faa10c700 1 -- start start 2024-04-23T10:17:12.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.663+0000 7f8faa10c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa41089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:12.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.663+0000 7f8faa10c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa4108fb0 con 0x7f8fa41085c0 2024-04-23T10:17:12.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.664+0000 7f8fa37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa41089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:12.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.664+0000 7f8fa37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa41089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57738/0 (socket says 172.21.15.69:57738) 2024-04-23T10:17:12.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.664+0000 7f8fa37fe700 1 -- 172.21.15.69:0/3482086647 learned_addr learned my addr 172.21.15.69:0/3482086647 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:12.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.664+0000 7f8fa37fe700 1 -- 172.21.15.69:0/3482086647 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa4109770 con 0x7f8fa41085c0 2024-04-23T10:17:12.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.664+0000 7f8fa37fe700 1 --2- 172.21.15.69:0/3482086647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa41089e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009e80 tx=0x7f8f9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66a2661cc56aac1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:12.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.664+0000 7f8fa27fc700 1 -- 172.21.15.69:0/3482086647 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f94017070 con 0x7f8fa41085c0 2024-04-23T10:17:12.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.664+0000 7f8fa27fc700 1 -- 172.21.15.69:0/3482086647 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8f9400b8c0 con 0x7f8fa41085c0 2024-04-23T10:17:12.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.664+0000 7f8fa27fc700 1 -- 172.21.15.69:0/3482086647 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f940045c0 con 0x7f8fa41085c0 2024-04-23T10:17:12.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.665+0000 7f8faa10c700 1 -- 172.21.15.69:0/3482086647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 msgr2=0x7f8fa41089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:12.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.665+0000 7f8faa10c700 1 --2- 172.21.15.69:0/3482086647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa41089e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009e80 tx=0x7f8f9400b330 comp rx=0 tx=0).stop 2024-04-23T10:17:12.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.665+0000 7f8faa10c700 1 -- 172.21.15.69:0/3482086647 shutdown_connections 2024-04-23T10:17:12.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.665+0000 7f8faa10c700 1 --2- 172.21.15.69:0/3482086647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa41089e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:12.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.665+0000 7f8faa10c700 1 -- 172.21.15.69:0/3482086647 >> 172.21.15.69:0/3482086647 conn(0x7f8fa4103be0 msgr2=0x7f8fa4106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:12.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.665+0000 7f8faa10c700 1 -- 172.21.15.69:0/3482086647 shutdown_connections 2024-04-23T10:17:12.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.665+0000 7f8faa10c700 1 -- 172.21.15.69:0/3482086647 wait complete. 2024-04-23T10:17:12.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.665+0000 7f8faa10c700 1 Processor -- start 2024-04-23T10:17:12.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.666+0000 7f8faa10c700 1 -- start start 2024-04-23T10:17:12.343 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.666+0000 7f8faa10c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa419c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:12.343 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.666+0000 7f8faa10c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa410cb20 con 0x7f8fa41085c0 2024-04-23T10:17:12.343 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.666+0000 7f8fa37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa419c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:12.343 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.666+0000 7f8fa37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa419c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57740/0 (socket says 172.21.15.69:57740) 2024-04-23T10:17:12.343 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.666+0000 7f8fa37fe700 1 -- 172.21.15.69:0/561362350 learned_addr learned my addr 172.21.15.69:0/561362350 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:12.343 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.666+0000 7f8fa37fe700 1 -- 172.21.15.69:0/561362350 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa419c960 con 0x7f8fa41085c0 2024-04-23T10:17:12.343 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.666+0000 7f8fa37fe700 1 --2- 172.21.15.69:0/561362350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa419c420 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b7b0 tx=0x7f8f9400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:12.343 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.666+0000 7f8fa0ff9700 1 -- 172.21.15.69:0/561362350 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f94017070 con 0x7f8fa41085c0 2024-04-23T10:17:12.343 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.667+0000 7f8fa0ff9700 1 -- 172.21.15.69:0/561362350 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8f94022070 con 0x7f8fa41085c0 2024-04-23T10:17:12.343 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.667+0000 7f8fa0ff9700 1 -- 172.21.15.69:0/561362350 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9401d6b0 con 0x7f8fa41085c0 2024-04-23T10:17:12.343 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.667+0000 7f8faa10c700 1 -- 172.21.15.69:0/561362350 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa419cbf0 con 0x7f8fa41085c0 2024-04-23T10:17:12.344 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.667+0000 7f8faa10c700 1 -- 172.21.15.69:0/561362350 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa419f8e0 con 0x7f8fa41085c0 2024-04-23T10:17:12.344 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.667+0000 7f8fa0ff9700 1 -- 172.21.15.69:0/561362350 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f9401d960 con 0x7f8fa41085c0 2024-04-23T10:17:12.344 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.667+0000 7f8fa0ff9700 1 -- 172.21.15.69:0/561362350 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8f9400f050 con 0x7f8fa41085c0 2024-04-23T10:17:12.344 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.667+0000 7f8faa10c700 1 -- 172.21.15.69:0/561362350 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa40640a0 con 0x7f8fa41085c0 2024-04-23T10:17:12.344 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.670+0000 7f8fa0ff9700 1 -- 172.21.15.69:0/561362350 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8f94003d60 con 0x7f8fa41085c0 2024-04-23T10:17:12.344 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.738+0000 7f8faa10c700 1 -- 172.21.15.69:0/561362350 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f8fa419fab0 con 0x7f8fa41085c0 2024-04-23T10:17:12.344 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.739+0000 7f8fa0ff9700 1 -- 172.21.15.69:0/561362350 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f8f9400b860 con 0x7f8fa41085c0 2024-04-23T10:17:12.344 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.740+0000 7f8faa10c700 1 -- 172.21.15.69:0/561362350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 msgr2=0x7f8fa419c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:12.344 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.740+0000 7f8faa10c700 1 --2- 172.21.15.69:0/561362350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa419c420 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b7b0 tx=0x7f8f9400bdc0 comp rx=0 tx=0).stop 2024-04-23T10:17:12.344 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.740+0000 7f8faa10c700 1 -- 172.21.15.69:0/561362350 shutdown_connections 2024-04-23T10:17:12.344 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.740+0000 7f8faa10c700 1 --2- 172.21.15.69:0/561362350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa41085c0 0x7f8fa419c420 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:12.345 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.740+0000 7f8faa10c700 1 -- 172.21.15.69:0/561362350 >> 172.21.15.69:0/561362350 conn(0x7f8fa4103be0 msgr2=0x7f8fa4104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:12.345 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.740+0000 7f8faa10c700 1 -- 172.21.15.69:0/561362350 shutdown_connections 2024-04-23T10:17:12.345 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:11.740+0000 7f8faa10c700 1 -- 172.21.15.69:0/561362350 wait complete. 2024-04-23T10:17:12.345 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-23T10:17:12.356 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-23T10:17:12.356 INFO:teuthology.orchestra.run.smithi069.stdout:Creating mgr... 2024-04-23T10:17:12.356 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-23T10:17:12.357 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-23T10:17:12.610 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.x 2024-04-23T10:17:12.611 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-23T10:17:12.757 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968.target.wants/ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@.service. 2024-04-23T10:17:12.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:12 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/561362350' entity='client.admin' 2024-04-23T10:17:12.993 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:12 smithi069 systemd[1]: Starting Ceph mgr.x for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:17:13.294 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:12 smithi069 podman[29806]: 2024-04-23 10:17:12.901332466 +0000 UTC m=+0.017737570 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:17:13.294 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:13 smithi069 podman[29806]: 2024-04-23 10:17:13.012879734 +0000 UTC m=+0.129284873 container create 63ea1f36ea85f01ba27343e7c71ae56c34338df6c413b7ad9f0b61deded73508 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x, ceph=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-23T10:17:13.294 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:13 smithi069 podman[29806]: 2024-04-23 10:17:13.220354978 +0000 UTC m=+0.336760072 container init 63ea1f36ea85f01ba27343e7c71ae56c34338df6c413b7ad9f0b61deded73508 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:17:13.294 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:13 smithi069 podman[29806]: 2024-04-23 10:17:13.223064843 +0000 UTC m=+0.339469938 container start 63ea1f36ea85f01ba27343e7c71ae56c34338df6c413b7ad9f0b61deded73508 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:17:13.294 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:13 smithi069 bash[29806]: 63ea1f36ea85f01ba27343e7c71ae56c34338df6c413b7ad9f0b61deded73508 2024-04-23T10:17:13.307 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T10:17:13.307 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2024-04-23T10:17:13.314 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T10:17:13.315 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-04-23T10:17:13.315 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2024-04-23T10:17:13.315 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to enable service . firewalld.service is not available 2024-04-23T10:17:13.323 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T10:17:13.323 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2024-04-23T10:17:13.330 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T10:17:13.330 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-04-23T10:17:13.331 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2024-04-23T10:17:13.331 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-23T10:17:13.331 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr to start... 2024-04-23T10:17:13.331 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr... 2024-04-23T10:17:13.558 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:13 smithi069 systemd[1]: Started Ceph mgr.x for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:17:13.558 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:13 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:13.377+0000 7f5696527200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:17:13.860 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:13 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:13.564+0000 7f5696527200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:17:13.860 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:13 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:13.668+0000 7f5696527200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:17:14.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:13 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3554597839' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T10:17:14.242 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:13 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:13.993+0000 7f5696527200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:17:14.242 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:14 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:14.078+0000 7f5696527200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:17:14.512 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:14.515 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-04-23T10:17:14.515 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:17:14.515 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T10:17:14.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T10:17:14.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T10:17:14.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T10:17:14.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:14.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T10:17:14.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T10:17:14.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2024-04-23T10:17:14.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:14.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T10:17:14.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2024-04-23T10:17:14.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:14.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-23T10:17:14.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T10:17:14.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:14.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-23T10:17:14.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T10:17:14.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:14.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T10:17:14.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:14.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T10:17:14.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T10:17:14.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T10:17:14.526 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T10:17:14.527 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T10:17:06.615738+0000", 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.781+0000 7ffb004f5700 1 Processor -- start 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.781+0000 7ffb004f5700 1 -- start start 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.781+0000 7ffb004f5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf810b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.781+0000 7ffb004f5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf807be40 con 0x7ffaf8109080 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.781+0000 7ffafe291700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf810b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:14.528 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.781+0000 7ffafe291700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf810b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57760/0 (socket says 172.21.15.69:57760) 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.782+0000 7ffafe291700 1 -- 172.21.15.69:0/327050643 learned_addr learned my addr 172.21.15.69:0/327050643 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.782+0000 7ffafe291700 1 -- 172.21.15.69:0/327050643 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf810b9b0 con 0x7ffaf8109080 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.782+0000 7ffafe291700 1 --2- 172.21.15.69:0/327050643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf810b470 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40098a0 tx=0x7ffaf4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0bb82bb0a3d93e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.782+0000 7ffafd28f700 1 -- 172.21.15.69:0/327050643 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf4004160 con 0x7ffaf8109080 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.782+0000 7ffafd28f700 1 -- 172.21.15.69:0/327050643 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7ffaf4004300 con 0x7ffaf8109080 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.782+0000 7ffafd28f700 1 -- 172.21.15.69:0/327050643 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf4011b20 con 0x7ffaf8109080 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.783+0000 7ffb004f5700 1 -- 172.21.15.69:0/327050643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 msgr2=0x7ffaf810b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.783+0000 7ffb004f5700 1 --2- 172.21.15.69:0/327050643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf810b470 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40098a0 tx=0x7ffaf4009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.783+0000 7ffb004f5700 1 -- 172.21.15.69:0/327050643 shutdown_connections 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.783+0000 7ffb004f5700 1 --2- 172.21.15.69:0/327050643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf810b470 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.783+0000 7ffb004f5700 1 -- 172.21.15.69:0/327050643 >> 172.21.15.69:0/327050643 conn(0x7ffaf8102a50 msgr2=0x7ffaf8104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.783+0000 7ffb004f5700 1 -- 172.21.15.69:0/327050643 shutdown_connections 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.783+0000 7ffb004f5700 1 -- 172.21.15.69:0/327050643 wait complete. 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.784+0000 7ffb004f5700 1 Processor -- start 2024-04-23T10:17:14.529 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.784+0000 7ffb004f5700 1 -- start start 2024-04-23T10:17:14.530 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.784+0000 7ffb004f5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf819c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:14.530 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.784+0000 7ffb004f5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf810c980 con 0x7ffaf8109080 2024-04-23T10:17:14.530 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.784+0000 7ffafe291700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf819c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:14.530 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.784+0000 7ffafe291700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf819c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57762/0 (socket says 172.21.15.69:57762) 2024-04-23T10:17:14.530 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.784+0000 7ffafe291700 1 -- 172.21.15.69:0/3554597839 learned_addr learned my addr 172.21.15.69:0/3554597839 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:14.530 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.784+0000 7ffafe291700 1 -- 172.21.15.69:0/3554597839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf819c900 con 0x7ffaf8109080 2024-04-23T10:17:14.530 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.784+0000 7ffafe291700 1 --2- 172.21.15.69:0/3554597839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf819c3c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4006af0 tx=0x7ffaf4011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:14.530 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.785+0000 7ffaef7fe700 1 -- 172.21.15.69:0/3554597839 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf40039a0 con 0x7ffaf8109080 2024-04-23T10:17:14.530 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.785+0000 7ffaef7fe700 1 -- 172.21.15.69:0/3554597839 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7ffaf4003b40 con 0x7ffaf8109080 2024-04-23T10:17:14.530 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.785+0000 7ffb004f5700 1 -- 172.21.15.69:0/3554597839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf819cb90 con 0x7ffaf8109080 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.785+0000 7ffaef7fe700 1 -- 172.21.15.69:0/3554597839 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf4019670 con 0x7ffaf8109080 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.785+0000 7ffb004f5700 1 -- 172.21.15.69:0/3554597839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf819cff0 con 0x7ffaf8109080 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.785+0000 7ffaef7fe700 1 -- 172.21.15.69:0/3554597839 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffaf4019cf0 con 0x7ffaf8109080 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.785+0000 7ffaef7fe700 1 -- 172.21.15.69:0/3554597839 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffaf4024770 con 0x7ffaf8109080 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.786+0000 7ffb004f5700 1 -- 172.21.15.69:0/3554597839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf80640a0 con 0x7ffaf8109080 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.788+0000 7ffaef7fe700 1 -- 172.21.15.69:0/3554597839 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ffaf4011e20 con 0x7ffaf8109080 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.860+0000 7ffb004f5700 1 -- 172.21.15.69:0/3554597839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ffaf819f9c0 con 0x7ffaf8109080 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.861+0000 7ffaef7fe700 1 -- 172.21.15.69:0/3554597839 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7ffaf4003cf0 con 0x7ffaf8109080 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.862+0000 7ffb004f5700 1 -- 172.21.15.69:0/3554597839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 msgr2=0x7ffaf819c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.862+0000 7ffb004f5700 1 --2- 172.21.15.69:0/3554597839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf819c3c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4006af0 tx=0x7ffaf4011ce0 comp rx=0 tx=0).stop 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.862+0000 7ffb004f5700 1 -- 172.21.15.69:0/3554597839 shutdown_connections 2024-04-23T10:17:14.531 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.862+0000 7ffb004f5700 1 --2- 172.21.15.69:0/3554597839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffaf8109080 0x7ffaf819c3c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:14.532 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.862+0000 7ffb004f5700 1 -- 172.21.15.69:0/3554597839 >> 172.21.15.69:0/3554597839 conn(0x7ffaf8102a50 msgr2=0x7ffaf8103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:14.532 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.863+0000 7ffb004f5700 1 -- 172.21.15.69:0/3554597839 shutdown_connections 2024-04-23T10:17:14.532 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:13.863+0000 7ffb004f5700 1 -- 172.21.15.69:0/3554597839 wait complete. 2024-04-23T10:17:14.532 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (1/15)... 2024-04-23T10:17:15.624 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:15 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:15.279+0000 7f5696527200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:17:15.624 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:15 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:15.447+0000 7f5696527200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:17:15.624 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:15 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:15.624+0000 7f5696527200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:17:16.203 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:15 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:15.910+0000 7f5696527200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:17:16.203 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:16 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:16.001+0000 7f5696527200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:17:16.203 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:16 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:16.203+0000 7f5696527200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:17:16.492 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:16 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:16.398+0000 7f5696527200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:17:17.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:17 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1978115152' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T10:17:17.242 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:17 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:17.020+0000 7f5696527200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T10:17:17.585 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:17.585 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-04-23T10:17:17.585 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T10:17:17.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T10:17:17.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T10:17:17.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T10:17:06.615738+0000", 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.913+0000 7f005db00700 1 Processor -- start 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.913+0000 7f005db00700 1 -- start start 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.913+0000 7f005db00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005807c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.913+0000 7f005db00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f005807c7f0 con 0x7f005807de00 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.914+0000 7f00577fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005807c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.914+0000 7f00577fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005807c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57774/0 (socket says 172.21.15.69:57774) 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.914+0000 7f00577fe700 1 -- 172.21.15.69:0/1531392427 learned_addr learned my addr 172.21.15.69:0/1531392427 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.914+0000 7f00577fe700 1 -- 172.21.15.69:0/1531392427 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005807c970 con 0x7f005807de00 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.914+0000 7f00577fe700 1 --2- 172.21.15.69:0/1531392427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005807c2b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0050009e80 tx=0x7f005000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dabb9669383bd46 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.914+0000 7f00567fc700 1 -- 172.21.15.69:0/1531392427 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050017070 con 0x7f005807de00 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.914+0000 7f00567fc700 1 -- 172.21.15.69:0/1531392427 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f005000b8c0 con 0x7f005807de00 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.914+0000 7f00567fc700 1 -- 172.21.15.69:0/1531392427 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00500045c0 con 0x7f005807de00 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.915+0000 7f005db00700 1 -- 172.21.15.69:0/1531392427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 msgr2=0x7f005807c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.915+0000 7f005db00700 1 --2- 172.21.15.69:0/1531392427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005807c2b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0050009e80 tx=0x7f005000b330 comp rx=0 tx=0).stop 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.915+0000 7f005db00700 1 -- 172.21.15.69:0/1531392427 shutdown_connections 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.915+0000 7f005db00700 1 --2- 172.21.15.69:0/1531392427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005807c2b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.915+0000 7f005db00700 1 -- 172.21.15.69:0/1531392427 >> 172.21.15.69:0/1531392427 conn(0x7f0058103cb0 msgr2=0x7f00581060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.915+0000 7f005db00700 1 -- 172.21.15.69:0/1531392427 shutdown_connections 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.915+0000 7f005db00700 1 -- 172.21.15.69:0/1531392427 wait complete. 2024-04-23T10:17:17.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.916+0000 7f005db00700 1 Processor -- start 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.916+0000 7f005db00700 1 -- start start 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.916+0000 7f005db00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005819e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.916+0000 7f005db00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f005810eb80 con 0x7f005807de00 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.916+0000 7f00577fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005819e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.916+0000 7f00577fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005819e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57788/0 (socket says 172.21.15.69:57788) 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.916+0000 7f00577fe700 1 -- 172.21.15.69:0/1978115152 learned_addr learned my addr 172.21.15.69:0/1978115152 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.916+0000 7f00577fe700 1 -- 172.21.15.69:0/1978115152 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005819eb50 con 0x7f005807de00 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.917+0000 7f00577fe700 1 --2- 172.21.15.69:0/1978115152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005819e610 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0050004170 tx=0x7f005000bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.917+0000 7f0054ff9700 1 -- 172.21.15.69:0/1978115152 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050017070 con 0x7f005807de00 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.917+0000 7f0054ff9700 1 -- 172.21.15.69:0/1978115152 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f0050018040 con 0x7f005807de00 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.917+0000 7f005db00700 1 -- 172.21.15.69:0/1978115152 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005819ede0 con 0x7f005807de00 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.917+0000 7f0054ff9700 1 -- 172.21.15.69:0/1978115152 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f005001d6d0 con 0x7f005807de00 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.917+0000 7f005db00700 1 -- 172.21.15.69:0/1978115152 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00581a1ad0 con 0x7f005807de00 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.917+0000 7f0054ff9700 1 -- 172.21.15.69:0/1978115152 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0050024020 con 0x7f005807de00 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.917+0000 7f0054ff9700 1 -- 172.21.15.69:0/1978115152 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0050022020 con 0x7f005807de00 2024-04-23T10:17:17.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.918+0000 7f005db00700 1 -- 172.21.15.69:0/1978115152 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00580640a0 con 0x7f005807de00 2024-04-23T10:17:17.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.920+0000 7f0054ff9700 1 -- 172.21.15.69:0/1978115152 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0050026df0 con 0x7f005807de00 2024-04-23T10:17:17.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.993+0000 7f005db00700 1 -- 172.21.15.69:0/1978115152 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f00581a2040 con 0x7f005807de00 2024-04-23T10:17:17.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.993+0000 7f0054ff9700 1 -- 172.21.15.69:0/1978115152 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f0050003d60 con 0x7f005807de00 2024-04-23T10:17:17.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.994+0000 7f005db00700 1 -- 172.21.15.69:0/1978115152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 msgr2=0x7f005819e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:17.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.994+0000 7f005db00700 1 --2- 172.21.15.69:0/1978115152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005819e610 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0050004170 tx=0x7f005000bdc0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.994+0000 7f005db00700 1 -- 172.21.15.69:0/1978115152 shutdown_connections 2024-04-23T10:17:17.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.994+0000 7f005db00700 1 --2- 172.21.15.69:0/1978115152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f005807de00 0x7f005819e610 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:17.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.994+0000 7f005db00700 1 -- 172.21.15.69:0/1978115152 >> 172.21.15.69:0/1978115152 conn(0x7f0058103cb0 msgr2=0x7f00581046f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:17.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.995+0000 7f005db00700 1 -- 172.21.15.69:0/1978115152 shutdown_connections 2024-04-23T10:17:17.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:16.995+0000 7f005db00700 1 -- 172.21.15.69:0/1978115152 wait complete. 2024-04-23T10:17:17.592 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (2/15)... 2024-04-23T10:17:17.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:17 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:17.450+0000 7f5696527200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:17:17.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:17 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:17.546+0000 7f5696527200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:17:18.242 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:17 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:17.748+0000 7f5696527200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T10:17:18.608 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:18 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:18.275+0000 7f5696527200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:17:18.608 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:18 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:18.367+0000 7f5696527200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:17:18.951 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:18 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:18.608+0000 7f5696527200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:17:18.951 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:18 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:18.741+0000 7f5696527200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:17:18.951 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:18 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:18.836+0000 7f5696527200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:17:18.951 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:18 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:18.951+0000 7f5696527200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:17:19.713 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:19 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:19.278+0000 7f5696527200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:17:19.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:19 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:19.892+0000 7f5696527200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:17:20.492 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:20.111+0000 7f5696527200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:17:20.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: Activating manager daemon x 2024-04-23T10:17:20.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3059266661' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: mgrmap e2: x(active, starting, since 0.00357346s) 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: from='mgr.14100 172.21.15.69:0/341560480' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: from='mgr.14100 172.21.15.69:0/341560480' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: from='mgr.14100 172.21.15.69:0/341560480' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: from='mgr.14100 172.21.15.69:0/341560480' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: from='mgr.14100 172.21.15.69:0/341560480' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: Manager daemon x is now available 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: from='mgr.14100 172.21.15.69:0/341560480' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: from='mgr.14100 172.21.15.69:0/341560480' entity='mgr.x' 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: from='mgr.14100 172.21.15.69:0/341560480' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: from='mgr.14100 172.21.15.69:0/341560480' entity='mgr.x' 2024-04-23T10:17:20.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:20 smithi069 ceph-mon[29593]: from='mgr.14100 172.21.15.69:0/341560480' entity='mgr.x' 2024-04-23T10:17:20.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:20.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-04-23T10:17:20.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:17:20.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T10:17:20.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T10:17:20.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:20.669 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T10:17:20.669 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:20.669 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T10:17:20.669 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T10:17:20.669 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T10:17:20.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:20.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:20.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T10:17:06.615738+0000", 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.033+0000 7fed5b063700 1 Processor -- start 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.034+0000 7fed5b063700 1 -- start start 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.034+0000 7fed5b063700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed541072c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.034+0000 7fed5b063700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fed5407be20 con 0x7fed54106ea0 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.034+0000 7fed58dff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed541072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.034+0000 7fed58dff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed541072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55300/0 (socket says 172.21.15.69:55300) 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.034+0000 7fed58dff700 1 -- 172.21.15.69:0/408183361 learned_addr learned my addr 172.21.15.69:0/408183361 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.034+0000 7fed58dff700 1 -- 172.21.15.69:0/408183361 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed54107800 con 0x7fed54106ea0 2024-04-23T10:17:20.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.035+0000 7fed58dff700 1 --2- 172.21.15.69:0/408183361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed541072c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fed480098a0 tx=0x7fed48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cebe0404ff19c87 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.035+0000 7fed537fe700 1 -- 172.21.15.69:0/408183361 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed48004160 con 0x7fed54106ea0 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.035+0000 7fed537fe700 1 -- 172.21.15.69:0/408183361 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fed48004300 con 0x7fed54106ea0 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.035+0000 7fed537fe700 1 -- 172.21.15.69:0/408183361 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed48011b20 con 0x7fed54106ea0 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.035+0000 7fed5b063700 1 -- 172.21.15.69:0/408183361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 msgr2=0x7fed541072c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.035+0000 7fed5b063700 1 --2- 172.21.15.69:0/408183361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed541072c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fed480098a0 tx=0x7fed48009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.036+0000 7fed5b063700 1 -- 172.21.15.69:0/408183361 shutdown_connections 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.036+0000 7fed5b063700 1 --2- 172.21.15.69:0/408183361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed541072c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.036+0000 7fed5b063700 1 -- 172.21.15.69:0/408183361 >> 172.21.15.69:0/408183361 conn(0x7fed54102aa0 msgr2=0x7fed54104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.036+0000 7fed5b063700 1 -- 172.21.15.69:0/408183361 shutdown_connections 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.036+0000 7fed5b063700 1 -- 172.21.15.69:0/408183361 wait complete. 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.036+0000 7fed5b063700 1 Processor -- start 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.036+0000 7fed5b063700 1 -- start start 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.036+0000 7fed5b063700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed5419e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.036+0000 7fed5b063700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fed54108890 con 0x7fed54106ea0 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.037+0000 7fed58dff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed5419e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:20.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.037+0000 7fed58dff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed5419e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55306/0 (socket says 172.21.15.69:55306) 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.037+0000 7fed58dff700 1 -- 172.21.15.69:0/3059266661 learned_addr learned my addr 172.21.15.69:0/3059266661 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.037+0000 7fed58dff700 1 -- 172.21.15.69:0/3059266661 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5419eb20 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.037+0000 7fed58dff700 1 --2- 172.21.15.69:0/3059266661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed5419e5e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed48006af0 tx=0x7fed48011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.037+0000 7fed51ffb700 1 -- 172.21.15.69:0/3059266661 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed480039a0 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.037+0000 7fed51ffb700 1 -- 172.21.15.69:0/3059266661 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fed48003b40 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.037+0000 7fed5b063700 1 -- 172.21.15.69:0/3059266661 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5419edb0 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.037+0000 7fed51ffb700 1 -- 172.21.15.69:0/3059266661 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed48019670 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.037+0000 7fed5b063700 1 -- 172.21.15.69:0/3059266661 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5419f210 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.038+0000 7fed51ffb700 1 -- 172.21.15.69:0/3059266661 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fed48019ce0 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.038+0000 7fed51ffb700 1 -- 172.21.15.69:0/3059266661 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fed48024780 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.038+0000 7fed5b063700 1 -- 172.21.15.69:0/3059266661 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed540640a0 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.041+0000 7fed51ffb700 1 -- 172.21.15.69:0/3059266661 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fed48043e50 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.113+0000 7fed5b063700 1 -- 172.21.15.69:0/3059266661 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fed5402df80 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.113+0000 7fed51ffb700 1 -- 172.21.15.69:0/3059266661 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fed48032020 con 0x7fed54106ea0 2024-04-23T10:17:20.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.114+0000 7fed5b063700 1 -- 172.21.15.69:0/3059266661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 msgr2=0x7fed5419e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:20.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.114+0000 7fed5b063700 1 --2- 172.21.15.69:0/3059266661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed5419e5e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed48006af0 tx=0x7fed48011ce0 comp rx=0 tx=0).stop 2024-04-23T10:17:20.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.114+0000 7fed5b063700 1 -- 172.21.15.69:0/3059266661 shutdown_connections 2024-04-23T10:17:20.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.114+0000 7fed5b063700 1 --2- 172.21.15.69:0/3059266661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed54106ea0 0x7fed5419e5e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:20.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.114+0000 7fed5b063700 1 -- 172.21.15.69:0/3059266661 >> 172.21.15.69:0/3059266661 conn(0x7fed54102aa0 msgr2=0x7fed541952c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:20.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.114+0000 7fed5b063700 1 -- 172.21.15.69:0/3059266661 shutdown_connections 2024-04-23T10:17:20.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:20.114+0000 7fed5b063700 1 -- 172.21.15.69:0/3059266661 wait complete. 2024-04-23T10:17:20.682 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (3/15)... 2024-04-23T10:17:22.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:22 smithi069 ceph-mon[29593]: mgrmap e3: x(active, since 1.00609s) 2024-04-23T10:17:23.427 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:23 smithi069 ceph-mon[29593]: mgrmap e4: x(active, since 2s) 2024-04-23T10:17:23.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:23.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-23T10:17:23.949 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:23.950 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-23T10:17:23.950 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-23T10:17:23.950 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:23.950 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-23T10:17:23.950 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:23.950 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-23T10:17:23.950 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-23T10:17:23.950 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-23T10:17:23.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-23T10:17:23.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-23T10:17:23.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-23T10:17:23.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:23.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-23T10:17:23.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2024-04-23T10:17:06.615738+0000", 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-04-23T10:17:23.960 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.142+0000 7f18ab8e2700 1 Processor -- start 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.142+0000 7f18ab8e2700 1 -- start start 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.142+0000 7f18ab8e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a41072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.142+0000 7f18ab8e2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f18a407be20 con 0x7f18a4106ec0 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.142+0000 7f18a967e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a41072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.142+0000 7f18a967e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a41072e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55368/0 (socket says 172.21.15.69:55368) 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.142+0000 7f18a967e700 1 -- 172.21.15.69:0/3136767709 learned_addr learned my addr 172.21.15.69:0/3136767709 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.142+0000 7f18a967e700 1 -- 172.21.15.69:0/3136767709 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a4107820 con 0x7f18a4106ec0 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.142+0000 7f18a967e700 1 --2- 172.21.15.69:0/3136767709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a41072e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f189c0098a0 tx=0x7f189c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34f298b17278c6b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.143+0000 7f189bfff700 1 -- 172.21.15.69:0/3136767709 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f189c004160 con 0x7f18a4106ec0 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.143+0000 7f189bfff700 1 -- 172.21.15.69:0/3136767709 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f189c004300 con 0x7f18a4106ec0 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.143+0000 7f189bfff700 1 -- 172.21.15.69:0/3136767709 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f189c011b20 con 0x7f18a4106ec0 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.143+0000 7f18ab8e2700 1 -- 172.21.15.69:0/3136767709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 msgr2=0x7f18a41072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.143+0000 7f18ab8e2700 1 --2- 172.21.15.69:0/3136767709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a41072e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f189c0098a0 tx=0x7f189c009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:23.961 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.143+0000 7f18ab8e2700 1 -- 172.21.15.69:0/3136767709 shutdown_connections 2024-04-23T10:17:23.962 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.143+0000 7f18ab8e2700 1 --2- 172.21.15.69:0/3136767709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a41072e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:23.962 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.143+0000 7f18ab8e2700 1 -- 172.21.15.69:0/3136767709 >> 172.21.15.69:0/3136767709 conn(0x7f18a4102a80 msgr2=0x7f18a4104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:23.962 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.143+0000 7f18ab8e2700 1 -- 172.21.15.69:0/3136767709 shutdown_connections 2024-04-23T10:17:23.962 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.143+0000 7f18ab8e2700 1 -- 172.21.15.69:0/3136767709 wait complete. 2024-04-23T10:17:23.962 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.144+0000 7f18ab8e2700 1 Processor -- start 2024-04-23T10:17:23.962 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.144+0000 7f18ab8e2700 1 -- start start 2024-04-23T10:17:23.962 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.144+0000 7f18ab8e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a419e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:23.962 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.144+0000 7f18ab8e2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41088b0 con 0x7f18a4106ec0 2024-04-23T10:17:23.963 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.144+0000 7f18a967e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a419e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:23.963 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.144+0000 7f18a967e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a419e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55378/0 (socket says 172.21.15.69:55378) 2024-04-23T10:17:23.963 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.144+0000 7f18a967e700 1 -- 172.21.15.69:0/2454799860 learned_addr learned my addr 172.21.15.69:0/2454799860 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:23.963 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.144+0000 7f18a967e700 1 -- 172.21.15.69:0/2454799860 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a419eb80 con 0x7f18a4106ec0 2024-04-23T10:17:23.963 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.145+0000 7f18a967e700 1 --2- 172.21.15.69:0/2454799860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a419e640 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f189c0117e0 tx=0x7f189c011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:23.963 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.145+0000 7f189a7fc700 1 -- 172.21.15.69:0/2454799860 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f189c003b30 con 0x7f18a4106ec0 2024-04-23T10:17:23.963 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.145+0000 7f189a7fc700 1 -- 172.21.15.69:0/2454799860 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f189c003cd0 con 0x7f18a4106ec0 2024-04-23T10:17:23.963 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.145+0000 7f18ab8e2700 1 -- 172.21.15.69:0/2454799860 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a419ee10 con 0x7f18a4106ec0 2024-04-23T10:17:23.963 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.145+0000 7f189a7fc700 1 -- 172.21.15.69:0/2454799860 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f189c01a7c0 con 0x7f18a4106ec0 2024-04-23T10:17:23.963 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.145+0000 7f18ab8e2700 1 -- 172.21.15.69:0/2454799860 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a419f270 con 0x7f18a4106ec0 2024-04-23T10:17:23.963 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.145+0000 7f189a7fc700 1 -- 172.21.15.69:0/2454799860 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f189c01a960 con 0x7f18a4106ec0 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.146+0000 7f189a7fc700 1 --2- 172.21.15.69:0/2454799860 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7f1890039670 0x7f189003bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.146+0000 7f18ab8e2700 1 -- 172.21.15.69:0/2454799860 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a40640a0 con 0x7f18a4106ec0 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.146+0000 7f189a7fc700 1 -- 172.21.15.69:0/2454799860 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f189c04dbe0 con 0x7f18a4106ec0 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.146+0000 7f18a8e7d700 1 --2- 172.21.15.69:0/2454799860 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7f1890039670 0x7f189003bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.146+0000 7f18a8e7d700 1 --2- 172.21.15.69:0/2454799860 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7f1890039670 0x7f189003bb30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1894006fd0 tx=0x7f1894006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.151+0000 7f189a7fc700 1 -- 172.21.15.69:0/2454799860 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f189c019c70 con 0x7f18a4106ec0 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.427+0000 7f18ab8e2700 1 -- 172.21.15.69:0/2454799860 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f18a4063650 con 0x7f18a4106ec0 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.428+0000 7f189a7fc700 1 -- 172.21.15.69:0/2454799860 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f189c0042e0 con 0x7f18a4106ec0 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.430+0000 7f18ab8e2700 1 -- 172.21.15.69:0/2454799860 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7f1890039670 msgr2=0x7f189003bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.430+0000 7f18ab8e2700 1 --2- 172.21.15.69:0/2454799860 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7f1890039670 0x7f189003bb30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1894006fd0 tx=0x7f1894006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.430+0000 7f18ab8e2700 1 -- 172.21.15.69:0/2454799860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 msgr2=0x7f18a419e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.430+0000 7f18ab8e2700 1 --2- 172.21.15.69:0/2454799860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a419e640 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f189c0117e0 tx=0x7f189c011ce0 comp rx=0 tx=0).stop 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.430+0000 7f18ab8e2700 1 -- 172.21.15.69:0/2454799860 shutdown_connections 2024-04-23T10:17:23.964 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.430+0000 7f18ab8e2700 1 --2- 172.21.15.69:0/2454799860 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7f1890039670 0x7f189003bb30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:23.965 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.430+0000 7f18ab8e2700 1 --2- 172.21.15.69:0/2454799860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18a4106ec0 0x7f18a419e640 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:23.965 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.430+0000 7f18ab8e2700 1 -- 172.21.15.69:0/2454799860 >> 172.21.15.69:0/2454799860 conn(0x7f18a4102a80 msgr2=0x7f18a41952e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:23.965 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.430+0000 7f18ab8e2700 1 -- 172.21.15.69:0/2454799860 shutdown_connections 2024-04-23T10:17:23.965 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:23.430+0000 7f18ab8e2700 1 -- 172.21.15.69:0/2454799860 wait complete. 2024-04-23T10:17:23.965 INFO:teuthology.orchestra.run.smithi069.stdout:mgr is available 2024-04-23T10:17:24.338 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:24 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2454799860' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-23T10:17:25.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [global] 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout fsid = ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [osd] 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-23T10:17:25.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.352+0000 7fb74dabd700 1 Processor -- start 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.352+0000 7fb74dabd700 1 -- start start 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.352+0000 7fb74dabd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb7481078e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.352+0000 7fb74dabd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb748107eb0 con 0x7fb7481074c0 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.353+0000 7fb7477fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb7481078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.353+0000 7fb7477fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb7481078e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55382/0 (socket says 172.21.15.69:55382) 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.353+0000 7fb7477fe700 1 -- 172.21.15.69:0/3679003750 learned_addr learned my addr 172.21.15.69:0/3679003750 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.353+0000 7fb7477fe700 1 -- 172.21.15.69:0/3679003750 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7481086c0 con 0x7fb7481074c0 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.353+0000 7fb7477fe700 1 --2- 172.21.15.69:0/3679003750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb7481078e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb7380098a0 tx=0x7fb738009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3292a5e7a94dfb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.353+0000 7fb7467fc700 1 -- 172.21.15.69:0/3679003750 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb738004160 con 0x7fb7481074c0 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.353+0000 7fb7467fc700 1 -- 172.21.15.69:0/3679003750 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fb738004300 con 0x7fb7481074c0 2024-04-23T10:17:25.102 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.353+0000 7fb7467fc700 1 -- 172.21.15.69:0/3679003750 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb738011b20 con 0x7fb7481074c0 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.354+0000 7fb74dabd700 1 -- 172.21.15.69:0/3679003750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 msgr2=0x7fb7481078e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.354+0000 7fb74dabd700 1 --2- 172.21.15.69:0/3679003750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb7481078e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb7380098a0 tx=0x7fb738009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.354+0000 7fb74dabd700 1 -- 172.21.15.69:0/3679003750 shutdown_connections 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.354+0000 7fb74dabd700 1 --2- 172.21.15.69:0/3679003750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb7481078e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.354+0000 7fb74dabd700 1 -- 172.21.15.69:0/3679003750 >> 172.21.15.69:0/3679003750 conn(0x7fb748102a80 msgr2=0x7fb748104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.354+0000 7fb74dabd700 1 -- 172.21.15.69:0/3679003750 shutdown_connections 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.354+0000 7fb74dabd700 1 -- 172.21.15.69:0/3679003750 wait complete. 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.354+0000 7fb74dabd700 1 Processor -- start 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb74dabd700 1 -- start start 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb74dabd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb74819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb74dabd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb74810ba70 con 0x7fb7481074c0 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb7477fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb74819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb7477fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb74819c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55392/0 (socket says 172.21.15.69:55392) 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb7477fe700 1 -- 172.21.15.69:0/1260873972 learned_addr learned my addr 172.21.15.69:0/1260873972 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb7477fe700 1 -- 172.21.15.69:0/1260873972 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74819c9b0 con 0x7fb7481074c0 2024-04-23T10:17:25.103 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb7477fe700 1 --2- 172.21.15.69:0/1260873972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb74819c470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7380117e0 tx=0x7fb738011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb744ff9700 1 -- 172.21.15.69:0/1260873972 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb738003b30 con 0x7fb7481074c0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb744ff9700 1 -- 172.21.15.69:0/1260873972 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fb738003cd0 con 0x7fb7481074c0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb74dabd700 1 -- 172.21.15.69:0/1260873972 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74819cc40 con 0x7fb7481074c0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb744ff9700 1 -- 172.21.15.69:0/1260873972 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb73801a830 con 0x7fb7481074c0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.355+0000 7fb74dabd700 1 -- 172.21.15.69:0/1260873972 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb74819d0a0 con 0x7fb7481074c0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.356+0000 7fb744ff9700 1 -- 172.21.15.69:0/1260873972 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7fb73801a9d0 con 0x7fb7481074c0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.356+0000 7fb744ff9700 1 --2- 172.21.15.69:0/1260873972 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fb730039620 0x7fb73003bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.356+0000 7fb744ff9700 1 -- 172.21.15.69:0/1260873972 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb73804e9d0 con 0x7fb7481074c0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.356+0000 7fb746ffd700 1 --2- 172.21.15.69:0/1260873972 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fb730039620 0x7fb73003bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.356+0000 7fb74dabd700 1 -- 172.21.15.69:0/1260873972 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7480640a0 con 0x7fb7481074c0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.357+0000 7fb746ffd700 1 --2- 172.21.15.69:0/1260873972 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fb730039620 0x7fb73003bae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb73c006fd0 tx=0x7fb73c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.362+0000 7fb744ff9700 1 -- 172.21.15.69:0/1260873972 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb738019c70 con 0x7fb7481074c0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.555+0000 7fb74dabd700 1 -- 172.21.15.69:0/1260873972 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fb74802e260 con 0x7fb7481074c0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.556+0000 7fb744ff9700 1 -- 172.21.15.69:0/1260873972 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7fb738020240 con 0x7fb7481074c0 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.559+0000 7fb74dabd700 1 -- 172.21.15.69:0/1260873972 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fb730039620 msgr2=0x7fb73003bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:25.104 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.559+0000 7fb74dabd700 1 --2- 172.21.15.69:0/1260873972 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fb730039620 0x7fb73003bae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb73c006fd0 tx=0x7fb73c006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:25.105 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.559+0000 7fb74dabd700 1 -- 172.21.15.69:0/1260873972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 msgr2=0x7fb74819c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:25.105 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.559+0000 7fb74dabd700 1 --2- 172.21.15.69:0/1260873972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb74819c470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7380117e0 tx=0x7fb738011ce0 comp rx=0 tx=0).stop 2024-04-23T10:17:25.105 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.559+0000 7fb74dabd700 1 -- 172.21.15.69:0/1260873972 shutdown_connections 2024-04-23T10:17:25.105 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.559+0000 7fb74dabd700 1 --2- 172.21.15.69:0/1260873972 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fb730039620 0x7fb73003bae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:25.105 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.559+0000 7fb74dabd700 1 --2- 172.21.15.69:0/1260873972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7481074c0 0x7fb74819c470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:25.105 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.559+0000 7fb74dabd700 1 -- 172.21.15.69:0/1260873972 >> 172.21.15.69:0/1260873972 conn(0x7fb748102a80 msgr2=0x7fb748192fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:25.105 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.559+0000 7fb74dabd700 1 -- 172.21.15.69:0/1260873972 shutdown_connections 2024-04-23T10:17:25.105 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:24.559+0000 7fb74dabd700 1 -- 172.21.15.69:0/1260873972 wait complete. 2024-04-23T10:17:25.105 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling cephadm module... 2024-04-23T10:17:25.403 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:25 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1260873972' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-23T10:17:26.414 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:26 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2413432616' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-23T10:17:26.414 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: ignoring --setuser ceph since I am not root 2024-04-23T10:17:26.414 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: ignoring --setgroup ceph since I am not root 2024-04-23T10:17:26.414 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:26.289+0000 7f1c7ec3d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:17:26.688 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:26.474+0000 7f1c7ec3d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:17:26.688 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:26.576+0000 7f1c7ec3d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:17:26.695 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.502+0000 7fd254950700 1 Processor -- start 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.502+0000 7fd254950700 1 -- start start 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.502+0000 7fd254950700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.502+0000 7fd254950700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd25007c8c0 con 0x7fd25007de40 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.502+0000 7fd24e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.502+0000 7fd24e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25007c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55396/0 (socket says 172.21.15.69:55396) 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.502+0000 7fd24e59c700 1 -- 172.21.15.69:0/2679735604 learned_addr learned my addr 172.21.15.69:0/2679735604 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.503+0000 7fd24e59c700 1 -- 172.21.15.69:0/2679735604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25007ca40 con 0x7fd25007de40 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.503+0000 7fd24e59c700 1 --2- 172.21.15.69:0/2679735604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25007c2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd2400098a0 tx=0x7fd240009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd07caa1a1268b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.503+0000 7fd24d59a700 1 -- 172.21.15.69:0/2679735604 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd240004160 con 0x7fd25007de40 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.503+0000 7fd24d59a700 1 -- 172.21.15.69:0/2679735604 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fd240004300 con 0x7fd25007de40 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.503+0000 7fd24d59a700 1 -- 172.21.15.69:0/2679735604 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd240011b20 con 0x7fd25007de40 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.504+0000 7fd254950700 1 -- 172.21.15.69:0/2679735604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 msgr2=0x7fd25007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.504+0000 7fd254950700 1 --2- 172.21.15.69:0/2679735604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25007c2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd2400098a0 tx=0x7fd240009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.504+0000 7fd254950700 1 -- 172.21.15.69:0/2679735604 shutdown_connections 2024-04-23T10:17:26.696 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.504+0000 7fd254950700 1 --2- 172.21.15.69:0/2679735604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25007c2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.504+0000 7fd254950700 1 -- 172.21.15.69:0/2679735604 >> 172.21.15.69:0/2679735604 conn(0x7fd250103cb0 msgr2=0x7fd2501060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.504+0000 7fd254950700 1 -- 172.21.15.69:0/2679735604 shutdown_connections 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.504+0000 7fd254950700 1 -- 172.21.15.69:0/2679735604 wait complete. 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.504+0000 7fd254950700 1 Processor -- start 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.504+0000 7fd254950700 1 -- start start 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd254950700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25019e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd254950700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd25010eba0 con 0x7fd25007de40 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd24e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25019e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd24e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25019e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55402/0 (socket says 172.21.15.69:55402) 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd24e59c700 1 -- 172.21.15.69:0/2413432616 learned_addr learned my addr 172.21.15.69:0/2413432616 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd24e59c700 1 -- 172.21.15.69:0/2413432616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25019eb50 con 0x7fd25007de40 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd24e59c700 1 --2- 172.21.15.69:0/2413432616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25019e610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd2400116a0 tx=0x7fd240011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd23f7fe700 1 -- 172.21.15.69:0/2413432616 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd240003ab0 con 0x7fd25007de40 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd23f7fe700 1 -- 172.21.15.69:0/2413432616 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fd240003c50 con 0x7fd25007de40 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd254950700 1 -- 172.21.15.69:0/2413432616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd25019ede0 con 0x7fd25007de40 2024-04-23T10:17:26.697 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd23f7fe700 1 -- 172.21.15.69:0/2413432616 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd240019870 con 0x7fd25007de40 2024-04-23T10:17:26.698 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.505+0000 7fd254950700 1 -- 172.21.15.69:0/2413432616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd25019f240 con 0x7fd25007de40 2024-04-23T10:17:26.698 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.506+0000 7fd23f7fe700 1 -- 172.21.15.69:0/2413432616 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7fd240019b30 con 0x7fd25007de40 2024-04-23T10:17:26.698 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.506+0000 7fd23f7fe700 1 --2- 172.21.15.69:0/2413432616 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd2380395d0 0x7fd23803ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:26.698 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.506+0000 7fd254950700 1 -- 172.21.15.69:0/2413432616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2500640a0 con 0x7fd25007de40 2024-04-23T10:17:26.698 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.506+0000 7fd23f7fe700 1 -- 172.21.15.69:0/2413432616 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd24004dc20 con 0x7fd25007de40 2024-04-23T10:17:26.698 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.506+0000 7fd24dd9b700 1 --2- 172.21.15.69:0/2413432616 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd2380395d0 0x7fd23803ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:26.698 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.507+0000 7fd24dd9b700 1 --2- 172.21.15.69:0/2413432616 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd2380395d0 0x7fd23803ba90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd244006fd0 tx=0x7fd244006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:26.698 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.511+0000 7fd23f7fe700 1 -- 172.21.15.69:0/2413432616 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd240011e20 con 0x7fd25007de40 2024-04-23T10:17:26.698 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:25.764+0000 7fd254950700 1 -- 172.21.15.69:0/2413432616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fd2501a1c10 con 0x7fd25007de40 2024-04-23T10:17:26.698 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.123+0000 7fd23f7fe700 1 -- 172.21.15.69:0/2413432616 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fd240029260 con 0x7fd25007de40 2024-04-23T10:17:26.698 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.125+0000 7fd23f7fe700 1 -- 172.21.15.69:0/2413432616 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7fd24002dcd0 con 0x7fd25007de40 2024-04-23T10:17:26.699 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.127+0000 7fd254950700 1 -- 172.21.15.69:0/2413432616 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd2380395d0 msgr2=0x7fd23803ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:26.699 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.127+0000 7fd254950700 1 --2- 172.21.15.69:0/2413432616 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd2380395d0 0x7fd23803ba90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd244006fd0 tx=0x7fd244006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:26.699 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.127+0000 7fd254950700 1 -- 172.21.15.69:0/2413432616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 msgr2=0x7fd25019e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:26.699 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.127+0000 7fd254950700 1 --2- 172.21.15.69:0/2413432616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25019e610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd2400116a0 tx=0x7fd240011ce0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.699 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.127+0000 7fd254950700 1 -- 172.21.15.69:0/2413432616 shutdown_connections 2024-04-23T10:17:26.699 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.127+0000 7fd254950700 1 --2- 172.21.15.69:0/2413432616 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd2380395d0 0x7fd23803ba90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.699 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.127+0000 7fd254950700 1 --2- 172.21.15.69:0/2413432616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd25007de40 0x7fd25019e610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.699 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.127+0000 7fd254950700 1 -- 172.21.15.69:0/2413432616 >> 172.21.15.69:0/2413432616 conn(0x7fd250103cb0 msgr2=0x7fd2501046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:26.699 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.127+0000 7fd254950700 1 -- 172.21.15.69:0/2413432616 shutdown_connections 2024-04-23T10:17:26.699 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:26.127+0000 7fd254950700 1 -- 172.21.15.69:0/2413432616 wait complete. 2024-04-23T10:17:26.977 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:26.890+0000 7f1c7ec3d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:17:26.977 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:26.978+0000 7f1c7ec3d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:17:27.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:27 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2413432616' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-23T10:17:27.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:27 smithi069 ceph-mon[29593]: mgrmap e5: x(active, since 6s) 2024-04-23T10:17:27.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-04-23T10:17:27.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-23T10:17:27.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-23T10:17:27.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-23T10:17:27.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-23T10:17:27.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-04-23T10:17:27.921 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.125+0000 7fd87dc2f700 1 Processor -- start 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.125+0000 7fd87dc2f700 1 -- start start 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.125+0000 7fd87dc2f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd8781089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.125+0000 7fd87dc2f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd878108fb0 con 0x7fd8781085c0 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.125+0000 7fd8777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd8781089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.125+0000 7fd8777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd8781089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55424/0 (socket says 172.21.15.69:55424) 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.125+0000 7fd8777fe700 1 -- 172.21.15.69:0/706121246 learned_addr learned my addr 172.21.15.69:0/706121246 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.125+0000 7fd8777fe700 1 -- 172.21.15.69:0/706121246 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd878109770 con 0x7fd8781085c0 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.125+0000 7fd8777fe700 1 --2- 172.21.15.69:0/706121246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd8781089e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd8680098a0 tx=0x7fd868009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547f35e4055a9d2d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.127+0000 7fd8767fc700 1 -- 172.21.15.69:0/706121246 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd868004160 con 0x7fd8781085c0 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.127+0000 7fd8767fc700 1 -- 172.21.15.69:0/706121246 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fd868004300 con 0x7fd8781085c0 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.127+0000 7fd8767fc700 1 -- 172.21.15.69:0/706121246 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd868011b20 con 0x7fd8781085c0 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.127+0000 7fd87dc2f700 1 -- 172.21.15.69:0/706121246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 msgr2=0x7fd8781089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:27.922 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.127+0000 7fd87dc2f700 1 --2- 172.21.15.69:0/706121246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd8781089e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd8680098a0 tx=0x7fd868009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.127+0000 7fd87dc2f700 1 -- 172.21.15.69:0/706121246 shutdown_connections 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.127+0000 7fd87dc2f700 1 --2- 172.21.15.69:0/706121246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd8781089e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.127+0000 7fd87dc2f700 1 -- 172.21.15.69:0/706121246 >> 172.21.15.69:0/706121246 conn(0x7fd878103be0 msgr2=0x7fd878106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.127+0000 7fd87dc2f700 1 -- 172.21.15.69:0/706121246 shutdown_connections 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.127+0000 7fd87dc2f700 1 -- 172.21.15.69:0/706121246 wait complete. 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.128+0000 7fd87dc2f700 1 Processor -- start 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.128+0000 7fd87dc2f700 1 -- start start 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.128+0000 7fd87dc2f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd87819c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.128+0000 7fd87dc2f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd87810cb20 con 0x7fd8781085c0 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.128+0000 7fd8777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd87819c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.129+0000 7fd8777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd87819c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55440/0 (socket says 172.21.15.69:55440) 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.129+0000 7fd8777fe700 1 -- 172.21.15.69:0/651441456 learned_addr learned my addr 172.21.15.69:0/651441456 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.129+0000 7fd8777fe700 1 -- 172.21.15.69:0/651441456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87819c930 con 0x7fd8781085c0 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.129+0000 7fd8777fe700 1 --2- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd87819c3f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd8680117e0 tx=0x7fd868011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:27.923 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.129+0000 7fd874ff9700 1 -- 172.21.15.69:0/651441456 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd868003b20 con 0x7fd8781085c0 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.129+0000 7fd874ff9700 1 -- 172.21.15.69:0/651441456 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fd868003cc0 con 0x7fd8781085c0 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.129+0000 7fd87dc2f700 1 -- 172.21.15.69:0/651441456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87819cbc0 con 0x7fd8781085c0 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.129+0000 7fd874ff9700 1 -- 172.21.15.69:0/651441456 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd868019870 con 0x7fd8781085c0 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.129+0000 7fd87dc2f700 1 -- 172.21.15.69:0/651441456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd87819d020 con 0x7fd8781085c0 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.130+0000 7fd87dc2f700 1 -- 172.21.15.69:0/651441456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8780640a0 con 0x7fd8781085c0 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.130+0000 7fd874ff9700 1 -- 172.21.15.69:0/651441456 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7fd868019af0 con 0x7fd8781085c0 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.130+0000 7fd874ff9700 1 --2- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd860039620 0x7fd86003bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.131+0000 7fd874ff9700 1 -- 172.21.15.69:0/651441456 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd86804dcf0 con 0x7fd8781085c0 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.131+0000 7fd876ffd700 1 -- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd860039620 msgr2=0x7fd86003bae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2746602813 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.131+0000 7fd876ffd700 1 --2- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd860039620 0x7fd86003bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.136+0000 7fd874ff9700 1 -- 172.21.15.69:0/651441456 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd868011e20 con 0x7fd8781085c0 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.332+0000 7fd876ffd700 1 -- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd860039620 msgr2=0x7fd86003bae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2746602813 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.332+0000 7fd876ffd700 1 --2- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd860039620 0x7fd86003bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.438+0000 7fd87dc2f700 1 -- 172.21.15.69:0/651441456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd87819f9d0 con 0x7fd8781085c0 2024-04-23T10:17:27.924 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.438+0000 7fd874ff9700 1 -- 172.21.15.69:0/651441456 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fd868029260 con 0x7fd8781085c0 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.440+0000 7fd87dc2f700 1 -- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd860039620 msgr2=0x7fd86003bae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.440+0000 7fd87dc2f700 1 --2- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd860039620 0x7fd86003bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.440+0000 7fd87dc2f700 1 -- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 msgr2=0x7fd87819c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.440+0000 7fd87dc2f700 1 --2- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd87819c3f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd8680117e0 tx=0x7fd868011ce0 comp rx=0 tx=0).stop 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.440+0000 7fd87dc2f700 1 -- 172.21.15.69:0/651441456 shutdown_connections 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.440+0000 7fd87dc2f700 1 --2- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fd860039620 0x7fd86003bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.440+0000 7fd87dc2f700 1 --2- 172.21.15.69:0/651441456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8781085c0 0x7fd87819c3f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.440+0000 7fd87dc2f700 1 -- 172.21.15.69:0/651441456 >> 172.21.15.69:0/651441456 conn(0x7fd878103be0 msgr2=0x7fd878104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.441+0000 7fd87dc2f700 1 -- 172.21.15.69:0/651441456 shutdown_connections 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:27.441+0000 7fd87dc2f700 1 -- 172.21.15.69:0/651441456 wait complete. 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for the mgr to restart... 2024-04-23T10:17:27.925 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr epoch 5... 2024-04-23T10:17:28.363 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:28 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/651441456' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-23T10:17:28.364 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:28 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:28.188+0000 7f1c7ec3d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:17:28.364 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:28 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:28.364+0000 7f1c7ec3d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:17:28.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:28 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:28.531+0000 7f1c7ec3d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:17:29.105 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:28 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:28.816+0000 7f1c7ec3d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:17:29.105 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:28 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:28.907+0000 7f1c7ec3d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:17:29.105 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:29 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:29.106+0000 7f1c7ec3d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:17:29.492 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:29 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:29.297+0000 7f1c7ec3d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:17:29.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:29 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:29.885+0000 7f1c7ec3d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T10:17:30.594 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:30 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:30.302+0000 7f1c7ec3d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:17:30.595 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:30 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:30.396+0000 7f1c7ec3d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:17:30.870 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:30 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:30.595+0000 7f1c7ec3d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T10:17:31.484 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:31 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:31.138+0000 7f1c7ec3d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:17:31.484 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:31 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:31.234+0000 7f1c7ec3d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:17:31.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:31 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:31.485+0000 7f1c7ec3d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:17:31.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:31 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:31.621+0000 7f1c7ec3d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:17:31.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:31 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:31.719+0000 7f1c7ec3d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:17:32.132 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:31 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:31.838+0000 7f1c7ec3d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:17:32.132 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:32.133+0000 7f1c7ec3d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:17:32.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:32.724+0000 7f1c7ec3d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:17:32.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:32.942+0000 7f1c7ec3d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:17:33.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: Active manager daemon x restarted 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: Activating manager daemon x 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: osdmap e2: 0 total, 0 up, 0 in 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: mgrmap e6: x(active, starting, since 0.00345227s) 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: Manager daemon x is now available 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:17:33.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:32 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T10:17:34.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:33 smithi069 ceph-mon[29593]: Found migration_current of "None". Setting to last migration. 2024-04-23T10:17:34.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:33 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T10:17:34.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:33 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:34.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:33 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:34.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:33 smithi069 ceph-mon[29593]: mgrmap e7: x(active, since 1.00576s) 2024-04-23T10:17:34.487 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-04-23T10:17:34.487 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-23T10:17:34.487 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-23T10:17:34.487 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-04-23T10:17:34.487 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.324+0000 7fa617d73700 1 Processor -- start 2024-04-23T10:17:34.487 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.324+0000 7fa617d73700 1 -- start start 2024-04-23T10:17:34.487 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.324+0000 7fa617d73700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61010b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.324+0000 7fa617d73700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa61007be60 con 0x7fa610109060 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.325+0000 7fa615b0f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61010b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.325+0000 7fa615b0f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61010b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55450/0 (socket says 172.21.15.69:55450) 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.325+0000 7fa615b0f700 1 -- 172.21.15.69:0/2201630077 learned_addr learned my addr 172.21.15.69:0/2201630077 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.325+0000 7fa615b0f700 1 -- 172.21.15.69:0/2201630077 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61010b990 con 0x7fa610109060 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.325+0000 7fa615b0f700 1 --2- 172.21.15.69:0/2201630077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61010b450 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa6000098a0 tx=0x7fa600009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c582ffe6a0d44737 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.325+0000 7fa614b0d700 1 -- 172.21.15.69:0/2201630077 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa600004160 con 0x7fa610109060 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.325+0000 7fa614b0d700 1 -- 172.21.15.69:0/2201630077 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fa600004300 con 0x7fa610109060 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.325+0000 7fa614b0d700 1 -- 172.21.15.69:0/2201630077 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa600011b20 con 0x7fa610109060 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.326+0000 7fa617d73700 1 -- 172.21.15.69:0/2201630077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 msgr2=0x7fa61010b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.326+0000 7fa617d73700 1 --2- 172.21.15.69:0/2201630077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61010b450 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa6000098a0 tx=0x7fa600009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.326+0000 7fa617d73700 1 -- 172.21.15.69:0/2201630077 shutdown_connections 2024-04-23T10:17:34.488 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.326+0000 7fa617d73700 1 --2- 172.21.15.69:0/2201630077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61010b450 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.326+0000 7fa617d73700 1 -- 172.21.15.69:0/2201630077 >> 172.21.15.69:0/2201630077 conn(0x7fa610102ab0 msgr2=0x7fa610104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.326+0000 7fa617d73700 1 -- 172.21.15.69:0/2201630077 shutdown_connections 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.326+0000 7fa617d73700 1 -- 172.21.15.69:0/2201630077 wait complete. 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.327+0000 7fa617d73700 1 Processor -- start 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.327+0000 7fa617d73700 1 -- start start 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.327+0000 7fa617d73700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61019c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.327+0000 7fa617d73700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa61010c9b0 con 0x7fa610109060 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.327+0000 7fa615b0f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61019c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.327+0000 7fa615b0f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61019c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55452/0 (socket says 172.21.15.69:55452) 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.327+0000 7fa615b0f700 1 -- 172.21.15.69:0/1286684229 learned_addr learned my addr 172.21.15.69:0/1286684229 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.327+0000 7fa615b0f700 1 -- 172.21.15.69:0/1286684229 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61019c920 con 0x7fa610109060 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.328+0000 7fa615b0f700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61019c3e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa6000117e0 tx=0x7fa600011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.328+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa600003b30 con 0x7fa610109060 2024-04-23T10:17:34.489 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.328+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fa600003cd0 con 0x7fa610109060 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.328+0000 7fa617d73700 1 -- 172.21.15.69:0/1286684229 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa61019cbb0 con 0x7fa610109060 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.328+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa60001a7c0 con 0x7fa610109060 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.328+0000 7fa617d73700 1 -- 172.21.15.69:0/1286684229 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa61019d010 con 0x7fa610109060 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.329+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7fa600024ba0 con 0x7fa610109060 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.329+0000 7fa606ffd700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 0x7fa5fc03bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.329+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 --> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa5fc03c240 con 0x7fa5fc039670 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.329+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa60004da10 con 0x7fa610109060 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.329+0000 7fa61530e700 1 -- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 msgr2=0x7fa5fc03bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2746602813 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.329+0000 7fa61530e700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 0x7fa5fc03bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.530+0000 7fa61530e700 1 -- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 msgr2=0x7fa5fc03bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2746602813 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.530+0000 7fa61530e700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 0x7fa5fc03bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.931+0000 7fa61530e700 1 -- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 msgr2=0x7fa5fc03bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2746602813 2024-04-23T10:17:34.490 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:28.931+0000 7fa61530e700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 0x7fa5fc03bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:29.732+0000 7fa61530e700 1 -- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 msgr2=0x7fa5fc03bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2746602813 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:29.732+0000 7fa61530e700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 0x7fa5fc03bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:31.333+0000 7fa61530e700 1 -- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 msgr2=0x7fa5fc03bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2746602813 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:31.333+0000 7fa61530e700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 0x7fa5fc03bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:32.946+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mgrmap(e 6) ==== 46325+0+0 (secure 0 0 0) 0x7fa600024440 con 0x7fa610109060 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:32.946+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 msgr2=0x7fa5fc03bb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:32.946+0000 7fa606ffd700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 0x7fa5fc03bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.947+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7fa60004f260 con 0x7fa610109060 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.947+0000 7fa606ffd700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fa5fc03cf60 0x7fa5fc03f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.947+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 --> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa60000fec0 con 0x7fa5fc03cf60 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.947+0000 7fa61530e700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fa5fc03cf60 0x7fa5fc03f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.948+0000 7fa61530e700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fa5fc03cf60 0x7fa5fc03f350 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa60c003a10 tx=0x7fa60c009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.948+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 <== mgr.14120 v2:172.21.15.69:6800/3345837257 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7fa60000fec0 con 0x7fa5fc03cf60 2024-04-23T10:17:34.491 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.955+0000 7fa617d73700 1 -- 172.21.15.69:0/1286684229 --> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fa6100640a0 con 0x7fa5fc03cf60 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.955+0000 7fa606ffd700 1 -- 172.21.15.69:0/1286684229 <== mgr.14120 v2:172.21.15.69:6800/3345837257 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fa6100640a0 con 0x7fa5fc03cf60 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.956+0000 7fa617d73700 1 -- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fa5fc03cf60 msgr2=0x7fa5fc03f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.956+0000 7fa617d73700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fa5fc03cf60 0x7fa5fc03f350 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa60c003a10 tx=0x7fa60c009290 comp rx=0 tx=0).stop 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.956+0000 7fa617d73700 1 -- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 msgr2=0x7fa61019c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.956+0000 7fa617d73700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61019c3e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa6000117e0 tx=0x7fa600011ce0 comp rx=0 tx=0).stop 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.956+0000 7fa617d73700 1 -- 172.21.15.69:0/1286684229 shutdown_connections 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.956+0000 7fa617d73700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fa5fc03cf60 0x7fa5fc03f350 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.956+0000 7fa617d73700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa610109060 0x7fa61019c3e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.956+0000 7fa617d73700 1 --2- 172.21.15.69:0/1286684229 >> [v2:172.21.15.69:6800/2746602813,v1:172.21.15.69:6801/2746602813] conn(0x7fa5fc039670 0x7fa5fc03bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.956+0000 7fa617d73700 1 -- 172.21.15.69:0/1286684229 >> 172.21.15.69:0/1286684229 conn(0x7fa610102ab0 msgr2=0x7fa610103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.956+0000 7fa617d73700 1 -- 172.21.15.69:0/1286684229 shutdown_connections 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:33.956+0000 7fa617d73700 1 -- 172.21.15.69:0/1286684229 wait complete. 2024-04-23T10:17:34.492 INFO:teuthology.orchestra.run.smithi069.stdout:mgr epoch 5 is available 2024-04-23T10:17:34.493 INFO:teuthology.orchestra.run.smithi069.stdout:Setting orchestrator backend to cephadm... 2024-04-23T10:17:35.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:34 smithi069 ceph-mon[29593]: [23/Apr/2024:10:17:33] ENGINE Bus STARTING 2024-04-23T10:17:35.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:34 smithi069 ceph-mon[29593]: [23/Apr/2024:10:17:33] ENGINE Serving on https://172.21.15.69:7150 2024-04-23T10:17:35.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:34 smithi069 ceph-mon[29593]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-23T10:17:35.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:34 smithi069 ceph-mon[29593]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-23T10:17:35.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:34 smithi069 ceph-mon[29593]: [23/Apr/2024:10:17:33] ENGINE Serving on http://172.21.15.69:8765 2024-04-23T10:17:35.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:34 smithi069 ceph-mon[29593]: [23/Apr/2024:10:17:33] ENGINE Bus STARTED 2024-04-23T10:17:35.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:34 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:17:35.602 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.848+0000 7f432ec84700 1 Processor -- start 2024-04-23T10:17:35.607 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.848+0000 7f432ec84700 1 -- start start 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.848+0000 7f432ec84700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432807c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.848+0000 7f432ec84700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f432807c7f0 con 0x7f432807de00 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.849+0000 7f432ca20700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432807c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.849+0000 7f432ca20700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432807c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54896/0 (socket says 172.21.15.69:54896) 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.849+0000 7f432ca20700 1 -- 172.21.15.69:0/1387256614 learned_addr learned my addr 172.21.15.69:0/1387256614 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.849+0000 7f432ca20700 1 -- 172.21.15.69:0/1387256614 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432807c970 con 0x7f432807de00 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.849+0000 7f432ca20700 1 --2- 172.21.15.69:0/1387256614 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432807c2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4324009e80 tx=0x7f432400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fbf48a90face7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.849+0000 7f431f7fe700 1 -- 172.21.15.69:0/1387256614 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4324017070 con 0x7f432807de00 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.849+0000 7f431f7fe700 1 -- 172.21.15.69:0/1387256614 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f432400b8c0 con 0x7f432807de00 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.849+0000 7f431f7fe700 1 -- 172.21.15.69:0/1387256614 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43240045c0 con 0x7f432807de00 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.850+0000 7f432ec84700 1 -- 172.21.15.69:0/1387256614 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 msgr2=0x7f432807c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.850+0000 7f432ec84700 1 --2- 172.21.15.69:0/1387256614 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432807c2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4324009e80 tx=0x7f432400b330 comp rx=0 tx=0).stop 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.850+0000 7f432ec84700 1 -- 172.21.15.69:0/1387256614 shutdown_connections 2024-04-23T10:17:35.608 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.850+0000 7f432ec84700 1 --2- 172.21.15.69:0/1387256614 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432807c2b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.850+0000 7f432ec84700 1 -- 172.21.15.69:0/1387256614 >> 172.21.15.69:0/1387256614 conn(0x7f4328103be0 msgr2=0x7f4328106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.850+0000 7f432ec84700 1 -- 172.21.15.69:0/1387256614 shutdown_connections 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.850+0000 7f432ec84700 1 -- 172.21.15.69:0/1387256614 wait complete. 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f432ec84700 1 Processor -- start 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f432ec84700 1 -- start start 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f432ec84700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432819e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f432ec84700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f432810ebb0 con 0x7f432807de00 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f432ca20700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432819e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f432ca20700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432819e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54910/0 (socket says 172.21.15.69:54910) 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f432ca20700 1 -- 172.21.15.69:0/595819769 learned_addr learned my addr 172.21.15.69:0/595819769 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f432ca20700 1 -- 172.21.15.69:0/595819769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432819eb30 con 0x7f432807de00 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f432ca20700 1 --2- 172.21.15.69:0/595819769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432819e5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f432400b7b0 tx=0x7f432400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f431dffb700 1 -- 172.21.15.69:0/595819769 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4324017070 con 0x7f432807de00 2024-04-23T10:17:35.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f431dffb700 1 -- 172.21.15.69:0/595819769 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f4324022070 con 0x7f432807de00 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f432ec84700 1 -- 172.21.15.69:0/595819769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432819edc0 con 0x7f432807de00 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.851+0000 7f431dffb700 1 -- 172.21.15.69:0/595819769 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f432401d6d0 con 0x7f432807de00 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.852+0000 7f432ec84700 1 -- 172.21.15.69:0/595819769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43281a1ab0 con 0x7f432807de00 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.852+0000 7f431dffb700 1 -- 172.21.15.69:0/595819769 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f4324012430 con 0x7f432807de00 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.853+0000 7f432ec84700 1 -- 172.21.15.69:0/595819769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43280640a0 con 0x7f432807de00 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.853+0000 7f431dffb700 1 --2- 172.21.15.69:0/595819769 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f4310039560 0x7f431003ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.853+0000 7f431dffb700 1 -- 172.21.15.69:0/595819769 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f432400f050 con 0x7f432807de00 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.853+0000 7f431ffff700 1 --2- 172.21.15.69:0/595819769 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f4310039560 0x7f431003ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.853+0000 7f431ffff700 1 --2- 172.21.15.69:0/595819769 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f4310039560 0x7f431003ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4318006fd0 tx=0x7f4318006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:34.860+0000 7f431dffb700 1 -- 172.21.15.69:0/595819769 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f432401bd80 con 0x7f432807de00 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.001+0000 7f431dffb700 1 -- 172.21.15.69:0/595819769 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f4324011c90 con 0x7f432807de00 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.076+0000 7f432ec84700 1 -- 172.21.15.69:0/595819769 --> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f4328104d20 con 0x7f4310039560 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.081+0000 7f431dffb700 1 -- 172.21.15.69:0/595819769 <== mgr.14120 v2:172.21.15.69:6800/3345837257 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4328104d20 con 0x7f4310039560 2024-04-23T10:17:35.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.083+0000 7f432ec84700 1 -- 172.21.15.69:0/595819769 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f4310039560 msgr2=0x7f431003ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:35.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.083+0000 7f432ec84700 1 --2- 172.21.15.69:0/595819769 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f4310039560 0x7f431003ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4318006fd0 tx=0x7f4318006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:35.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.083+0000 7f432ec84700 1 -- 172.21.15.69:0/595819769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 msgr2=0x7f432819e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:35.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.083+0000 7f432ec84700 1 --2- 172.21.15.69:0/595819769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432819e5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f432400b7b0 tx=0x7f432400bdc0 comp rx=0 tx=0).stop 2024-04-23T10:17:35.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.083+0000 7f432ec84700 1 -- 172.21.15.69:0/595819769 shutdown_connections 2024-04-23T10:17:35.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.083+0000 7f432ec84700 1 --2- 172.21.15.69:0/595819769 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f4310039560 0x7f431003ba20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:35.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.084+0000 7f432ec84700 1 --2- 172.21.15.69:0/595819769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f432807de00 0x7f432819e5f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:35.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.084+0000 7f432ec84700 1 -- 172.21.15.69:0/595819769 >> 172.21.15.69:0/595819769 conn(0x7f4328103be0 msgr2=0x7f4328104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:35.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.084+0000 7f432ec84700 1 -- 172.21.15.69:0/595819769 shutdown_connections 2024-04-23T10:17:35.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:35.084+0000 7f432ec84700 1 -- 172.21.15.69:0/595819769 wait complete. 2024-04-23T10:17:36.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:36 smithi069 ceph-mon[29593]: mgrmap e8: x(active, since 2s) 2024-04-23T10:17:36.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:36 smithi069 ceph-mon[29593]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:17:36.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:36 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:36.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:36 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:17:36.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-23T10:17:36.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.010+0000 7f8dabad3700 1 Processor -- start 2024-04-23T10:17:36.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.010+0000 7f8dabad3700 1 -- start start 2024-04-23T10:17:36.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.010+0000 7f8dabad3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da41089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:36.796 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.010+0000 7f8dabad3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8da4108fb0 con 0x7f8da41085c0 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.010+0000 7f8da986f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da41089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.010+0000 7f8da986f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da41089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54920/0 (socket says 172.21.15.69:54920) 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.010+0000 7f8da986f700 1 -- 172.21.15.69:0/802859793 learned_addr learned my addr 172.21.15.69:0/802859793 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.011+0000 7f8da986f700 1 -- 172.21.15.69:0/802859793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da4109770 con 0x7f8da41085c0 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.011+0000 7f8da986f700 1 --2- 172.21.15.69:0/802859793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da41089e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8da00098a0 tx=0x7f8da0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e7c77e581624c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.011+0000 7f8da886d700 1 -- 172.21.15.69:0/802859793 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8da0004160 con 0x7f8da41085c0 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.011+0000 7f8da886d700 1 -- 172.21.15.69:0/802859793 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8da0004300 con 0x7f8da41085c0 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.011+0000 7f8da886d700 1 -- 172.21.15.69:0/802859793 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8da0011b20 con 0x7f8da41085c0 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.011+0000 7f8dabad3700 1 -- 172.21.15.69:0/802859793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 msgr2=0x7f8da41089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.011+0000 7f8dabad3700 1 --2- 172.21.15.69:0/802859793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da41089e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8da00098a0 tx=0x7f8da0009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.011+0000 7f8dabad3700 1 -- 172.21.15.69:0/802859793 shutdown_connections 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.012+0000 7f8dabad3700 1 --2- 172.21.15.69:0/802859793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da41089e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.012+0000 7f8dabad3700 1 -- 172.21.15.69:0/802859793 >> 172.21.15.69:0/802859793 conn(0x7f8da4103be0 msgr2=0x7f8da4106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:36.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.012+0000 7f8dabad3700 1 -- 172.21.15.69:0/802859793 shutdown_connections 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.012+0000 7f8dabad3700 1 -- 172.21.15.69:0/802859793 wait complete. 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.012+0000 7f8dabad3700 1 Processor -- start 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.012+0000 7f8dabad3700 1 -- start start 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.012+0000 7f8dabad3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da407db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.012+0000 7f8dabad3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8da410cb20 con 0x7f8da41085c0 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.012+0000 7f8da986f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da407db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.012+0000 7f8da986f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da407db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54930/0 (socket says 172.21.15.69:54930) 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.012+0000 7f8da986f700 1 -- 172.21.15.69:0/2753245526 learned_addr learned my addr 172.21.15.69:0/2753245526 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.013+0000 7f8da986f700 1 -- 172.21.15.69:0/2753245526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da407e0a0 con 0x7f8da41085c0 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.013+0000 7f8da986f700 1 --2- 172.21.15.69:0/2753245526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da407db60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8da00117e0 tx=0x7f8da0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.013+0000 7f8d9affd700 1 -- 172.21.15.69:0/2753245526 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8da0003b20 con 0x7f8da41085c0 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.013+0000 7f8d9affd700 1 -- 172.21.15.69:0/2753245526 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8da0003cc0 con 0x7f8da41085c0 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.013+0000 7f8dabad3700 1 -- 172.21.15.69:0/2753245526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da407c290 con 0x7f8da41085c0 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.013+0000 7f8d9affd700 1 -- 172.21.15.69:0/2753245526 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8da0019870 con 0x7f8da41085c0 2024-04-23T10:17:36.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.013+0000 7f8dabad3700 1 -- 172.21.15.69:0/2753245526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da407c750 con 0x7f8da41085c0 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.014+0000 7f8d9affd700 1 -- 172.21.15.69:0/2753245526 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f8da0019aa0 con 0x7f8da41085c0 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.014+0000 7f8d9affd700 1 --2- 172.21.15.69:0/2753245526 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f8d90039670 0x7f8d9003bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.014+0000 7f8d9affd700 1 -- 172.21.15.69:0/2753245526 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8da004d970 con 0x7f8da41085c0 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.014+0000 7f8dabad3700 1 -- 172.21.15.69:0/2753245526 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da40640a0 con 0x7f8da41085c0 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.014+0000 7f8da906e700 1 --2- 172.21.15.69:0/2753245526 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f8d90039670 0x7f8d9003bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.015+0000 7f8da906e700 1 --2- 172.21.15.69:0/2753245526 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f8d90039670 0x7f8d9003bb30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8d94006fd0 tx=0x7f8d94006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.019+0000 7f8d9affd700 1 -- 172.21.15.69:0/2753245526 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8da0011e20 con 0x7f8da41085c0 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.217+0000 7f8dabad3700 1 -- 172.21.15.69:0/2753245526 --> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f8da407d0f0 con 0x7f8d90039670 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.217+0000 7f8d9affd700 1 -- 172.21.15.69:0/2753245526 <== mgr.14120 v2:172.21.15.69:6800/3345837257 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f8da407d0f0 con 0x7f8d90039670 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.220+0000 7f8dabad3700 1 -- 172.21.15.69:0/2753245526 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f8d90039670 msgr2=0x7f8d9003bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.220+0000 7f8dabad3700 1 --2- 172.21.15.69:0/2753245526 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f8d90039670 0x7f8d9003bb30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8d94006fd0 tx=0x7f8d94006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.220+0000 7f8dabad3700 1 -- 172.21.15.69:0/2753245526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 msgr2=0x7f8da407db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.220+0000 7f8dabad3700 1 --2- 172.21.15.69:0/2753245526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da407db60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8da00117e0 tx=0x7f8da0011ce0 comp rx=0 tx=0).stop 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.220+0000 7f8dabad3700 1 -- 172.21.15.69:0/2753245526 shutdown_connections 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.220+0000 7f8dabad3700 1 --2- 172.21.15.69:0/2753245526 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f8d90039670 0x7f8d9003bb30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:36.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.220+0000 7f8dabad3700 1 --2- 172.21.15.69:0/2753245526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da41085c0 0x7f8da407db60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:36.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.220+0000 7f8dabad3700 1 -- 172.21.15.69:0/2753245526 >> 172.21.15.69:0/2753245526 conn(0x7f8da4103be0 msgr2=0x7f8da41045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:36.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.220+0000 7f8dabad3700 1 -- 172.21.15.69:0/2753245526 shutdown_connections 2024-04-23T10:17:36.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:36.220+0000 7f8dabad3700 1 -- 172.21.15.69:0/2753245526 wait complete. 2024-04-23T10:17:36.800 INFO:teuthology.orchestra.run.smithi069.stdout:Generating ssh key... 2024-04-23T10:17:37.408 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-mon[29593]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:17:38.177 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: Generating public/private rsa key pair. 2024-04-23T10:17:38.177 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: Your identification has been saved in /tmp/tmp7x031rqu/key. 2024-04-23T10:17:38.177 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: Your public key has been saved in /tmp/tmp7x031rqu/key.pub. 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: The key fingerprint is: 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: SHA256:b0Zqdwg+tDybAEZXzbH3v1UblIogxoygEWXuD5zqGBk ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: The key's randomart image is: 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: +---[RSA 3072]----+ 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: | oo+ .o.. | 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: | = . +. o. .| 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: | . ....= .. . o | 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: | o.... . ....o | 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: |E =o S .. ....| 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: | o..o. + * . .+| 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: |o. .. O * . .o| 2024-04-23T10:17:38.178 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: |o. o O . o| 2024-04-23T10:17:38.179 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: |.. o . | 2024-04-23T10:17:38.179 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: +----[SHA256]-----+ 2024-04-23T10:17:38.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.202+0000 7f741cf09700 1 Processor -- start 2024-04-23T10:17:38.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.202+0000 7f741cf09700 1 -- start start 2024-04-23T10:17:38.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.202+0000 7f741cf09700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f74181078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:38.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.202+0000 7f741cf09700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7418107ea0 con 0x7f74181074b0 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.203+0000 7f741659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f74181078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.203+0000 7f741659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f74181078d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54938/0 (socket says 172.21.15.69:54938) 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.203+0000 7f741659c700 1 -- 172.21.15.69:0/2038799193 learned_addr learned my addr 172.21.15.69:0/2038799193 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.203+0000 7f741659c700 1 -- 172.21.15.69:0/2038799193 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74181086b0 con 0x7f74181074b0 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.203+0000 7f741659c700 1 --2- 172.21.15.69:0/2038799193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f74181078d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f740800bb40 tx=0x7f740800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1195079457f5821d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.203+0000 7f741559a700 1 -- 172.21.15.69:0/2038799193 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f740800dbe0 con 0x7f74181074b0 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.203+0000 7f741559a700 1 -- 172.21.15.69:0/2038799193 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f74080044e0 con 0x7f74181074b0 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.203+0000 7f741559a700 1 -- 172.21.15.69:0/2038799193 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7408010470 con 0x7f74181074b0 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.204+0000 7f741cf09700 1 -- 172.21.15.69:0/2038799193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 msgr2=0x7f74181078d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.204+0000 7f741cf09700 1 --2- 172.21.15.69:0/2038799193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f74181078d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f740800bb40 tx=0x7f740800be50 comp rx=0 tx=0).stop 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.204+0000 7f741cf09700 1 -- 172.21.15.69:0/2038799193 shutdown_connections 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.204+0000 7f741cf09700 1 --2- 172.21.15.69:0/2038799193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f74181078d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.204+0000 7f741cf09700 1 -- 172.21.15.69:0/2038799193 >> 172.21.15.69:0/2038799193 conn(0x7f7418102a90 msgr2=0x7f7418104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.204+0000 7f741cf09700 1 -- 172.21.15.69:0/2038799193 shutdown_connections 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.204+0000 7f741cf09700 1 -- 172.21.15.69:0/2038799193 wait complete. 2024-04-23T10:17:38.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f741cf09700 1 Processor -- start 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f741cf09700 1 -- start start 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f741cf09700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f741819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f741cf09700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f741807afc0 con 0x7f74181074b0 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f741659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f741819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f741659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f741819a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54944/0 (socket says 172.21.15.69:54944) 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f741659c700 1 -- 172.21.15.69:0/1787415937 learned_addr learned my addr 172.21.15.69:0/1787415937 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f741659c700 1 -- 172.21.15.69:0/1787415937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741819a770 con 0x7f74181074b0 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f741659c700 1 --2- 172.21.15.69:0/1787415937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f741819a230 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f740800b340 tx=0x7f7408004080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f74077fe700 1 -- 172.21.15.69:0/1787415937 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7408027070 con 0x7f74181074b0 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f74077fe700 1 -- 172.21.15.69:0/1787415937 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f7408010d00 con 0x7f74181074b0 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f741cf09700 1 -- 172.21.15.69:0/1787415937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741819aa00 con 0x7f74181074b0 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.205+0000 7f74077fe700 1 -- 172.21.15.69:0/1787415937 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7408022bf0 con 0x7f74181074b0 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.206+0000 7f741cf09700 1 -- 172.21.15.69:0/1787415937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741819d6f0 con 0x7f74181074b0 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.206+0000 7f74077fe700 1 -- 172.21.15.69:0/1787415937 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f740802a070 con 0x7f74181074b0 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.207+0000 7f741cf09700 1 -- 172.21.15.69:0/1787415937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74180640a0 con 0x7f74181074b0 2024-04-23T10:17:38.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.207+0000 7f74077fe700 1 --2- 172.21.15.69:0/1787415937 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7400039670 0x7f740003bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.207+0000 7f74077fe700 1 -- 172.21.15.69:0/1787415937 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f740801f070 con 0x7f74181074b0 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.207+0000 7f7415d9b700 1 --2- 172.21.15.69:0/1787415937 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7400039670 0x7f740003bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.207+0000 7f7415d9b700 1 --2- 172.21.15.69:0/1787415937 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7400039670 0x7f740003bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f740c006fd0 tx=0x7f740c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.212+0000 7f74077fe700 1 -- 172.21.15.69:0/1787415937 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7408015070 con 0x7f74181074b0 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.408+0000 7f741cf09700 1 -- 172.21.15.69:0/1787415937 --> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f7418062e80 con 0x7f7400039670 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.883+0000 7f74077fe700 1 -- 172.21.15.69:0/1787415937 <== mgr.14120 v2:172.21.15.69:6800/3345837257 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7418062e80 con 0x7f7400039670 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.885+0000 7f741cf09700 1 -- 172.21.15.69:0/1787415937 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7400039670 msgr2=0x7f740003bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.885+0000 7f741cf09700 1 --2- 172.21.15.69:0/1787415937 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7400039670 0x7f740003bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f740c006fd0 tx=0x7f740c006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.885+0000 7f741cf09700 1 -- 172.21.15.69:0/1787415937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 msgr2=0x7f741819a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.885+0000 7f741cf09700 1 --2- 172.21.15.69:0/1787415937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f741819a230 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f740800b340 tx=0x7f7408004080 comp rx=0 tx=0).stop 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.885+0000 7f741cf09700 1 -- 172.21.15.69:0/1787415937 shutdown_connections 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.885+0000 7f741cf09700 1 --2- 172.21.15.69:0/1787415937 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7400039670 0x7f740003bb30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.885+0000 7f741cf09700 1 --2- 172.21.15.69:0/1787415937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74181074b0 0x7f741819a230 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.885+0000 7f741cf09700 1 -- 172.21.15.69:0/1787415937 >> 172.21.15.69:0/1787415937 conn(0x7f7418102a90 msgr2=0x7f7418190870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.886+0000 7f741cf09700 1 -- 172.21.15.69:0/1787415937 shutdown_connections 2024-04-23T10:17:38.447 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:37.886+0000 7f741cf09700 1 -- 172.21.15.69:0/1787415937 wait complete. 2024-04-23T10:17:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:38 smithi069 ceph-mon[29593]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:17:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:38 smithi069 ceph-mon[29593]: Generating ssh key... 2024-04-23T10:17:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:38 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:38 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:39.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCkOWn4cq3FZF06QayCItqAjf4drkMcHyNC6oSLwCE4Htu4K+7lHBfwDsBgOKrwlCDeWXg+4ZRV2ZP6202FAf5+gonUMrvHlpRkxGHQXRtkJwQxnz+8PUD7nD0K5jVyt+kfoxMkAMm0wfMaYuiZ5OQkagaGGnegN5co27/LlO5jdtMYID/V8+BrAVEXfp6maJh9Ah76qtoogG8s8IzSO04G8mLVe9FxK55Z5y1tdcv2sdC4iFb5Px0ryLnC+CJHA62QX/bif3PExTdAZ5i4dEpTt5VlZQolCv2D+MmEIigigrod2QvqTRYg9zfJf6iG45vRHrtuGWgzIgpXD3rFNi9MtwgYeRrbK+guVVSnR9+kULYi8e9iTyuFp6kMxovO+VncYtwGdtriqtSGv24Ceht7UdEj4aqtxURENLx68XiHF5yFGEIPXbPH5WPBQDog2dBcQB4XqhcSD0r+bqp5cozpd30JKUJaB169i/fACVxsePB3PYWCjc2xulSU1fSNh0= ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:17:39.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.804+0000 7fc045072700 1 Processor -- start 2024-04-23T10:17:39.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.804+0000 7fc045072700 1 -- start start 2024-04-23T10:17:39.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.805+0000 7fc045072700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04010b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.805+0000 7fc045072700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc04007be60 con 0x7fc040109090 2024-04-23T10:17:39.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.805+0000 7fc03ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04010b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.516 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.805+0000 7fc03ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04010b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54946/0 (socket says 172.21.15.69:54946) 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.805+0000 7fc03ed9d700 1 -- 172.21.15.69:0/2424107647 learned_addr learned my addr 172.21.15.69:0/2424107647 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.805+0000 7fc03ed9d700 1 -- 172.21.15.69:0/2424107647 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04010b9c0 con 0x7fc040109090 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.805+0000 7fc03ed9d700 1 --2- 172.21.15.69:0/2424107647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04010b480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc0300098a0 tx=0x7fc030009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59caa749a8309c18 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.805+0000 7fc03e59c700 1 -- 172.21.15.69:0/2424107647 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc030004160 con 0x7fc040109090 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.805+0000 7fc03e59c700 1 -- 172.21.15.69:0/2424107647 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fc030004300 con 0x7fc040109090 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.805+0000 7fc03e59c700 1 -- 172.21.15.69:0/2424107647 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc030011b20 con 0x7fc040109090 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.806+0000 7fc045072700 1 -- 172.21.15.69:0/2424107647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 msgr2=0x7fc04010b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.806+0000 7fc045072700 1 --2- 172.21.15.69:0/2424107647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04010b480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc0300098a0 tx=0x7fc030009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.806+0000 7fc045072700 1 -- 172.21.15.69:0/2424107647 shutdown_connections 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.806+0000 7fc045072700 1 --2- 172.21.15.69:0/2424107647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04010b480 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.806+0000 7fc045072700 1 -- 172.21.15.69:0/2424107647 >> 172.21.15.69:0/2424107647 conn(0x7fc040102a80 msgr2=0x7fc040104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.806+0000 7fc045072700 1 -- 172.21.15.69:0/2424107647 shutdown_connections 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.806+0000 7fc045072700 1 -- 172.21.15.69:0/2424107647 wait complete. 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.806+0000 7fc045072700 1 Processor -- start 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.807+0000 7fc045072700 1 -- start start 2024-04-23T10:17:39.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.807+0000 7fc045072700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04019c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.807+0000 7fc045072700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc04010c9e0 con 0x7fc040109090 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.807+0000 7fc03ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04019c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.807+0000 7fc03ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04019c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54956/0 (socket says 172.21.15.69:54956) 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.807+0000 7fc03ed9d700 1 -- 172.21.15.69:0/816178879 learned_addr learned my addr 172.21.15.69:0/816178879 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.807+0000 7fc03ed9d700 1 -- 172.21.15.69:0/816178879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04019c950 con 0x7fc040109090 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.807+0000 7fc03ed9d700 1 --2- 172.21.15.69:0/816178879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04019c410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc030006af0 tx=0x7fc030011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.807+0000 7fc03cd99700 1 -- 172.21.15.69:0/816178879 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0300039a0 con 0x7fc040109090 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.808+0000 7fc045072700 1 -- 172.21.15.69:0/816178879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04019cbe0 con 0x7fc040109090 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.808+0000 7fc03cd99700 1 -- 172.21.15.69:0/816178879 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fc030003b40 con 0x7fc040109090 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.808+0000 7fc03cd99700 1 -- 172.21.15.69:0/816178879 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc030019670 con 0x7fc040109090 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.808+0000 7fc045072700 1 -- 172.21.15.69:0/816178879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc04019d040 con 0x7fc040109090 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.808+0000 7fc045072700 1 -- 172.21.15.69:0/816178879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0400640a0 con 0x7fc040109090 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.809+0000 7fc03cd99700 1 -- 172.21.15.69:0/816178879 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fc03001aa90 con 0x7fc040109090 2024-04-23T10:17:39.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.809+0000 7fc03cd99700 1 --2- 172.21.15.69:0/816178879 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc02c039620 0x7fc02c03bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.809+0000 7fc03cd99700 1 -- 172.21.15.69:0/816178879 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc03004def0 con 0x7fc040109090 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.809+0000 7fc03659c700 1 --2- 172.21.15.69:0/816178879 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc02c039620 0x7fc02c03bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.810+0000 7fc03659c700 1 --2- 172.21.15.69:0/816178879 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc02c039620 0x7fc02c03bae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc028006fd0 tx=0x7fc028006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:38.814+0000 7fc03cd99700 1 -- 172.21.15.69:0/816178879 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc030011e20 con 0x7fc040109090 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.019+0000 7fc045072700 1 -- 172.21.15.69:0/816178879 --> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fc040103b90 con 0x7fc02c039620 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.019+0000 7fc03cd99700 1 -- 172.21.15.69:0/816178879 <== mgr.14120 v2:172.21.15.69:6800/3345837257 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fc040103b90 con 0x7fc02c039620 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.021+0000 7fc045072700 1 -- 172.21.15.69:0/816178879 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc02c039620 msgr2=0x7fc02c03bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.021+0000 7fc045072700 1 --2- 172.21.15.69:0/816178879 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc02c039620 0x7fc02c03bae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc028006fd0 tx=0x7fc028006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.021+0000 7fc045072700 1 -- 172.21.15.69:0/816178879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 msgr2=0x7fc04019c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.021+0000 7fc045072700 1 --2- 172.21.15.69:0/816178879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04019c410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc030006af0 tx=0x7fc030011ce0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.022+0000 7fc045072700 1 -- 172.21.15.69:0/816178879 shutdown_connections 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.022+0000 7fc045072700 1 --2- 172.21.15.69:0/816178879 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc02c039620 0x7fc02c03bae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.022+0000 7fc045072700 1 --2- 172.21.15.69:0/816178879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc040109090 0x7fc04019c410 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.022+0000 7fc045072700 1 -- 172.21.15.69:0/816178879 >> 172.21.15.69:0/816178879 conn(0x7fc040102a80 msgr2=0x7fc040103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.022+0000 7fc045072700 1 -- 172.21.15.69:0/816178879 shutdown_connections 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.022+0000 7fc045072700 1 -- 172.21.15.69:0/816178879 wait complete. 2024-04-23T10:17:39.519 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-23T10:17:39.520 INFO:teuthology.orchestra.run.smithi069.stdout:Adding key to root@localhost authorized_keys... 2024-04-23T10:17:39.520 INFO:teuthology.orchestra.run.smithi069.stdout:Adding host smithi069... 2024-04-23T10:17:40.177 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:39 smithi069 ceph-mon[29593]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:17:41.322 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:41 smithi069 ceph-mon[29593]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi069", "addr": "172.21.15.69", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:17:41.322 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:41 smithi069 ceph-mon[29593]: Deploying cephadm binary to smithi069 2024-04-23T10:17:44.824 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Added host 'smithi069' with addr '172.21.15.69' 2024-04-23T10:17:44.824 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.963+0000 7f795a16a700 1 Processor -- start 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.963+0000 7f795a16a700 1 -- start start 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.963+0000 7f795a16a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795410b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.963+0000 7f795a16a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f795407be60 con 0x7f7954109050 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.964+0000 7f79537fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795410b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.964+0000 7f79537fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795410b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48624/0 (socket says 172.21.15.69:48624) 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.964+0000 7f79537fe700 1 -- 172.21.15.69:0/2676938828 learned_addr learned my addr 172.21.15.69:0/2676938828 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.964+0000 7f79537fe700 1 -- 172.21.15.69:0/2676938828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795410b980 con 0x7f7954109050 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.964+0000 7f79537fe700 1 --2- 172.21.15.69:0/2676938828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795410b440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7944009e80 tx=0x7f794400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9962fa61ff8a25 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.964+0000 7f79527fc700 1 -- 172.21.15.69:0/2676938828 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7944017070 con 0x7f7954109050 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.964+0000 7f79527fc700 1 -- 172.21.15.69:0/2676938828 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f794400b8c0 con 0x7f7954109050 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.964+0000 7f79527fc700 1 -- 172.21.15.69:0/2676938828 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79440045c0 con 0x7f7954109050 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.965+0000 7f795a16a700 1 -- 172.21.15.69:0/2676938828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 msgr2=0x7f795410b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:44.825 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.965+0000 7f795a16a700 1 --2- 172.21.15.69:0/2676938828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795410b440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7944009e80 tx=0x7f794400b330 comp rx=0 tx=0).stop 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.965+0000 7f795a16a700 1 -- 172.21.15.69:0/2676938828 shutdown_connections 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.965+0000 7f795a16a700 1 --2- 172.21.15.69:0/2676938828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795410b440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.965+0000 7f795a16a700 1 -- 172.21.15.69:0/2676938828 >> 172.21.15.69:0/2676938828 conn(0x7f7954102a40 msgr2=0x7f7954104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.965+0000 7f795a16a700 1 -- 172.21.15.69:0/2676938828 shutdown_connections 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.965+0000 7f795a16a700 1 -- 172.21.15.69:0/2676938828 wait complete. 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.965+0000 7f795a16a700 1 Processor -- start 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.966+0000 7f795a16a700 1 -- start start 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.966+0000 7f795a16a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795419c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.966+0000 7f795a16a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f795410c9a0 con 0x7f7954109050 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.966+0000 7f79537fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795419c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.966+0000 7f79537fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795419c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48636/0 (socket says 172.21.15.69:48636) 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.966+0000 7f79537fe700 1 -- 172.21.15.69:0/2921691601 learned_addr learned my addr 172.21.15.69:0/2921691601 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.966+0000 7f79537fe700 1 -- 172.21.15.69:0/2921691601 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795419c970 con 0x7f7954109050 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.966+0000 7f79537fe700 1 --2- 172.21.15.69:0/2921691601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795419c430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7944000f80 tx=0x7f794400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:44.826 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.966+0000 7f7950ff9700 1 -- 172.21.15.69:0/2921691601 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7944017070 con 0x7f7954109050 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.967+0000 7f7950ff9700 1 -- 172.21.15.69:0/2921691601 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f7944022070 con 0x7f7954109050 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.967+0000 7f795a16a700 1 -- 172.21.15.69:0/2921691601 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795419cc00 con 0x7f7954109050 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.967+0000 7f7950ff9700 1 -- 172.21.15.69:0/2921691601 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f794401d6d0 con 0x7f7954109050 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.967+0000 7f795a16a700 1 -- 172.21.15.69:0/2921691601 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795419f8f0 con 0x7f7954109050 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.967+0000 7f7950ff9700 1 -- 172.21.15.69:0/2921691601 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f794401d940 con 0x7f7954109050 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.967+0000 7f7950ff9700 1 --2- 172.21.15.69:0/2921691601 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f793c0396c0 0x7f793c03bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.968+0000 7f7950ff9700 1 -- 172.21.15.69:0/2921691601 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f794400f050 con 0x7f7954109050 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.968+0000 7f795a16a700 1 -- 172.21.15.69:0/2921691601 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79540640a0 con 0x7f7954109050 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.968+0000 7f7952ffd700 1 --2- 172.21.15.69:0/2921691601 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f793c0396c0 0x7f793c03bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.968+0000 7f7952ffd700 1 --2- 172.21.15.69:0/2921691601 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f793c0396c0 0x7f793c03bb80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7948006fd0 tx=0x7f7948006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:39.973+0000 7f7950ff9700 1 -- 172.21.15.69:0/2921691601 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7944026c70 con 0x7f7954109050 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:40.178+0000 7f795a16a700 1 -- 172.21.15.69:0/2921691601 --> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi069", "addr": "172.21.15.69", "target": ["mon-mgr", ""]}) -- 0x7f7954103ba0 con 0x7f793c0396c0 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:44.247+0000 7f7950ff9700 1 -- 172.21.15.69:0/2921691601 <== mgr.14120 v2:172.21.15.69:6800/3345837257 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f7954103ba0 con 0x7f793c0396c0 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:44.249+0000 7f795a16a700 1 -- 172.21.15.69:0/2921691601 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f793c0396c0 msgr2=0x7f793c03bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:44.249+0000 7f795a16a700 1 --2- 172.21.15.69:0/2921691601 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f793c0396c0 0x7f793c03bb80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7948006fd0 tx=0x7f7948006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:44.827 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:44.249+0000 7f795a16a700 1 -- 172.21.15.69:0/2921691601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 msgr2=0x7f795419c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:44.828 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:44.249+0000 7f795a16a700 1 --2- 172.21.15.69:0/2921691601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795419c430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7944000f80 tx=0x7f794400bdc0 comp rx=0 tx=0).stop 2024-04-23T10:17:44.828 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:44.250+0000 7f795a16a700 1 -- 172.21.15.69:0/2921691601 shutdown_connections 2024-04-23T10:17:44.828 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:44.250+0000 7f795a16a700 1 --2- 172.21.15.69:0/2921691601 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f793c0396c0 0x7f793c03bb80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:44.828 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:44.250+0000 7f795a16a700 1 --2- 172.21.15.69:0/2921691601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7954109050 0x7f795419c430 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:44.828 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:44.250+0000 7f795a16a700 1 -- 172.21.15.69:0/2921691601 >> 172.21.15.69:0/2921691601 conn(0x7f7954102a40 msgr2=0x7f7954103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:44.828 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:44.250+0000 7f795a16a700 1 -- 172.21.15.69:0/2921691601 shutdown_connections 2024-04-23T10:17:44.828 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:44.250+0000 7f795a16a700 1 -- 172.21.15.69:0/2921691601 wait complete. 2024-04-23T10:17:44.828 INFO:teuthology.orchestra.run.smithi069.stdout:Deploying unmanaged mon service... 2024-04-23T10:17:45.365 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:45 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:45.365 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:45 smithi069 ceph-mon[29593]: Added host smithi069 2024-04-23T10:17:45.366 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:45 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:17:46.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-23T10:17:46.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.314+0000 7f7cc0652700 1 Processor -- start 2024-04-23T10:17:46.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.314+0000 7f7cc0652700 1 -- start start 2024-04-23T10:17:46.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.314+0000 7f7cc0652700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb81078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:46.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.314+0000 7f7cc0652700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb8107e90 con 0x7f7cb81074a0 2024-04-23T10:17:46.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.315+0000 7f7cbe3ee700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb81078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:46.192 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.315+0000 7f7cbe3ee700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb81078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48650/0 (socket says 172.21.15.69:48650) 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.315+0000 7f7cbe3ee700 1 -- 172.21.15.69:0/909134770 learned_addr learned my addr 172.21.15.69:0/909134770 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.315+0000 7f7cbe3ee700 1 -- 172.21.15.69:0/909134770 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb81086a0 con 0x7f7cb81074a0 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.315+0000 7f7cbe3ee700 1 --2- 172.21.15.69:0/909134770 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb81078c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009e80 tx=0x7f7cb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9631677bb23ec373 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.315+0000 7f7cbd3ec700 1 -- 172.21.15.69:0/909134770 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cb4017070 con 0x7f7cb81074a0 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.315+0000 7f7cbd3ec700 1 -- 172.21.15.69:0/909134770 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f7cb400b8c0 con 0x7f7cb81074a0 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.315+0000 7f7cbd3ec700 1 -- 172.21.15.69:0/909134770 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cb40045c0 con 0x7f7cb81074a0 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.316+0000 7f7cc0652700 1 -- 172.21.15.69:0/909134770 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 msgr2=0x7f7cb81078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.316+0000 7f7cc0652700 1 --2- 172.21.15.69:0/909134770 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb81078c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009e80 tx=0x7f7cb400b330 comp rx=0 tx=0).stop 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.316+0000 7f7cc0652700 1 -- 172.21.15.69:0/909134770 shutdown_connections 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.316+0000 7f7cc0652700 1 --2- 172.21.15.69:0/909134770 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb81078c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.316+0000 7f7cc0652700 1 -- 172.21.15.69:0/909134770 >> 172.21.15.69:0/909134770 conn(0x7f7cb8102a40 msgr2=0x7f7cb8104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.316+0000 7f7cc0652700 1 -- 172.21.15.69:0/909134770 shutdown_connections 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.316+0000 7f7cc0652700 1 -- 172.21.15.69:0/909134770 wait complete. 2024-04-23T10:17:46.193 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7cc0652700 1 Processor -- start 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7cc0652700 1 -- start start 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7cc0652700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7cc0652700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb810ba50 con 0x7f7cb81074a0 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7cbe3ee700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7cbe3ee700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb819e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48660/0 (socket says 172.21.15.69:48660) 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7cbe3ee700 1 -- 172.21.15.69:0/2543504704 learned_addr learned my addr 172.21.15.69:0/2543504704 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7cbe3ee700 1 -- 172.21.15.69:0/2543504704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb819ebd0 con 0x7f7cb81074a0 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7cbe3ee700 1 --2- 172.21.15.69:0/2543504704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb819e690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400b7b0 tx=0x7f7cb400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7caf7fe700 1 -- 172.21.15.69:0/2543504704 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cb4017070 con 0x7f7cb81074a0 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7caf7fe700 1 -- 172.21.15.69:0/2543504704 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f7cb4022070 con 0x7f7cb81074a0 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7caf7fe700 1 -- 172.21.15.69:0/2543504704 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cb401d5f0 con 0x7f7cb81074a0 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.317+0000 7f7cc0652700 1 -- 172.21.15.69:0/2543504704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb819ee60 con 0x7f7cb81074a0 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.318+0000 7f7cc0652700 1 -- 172.21.15.69:0/2543504704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb81a1b50 con 0x7f7cb81074a0 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.318+0000 7f7caf7fe700 1 -- 172.21.15.69:0/2543504704 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f7cb401d8f0 con 0x7f7cb81074a0 2024-04-23T10:17:46.194 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.318+0000 7f7cc0652700 1 -- 172.21.15.69:0/2543504704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb80640a0 con 0x7f7cb81074a0 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.318+0000 7f7caf7fe700 1 --2- 172.21.15.69:0/2543504704 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7ca4039620 0x7f7ca403bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.318+0000 7f7caf7fe700 1 -- 172.21.15.69:0/2543504704 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7cb400f050 con 0x7f7cb81074a0 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.319+0000 7f7cbdbed700 1 --2- 172.21.15.69:0/2543504704 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7ca4039620 0x7f7ca403bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.319+0000 7f7cbdbed700 1 --2- 172.21.15.69:0/2543504704 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7ca4039620 0x7f7ca403bae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8006fd0 tx=0x7f7ca8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.323+0000 7f7caf7fe700 1 -- 172.21.15.69:0/2543504704 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7cb4025cd0 con 0x7f7cb81074a0 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.543+0000 7f7cc0652700 1 -- 172.21.15.69:0/2543504704 --> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f7cb80008d0 con 0x7f7ca4039620 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.548+0000 7f7caf7fe700 1 -- 172.21.15.69:0/2543504704 <== mgr.14120 v2:172.21.15.69:6800/3345837257 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7cb80008d0 con 0x7f7ca4039620 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.550+0000 7f7cc0652700 1 -- 172.21.15.69:0/2543504704 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7ca4039620 msgr2=0x7f7ca403bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.550+0000 7f7cc0652700 1 --2- 172.21.15.69:0/2543504704 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7ca4039620 0x7f7ca403bae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8006fd0 tx=0x7f7ca8006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.550+0000 7f7cc0652700 1 -- 172.21.15.69:0/2543504704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 msgr2=0x7f7cb819e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.550+0000 7f7cc0652700 1 --2- 172.21.15.69:0/2543504704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb819e690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400b7b0 tx=0x7f7cb400bdc0 comp rx=0 tx=0).stop 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.550+0000 7f7cc0652700 1 -- 172.21.15.69:0/2543504704 shutdown_connections 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.550+0000 7f7cc0652700 1 --2- 172.21.15.69:0/2543504704 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f7ca4039620 0x7f7ca403bae0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.550+0000 7f7cc0652700 1 --2- 172.21.15.69:0/2543504704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb81074a0 0x7f7cb819e690 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.550+0000 7f7cc0652700 1 -- 172.21.15.69:0/2543504704 >> 172.21.15.69:0/2543504704 conn(0x7f7cb8102a40 msgr2=0x7f7cb8103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:46.195 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.550+0000 7f7cc0652700 1 -- 172.21.15.69:0/2543504704 shutdown_connections 2024-04-23T10:17:46.196 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:45.550+0000 7f7cc0652700 1 -- 172.21.15.69:0/2543504704 wait complete. 2024-04-23T10:17:46.196 INFO:teuthology.orchestra.run.smithi069.stdout:Deploying unmanaged mgr service... 2024-04-23T10:17:46.730 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:46 smithi069 ceph-mon[29593]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:17:46.730 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:46 smithi069 ceph-mon[29593]: Saving service mon spec with placement count:5 2024-04-23T10:17:46.730 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:46 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:47.944 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-23T10:17:47.944 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.002+0000 7f08119e5700 1 Processor -- start 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.002+0000 7f08119e5700 1 -- start start 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.002+0000 7f08119e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c106ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.002+0000 7f08119e5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f080c107270 con 0x7f080c106880 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.002+0000 7f080affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c106ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.002+0000 7f080affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c106ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48662/0 (socket says 172.21.15.69:48662) 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.002+0000 7f080affd700 1 -- 172.21.15.69:0/1923388274 learned_addr learned my addr 172.21.15.69:0/1923388274 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.002+0000 7f080affd700 1 -- 172.21.15.69:0/1923388274 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c109810 con 0x7f080c106880 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.003+0000 7f080affd700 1 --2- 172.21.15.69:0/1923388274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c106ca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0098a0 tx=0x7f07fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebcd1cea1f51836 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.003+0000 7f0809ffb700 1 -- 172.21.15.69:0/1923388274 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc004160 con 0x7f080c106880 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.003+0000 7f0809ffb700 1 -- 172.21.15.69:0/1923388274 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f07fc004300 con 0x7f080c106880 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.003+0000 7f0809ffb700 1 -- 172.21.15.69:0/1923388274 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc011b20 con 0x7f080c106880 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.003+0000 7f08119e5700 1 -- 172.21.15.69:0/1923388274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 msgr2=0x7f080c106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.003+0000 7f08119e5700 1 --2- 172.21.15.69:0/1923388274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c106ca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0098a0 tx=0x7f07fc009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.003+0000 7f08119e5700 1 -- 172.21.15.69:0/1923388274 shutdown_connections 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.003+0000 7f08119e5700 1 --2- 172.21.15.69:0/1923388274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c106ca0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:47.945 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.003+0000 7f08119e5700 1 -- 172.21.15.69:0/1923388274 >> 172.21.15.69:0/1923388274 conn(0x7f080c1021b0 msgr2=0x7f080c1045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.003+0000 7f08119e5700 1 -- 172.21.15.69:0/1923388274 shutdown_connections 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.003+0000 7f08119e5700 1 -- 172.21.15.69:0/1923388274 wait complete. 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.004+0000 7f08119e5700 1 Processor -- start 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.004+0000 7f08119e5700 1 -- start start 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.004+0000 7f08119e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c19c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.004+0000 7f08119e5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f080c10cbc0 con 0x7f080c106880 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.004+0000 7f080affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c19c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.005+0000 7f080affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c19c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48666/0 (socket says 172.21.15.69:48666) 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.005+0000 7f080affd700 1 -- 172.21.15.69:0/1313484047 learned_addr learned my addr 172.21.15.69:0/1313484047 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.005+0000 7f080affd700 1 -- 172.21.15.69:0/1313484047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c19c990 con 0x7f080c106880 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.005+0000 7f080affd700 1 --2- 172.21.15.69:0/1313484047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c19c450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0117e0 tx=0x7f07fc011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.005+0000 7f08109e3700 1 -- 172.21.15.69:0/1313484047 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc003b30 con 0x7f080c106880 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.005+0000 7f08109e3700 1 -- 172.21.15.69:0/1313484047 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f07fc003cd0 con 0x7f080c106880 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.005+0000 7f08119e5700 1 -- 172.21.15.69:0/1313484047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080c19cc20 con 0x7f080c106880 2024-04-23T10:17:47.946 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.005+0000 7f08109e3700 1 -- 172.21.15.69:0/1313484047 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc01a830 con 0x7f080c106880 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.005+0000 7f08119e5700 1 -- 172.21.15.69:0/1313484047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080c19d080 con 0x7f080c106880 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.006+0000 7f08109e3700 1 -- 172.21.15.69:0/1313484047 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f07fc01a9d0 con 0x7f080c106880 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.006+0000 7f08119e5700 1 -- 172.21.15.69:0/1313484047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f080c0640a0 con 0x7f080c106880 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.006+0000 7f08109e3700 1 --2- 172.21.15.69:0/1313484047 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f07f40396c0 0x7f07f403bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.006+0000 7f08109e3700 1 -- 172.21.15.69:0/1313484047 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f07fc04dc00 con 0x7f080c106880 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.006+0000 7f080a7fc700 1 --2- 172.21.15.69:0/1313484047 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f07f40396c0 0x7f07f403bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.007+0000 7f080a7fc700 1 --2- 172.21.15.69:0/1313484047 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f07f40396c0 0x7f07f403bb80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0800006fd0 tx=0x7f0800006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.011+0000 7f08109e3700 1 -- 172.21.15.69:0/1313484047 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f07fc019c70 con 0x7f080c106880 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.226+0000 7f08119e5700 1 -- 172.21.15.69:0/1313484047 --> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f080c1032b0 con 0x7f07f40396c0 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.231+0000 7f08109e3700 1 -- 172.21.15.69:0/1313484047 <== mgr.14120 v2:172.21.15.69:6800/3345837257 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f080c1032b0 con 0x7f07f40396c0 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.233+0000 7f08119e5700 1 -- 172.21.15.69:0/1313484047 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f07f40396c0 msgr2=0x7f07f403bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.233+0000 7f08119e5700 1 --2- 172.21.15.69:0/1313484047 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f07f40396c0 0x7f07f403bb80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0800006fd0 tx=0x7f0800006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.233+0000 7f08119e5700 1 -- 172.21.15.69:0/1313484047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 msgr2=0x7f080c19c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.233+0000 7f08119e5700 1 --2- 172.21.15.69:0/1313484047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c19c450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0117e0 tx=0x7f07fc011ce0 comp rx=0 tx=0).stop 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.233+0000 7f08119e5700 1 -- 172.21.15.69:0/1313484047 shutdown_connections 2024-04-23T10:17:47.947 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.233+0000 7f08119e5700 1 --2- 172.21.15.69:0/1313484047 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f07f40396c0 0x7f07f403bb80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:47.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.233+0000 7f08119e5700 1 --2- 172.21.15.69:0/1313484047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f080c106880 0x7f080c19c450 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:47.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.233+0000 7f08119e5700 1 -- 172.21.15.69:0/1313484047 >> 172.21.15.69:0/1313484047 conn(0x7f080c1021b0 msgr2=0x7f080c102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:47.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.233+0000 7f08119e5700 1 -- 172.21.15.69:0/1313484047 shutdown_connections 2024-04-23T10:17:47.948 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:47.233+0000 7f08119e5700 1 -- 172.21.15.69:0/1313484047 wait complete. 2024-04-23T10:17:48.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:48 smithi069 ceph-mon[29593]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:17:48.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:48 smithi069 ceph-mon[29593]: Saving service mgr spec with placement count:2 2024-04-23T10:17:48.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:48 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:48.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:48 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:48.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:48 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:49.477 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.385+0000 7f01ff6ff700 1 Processor -- start 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.386+0000 7f01ff6ff700 1 -- start start 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.386+0000 7f01ff6ff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f81078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.386+0000 7f01ff6ff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f01f8107e90 con 0x7f01f81074a0 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.386+0000 7f01fd49b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f81078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.386+0000 7f01fd49b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f81078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48668/0 (socket says 172.21.15.69:48668) 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.386+0000 7f01fd49b700 1 -- 172.21.15.69:0/2573409305 learned_addr learned my addr 172.21.15.69:0/2573409305 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.386+0000 7f01fd49b700 1 -- 172.21.15.69:0/2573409305 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f81086a0 con 0x7f01f81074a0 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.386+0000 7f01fd49b700 1 --2- 172.21.15.69:0/2573409305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f81078c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f01f40098a0 tx=0x7f01f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88530ac666870842 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.387+0000 7f01effff700 1 -- 172.21.15.69:0/2573409305 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f4004160 con 0x7f01f81074a0 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.387+0000 7f01effff700 1 -- 172.21.15.69:0/2573409305 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01f4004300 con 0x7f01f81074a0 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.387+0000 7f01effff700 1 -- 172.21.15.69:0/2573409305 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f4011af0 con 0x7f01f81074a0 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.387+0000 7f01ff6ff700 1 -- 172.21.15.69:0/2573409305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 msgr2=0x7f01f81078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:49.478 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.387+0000 7f01ff6ff700 1 --2- 172.21.15.69:0/2573409305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f81078c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f01f40098a0 tx=0x7f01f4009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.387+0000 7f01ff6ff700 1 -- 172.21.15.69:0/2573409305 shutdown_connections 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.387+0000 7f01ff6ff700 1 --2- 172.21.15.69:0/2573409305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f81078c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.387+0000 7f01ff6ff700 1 -- 172.21.15.69:0/2573409305 >> 172.21.15.69:0/2573409305 conn(0x7f01f8102a40 msgr2=0x7f01f8104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.387+0000 7f01ff6ff700 1 -- 172.21.15.69:0/2573409305 shutdown_connections 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.387+0000 7f01ff6ff700 1 -- 172.21.15.69:0/2573409305 wait complete. 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.388+0000 7f01ff6ff700 1 Processor -- start 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.388+0000 7f01ff6ff700 1 -- start start 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.388+0000 7f01ff6ff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f807ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.388+0000 7f01ff6ff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f01f810ba50 con 0x7f01f81074a0 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.389+0000 7f01fd49b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f807ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.389+0000 7f01fd49b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f807ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48684/0 (socket says 172.21.15.69:48684) 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.389+0000 7f01fd49b700 1 -- 172.21.15.69:0/3672501344 learned_addr learned my addr 172.21.15.69:0/3672501344 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.389+0000 7f01fd49b700 1 -- 172.21.15.69:0/3672501344 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f819f1a0 con 0x7f01f81074a0 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.389+0000 7f01fd49b700 1 --2- 172.21.15.69:0/3672501344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f807ba60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01f4003f90 tx=0x7f01f4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:49.479 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.389+0000 7f01ee7fc700 1 -- 172.21.15.69:0/3672501344 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f40039e0 con 0x7f01f81074a0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.389+0000 7f01ee7fc700 1 -- 172.21.15.69:0/3672501344 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01f4003b80 con 0x7f01f81074a0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.389+0000 7f01ff6ff700 1 -- 172.21.15.69:0/3672501344 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f819f370 con 0x7f01f81074a0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.389+0000 7f01ff6ff700 1 -- 172.21.15.69:0/3672501344 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f819f790 con 0x7f01f81074a0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.389+0000 7f01ee7fc700 1 -- 172.21.15.69:0/3672501344 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f40196e0 con 0x7f01f81074a0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.390+0000 7f01ee7fc700 1 -- 172.21.15.69:0/3672501344 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f01f4022020 con 0x7f01f81074a0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.390+0000 7f01ff6ff700 1 -- 172.21.15.69:0/3672501344 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f80640a0 con 0x7f01f81074a0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.390+0000 7f01ee7fc700 1 --2- 172.21.15.69:0/3672501344 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f01e4039670 0x7f01e403bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.390+0000 7f01ee7fc700 1 -- 172.21.15.69:0/3672501344 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f01f404d8a0 con 0x7f01f81074a0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.390+0000 7f01fcc9a700 1 --2- 172.21.15.69:0/3672501344 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f01e4039670 0x7f01e403bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.391+0000 7f01fcc9a700 1 --2- 172.21.15.69:0/3672501344 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f01e4039670 0x7f01e403bb30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f01e8006fd0 tx=0x7f01e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.400+0000 7f01ee7fc700 1 -- 172.21.15.69:0/3672501344 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f01f4020e80 con 0x7f01f81074a0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.613+0000 7f01ff6ff700 1 -- 172.21.15.69:0/3672501344 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f01f819f9c0 con 0x7f01f81074a0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.618+0000 7f01ee7fc700 1 -- 172.21.15.69:0/3672501344 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f01f402bbe0 con 0x7f01f81074a0 2024-04-23T10:17:49.480 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.621+0000 7f01ff6ff700 1 -- 172.21.15.69:0/3672501344 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f01e4039670 msgr2=0x7f01e403bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:49.481 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.621+0000 7f01ff6ff700 1 --2- 172.21.15.69:0/3672501344 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f01e4039670 0x7f01e403bb30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f01e8006fd0 tx=0x7f01e8006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:49.481 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.621+0000 7f01ff6ff700 1 -- 172.21.15.69:0/3672501344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 msgr2=0x7f01f807ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:49.481 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.621+0000 7f01ff6ff700 1 --2- 172.21.15.69:0/3672501344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f807ba60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01f4003f90 tx=0x7f01f4011b70 comp rx=0 tx=0).stop 2024-04-23T10:17:49.481 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.621+0000 7f01ff6ff700 1 -- 172.21.15.69:0/3672501344 shutdown_connections 2024-04-23T10:17:49.481 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.621+0000 7f01ff6ff700 1 --2- 172.21.15.69:0/3672501344 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7f01e4039670 0x7f01e403bb30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:49.481 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.621+0000 7f01ff6ff700 1 --2- 172.21.15.69:0/3672501344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01f81074a0 0x7f01f807ba60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:49.481 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.621+0000 7f01ff6ff700 1 -- 172.21.15.69:0/3672501344 >> 172.21.15.69:0/3672501344 conn(0x7f01f8102a40 msgr2=0x7f01f81034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:49.481 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.621+0000 7f01ff6ff700 1 -- 172.21.15.69:0/3672501344 shutdown_connections 2024-04-23T10:17:49.481 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:48.621+0000 7f01ff6ff700 1 -- 172.21.15.69:0/3672501344 wait complete. 2024-04-23T10:17:49.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:49 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3672501344' entity='client.admin' 2024-04-23T10:17:51.010 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.213+0000 7faadaa23700 1 Processor -- start 2024-04-23T10:17:51.010 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.213+0000 7faadaa23700 1 -- start start 2024-04-23T10:17:51.010 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.213+0000 7faadaa23700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:51.010 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.213+0000 7faadaa23700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7faad407c8c0 con 0x7faad407de40 2024-04-23T10:17:51.010 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.214+0000 7faad3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:51.010 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.214+0000 7faad3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad407c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42466/0 (socket says 172.21.15.69:42466) 2024-04-23T10:17:51.010 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.214+0000 7faad3fff700 1 -- 172.21.15.69:0/642161121 learned_addr learned my addr 172.21.15.69:0/642161121 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:51.010 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.214+0000 7faad3fff700 1 -- 172.21.15.69:0/642161121 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad407ca40 con 0x7faad407de40 2024-04-23T10:17:51.010 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.214+0000 7faad3fff700 1 --2- 172.21.15.69:0/642161121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad407c2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faac40098a0 tx=0x7faac4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e445ddd83cbb64b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:51.010 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.214+0000 7faad2ffd700 1 -- 172.21.15.69:0/642161121 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac4004160 con 0x7faad407de40 2024-04-23T10:17:51.010 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.214+0000 7faad2ffd700 1 -- 172.21.15.69:0/642161121 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faac4004300 con 0x7faad407de40 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.214+0000 7faad2ffd700 1 -- 172.21.15.69:0/642161121 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac4011af0 con 0x7faad407de40 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.215+0000 7faadaa23700 1 -- 172.21.15.69:0/642161121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 msgr2=0x7faad407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.215+0000 7faadaa23700 1 --2- 172.21.15.69:0/642161121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad407c2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faac40098a0 tx=0x7faac4009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.215+0000 7faadaa23700 1 -- 172.21.15.69:0/642161121 shutdown_connections 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.215+0000 7faadaa23700 1 --2- 172.21.15.69:0/642161121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad407c2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.215+0000 7faadaa23700 1 -- 172.21.15.69:0/642161121 >> 172.21.15.69:0/642161121 conn(0x7faad4103be0 msgr2=0x7faad4106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.215+0000 7faadaa23700 1 -- 172.21.15.69:0/642161121 shutdown_connections 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.215+0000 7faadaa23700 1 -- 172.21.15.69:0/642161121 wait complete. 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.216+0000 7faadaa23700 1 Processor -- start 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.216+0000 7faadaa23700 1 -- start start 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.216+0000 7faadaa23700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad419e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.216+0000 7faadaa23700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7faad410ebc0 con 0x7faad407de40 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.216+0000 7faad3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad419e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.216+0000 7faad3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad419e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42474/0 (socket says 172.21.15.69:42474) 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.216+0000 7faad3fff700 1 -- 172.21.15.69:0/2530327366 learned_addr learned my addr 172.21.15.69:0/2530327366 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:51.011 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.217+0000 7faad3fff700 1 -- 172.21.15.69:0/2530327366 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad419eb20 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.217+0000 7faad3fff700 1 --2- 172.21.15.69:0/2530327366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad419e5e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faac40117b0 tx=0x7faac4003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.217+0000 7faad17fa700 1 -- 172.21.15.69:0/2530327366 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac40036a0 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.217+0000 7faad17fa700 1 -- 172.21.15.69:0/2530327366 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faac401a430 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.217+0000 7faad17fa700 1 -- 172.21.15.69:0/2530327366 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac4019530 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.217+0000 7faadaa23700 1 -- 172.21.15.69:0/2530327366 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad419edb0 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.217+0000 7faadaa23700 1 -- 172.21.15.69:0/2530327366 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad419f1d0 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.218+0000 7faad17fa700 1 -- 172.21.15.69:0/2530327366 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7faac40197e0 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.218+0000 7faadaa23700 1 -- 172.21.15.69:0/2530327366 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad40640a0 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.218+0000 7faad17fa700 1 --2- 172.21.15.69:0/2530327366 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7faac0039620 0x7faac003bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.218+0000 7faad17fa700 1 -- 172.21.15.69:0/2530327366 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faac404d870 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.218+0000 7faad37fe700 1 --2- 172.21.15.69:0/2530327366 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7faac0039620 0x7faac003bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.219+0000 7faad37fe700 1 --2- 172.21.15.69:0/2530327366 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7faac0039620 0x7faac003bae0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faabc006fd0 tx=0x7faabc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.223+0000 7faad17fa700 1 -- 172.21.15.69:0/2530327366 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faac400ba30 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.427+0000 7faadaa23700 1 -- 172.21.15.69:0/2530327366 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7faad41a1ca0 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.430+0000 7faad17fa700 1 -- 172.21.15.69:0/2530327366 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7faac400bc90 con 0x7faad407de40 2024-04-23T10:17:51.012 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.433+0000 7faadaa23700 1 -- 172.21.15.69:0/2530327366 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7faac0039620 msgr2=0x7faac003bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:51.013 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.433+0000 7faadaa23700 1 --2- 172.21.15.69:0/2530327366 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7faac0039620 0x7faac003bae0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faabc006fd0 tx=0x7faabc006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:51.013 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.433+0000 7faadaa23700 1 -- 172.21.15.69:0/2530327366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 msgr2=0x7faad419e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:51.013 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.433+0000 7faadaa23700 1 --2- 172.21.15.69:0/2530327366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad419e5e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faac40117b0 tx=0x7faac4003eb0 comp rx=0 tx=0).stop 2024-04-23T10:17:51.013 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.433+0000 7faadaa23700 1 -- 172.21.15.69:0/2530327366 shutdown_connections 2024-04-23T10:17:51.013 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.433+0000 7faadaa23700 1 --2- 172.21.15.69:0/2530327366 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7faac0039620 0x7faac003bae0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:51.013 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.433+0000 7faadaa23700 1 --2- 172.21.15.69:0/2530327366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad407de40 0x7faad419e5e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:51.013 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.433+0000 7faadaa23700 1 -- 172.21.15.69:0/2530327366 >> 172.21.15.69:0/2530327366 conn(0x7faad4103be0 msgr2=0x7faad41045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:51.013 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.433+0000 7faadaa23700 1 -- 172.21.15.69:0/2530327366 shutdown_connections 2024-04-23T10:17:51.013 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:50.433+0000 7faadaa23700 1 -- 172.21.15.69:0/2530327366 wait complete. 2024-04-23T10:17:51.013 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling the dashboard module... 2024-04-23T10:17:51.330 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:51 smithi069 ceph-mon[29593]: from='mgr.14120 172.21.15.69:0/2449261944' entity='mgr.x' 2024-04-23T10:17:51.330 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:51 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2530327366' entity='client.admin' 2024-04-23T10:17:52.375 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:52 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/413001149' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-23T10:17:52.376 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: ignoring --setuser ceph since I am not root 2024-04-23T10:17:52.376 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: ignoring --setgroup ceph since I am not root 2024-04-23T10:17:52.376 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:52.204+0000 7faa7cce5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:17:52.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.430+0000 7fc1f22dd700 1 Processor -- start 2024-04-23T10:17:52.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.430+0000 7fc1f22dd700 1 -- start start 2024-04-23T10:17:52.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.430+0000 7fc1f22dd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec10b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:52.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.430+0000 7fc1f22dd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec07be80 con 0x7fc1ec109050 2024-04-23T10:17:52.609 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.430+0000 7fc1ebfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec10b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.431+0000 7fc1ebfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec10b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42478/0 (socket says 172.21.15.69:42478) 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.431+0000 7fc1ebfff700 1 -- 172.21.15.69:0/1358587339 learned_addr learned my addr 172.21.15.69:0/1358587339 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.431+0000 7fc1ebfff700 1 -- 172.21.15.69:0/1358587339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec10b980 con 0x7fc1ec109050 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.431+0000 7fc1ebfff700 1 --2- 172.21.15.69:0/1358587339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec10b440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0098a0 tx=0x7fc1dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58b2e4012e9dc17 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.431+0000 7fc1eaffd700 1 -- 172.21.15.69:0/1358587339 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1dc004160 con 0x7fc1ec109050 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.431+0000 7fc1eaffd700 1 -- 172.21.15.69:0/1358587339 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc1dc004300 con 0x7fc1ec109050 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.431+0000 7fc1eaffd700 1 -- 172.21.15.69:0/1358587339 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1dc011af0 con 0x7fc1ec109050 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.432+0000 7fc1f22dd700 1 -- 172.21.15.69:0/1358587339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 msgr2=0x7fc1ec10b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.432+0000 7fc1f22dd700 1 --2- 172.21.15.69:0/1358587339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec10b440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0098a0 tx=0x7fc1dc009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.432+0000 7fc1f22dd700 1 -- 172.21.15.69:0/1358587339 shutdown_connections 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.432+0000 7fc1f22dd700 1 --2- 172.21.15.69:0/1358587339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec10b440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.432+0000 7fc1f22dd700 1 -- 172.21.15.69:0/1358587339 >> 172.21.15.69:0/1358587339 conn(0x7fc1ec102a80 msgr2=0x7fc1ec104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:52.610 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.432+0000 7fc1f22dd700 1 -- 172.21.15.69:0/1358587339 shutdown_connections 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.432+0000 7fc1f22dd700 1 -- 172.21.15.69:0/1358587339 wait complete. 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.432+0000 7fc1f22dd700 1 Processor -- start 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.432+0000 7fc1f22dd700 1 -- start start 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1f22dd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1f22dd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec10c980 con 0x7fc1ec109050 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1ebfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1ebfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec19c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42486/0 (socket says 172.21.15.69:42486) 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1ebfff700 1 -- 172.21.15.69:0/413001149 learned_addr learned my addr 172.21.15.69:0/413001149 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1ebfff700 1 -- 172.21.15.69:0/413001149 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec19c900 con 0x7fc1ec109050 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1ebfff700 1 --2- 172.21.15.69:0/413001149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec19c3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc003f90 tx=0x7fc1dc011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1e97fa700 1 -- 172.21.15.69:0/413001149 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1dc0039e0 con 0x7fc1ec109050 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1f22dd700 1 -- 172.21.15.69:0/413001149 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ec19cbf0 con 0x7fc1ec109050 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1e97fa700 1 -- 172.21.15.69:0/413001149 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc1dc003b80 con 0x7fc1ec109050 2024-04-23T10:17:52.611 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1e97fa700 1 -- 172.21.15.69:0/413001149 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1dc0196e0 con 0x7fc1ec109050 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.433+0000 7fc1f22dd700 1 -- 172.21.15.69:0/413001149 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ec19f880 con 0x7fc1ec109050 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.434+0000 7fc1e97fa700 1 -- 172.21.15.69:0/413001149 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fc1dc022020 con 0x7fc1ec109050 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.434+0000 7fc1f22dd700 1 -- 172.21.15.69:0/413001149 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1ec0640a0 con 0x7fc1ec109050 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.434+0000 7fc1e97fa700 1 --2- 172.21.15.69:0/413001149 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc1d4039670 0x7fc1d403bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.435+0000 7fc1e97fa700 1 -- 172.21.15.69:0/413001149 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc1dc04d7f0 con 0x7fc1ec109050 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.435+0000 7fc1eb7fe700 1 --2- 172.21.15.69:0/413001149 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc1d4039670 0x7fc1d403bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.435+0000 7fc1eb7fe700 1 --2- 172.21.15.69:0/413001149 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc1d4039670 0x7fc1d403bb30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0006fd0 tx=0x7fc1e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.440+0000 7fc1e97fa700 1 -- 172.21.15.69:0/413001149 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc1dc01a480 con 0x7fc1ec109050 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:51.702+0000 7fc1f22dd700 1 -- 172.21.15.69:0/413001149 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fc1ec19ff90 con 0x7fc1ec109050 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.021+0000 7fc1e97fa700 1 -- 172.21.15.69:0/413001149 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fc1dc02cbf0 con 0x7fc1ec109050 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.023+0000 7fc1e97fa700 1 -- 172.21.15.69:0/413001149 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7fc1dc01ab40 con 0x7fc1ec109050 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.024+0000 7fc1f22dd700 1 -- 172.21.15.69:0/413001149 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc1d4039670 msgr2=0x7fc1d403bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.024+0000 7fc1f22dd700 1 --2- 172.21.15.69:0/413001149 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc1d4039670 0x7fc1d403bb30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0006fd0 tx=0x7fc1e0006e40 comp rx=0 tx=0).stop 2024-04-23T10:17:52.612 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.024+0000 7fc1f22dd700 1 -- 172.21.15.69:0/413001149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 msgr2=0x7fc1ec19c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:52.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.024+0000 7fc1f22dd700 1 --2- 172.21.15.69:0/413001149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec19c3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc003f90 tx=0x7fc1dc011b70 comp rx=0 tx=0).stop 2024-04-23T10:17:52.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.024+0000 7fc1f22dd700 1 -- 172.21.15.69:0/413001149 shutdown_connections 2024-04-23T10:17:52.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.024+0000 7fc1f22dd700 1 --2- 172.21.15.69:0/413001149 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fc1d4039670 0x7fc1d403bb30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:52.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.024+0000 7fc1f22dd700 1 --2- 172.21.15.69:0/413001149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1ec109050 0x7fc1ec19c3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:52.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.024+0000 7fc1f22dd700 1 -- 172.21.15.69:0/413001149 >> 172.21.15.69:0/413001149 conn(0x7fc1ec102a80 msgr2=0x7fc1ec103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:52.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.024+0000 7fc1f22dd700 1 -- 172.21.15.69:0/413001149 shutdown_connections 2024-04-23T10:17:52.613 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:52.024+0000 7fc1f22dd700 1 -- 172.21.15.69:0/413001149 wait complete. 2024-04-23T10:17:52.728 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:52.389+0000 7faa7cce5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:17:52.728 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:52.490+0000 7faa7cce5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:17:52.988 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:52.809+0000 7faa7cce5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:17:52.988 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:52.901+0000 7faa7cce5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:17:53.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:53 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/413001149' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-23T10:17:53.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:53 smithi069 ceph-mon[29593]: mgrmap e9: x(active, since 19s) 2024-04-23T10:17:53.966 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.090+0000 7fb6ead1c700 1 Processor -- start 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.090+0000 7fb6ead1c700 1 -- start start 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.090+0000 7fb6ead1c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e410b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.090+0000 7fb6ead1c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e407be80 con 0x7fb6e4109030 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.091+0000 7fb6e8ab8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e410b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.091+0000 7fb6e8ab8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e410b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42512/0 (socket says 172.21.15.69:42512) 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.091+0000 7fb6e8ab8700 1 -- 172.21.15.69:0/2960157327 learned_addr learned my addr 172.21.15.69:0/2960157327 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:53.967 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.091+0000 7fb6e8ab8700 1 -- 172.21.15.69:0/2960157327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e410b960 con 0x7fb6e4109030 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.091+0000 7fb6e8ab8700 1 --2- 172.21.15.69:0/2960157327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e410b420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80098a0 tx=0x7fb6d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9124f0fbdd57da server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.091+0000 7fb6e37fe700 1 -- 172.21.15.69:0/2960157327 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d8004160 con 0x7fb6e4109030 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.091+0000 7fb6e37fe700 1 -- 172.21.15.69:0/2960157327 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb6d8004300 con 0x7fb6e4109030 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.091+0000 7fb6e37fe700 1 -- 172.21.15.69:0/2960157327 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d8011af0 con 0x7fb6e4109030 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.092+0000 7fb6ead1c700 1 -- 172.21.15.69:0/2960157327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 msgr2=0x7fb6e410b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.092+0000 7fb6ead1c700 1 --2- 172.21.15.69:0/2960157327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e410b420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80098a0 tx=0x7fb6d8009bb0 comp rx=0 tx=0).stop 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.092+0000 7fb6ead1c700 1 -- 172.21.15.69:0/2960157327 shutdown_connections 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.092+0000 7fb6ead1c700 1 --2- 172.21.15.69:0/2960157327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e410b420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.092+0000 7fb6ead1c700 1 -- 172.21.15.69:0/2960157327 >> 172.21.15.69:0/2960157327 conn(0x7fb6e4102a40 msgr2=0x7fb6e4104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.092+0000 7fb6ead1c700 1 -- 172.21.15.69:0/2960157327 shutdown_connections 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.092+0000 7fb6ead1c700 1 -- 172.21.15.69:0/2960157327 wait complete. 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.093+0000 7fb6ead1c700 1 Processor -- start 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.093+0000 7fb6ead1c700 1 -- start start 2024-04-23T10:17:53.968 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.093+0000 7fb6ead1c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e419c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.093+0000 7fb6ead1c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e410c960 con 0x7fb6e4109030 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.093+0000 7fb6e8ab8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e419c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.093+0000 7fb6e8ab8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e419c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42514/0 (socket says 172.21.15.69:42514) 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.093+0000 7fb6e8ab8700 1 -- 172.21.15.69:0/654150771 learned_addr learned my addr 172.21.15.69:0/654150771 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.093+0000 7fb6e8ab8700 1 -- 172.21.15.69:0/654150771 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e419c910 con 0x7fb6e4109030 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.094+0000 7fb6e8ab8700 1 --2- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e419c3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8003f90 tx=0x7fb6d8011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.094+0000 7fb6e1ffb700 1 -- 172.21.15.69:0/654150771 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d80039e0 con 0x7fb6e4109030 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.094+0000 7fb6e1ffb700 1 -- 172.21.15.69:0/654150771 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb6d8003b80 con 0x7fb6e4109030 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.094+0000 7fb6ead1c700 1 -- 172.21.15.69:0/654150771 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e419cc00 con 0x7fb6e4109030 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.094+0000 7fb6e1ffb700 1 -- 172.21.15.69:0/654150771 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d80196e0 con 0x7fb6e4109030 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.094+0000 7fb6ead1c700 1 -- 172.21.15.69:0/654150771 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e419f890 con 0x7fb6e4109030 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.095+0000 7fb6e1ffb700 1 -- 172.21.15.69:0/654150771 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7fb6d8022020 con 0x7fb6e4109030 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.095+0000 7fb6ead1c700 1 -- 172.21.15.69:0/654150771 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e40640a0 con 0x7fb6e4109030 2024-04-23T10:17:53.969 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.095+0000 7fb6e1ffb700 1 --2- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fb6d40396c0 0x7fb6d403bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.095+0000 7fb6e3fff700 1 -- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fb6d40396c0 msgr2=0x7fb6d403bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3345837257 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.095+0000 7fb6e1ffb700 1 -- 172.21.15.69:0/654150771 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb6d804d870 con 0x7fb6e4109030 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.095+0000 7fb6e3fff700 1 --2- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fb6d40396c0 0x7fb6d403bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.100+0000 7fb6e1ffb700 1 -- 172.21.15.69:0/654150771 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb6d800e260 con 0x7fb6e4109030 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.296+0000 7fb6e3fff700 1 -- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fb6d40396c0 msgr2=0x7fb6d403bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3345837257 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.296+0000 7fb6e3fff700 1 --2- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fb6d40396c0 0x7fb6d403bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.397+0000 7fb6ead1c700 1 -- 172.21.15.69:0/654150771 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb6e419ffa0 con 0x7fb6e4109030 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.397+0000 7fb6e1ffb700 1 -- 172.21.15.69:0/654150771 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fb6d802bbe0 con 0x7fb6e4109030 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.399+0000 7fb6ead1c700 1 -- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fb6d40396c0 msgr2=0x7fb6d403bb80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.399+0000 7fb6ead1c700 1 --2- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fb6d40396c0 0x7fb6d403bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.399+0000 7fb6ead1c700 1 -- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 msgr2=0x7fb6e419c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.399+0000 7fb6ead1c700 1 --2- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e419c3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8003f90 tx=0x7fb6d8011b70 comp rx=0 tx=0).stop 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.399+0000 7fb6ead1c700 1 -- 172.21.15.69:0/654150771 shutdown_connections 2024-04-23T10:17:53.970 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.399+0000 7fb6ead1c700 1 --2- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7fb6d40396c0 0x7fb6d403bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:53.971 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.399+0000 7fb6ead1c700 1 --2- 172.21.15.69:0/654150771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6e4109030 0x7fb6e419c3d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:53.971 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.399+0000 7fb6ead1c700 1 -- 172.21.15.69:0/654150771 >> 172.21.15.69:0/654150771 conn(0x7fb6e4102a40 msgr2=0x7fb6e4103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:53.971 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.400+0000 7fb6ead1c700 1 -- 172.21.15.69:0/654150771 shutdown_connections 2024-04-23T10:17:53.971 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:53.400+0000 7fb6ead1c700 1 -- 172.21.15.69:0/654150771 wait complete. 2024-04-23T10:17:53.971 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for the mgr to restart... 2024-04-23T10:17:53.971 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr epoch 9... 2024-04-23T10:17:54.300 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:54 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/654150771' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-23T10:17:54.300 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:54 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:54.124+0000 7faa7cce5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:17:54.300 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:54 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:54.300+0000 7faa7cce5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:17:54.668 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:54 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:54.478+0000 7faa7cce5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:17:54.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:54 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:54.767+0000 7faa7cce5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:17:54.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:54 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:54.862+0000 7faa7cce5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:17:55.492 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:55 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:55.064+0000 7faa7cce5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:17:55.492 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:55 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:55.260+0000 7faa7cce5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:17:56.242 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:55 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:55.853+0000 7faa7cce5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T10:17:56.573 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:56 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:56.278+0000 7faa7cce5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:17:56.573 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:56 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:56.374+0000 7faa7cce5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:17:56.573 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:56 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:56.574+0000 7faa7cce5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T10:17:57.448 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:57.112+0000 7faa7cce5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:17:57.448 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:57.204+0000 7faa7cce5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:17:57.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:57.448+0000 7faa7cce5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:17:57.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:57.584+0000 7faa7cce5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:17:57.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:57.682+0000 7faa7cce5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:17:58.096 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:57.797+0000 7faa7cce5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:17:58.096 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:58.097+0000 7faa7cce5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:17:58.973 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:58.702+0000 7faa7cce5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:17:58.973 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:17:58.921+0000 7faa7cce5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:17:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: Active manager daemon x restarted 2024-04-23T10:17:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: Activating manager daemon x 2024-04-23T10:17:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: osdmap e3: 0 total, 0 up, 0 in 2024-04-23T10:17:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: mgrmap e10: x(active, starting, since 0.00343387s) 2024-04-23T10:17:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:17:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T10:17:59.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T10:17:59.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T10:17:59.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T10:17:59.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: Manager daemon x is now available 2024-04-23T10:17:59.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:17:59.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T10:18:00.143 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T10:18:00.143 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:17:59 smithi069 ceph-mon[29593]: mgrmap e11: x(active, since 1.00637s) 2024-04-23T10:18:00.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-04-23T10:18:00.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-23T10:18:00.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-23T10:18:00.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-04-23T10:18:00.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.462+0000 7ff4d355f700 1 Processor -- start 2024-04-23T10:18:00.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.463+0000 7ff4d355f700 1 -- start start 2024-04-23T10:18:00.876 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.463+0000 7ff4d355f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc10b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.463+0000 7ff4d355f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc07be60 con 0x7ff4cc109050 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.463+0000 7ff4d12fb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc10b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.463+0000 7ff4d12fb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc10b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42516/0 (socket says 172.21.15.69:42516) 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.463+0000 7ff4d12fb700 1 -- 172.21.15.69:0/2378978670 learned_addr learned my addr 172.21.15.69:0/2378978670 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.463+0000 7ff4d12fb700 1 -- 172.21.15.69:0/2378978670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4cc10b980 con 0x7ff4cc109050 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.464+0000 7ff4d12fb700 1 --2- 172.21.15.69:0/2378978670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc10b440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0098a0 tx=0x7ff4bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed49034af3ce1a36 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.464+0000 7ff4c3fff700 1 -- 172.21.15.69:0/2378978670 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4bc004160 con 0x7ff4cc109050 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.464+0000 7ff4c3fff700 1 -- 172.21.15.69:0/2378978670 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff4bc004300 con 0x7ff4cc109050 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.464+0000 7ff4c3fff700 1 -- 172.21.15.69:0/2378978670 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4bc011af0 con 0x7ff4cc109050 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.465+0000 7ff4d355f700 1 -- 172.21.15.69:0/2378978670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 msgr2=0x7ff4cc10b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.465+0000 7ff4d355f700 1 --2- 172.21.15.69:0/2378978670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc10b440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0098a0 tx=0x7ff4bc009bb0 comp rx=0 tx=0).stop 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.465+0000 7ff4d355f700 1 -- 172.21.15.69:0/2378978670 shutdown_connections 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.465+0000 7ff4d355f700 1 --2- 172.21.15.69:0/2378978670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc10b440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.465+0000 7ff4d355f700 1 -- 172.21.15.69:0/2378978670 >> 172.21.15.69:0/2378978670 conn(0x7ff4cc102a40 msgr2=0x7ff4cc104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:00.877 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.465+0000 7ff4d355f700 1 -- 172.21.15.69:0/2378978670 shutdown_connections 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.465+0000 7ff4d355f700 1 -- 172.21.15.69:0/2378978670 wait complete. 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.466+0000 7ff4d355f700 1 Processor -- start 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.466+0000 7ff4d355f700 1 -- start start 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.466+0000 7ff4d355f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc19c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.466+0000 7ff4d355f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc10c9e0 con 0x7ff4cc109050 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.466+0000 7ff4d12fb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc19c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.466+0000 7ff4d12fb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc19c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42532/0 (socket says 172.21.15.69:42532) 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.466+0000 7ff4d12fb700 1 -- 172.21.15.69:0/276602525 learned_addr learned my addr 172.21.15.69:0/276602525 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.466+0000 7ff4d12fb700 1 -- 172.21.15.69:0/276602525 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4cc19c950 con 0x7ff4cc109050 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.466+0000 7ff4d12fb700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc19c410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0117b0 tx=0x7ff4bc003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.467+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4bc0036a0 con 0x7ff4cc109050 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.467+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff4bc01a430 con 0x7ff4cc109050 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.467+0000 7ff4d355f700 1 -- 172.21.15.69:0/276602525 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4cc19cbe0 con 0x7ff4cc109050 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.467+0000 7ff4d355f700 1 -- 172.21.15.69:0/276602525 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4cc19f8d0 con 0x7ff4cc109050 2024-04-23T10:18:00.878 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.467+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4bc019530 con 0x7ff4cc109050 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.468+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7ff4bc0197e0 con 0x7ff4cc109050 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.468+0000 7ff4c27fc700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 0x7ff4b803bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.468+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 --> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff4b803c240 con 0x7ff4b8039670 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.468+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff4bc04d860 con 0x7ff4cc109050 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.468+0000 7ff4d0afa700 1 -- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 msgr2=0x7ff4b803bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3345837257 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.468+0000 7ff4d0afa700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 0x7ff4b803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.669+0000 7ff4d0afa700 1 -- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 msgr2=0x7ff4b803bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3345837257 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:54.669+0000 7ff4d0afa700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 0x7ff4b803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:55.070+0000 7ff4d0afa700 1 -- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 msgr2=0x7ff4b803bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3345837257 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:55.070+0000 7ff4d0afa700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 0x7ff4b803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:55.871+0000 7ff4d0afa700 1 -- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 msgr2=0x7ff4b803bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3345837257 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:55.871+0000 7ff4d0afa700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 0x7ff4b803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:57.472+0000 7ff4d0afa700 1 -- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 msgr2=0x7ff4b803bb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/3345837257 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:57.472+0000 7ff4d0afa700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 0x7ff4b803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-23T10:18:00.879 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:58.925+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mgrmap(e 10) ==== 46338+0+0 (secure 0 0 0) 0x7ff4bc019b70 con 0x7ff4cc109050 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:58.925+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 msgr2=0x7ff4b803bb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:58.925+0000 7ff4c27fc700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 0x7ff4b803bb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.926+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7ff4bc04f7a0 con 0x7ff4cc109050 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.926+0000 7ff4c27fc700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4b803cfb0 0x7ff4b803f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.927+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff4b803c240 con 0x7ff4b803cfb0 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.928+0000 7ff4d0afa700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4b803cfb0 0x7ff4b803f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.928+0000 7ff4d0afa700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4b803cfb0 0x7ff4b803f3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8003a10 tx=0x7ff4c80092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.929+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7ff4b803c240 con 0x7ff4b803cfb0 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 -- 172.21.15.69:0/276602525 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff4b0002630 con 0x7ff4b803cfb0 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4c27fc700 1 -- 172.21.15.69:0/276602525 <== mgr.14152 v2:172.21.15.69:6800/847729550 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ff4b0002630 con 0x7ff4b803cfb0 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 -- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4b803cfb0 msgr2=0x7ff4b803f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4b803cfb0 0x7ff4b803f3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8003a10 tx=0x7ff4c80092b0 comp rx=0 tx=0).stop 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 -- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 msgr2=0x7ff4cc19c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc19c410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0117b0 tx=0x7ff4bc003eb0 comp rx=0 tx=0).stop 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 -- 172.21.15.69:0/276602525 shutdown_connections 2024-04-23T10:18:00.880 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4b803cfb0 0x7ff4b803f3a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:00.881 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4cc109050 0x7ff4cc19c410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:00.881 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 --2- 172.21.15.69:0/276602525 >> [v2:172.21.15.69:6800/3345837257,v1:172.21.15.69:6801/3345837257] conn(0x7ff4b8039670 0x7ff4b803bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:00.881 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 -- 172.21.15.69:0/276602525 >> 172.21.15.69:0/276602525 conn(0x7ff4cc102a40 msgr2=0x7ff4cc103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:00.881 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 -- 172.21.15.69:0/276602525 shutdown_connections 2024-04-23T10:18:00.881 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:17:59.936+0000 7ff4d355f700 1 -- 172.21.15.69:0/276602525 wait complete. 2024-04-23T10:18:00.881 INFO:teuthology.orchestra.run.smithi069.stdout:mgr epoch 9 is available 2024-04-23T10:18:00.881 INFO:teuthology.orchestra.run.smithi069.stdout:Generating a dashboard self-signed certificate... 2024-04-23T10:18:01.118 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:00 smithi069 ceph-mon[29593]: [23/Apr/2024:10:17:59] ENGINE Bus STARTING 2024-04-23T10:18:01.118 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:00 smithi069 ceph-mon[29593]: [23/Apr/2024:10:17:59] ENGINE Serving on https://172.21.15.69:7150 2024-04-23T10:18:01.118 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:00 smithi069 ceph-mon[29593]: [23/Apr/2024:10:17:59] ENGINE Serving on http://172.21.15.69:8765 2024-04-23T10:18:01.118 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:00 smithi069 ceph-mon[29593]: [23/Apr/2024:10:17:59] ENGINE Bus STARTED 2024-04-23T10:18:01.118 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:00 smithi069 ceph-mon[29593]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-23T10:18:01.118 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:00 smithi069 ceph-mon[29593]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-23T10:18:01.118 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.291+0000 7ffb03964700 1 Processor -- start 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.292+0000 7ffb03964700 1 -- start start 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.292+0000 7ffb03964700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.292+0000 7ffb03964700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc07c8c0 con 0x7ffafc07de40 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.292+0000 7ffb01700700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.292+0000 7ffb01700700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc07c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53926/0 (socket says 172.21.15.69:53926) 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.292+0000 7ffb01700700 1 -- 172.21.15.69:0/3966724200 learned_addr learned my addr 172.21.15.69:0/3966724200 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.292+0000 7ffb01700700 1 -- 172.21.15.69:0/3966724200 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc07ca40 con 0x7ffafc07de40 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.293+0000 7ffb01700700 1 --2- 172.21.15.69:0/3966724200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc07c2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80098a0 tx=0x7ffaf8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709b260a71521a49 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.293+0000 7ffaf3fff700 1 -- 172.21.15.69:0/3966724200 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf8004160 con 0x7ffafc07de40 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.293+0000 7ffaf3fff700 1 -- 172.21.15.69:0/3966724200 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffaf8004300 con 0x7ffafc07de40 2024-04-23T10:18:02.131 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.293+0000 7ffaf3fff700 1 -- 172.21.15.69:0/3966724200 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf8011af0 con 0x7ffafc07de40 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.294+0000 7ffb03964700 1 -- 172.21.15.69:0/3966724200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 msgr2=0x7ffafc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.294+0000 7ffb03964700 1 --2- 172.21.15.69:0/3966724200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc07c2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80098a0 tx=0x7ffaf8009bb0 comp rx=0 tx=0).stop 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.294+0000 7ffb03964700 1 -- 172.21.15.69:0/3966724200 shutdown_connections 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.294+0000 7ffb03964700 1 --2- 172.21.15.69:0/3966724200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc07c2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.294+0000 7ffb03964700 1 -- 172.21.15.69:0/3966724200 >> 172.21.15.69:0/3966724200 conn(0x7ffafc103bb0 msgr2=0x7ffafc105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.294+0000 7ffb03964700 1 -- 172.21.15.69:0/3966724200 shutdown_connections 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.294+0000 7ffb03964700 1 -- 172.21.15.69:0/3966724200 wait complete. 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.295+0000 7ffb03964700 1 Processor -- start 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.295+0000 7ffb03964700 1 -- start start 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.295+0000 7ffb03964700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc19e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.295+0000 7ffb03964700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc10eb90 con 0x7ffafc07de40 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.295+0000 7ffb01700700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc19e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.295+0000 7ffb01700700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc19e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53930/0 (socket says 172.21.15.69:53930) 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.295+0000 7ffb01700700 1 -- 172.21.15.69:0/4102978335 learned_addr learned my addr 172.21.15.69:0/4102978335 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:02.132 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.296+0000 7ffb01700700 1 -- 172.21.15.69:0/4102978335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc19eae0 con 0x7ffafc07de40 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.296+0000 7ffb01700700 1 --2- 172.21.15.69:0/4102978335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc19e5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8003f90 tx=0x7ffaf8011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.296+0000 7ffaf27fc700 1 -- 172.21.15.69:0/4102978335 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf80039e0 con 0x7ffafc07de40 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.296+0000 7ffaf27fc700 1 -- 172.21.15.69:0/4102978335 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffaf8003b80 con 0x7ffafc07de40 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.296+0000 7ffaf27fc700 1 -- 172.21.15.69:0/4102978335 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf80196e0 con 0x7ffafc07de40 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.296+0000 7ffb03964700 1 -- 172.21.15.69:0/4102978335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffafc19ed70 con 0x7ffafc07de40 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.296+0000 7ffb03964700 1 -- 172.21.15.69:0/4102978335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffafc1a1a60 con 0x7ffafc07de40 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.297+0000 7ffb03964700 1 -- 172.21.15.69:0/4102978335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffafc0640a0 con 0x7ffafc07de40 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.297+0000 7ffaf27fc700 1 -- 172.21.15.69:0/4102978335 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7ffaf8022020 con 0x7ffafc07de40 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.297+0000 7ffaf27fc700 1 --2- 172.21.15.69:0/4102978335 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ffae80396c0 0x7ffae803bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.297+0000 7ffaf27fc700 1 -- 172.21.15.69:0/4102978335 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ffaf804dcc0 con 0x7ffafc07de40 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.298+0000 7ffb00eff700 1 --2- 172.21.15.69:0/4102978335 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ffae80396c0 0x7ffae803bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.298+0000 7ffb00eff700 1 --2- 172.21.15.69:0/4102978335 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ffae80396c0 0x7ffae803bb80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffaec006fd0 tx=0x7ffaec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.307+0000 7ffaf27fc700 1 -- 172.21.15.69:0/4102978335 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ffaf8054080 con 0x7ffafc07de40 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.521+0000 7ffb03964700 1 -- 172.21.15.69:0/4102978335 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7ffafc104cc0 con 0x7ffae80396c0 2024-04-23T10:18:02.133 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.573+0000 7ffaf27fc700 1 -- 172.21.15.69:0/4102978335 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7ffafc104cc0 con 0x7ffae80396c0 2024-04-23T10:18:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.575+0000 7ffb03964700 1 -- 172.21.15.69:0/4102978335 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ffae80396c0 msgr2=0x7ffae803bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.575+0000 7ffb03964700 1 --2- 172.21.15.69:0/4102978335 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ffae80396c0 0x7ffae803bb80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffaec006fd0 tx=0x7ffaec006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.575+0000 7ffb03964700 1 -- 172.21.15.69:0/4102978335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 msgr2=0x7ffafc19e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.575+0000 7ffb03964700 1 --2- 172.21.15.69:0/4102978335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc19e5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8003f90 tx=0x7ffaf8011b70 comp rx=0 tx=0).stop 2024-04-23T10:18:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.575+0000 7ffb03964700 1 -- 172.21.15.69:0/4102978335 shutdown_connections 2024-04-23T10:18:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.575+0000 7ffb03964700 1 --2- 172.21.15.69:0/4102978335 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ffae80396c0 0x7ffae803bb80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.575+0000 7ffb03964700 1 --2- 172.21.15.69:0/4102978335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffafc07de40 0x7ffafc19e5a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.575+0000 7ffb03964700 1 -- 172.21.15.69:0/4102978335 >> 172.21.15.69:0/4102978335 conn(0x7ffafc103bb0 msgr2=0x7ffafc1045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.575+0000 7ffb03964700 1 -- 172.21.15.69:0/4102978335 shutdown_connections 2024-04-23T10:18:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:01.575+0000 7ffb03964700 1 -- 172.21.15.69:0/4102978335 wait complete. 2024-04-23T10:18:02.134 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial admin user... 2024-04-23T10:18:02.543 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:02 smithi069 ceph-mon[29593]: mgrmap e12: x(active, since 2s) 2024-04-23T10:18:02.543 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:02 smithi069 ceph-mon[29593]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:18:02.543 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:02 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:02.543 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:02 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:02.543 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:02 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:03.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$xr5SroMJ75peR8uEh7k1XeQ8EE0ui9MEL39OhJKsgHLS3x1h78g4e", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1713867483, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-23T10:18:03.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.570+0000 7feb6444a700 1 Processor -- start 2024-04-23T10:18:03.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.570+0000 7feb6444a700 1 -- start start 2024-04-23T10:18:03.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.571+0000 7feb6444a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c106cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:03.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.571+0000 7feb6444a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c1072c0 con 0x7feb5c1068d0 2024-04-23T10:18:03.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.571+0000 7feb621e6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c106cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:03.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.571+0000 7feb621e6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c106cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53946/0 (socket says 172.21.15.69:53946) 2024-04-23T10:18:03.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.571+0000 7feb621e6700 1 -- 172.21.15.69:0/2481159613 learned_addr learned my addr 172.21.15.69:0/2481159613 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:03.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.571+0000 7feb621e6700 1 -- 172.21.15.69:0/2481159613 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c109900 con 0x7feb5c1068d0 2024-04-23T10:18:03.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.571+0000 7feb621e6700 1 --2- 172.21.15.69:0/2481159613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c106cf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0098a0 tx=0x7feb4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc3edff33700db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.572+0000 7feb611e4700 1 -- 172.21.15.69:0/2481159613 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4c004160 con 0x7feb5c1068d0 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.572+0000 7feb611e4700 1 -- 172.21.15.69:0/2481159613 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feb4c004300 con 0x7feb5c1068d0 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.572+0000 7feb611e4700 1 -- 172.21.15.69:0/2481159613 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4c011af0 con 0x7feb5c1068d0 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.572+0000 7feb6444a700 1 -- 172.21.15.69:0/2481159613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 msgr2=0x7feb5c106cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.572+0000 7feb6444a700 1 --2- 172.21.15.69:0/2481159613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c106cf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0098a0 tx=0x7feb4c009bb0 comp rx=0 tx=0).stop 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.572+0000 7feb6444a700 1 -- 172.21.15.69:0/2481159613 shutdown_connections 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.572+0000 7feb6444a700 1 --2- 172.21.15.69:0/2481159613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c106cf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.572+0000 7feb6444a700 1 -- 172.21.15.69:0/2481159613 >> 172.21.15.69:0/2481159613 conn(0x7feb5c102240 msgr2=0x7feb5c104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.572+0000 7feb6444a700 1 -- 172.21.15.69:0/2481159613 shutdown_connections 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.572+0000 7feb6444a700 1 -- 172.21.15.69:0/2481159613 wait complete. 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.573+0000 7feb6444a700 1 Processor -- start 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.573+0000 7feb6444a700 1 -- start start 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.573+0000 7feb6444a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.573+0000 7feb6444a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c10cb30 con 0x7feb5c1068d0 2024-04-23T10:18:03.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.573+0000 7feb621e6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.573+0000 7feb621e6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53950/0 (socket says 172.21.15.69:53950) 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.573+0000 7feb621e6700 1 -- 172.21.15.69:0/3447029822 learned_addr learned my addr 172.21.15.69:0/3447029822 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.574+0000 7feb621e6700 1 -- 172.21.15.69:0/3447029822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c1096c0 con 0x7feb5c1068d0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.574+0000 7feb621e6700 1 --2- 172.21.15.69:0/3447029822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c109180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009520 tx=0x7feb4c003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.574+0000 7feb537fe700 1 -- 172.21.15.69:0/3447029822 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4c0036a0 con 0x7feb5c1068d0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.574+0000 7feb537fe700 1 -- 172.21.15.69:0/3447029822 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feb4c01a430 con 0x7feb5c1068d0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.574+0000 7feb6444a700 1 -- 172.21.15.69:0/3447029822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5c1078b0 con 0x7feb5c1068d0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.574+0000 7feb537fe700 1 -- 172.21.15.69:0/3447029822 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4c0193c0 con 0x7feb5c1068d0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.574+0000 7feb6444a700 1 -- 172.21.15.69:0/3447029822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5c107df0 con 0x7feb5c1068d0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.575+0000 7feb537fe700 1 -- 172.21.15.69:0/3447029822 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7feb4c019670 con 0x7feb5c1068d0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.575+0000 7feb537fe700 1 --2- 172.21.15.69:0/3447029822 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb48039670 0x7feb4803bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.575+0000 7feb6444a700 1 -- 172.21.15.69:0/3447029822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5c0640a0 con 0x7feb5c1068d0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.575+0000 7feb537fe700 1 -- 172.21.15.69:0/3447029822 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7feb4c04d960 con 0x7feb5c1068d0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.575+0000 7feb619e5700 1 --2- 172.21.15.69:0/3447029822 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb48039670 0x7feb4803bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.575+0000 7feb619e5700 1 --2- 172.21.15.69:0/3447029822 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb48039670 0x7feb4803bb30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb58006fd0 tx=0x7feb58006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:03.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.580+0000 7feb537fe700 1 -- 172.21.15.69:0/3447029822 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feb4c020240 con 0x7feb5c1068d0 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:02.808+0000 7feb6444a700 1 -- 172.21.15.69:0/3447029822 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7feb5c108070 con 0x7feb48039670 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:03.033+0000 7feb537fe700 1 -- 172.21.15.69:0/3447029822 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7feb5c108070 con 0x7feb48039670 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:03.035+0000 7feb6444a700 1 -- 172.21.15.69:0/3447029822 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb48039670 msgr2=0x7feb4803bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:03.035+0000 7feb6444a700 1 --2- 172.21.15.69:0/3447029822 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb48039670 0x7feb4803bb30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb58006fd0 tx=0x7feb58006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:03.035+0000 7feb6444a700 1 -- 172.21.15.69:0/3447029822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 msgr2=0x7feb5c109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:03.035+0000 7feb6444a700 1 --2- 172.21.15.69:0/3447029822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c109180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009520 tx=0x7feb4c003eb0 comp rx=0 tx=0).stop 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:03.035+0000 7feb6444a700 1 -- 172.21.15.69:0/3447029822 shutdown_connections 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:03.035+0000 7feb6444a700 1 --2- 172.21.15.69:0/3447029822 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb48039670 0x7feb4803bb30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:03.035+0000 7feb6444a700 1 --2- 172.21.15.69:0/3447029822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb5c1068d0 0x7feb5c109180 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:03.035+0000 7feb6444a700 1 -- 172.21.15.69:0/3447029822 >> 172.21.15.69:0/3447029822 conn(0x7feb5c102240 msgr2=0x7feb5c102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:03.036+0000 7feb6444a700 1 -- 172.21.15.69:0/3447029822 shutdown_connections 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:03.036+0000 7feb6444a700 1 -- 172.21.15.69:0/3447029822 wait complete. 2024-04-23T10:18:03.678 INFO:teuthology.orchestra.run.smithi069.stdout:Fetching dashboard port number... 2024-04-23T10:18:04.297 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:04 smithi069 ceph-mon[29593]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:18:04.297 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:05.167 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:05 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1043844402' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-23T10:18:05.174 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 8443 2024-04-23T10:18:05.174 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.097+0000 7fd2f6f95700 1 Processor -- start 2024-04-23T10:18:05.174 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.097+0000 7fd2f6f95700 1 -- start start 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.097+0000 7fd2f6f95700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f010b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.097+0000 7fd2f6f95700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f007be60 con 0x7fd2f01090c0 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.098+0000 7fd2f4d31700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f010b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.098+0000 7fd2f4d31700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f010b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53958/0 (socket says 172.21.15.69:53958) 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.098+0000 7fd2f4d31700 1 -- 172.21.15.69:0/423793892 learned_addr learned my addr 172.21.15.69:0/423793892 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.098+0000 7fd2f4d31700 1 -- 172.21.15.69:0/423793892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f010b9f0 con 0x7fd2f01090c0 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.098+0000 7fd2f4d31700 1 --2- 172.21.15.69:0/423793892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f010b4b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40098a0 tx=0x7fd2e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab69ace32006dfa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.098+0000 7fd2ef7fe700 1 -- 172.21.15.69:0/423793892 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2e4004160 con 0x7fd2f01090c0 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.098+0000 7fd2ef7fe700 1 -- 172.21.15.69:0/423793892 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd2e4004300 con 0x7fd2f01090c0 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.098+0000 7fd2ef7fe700 1 -- 172.21.15.69:0/423793892 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2e4011af0 con 0x7fd2f01090c0 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.099+0000 7fd2f6f95700 1 -- 172.21.15.69:0/423793892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 msgr2=0x7fd2f010b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.099+0000 7fd2f6f95700 1 --2- 172.21.15.69:0/423793892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f010b4b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40098a0 tx=0x7fd2e4009bb0 comp rx=0 tx=0).stop 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.099+0000 7fd2f6f95700 1 -- 172.21.15.69:0/423793892 shutdown_connections 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.099+0000 7fd2f6f95700 1 --2- 172.21.15.69:0/423793892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f010b4b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:05.175 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.099+0000 7fd2f6f95700 1 -- 172.21.15.69:0/423793892 >> 172.21.15.69:0/423793892 conn(0x7fd2f0102ad0 msgr2=0x7fd2f0104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.099+0000 7fd2f6f95700 1 -- 172.21.15.69:0/423793892 shutdown_connections 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.099+0000 7fd2f6f95700 1 -- 172.21.15.69:0/423793892 wait complete. 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.099+0000 7fd2f6f95700 1 Processor -- start 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.099+0000 7fd2f6f95700 1 -- start start 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.100+0000 7fd2f6f95700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f019e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.100+0000 7fd2f6f95700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f010ca50 con 0x7fd2f01090c0 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.100+0000 7fd2f4d31700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f019e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.100+0000 7fd2f4d31700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f019e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53964/0 (socket says 172.21.15.69:53964) 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.100+0000 7fd2f4d31700 1 -- 172.21.15.69:0/1043844402 learned_addr learned my addr 172.21.15.69:0/1043844402 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.100+0000 7fd2f4d31700 1 -- 172.21.15.69:0/1043844402 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f019eb70 con 0x7fd2f01090c0 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.100+0000 7fd2f4d31700 1 --2- 172.21.15.69:0/1043844402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f019e630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40117b0 tx=0x7fd2e4003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.100+0000 7fd2edffb700 1 -- 172.21.15.69:0/1043844402 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2e40036a0 con 0x7fd2f01090c0 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.100+0000 7fd2f6f95700 1 -- 172.21.15.69:0/1043844402 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f019ee00 con 0x7fd2f01090c0 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.100+0000 7fd2edffb700 1 -- 172.21.15.69:0/1043844402 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd2e401a430 con 0x7fd2f01090c0 2024-04-23T10:18:05.176 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.100+0000 7fd2edffb700 1 -- 172.21.15.69:0/1043844402 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2e4019530 con 0x7fd2f01090c0 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.101+0000 7fd2f6f95700 1 -- 172.21.15.69:0/1043844402 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f01a1af0 con 0x7fd2f01090c0 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.101+0000 7fd2edffb700 1 -- 172.21.15.69:0/1043844402 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7fd2e40197e0 con 0x7fd2f01090c0 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.102+0000 7fd2edffb700 1 --2- 172.21.15.69:0/1043844402 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd2e0039670 0x7fd2e003bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.102+0000 7fd2edffb700 1 -- 172.21.15.69:0/1043844402 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd2e404d9c0 con 0x7fd2f01090c0 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.102+0000 7fd2f6f95700 1 -- 172.21.15.69:0/1043844402 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f00640a0 con 0x7fd2f01090c0 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.102+0000 7fd2effff700 1 --2- 172.21.15.69:0/1043844402 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd2e0039670 0x7fd2e003bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.102+0000 7fd2effff700 1 --2- 172.21.15.69:0/1043844402 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd2e0039670 0x7fd2e003bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc006fd0 tx=0x7fd2dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.107+0000 7fd2edffb700 1 -- 172.21.15.69:0/1043844402 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd2e400bc70 con 0x7fd2f01090c0 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.317+0000 7fd2f6f95700 1 -- 172.21.15.69:0/1043844402 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fd2f01a1cc0 con 0x7fd2f01090c0 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.318+0000 7fd2edffb700 1 -- 172.21.15.69:0/1043844402 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fd2e400fda0 con 0x7fd2f01090c0 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.320+0000 7fd2f6f95700 1 -- 172.21.15.69:0/1043844402 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd2e0039670 msgr2=0x7fd2e003bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.320+0000 7fd2f6f95700 1 --2- 172.21.15.69:0/1043844402 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd2e0039670 0x7fd2e003bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc006fd0 tx=0x7fd2dc006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.320+0000 7fd2f6f95700 1 -- 172.21.15.69:0/1043844402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 msgr2=0x7fd2f019e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.320+0000 7fd2f6f95700 1 --2- 172.21.15.69:0/1043844402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f019e630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40117b0 tx=0x7fd2e4003eb0 comp rx=0 tx=0).stop 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.320+0000 7fd2f6f95700 1 -- 172.21.15.69:0/1043844402 shutdown_connections 2024-04-23T10:18:05.177 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.320+0000 7fd2f6f95700 1 --2- 172.21.15.69:0/1043844402 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd2e0039670 0x7fd2e003bb30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:05.178 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.320+0000 7fd2f6f95700 1 --2- 172.21.15.69:0/1043844402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2f01090c0 0x7fd2f019e630 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:05.178 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.320+0000 7fd2f6f95700 1 -- 172.21.15.69:0/1043844402 >> 172.21.15.69:0/1043844402 conn(0x7fd2f0102ad0 msgr2=0x7fd2f0106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:05.178 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.320+0000 7fd2f6f95700 1 -- 172.21.15.69:0/1043844402 shutdown_connections 2024-04-23T10:18:05.178 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:04.320+0000 7fd2f6f95700 1 -- 172.21.15.69:0/1043844402 wait complete. 2024-04-23T10:18:05.182 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-23T10:18:05.183 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2024-04-23T10:18:05.190 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-23T10:18:05.190 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-04-23T10:18:05.190 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2024-04-23T10:18:05.190 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-23T10:18:05.191 INFO:teuthology.orchestra.run.smithi069.stdout:Ceph Dashboard is now available at: 2024-04-23T10:18:05.191 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:05.192 INFO:teuthology.orchestra.run.smithi069.stdout: URL: https://smithi069:8443/ 2024-04-23T10:18:05.192 INFO:teuthology.orchestra.run.smithi069.stdout: User: admin 2024-04-23T10:18:05.192 INFO:teuthology.orchestra.run.smithi069.stdout: Password: fau9p8hqny 2024-04-23T10:18:05.192 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:05.192 INFO:teuthology.orchestra.run.smithi069.stdout:Saving cluster configuration to /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config directory 2024-04-23T10:18:05.192 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling autotune for osd_memory_target 2024-04-23T10:18:06.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:06 smithi069 ceph-mon[29593]: mgrmap e13: x(active, since 6s) 2024-04-23T10:18:06.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.602+0000 7f1d38c2b700 1 Processor -- start 2024-04-23T10:18:06.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.602+0000 7f1d38c2b700 1 -- start start 2024-04-23T10:18:06.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.602+0000 7f1d38c2b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3410b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:06.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.602+0000 7f1d38c2b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3407bde0 con 0x7f1d341090f0 2024-04-23T10:18:06.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.603+0000 7f1d3259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3410b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:06.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.603+0000 7f1d3259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3410b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53976/0 (socket says 172.21.15.69:53976) 2024-04-23T10:18:06.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.603+0000 7f1d3259c700 1 -- 172.21.15.69:0/3575349638 learned_addr learned my addr 172.21.15.69:0/3575349638 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:06.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.603+0000 7f1d3259c700 1 -- 172.21.15.69:0/3575349638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3410ba20 con 0x7f1d341090f0 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.603+0000 7f1d3259c700 1 --2- 172.21.15.69:0/3575349638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3410b4e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d240098a0 tx=0x7f1d24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c98dc2ddcdc8477 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.603+0000 7f1d31d9b700 1 -- 172.21.15.69:0/3575349638 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d24004160 con 0x7f1d341090f0 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.603+0000 7f1d31d9b700 1 -- 172.21.15.69:0/3575349638 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d24004300 con 0x7f1d341090f0 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.603+0000 7f1d31d9b700 1 -- 172.21.15.69:0/3575349638 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d24011af0 con 0x7f1d341090f0 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.604+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3575349638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 msgr2=0x7f1d3410b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.604+0000 7f1d38c2b700 1 --2- 172.21.15.69:0/3575349638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3410b4e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d240098a0 tx=0x7f1d24009bb0 comp rx=0 tx=0).stop 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.604+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3575349638 shutdown_connections 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.604+0000 7f1d38c2b700 1 --2- 172.21.15.69:0/3575349638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3410b4e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.604+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3575349638 >> 172.21.15.69:0/3575349638 conn(0x7f1d34102ac0 msgr2=0x7f1d34104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.604+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3575349638 shutdown_connections 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.604+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3575349638 wait complete. 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.605+0000 7f1d38c2b700 1 Processor -- start 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.605+0000 7f1d38c2b700 1 -- start start 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.605+0000 7f1d38c2b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3419c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:06.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.605+0000 7f1d38c2b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3410c9d0 con 0x7f1d341090f0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.605+0000 7f1d3259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3419c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.605+0000 7f1d3259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3419c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53988/0 (socket says 172.21.15.69:53988) 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.605+0000 7f1d3259c700 1 -- 172.21.15.69:0/3067359818 learned_addr learned my addr 172.21.15.69:0/3067359818 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.605+0000 7f1d3259c700 1 -- 172.21.15.69:0/3067359818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3419c960 con 0x7f1d341090f0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.605+0000 7f1d3259c700 1 --2- 172.21.15.69:0/3067359818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3419c420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1d240117b0 tx=0x7f1d24003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.606+0000 7f1d2bfff700 1 -- 172.21.15.69:0/3067359818 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d240036a0 con 0x7f1d341090f0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.606+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3067359818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3419cbf0 con 0x7f1d341090f0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.606+0000 7f1d2bfff700 1 -- 172.21.15.69:0/3067359818 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d2401a430 con 0x7f1d341090f0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.606+0000 7f1d2bfff700 1 -- 172.21.15.69:0/3067359818 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d24019530 con 0x7f1d341090f0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.606+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3067359818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3419f8e0 con 0x7f1d341090f0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.606+0000 7f1d2bfff700 1 -- 172.21.15.69:0/3067359818 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f1d240197e0 con 0x7f1d341090f0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.607+0000 7f1d2bfff700 1 --2- 172.21.15.69:0/3067359818 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1d20039710 0x7f1d2003bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.607+0000 7f1d2bfff700 1 -- 172.21.15.69:0/3067359818 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1d2401aa60 con 0x7f1d341090f0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.607+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3067359818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d340640a0 con 0x7f1d341090f0 2024-04-23T10:18:06.341 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.607+0000 7f1d29d9b700 1 --2- 172.21.15.69:0/3067359818 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1d20039710 0x7f1d2003bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.607+0000 7f1d29d9b700 1 --2- 172.21.15.69:0/3067359818 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1d20039710 0x7f1d2003bbd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c006fd0 tx=0x7f1d1c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.612+0000 7f1d2bfff700 1 -- 172.21.15.69:0/3067359818 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1d24020240 con 0x7f1d341090f0 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.807+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3067359818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f1d3419fab0 con 0x7f1d341090f0 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.807+0000 7f1d2bfff700 1 -- 172.21.15.69:0/3067359818 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f1d24032020 con 0x7f1d341090f0 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.810+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3067359818 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1d20039710 msgr2=0x7f1d2003bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.810+0000 7f1d38c2b700 1 --2- 172.21.15.69:0/3067359818 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1d20039710 0x7f1d2003bbd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c006fd0 tx=0x7f1d1c006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.810+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3067359818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 msgr2=0x7f1d3419c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.810+0000 7f1d38c2b700 1 --2- 172.21.15.69:0/3067359818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3419c420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1d240117b0 tx=0x7f1d24003eb0 comp rx=0 tx=0).stop 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.810+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3067359818 shutdown_connections 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.810+0000 7f1d38c2b700 1 --2- 172.21.15.69:0/3067359818 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1d20039710 0x7f1d2003bbd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.810+0000 7f1d38c2b700 1 --2- 172.21.15.69:0/3067359818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d341090f0 0x7f1d3419c420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.810+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3067359818 >> 172.21.15.69:0/3067359818 conn(0x7f1d34102ac0 msgr2=0x7f1d34103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.811+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3067359818 shutdown_connections 2024-04-23T10:18:06.342 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:05.811+0000 7f1d38c2b700 1 -- 172.21.15.69:0/3067359818 wait complete. 2024-04-23T10:18:07.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.753+0000 7f48c9820700 1 Processor -- start 2024-04-23T10:18:07.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.753+0000 7f48c9820700 1 -- start start 2024-04-23T10:18:07.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.753+0000 7f48c9820700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c41078e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:07.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.753+0000 7f48c9820700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f48c4107eb0 con 0x7f48c41074c0 2024-04-23T10:18:07.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.753+0000 7f48c2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c41078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:07.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.753+0000 7f48c2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c41078e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54000/0 (socket says 172.21.15.69:54000) 2024-04-23T10:18:07.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.753+0000 7f48c2ffd700 1 -- 172.21.15.69:0/1143712234 learned_addr learned my addr 172.21.15.69:0/1143712234 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:07.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.753+0000 7f48c2ffd700 1 -- 172.21.15.69:0/1143712234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c41086c0 con 0x7f48c41074c0 2024-04-23T10:18:07.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.753+0000 7f48c2ffd700 1 --2- 172.21.15.69:0/1143712234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c41078e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f48b40098a0 tx=0x7f48b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0abfb6853608c3e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:07.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.754+0000 7f48c1ffb700 1 -- 172.21.15.69:0/1143712234 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b4004160 con 0x7f48c41074c0 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.754+0000 7f48c1ffb700 1 -- 172.21.15.69:0/1143712234 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f48b4004300 con 0x7f48c41074c0 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.754+0000 7f48c1ffb700 1 -- 172.21.15.69:0/1143712234 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b4011af0 con 0x7f48c41074c0 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.754+0000 7f48c9820700 1 -- 172.21.15.69:0/1143712234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 msgr2=0x7f48c41078e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.754+0000 7f48c9820700 1 --2- 172.21.15.69:0/1143712234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c41078e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f48b40098a0 tx=0x7f48b4009bb0 comp rx=0 tx=0).stop 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.754+0000 7f48c9820700 1 -- 172.21.15.69:0/1143712234 shutdown_connections 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.754+0000 7f48c9820700 1 --2- 172.21.15.69:0/1143712234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c41078e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.754+0000 7f48c9820700 1 -- 172.21.15.69:0/1143712234 >> 172.21.15.69:0/1143712234 conn(0x7f48c4102ac0 msgr2=0x7f48c4104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.754+0000 7f48c9820700 1 -- 172.21.15.69:0/1143712234 shutdown_connections 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.754+0000 7f48c9820700 1 -- 172.21.15.69:0/1143712234 wait complete. 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.755+0000 7f48c9820700 1 Processor -- start 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.755+0000 7f48c9820700 1 -- start start 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.755+0000 7f48c9820700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:07.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.755+0000 7f48c9820700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f48c410ba70 con 0x7f48c41074c0 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.755+0000 7f48c2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.755+0000 7f48c2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54016/0 (socket says 172.21.15.69:54016) 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.755+0000 7f48c2ffd700 1 -- 172.21.15.69:0/2726280607 learned_addr learned my addr 172.21.15.69:0/2726280607 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.756+0000 7f48c2ffd700 1 -- 172.21.15.69:0/2726280607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c419b890 con 0x7f48c41074c0 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.756+0000 7f48c2ffd700 1 --2- 172.21.15.69:0/2726280607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c419b350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48b4003f90 tx=0x7f48b4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.756+0000 7f48c881e700 1 -- 172.21.15.69:0/2726280607 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b40039e0 con 0x7f48c41074c0 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.756+0000 7f48c881e700 1 -- 172.21.15.69:0/2726280607 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f48b4003b80 con 0x7f48c41074c0 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.756+0000 7f48c9820700 1 -- 172.21.15.69:0/2726280607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c419bb20 con 0x7f48c41074c0 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.756+0000 7f48c881e700 1 -- 172.21.15.69:0/2726280607 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b40196e0 con 0x7f48c41074c0 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.756+0000 7f48c9820700 1 -- 172.21.15.69:0/2726280607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c419e810 con 0x7f48c41074c0 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.757+0000 7f48c881e700 1 -- 172.21.15.69:0/2726280607 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f48b4022020 con 0x7f48c41074c0 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.757+0000 7f48c881e700 1 --2- 172.21.15.69:0/2726280607 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f48ac0397c0 0x7f48ac03bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:07.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.757+0000 7f48c9820700 1 -- 172.21.15.69:0/2726280607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c40640a0 con 0x7f48c41074c0 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.757+0000 7f48c881e700 1 -- 172.21.15.69:0/2726280607 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f48b404da10 con 0x7f48c41074c0 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.757+0000 7f48c27fc700 1 --2- 172.21.15.69:0/2726280607 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f48ac0397c0 0x7f48ac03bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.757+0000 7f48c27fc700 1 --2- 172.21.15.69:0/2726280607 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f48ac0397c0 0x7f48ac03bc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f48b8006fd0 tx=0x7f48b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:06.762+0000 7f48c881e700 1 -- 172.21.15.69:0/2726280607 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f48b401a430 con 0x7f48c41074c0 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.074+0000 7f48c9820700 1 -- 172.21.15.69:0/2726280607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f48c419e9e0 con 0x7f48c41074c0 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.077+0000 7f48c881e700 1 -- 172.21.15.69:0/2726280607 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f48c419e9e0 con 0x7f48c41074c0 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.079+0000 7f48c9820700 1 -- 172.21.15.69:0/2726280607 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f48ac0397c0 msgr2=0x7f48ac03bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.079+0000 7f48c9820700 1 --2- 172.21.15.69:0/2726280607 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f48ac0397c0 0x7f48ac03bc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f48b8006fd0 tx=0x7f48b8006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.079+0000 7f48c9820700 1 -- 172.21.15.69:0/2726280607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 msgr2=0x7f48c419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.079+0000 7f48c9820700 1 --2- 172.21.15.69:0/2726280607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c419b350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48b4003f90 tx=0x7f48b4011b70 comp rx=0 tx=0).stop 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.079+0000 7f48c9820700 1 -- 172.21.15.69:0/2726280607 shutdown_connections 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.079+0000 7f48c9820700 1 --2- 172.21.15.69:0/2726280607 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f48ac0397c0 0x7f48ac03bc80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:07.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.079+0000 7f48c9820700 1 --2- 172.21.15.69:0/2726280607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48c41074c0 0x7f48c419b350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.079+0000 7f48c9820700 1 -- 172.21.15.69:0/2726280607 >> 172.21.15.69:0/2726280607 conn(0x7f48c4102ac0 msgr2=0x7f48c41034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.079+0000 7f48c9820700 1 -- 172.21.15.69:0/2726280607 shutdown_connections 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-04-23T10:18:07.079+0000 7f48c9820700 1 -- 172.21.15.69:0/2726280607 wait complete. 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout:Or, if you are only running a single cluster on this host: 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-23T10:18:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: ceph telemetry on 2024-04-23T10:18:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:07.593 INFO:teuthology.orchestra.run.smithi069.stdout:For more information see: 2024-04-23T10:18:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-23T10:18:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:07.593 INFO:teuthology.orchestra.run.smithi069.stdout:Bootstrap complete. 2024-04-23T10:18:07.622 INFO:tasks.cephadm:Fetching config... 2024-04-23T10:18:07.623 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:18:07.623 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-23T10:18:07.638 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-23T10:18:07.638 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:18:07.638 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-23T10:18:07.694 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-23T10:18:07.694 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:18:07.694 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-23T10:18:07.757 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-23T10:18:07.757 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:18:07.757 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-23T10:18:07.813 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-23T10:18:07.813 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCkOWn4cq3FZF06QayCItqAjf4drkMcHyNC6oSLwCE4Htu4K+7lHBfwDsBgOKrwlCDeWXg+4ZRV2ZP6202FAf5+gonUMrvHlpRkxGHQXRtkJwQxnz+8PUD7nD0K5jVyt+kfoxMkAMm0wfMaYuiZ5OQkagaGGnegN5co27/LlO5jdtMYID/V8+BrAVEXfp6maJh9Ah76qtoogG8s8IzSO04G8mLVe9FxK55Z5y1tdcv2sdC4iFb5Px0ryLnC+CJHA62QX/bif3PExTdAZ5i4dEpTt5VlZQolCv2D+MmEIigigrod2QvqTRYg9zfJf6iG45vRHrtuGWgzIgpXD3rFNi9MtwgYeRrbK+guVVSnR9+kULYi8e9iTyuFp6kMxovO+VncYtwGdtriqtSGv24Ceht7UdEj4aqtxURENLx68XiHF5yFGEIPXbPH5WPBQDog2dBcQB4XqhcSD0r+bqp5cozpd30JKUJaB169i/fACVxsePB3PYWCjc2xulSU1fSNh0= ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-23T10:18:07.885 INFO:teuthology.orchestra.run.smithi069.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCkOWn4cq3FZF06QayCItqAjf4drkMcHyNC6oSLwCE4Htu4K+7lHBfwDsBgOKrwlCDeWXg+4ZRV2ZP6202FAf5+gonUMrvHlpRkxGHQXRtkJwQxnz+8PUD7nD0K5jVyt+kfoxMkAMm0wfMaYuiZ5OQkagaGGnegN5co27/LlO5jdtMYID/V8+BrAVEXfp6maJh9Ah76qtoogG8s8IzSO04G8mLVe9FxK55Z5y1tdcv2sdC4iFb5Px0ryLnC+CJHA62QX/bif3PExTdAZ5i4dEpTt5VlZQolCv2D+MmEIigigrod2QvqTRYg9zfJf6iG45vRHrtuGWgzIgpXD3rFNi9MtwgYeRrbK+guVVSnR9+kULYi8e9iTyuFp6kMxovO+VncYtwGdtriqtSGv24Ceht7UdEj4aqtxURENLx68XiHF5yFGEIPXbPH5WPBQDog2dBcQB4XqhcSD0r+bqp5cozpd30JKUJaB169i/fACVxsePB3PYWCjc2xulSU1fSNh0= ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:07.896 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCkOWn4cq3FZF06QayCItqAjf4drkMcHyNC6oSLwCE4Htu4K+7lHBfwDsBgOKrwlCDeWXg+4ZRV2ZP6202FAf5+gonUMrvHlpRkxGHQXRtkJwQxnz+8PUD7nD0K5jVyt+kfoxMkAMm0wfMaYuiZ5OQkagaGGnegN5co27/LlO5jdtMYID/V8+BrAVEXfp6maJh9Ah76qtoogG8s8IzSO04G8mLVe9FxK55Z5y1tdcv2sdC4iFb5Px0ryLnC+CJHA62QX/bif3PExTdAZ5i4dEpTt5VlZQolCv2D+MmEIigigrod2QvqTRYg9zfJf6iG45vRHrtuGWgzIgpXD3rFNi9MtwgYeRrbK+guVVSnR9+kULYi8e9iTyuFp6kMxovO+VncYtwGdtriqtSGv24Ceht7UdEj4aqtxURENLx68XiHF5yFGEIPXbPH5WPBQDog2dBcQB4XqhcSD0r+bqp5cozpd30JKUJaB169i/fACVxsePB3PYWCjc2xulSU1fSNh0= ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-23T10:18:07.936 INFO:teuthology.orchestra.run.smithi146.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCkOWn4cq3FZF06QayCItqAjf4drkMcHyNC6oSLwCE4Htu4K+7lHBfwDsBgOKrwlCDeWXg+4ZRV2ZP6202FAf5+gonUMrvHlpRkxGHQXRtkJwQxnz+8PUD7nD0K5jVyt+kfoxMkAMm0wfMaYuiZ5OQkagaGGnegN5co27/LlO5jdtMYID/V8+BrAVEXfp6maJh9Ah76qtoogG8s8IzSO04G8mLVe9FxK55Z5y1tdcv2sdC4iFb5Px0ryLnC+CJHA62QX/bif3PExTdAZ5i4dEpTt5VlZQolCv2D+MmEIigigrod2QvqTRYg9zfJf6iG45vRHrtuGWgzIgpXD3rFNi9MtwgYeRrbK+guVVSnR9+kULYi8e9iTyuFp6kMxovO+VncYtwGdtriqtSGv24Ceht7UdEj4aqtxURENLx68XiHF5yFGEIPXbPH5WPBQDog2dBcQB4XqhcSD0r+bqp5cozpd30JKUJaB169i/fACVxsePB3PYWCjc2xulSU1fSNh0= ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:07.948 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCkOWn4cq3FZF06QayCItqAjf4drkMcHyNC6oSLwCE4Htu4K+7lHBfwDsBgOKrwlCDeWXg+4ZRV2ZP6202FAf5+gonUMrvHlpRkxGHQXRtkJwQxnz+8PUD7nD0K5jVyt+kfoxMkAMm0wfMaYuiZ5OQkagaGGnegN5co27/LlO5jdtMYID/V8+BrAVEXfp6maJh9Ah76qtoogG8s8IzSO04G8mLVe9FxK55Z5y1tdcv2sdC4iFb5Px0ryLnC+CJHA62QX/bif3PExTdAZ5i4dEpTt5VlZQolCv2D+MmEIigigrod2QvqTRYg9zfJf6iG45vRHrtuGWgzIgpXD3rFNi9MtwgYeRrbK+guVVSnR9+kULYi8e9iTyuFp6kMxovO+VncYtwGdtriqtSGv24Ceht7UdEj4aqtxURENLx68XiHF5yFGEIPXbPH5WPBQDog2dBcQB4XqhcSD0r+bqp5cozpd30JKUJaB169i/fACVxsePB3PYWCjc2xulSU1fSNh0= ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-23T10:18:07.987 INFO:teuthology.orchestra.run.smithi167.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCkOWn4cq3FZF06QayCItqAjf4drkMcHyNC6oSLwCE4Htu4K+7lHBfwDsBgOKrwlCDeWXg+4ZRV2ZP6202FAf5+gonUMrvHlpRkxGHQXRtkJwQxnz+8PUD7nD0K5jVyt+kfoxMkAMm0wfMaYuiZ5OQkagaGGnegN5co27/LlO5jdtMYID/V8+BrAVEXfp6maJh9Ah76qtoogG8s8IzSO04G8mLVe9FxK55Z5y1tdcv2sdC4iFb5Px0ryLnC+CJHA62QX/bif3PExTdAZ5i4dEpTt5VlZQolCv2D+MmEIigigrod2QvqTRYg9zfJf6iG45vRHrtuGWgzIgpXD3rFNi9MtwgYeRrbK+guVVSnR9+kULYi8e9iTyuFp6kMxovO+VncYtwGdtriqtSGv24Ceht7UdEj4aqtxURENLx68XiHF5yFGEIPXbPH5WPBQDog2dBcQB4XqhcSD0r+bqp5cozpd30JKUJaB169i/fACVxsePB3PYWCjc2xulSU1fSNh0= ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:07.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-23T10:18:08.241 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:18:08.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:08 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2726280607' entity='client.admin' 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.184+0000 7fd0a7f22700 1 -- 172.21.15.69:0/1375333261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0a0103ad0 msgr2=0x7fd0a0103ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.184+0000 7fd0a7f22700 1 --2- 172.21.15.69:0/1375333261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0a0103ad0 0x7fd0a0103ef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009910 tx=0x7fd09c009c20 comp rx=0 tx=0).stop 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.184+0000 7fd0a7f22700 1 -- 172.21.15.69:0/1375333261 shutdown_connections 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.184+0000 7fd0a7f22700 1 --2- 172.21.15.69:0/1375333261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0a0103ad0 0x7fd0a0103ef0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.184+0000 7fd0a7f22700 1 -- 172.21.15.69:0/1375333261 >> 172.21.15.69:0/1375333261 conn(0x7fd0a00fc0f0 msgr2=0x7fd0a00fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.184+0000 7fd0a7f22700 1 -- 172.21.15.69:0/1375333261 shutdown_connections 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.184+0000 7fd0a7f22700 1 -- 172.21.15.69:0/1375333261 wait complete. 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.185+0000 7fd0a7f22700 1 Processor -- start 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.185+0000 7fd0a7f22700 1 -- start start 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.185+0000 7fd0a7f22700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0a0103ad0 0x7fd0a0197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.185+0000 7fd0a7f22700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a01084f0 con 0x7fd0a0103ad0 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.185+0000 7fd0a5cbe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0a0103ad0 0x7fd0a0197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.185+0000 7fd0a5cbe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0a0103ad0 0x7fd0a0197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55958/0 (socket says 172.21.15.69:55958) 2024-04-23T10:18:10.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.185+0000 7fd0a5cbe700 1 -- 172.21.15.69:0/4119959024 learned_addr learned my addr 172.21.15.69:0/4119959024 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:10.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.185+0000 7fd0a5cbe700 1 -- 172.21.15.69:0/4119959024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a0198000 con 0x7fd0a0103ad0 2024-04-23T10:18:10.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.185+0000 7fd0a5cbe700 1 --2- 172.21.15.69:0/4119959024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0a0103ad0 0x7fd0a0197ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009ec0 tx=0x7fd09c004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:10.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.186+0000 7fd096ffd700 1 -- 172.21.15.69:0/4119959024 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd09c027070 con 0x7fd0a0103ad0 2024-04-23T10:18:10.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.186+0000 7fd096ffd700 1 -- 172.21.15.69:0/4119959024 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd09c022470 con 0x7fd0a0103ad0 2024-04-23T10:18:10.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.186+0000 7fd0a7f22700 1 -- 172.21.15.69:0/4119959024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a01982f0 con 0x7fd0a0103ad0 2024-04-23T10:18:10.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.186+0000 7fd096ffd700 1 -- 172.21.15.69:0/4119959024 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd09c00f5f0 con 0x7fd0a0103ad0 2024-04-23T10:18:10.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.186+0000 7fd0a7f22700 1 -- 172.21.15.69:0/4119959024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a019af80 con 0x7fd0a0103ad0 2024-04-23T10:18:10.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.186+0000 7fd096ffd700 1 -- 172.21.15.69:0/4119959024 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fd09c02a070 con 0x7fd0a0103ad0 2024-04-23T10:18:10.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.186+0000 7fd0a7f22700 1 -- 172.21.15.69:0/4119959024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a0108c70 con 0x7fd0a0103ad0 2024-04-23T10:18:10.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.187+0000 7fd096ffd700 1 --2- 172.21.15.69:0/4119959024 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd08c0396b0 0x7fd08c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:10.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.187+0000 7fd096ffd700 1 -- 172.21.15.69:0/4119959024 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd09c01e030 con 0x7fd0a0103ad0 2024-04-23T10:18:10.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.187+0000 7fd0a54bd700 1 --2- 172.21.15.69:0/4119959024 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd08c0396b0 0x7fd08c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:10.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.187+0000 7fd0a54bd700 1 --2- 172.21.15.69:0/4119959024 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd08c0396b0 0x7fd08c03bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd090006fd0 tx=0x7fd090006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:10.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.192+0000 7fd096ffd700 1 -- 172.21.15.69:0/4119959024 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd09c013070 con 0x7fd0a0103ad0 2024-04-23T10:18:10.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.387+0000 7fd0a7f22700 1 -- 172.21.15.69:0/4119959024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fd0a002e100 con 0x7fd0a0103ad0 2024-04-23T10:18:10.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.390+0000 7fd096ffd700 1 -- 172.21.15.69:0/4119959024 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fd09c00e3e0 con 0x7fd0a0103ad0 2024-04-23T10:18:10.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.392+0000 7fd0a7f22700 1 -- 172.21.15.69:0/4119959024 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd08c0396b0 msgr2=0x7fd08c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:10.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.392+0000 7fd0a7f22700 1 --2- 172.21.15.69:0/4119959024 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd08c0396b0 0x7fd08c03bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd090006fd0 tx=0x7fd090006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:10.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.392+0000 7fd0a7f22700 1 -- 172.21.15.69:0/4119959024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0a0103ad0 msgr2=0x7fd0a0197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:10.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.392+0000 7fd0a7f22700 1 --2- 172.21.15.69:0/4119959024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0a0103ad0 0x7fd0a0197ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009ec0 tx=0x7fd09c004690 comp rx=0 tx=0).stop 2024-04-23T10:18:10.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.392+0000 7fd0a7f22700 1 -- 172.21.15.69:0/4119959024 shutdown_connections 2024-04-23T10:18:10.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.392+0000 7fd0a7f22700 1 --2- 172.21.15.69:0/4119959024 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd08c0396b0 0x7fd08c03bb70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:10.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.392+0000 7fd0a7f22700 1 --2- 172.21.15.69:0/4119959024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0a0103ad0 0x7fd0a0197ac0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:10.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.392+0000 7fd0a7f22700 1 -- 172.21.15.69:0/4119959024 >> 172.21.15.69:0/4119959024 conn(0x7fd0a00fc0f0 msgr2=0x7fd0a00fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:10.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.392+0000 7fd0a7f22700 1 -- 172.21.15.69:0/4119959024 shutdown_connections 2024-04-23T10:18:10.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:10.392+0000 7fd0a7f22700 1 -- 172.21.15.69:0/4119959024 wait complete. 2024-04-23T10:18:10.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:10.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:10.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi069", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:18:10.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:10.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:18:10.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:10.699 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:10 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/4119959024' entity='client.admin' 2024-04-23T10:18:10.699 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:18:10.699 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:10.994 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-23T10:18:10.994 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-23T10:18:11.229 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:18:12.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.596+0000 7f21982b6700 1 -- 172.21.15.69:0/1350008175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2190102f90 msgr2=0x7f2190105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:12.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.596+0000 7f21982b6700 1 --2- 172.21.15.69:0/1350008175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2190102f90 0x7f2190105380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f218c009910 tx=0x7f218c009c20 comp rx=0 tx=0).stop 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.596+0000 7f21982b6700 1 -- 172.21.15.69:0/1350008175 shutdown_connections 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.596+0000 7f21982b6700 1 --2- 172.21.15.69:0/1350008175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2190102f90 0x7f2190105380 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.596+0000 7f21982b6700 1 -- 172.21.15.69:0/1350008175 >> 172.21.15.69:0/1350008175 conn(0x7f21900fc940 msgr2=0x7f21900fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.596+0000 7f21982b6700 1 -- 172.21.15.69:0/1350008175 shutdown_connections 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.596+0000 7f21982b6700 1 -- 172.21.15.69:0/1350008175 wait complete. 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.596+0000 7f21982b6700 1 Processor -- start 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.596+0000 7f21982b6700 1 -- start start 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.596+0000 7f21982b6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2190102f90 0x7f2190197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.596+0000 7f21982b6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2190108530 con 0x7f2190102f90 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.597+0000 7f2196052700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2190102f90 0x7f2190197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.597+0000 7f2196052700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2190102f90 0x7f2190197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55978/0 (socket says 172.21.15.69:55978) 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.597+0000 7f2196052700 1 -- 172.21.15.69:0/3656571883 learned_addr learned my addr 172.21.15.69:0/3656571883 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:12.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.597+0000 7f2196052700 1 -- 172.21.15.69:0/3656571883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2190198020 con 0x7f2190102f90 2024-04-23T10:18:12.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.597+0000 7f2196052700 1 --2- 172.21.15.69:0/3656571883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2190102f90 0x7f2190197ae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f218c009ef0 tx=0x7f218c004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:12.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.597+0000 7f21877fe700 1 -- 172.21.15.69:0/3656571883 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c027070 con 0x7f2190102f90 2024-04-23T10:18:12.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.597+0000 7f21877fe700 1 -- 172.21.15.69:0/3656571883 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f218c022470 con 0x7f2190102f90 2024-04-23T10:18:12.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.597+0000 7f21982b6700 1 -- 172.21.15.69:0/3656571883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21901982b0 con 0x7f2190102f90 2024-04-23T10:18:12.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.597+0000 7f21877fe700 1 -- 172.21.15.69:0/3656571883 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c00f5f0 con 0x7f2190102f90 2024-04-23T10:18:12.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.597+0000 7f21982b6700 1 -- 172.21.15.69:0/3656571883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219019afa0 con 0x7f2190102f90 2024-04-23T10:18:12.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.598+0000 7f21877fe700 1 -- 172.21.15.69:0/3656571883 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f218c02a070 con 0x7f2190102f90 2024-04-23T10:18:12.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.598+0000 7f21982b6700 1 -- 172.21.15.69:0/3656571883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2190108cb0 con 0x7f2190102f90 2024-04-23T10:18:12.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.598+0000 7f21877fe700 1 --2- 172.21.15.69:0/3656571883 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f217c0396b0 0x7f217c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:12.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.598+0000 7f21877fe700 1 -- 172.21.15.69:0/3656571883 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f218c01e030 con 0x7f2190102f90 2024-04-23T10:18:12.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.598+0000 7f2195851700 1 --2- 172.21.15.69:0/3656571883 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f217c0396b0 0x7f217c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:12.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.599+0000 7f2195851700 1 --2- 172.21.15.69:0/3656571883 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f217c0396b0 0x7f217c03bb70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2180006fd0 tx=0x7f2180006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:12.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.603+0000 7f21877fe700 1 -- 172.21.15.69:0/3656571883 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f218c013070 con 0x7f2190102f90 2024-04-23T10:18:12.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.804+0000 7f21982b6700 1 -- 172.21.15.69:0/3656571883 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f219002e120 con 0x7f217c0396b0 2024-04-23T10:18:12.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.808+0000 7f21877fe700 1 -- 172.21.15.69:0/3656571883 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f219002e120 con 0x7f217c0396b0 2024-04-23T10:18:12.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.810+0000 7f21982b6700 1 -- 172.21.15.69:0/3656571883 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f217c0396b0 msgr2=0x7f217c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:12.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.810+0000 7f21982b6700 1 --2- 172.21.15.69:0/3656571883 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f217c0396b0 0x7f217c03bb70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2180006fd0 tx=0x7f2180006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:12.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.810+0000 7f21982b6700 1 -- 172.21.15.69:0/3656571883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2190102f90 msgr2=0x7f2190197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:12.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.810+0000 7f21982b6700 1 --2- 172.21.15.69:0/3656571883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2190102f90 0x7f2190197ae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f218c009ef0 tx=0x7f218c004690 comp rx=0 tx=0).stop 2024-04-23T10:18:12.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.810+0000 7f21982b6700 1 -- 172.21.15.69:0/3656571883 shutdown_connections 2024-04-23T10:18:12.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.810+0000 7f21982b6700 1 --2- 172.21.15.69:0/3656571883 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f217c0396b0 0x7f217c03bb70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:12.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.810+0000 7f21982b6700 1 --2- 172.21.15.69:0/3656571883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2190102f90 0x7f2190197ae0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:12.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.810+0000 7f21982b6700 1 -- 172.21.15.69:0/3656571883 >> 172.21.15.69:0/3656571883 conn(0x7f21900fc940 msgr2=0x7f21900fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:12.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.810+0000 7f21982b6700 1 -- 172.21.15.69:0/3656571883 shutdown_connections 2024-04-23T10:18:12.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:12.810+0000 7f21982b6700 1 -- 172.21.15.69:0/3656571883 wait complete. 2024-04-23T10:18:13.511 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi146 2024-04-23T10:18:13.511 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-23T10:18:13.511 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/etc/ceph/ceph.conf 2024-04-23T10:18:13.530 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-23T10:18:13.531 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:18:13.588 INFO:tasks.cephadm:Adding host smithi146 to orchestrator... 2024-04-23T10:18:13.589 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch host add smithi146 2024-04-23T10:18:13.842 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:18:14.081 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:13 smithi069 ceph-mon[29593]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:18:14.082 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:13 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:14.082 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:13 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:18:14.082 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:13 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:14.082 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:13 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:18:14.082 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:13 smithi069 ceph-mon[29593]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-23T10:18:14.082 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:13 smithi069 ceph-mon[29593]: Updating smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:14.082 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:13 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:14.082 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:13 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:14.082 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:13 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:14.990 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:14 smithi069 ceph-mon[29593]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:18:14.990 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:14 smithi069 ceph-mon[29593]: Updating smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:18:15.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.287+0000 7feb01f9c700 1 -- 172.21.15.69:0/1913086048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feafc1084e0 msgr2=0x7feafc1088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:15.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.287+0000 7feb01f9c700 1 --2- 172.21.15.69:0/1913086048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feafc1084e0 0x7feafc1088c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feaec009910 tx=0x7feaec009c20 comp rx=0 tx=0).stop 2024-04-23T10:18:15.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.287+0000 7feb01f9c700 1 -- 172.21.15.69:0/1913086048 shutdown_connections 2024-04-23T10:18:15.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.287+0000 7feb01f9c700 1 --2- 172.21.15.69:0/1913086048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feafc1084e0 0x7feafc1088c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:15.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.287+0000 7feb01f9c700 1 -- 172.21.15.69:0/1913086048 >> 172.21.15.69:0/1913086048 conn(0x7feafc0fdf80 msgr2=0x7feafc1003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:15.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.287+0000 7feb01f9c700 1 -- 172.21.15.69:0/1913086048 shutdown_connections 2024-04-23T10:18:15.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.287+0000 7feb01f9c700 1 -- 172.21.15.69:0/1913086048 wait complete. 2024-04-23T10:18:15.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.287+0000 7feb01f9c700 1 Processor -- start 2024-04-23T10:18:15.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.287+0000 7feb01f9c700 1 -- start start 2024-04-23T10:18:15.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feb01f9c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feafc1084e0 0x7feafc074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:15.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feb01f9c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7feafc10ca80 con 0x7feafc1084e0 2024-04-23T10:18:15.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feafb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feafc1084e0 0x7feafc074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:15.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feafb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feafc1084e0 0x7feafc074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56000/0 (socket says 172.21.15.69:56000) 2024-04-23T10:18:15.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feafb7fe700 1 -- 172.21.15.69:0/2137506229 learned_addr learned my addr 172.21.15.69:0/2137506229 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:15.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feafb7fe700 1 -- 172.21.15.69:0/2137506229 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc076b90 con 0x7feafc1084e0 2024-04-23T10:18:15.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feafb7fe700 1 --2- 172.21.15.69:0/2137506229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feafc1084e0 0x7feafc074d40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feaec005780 tx=0x7feaec0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:15.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feaf97fa700 1 -- 172.21.15.69:0/2137506229 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec026070 con 0x7feafc1084e0 2024-04-23T10:18:15.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feaf97fa700 1 -- 172.21.15.69:0/2137506229 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feaec004370 con 0x7feafc1084e0 2024-04-23T10:18:15.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feb01f9c700 1 -- 172.21.15.69:0/2137506229 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feafc075280 con 0x7feafc1084e0 2024-04-23T10:18:15.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feaf97fa700 1 -- 172.21.15.69:0/2137506229 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec003a30 con 0x7feafc1084e0 2024-04-23T10:18:15.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.288+0000 7feb01f9c700 1 -- 172.21.15.69:0/2137506229 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feafc075740 con 0x7feafc1084e0 2024-04-23T10:18:15.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.289+0000 7feaf97fa700 1 -- 172.21.15.69:0/2137506229 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7feaec029070 con 0x7feafc1084e0 2024-04-23T10:18:15.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.289+0000 7feb01f9c700 1 -- 172.21.15.69:0/2137506229 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feafc103b90 con 0x7feafc1084e0 2024-04-23T10:18:15.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.289+0000 7feaf97fa700 1 --2- 172.21.15.69:0/2137506229 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feae80396b0 0x7feae803bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:15.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.289+0000 7feaf97fa700 1 -- 172.21.15.69:0/2137506229 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7feaec01e070 con 0x7feafc1084e0 2024-04-23T10:18:15.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.290+0000 7feaf2ffd700 1 --2- 172.21.15.69:0/2137506229 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feae80396b0 0x7feae803bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:15.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.290+0000 7feaf2ffd700 1 --2- 172.21.15.69:0/2137506229 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feae80396b0 0x7feae803bb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feae4006fd0 tx=0x7feae4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:15.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.294+0000 7feaf97fa700 1 -- 172.21.15.69:0/2137506229 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feaec013070 con 0x7feafc1084e0 2024-04-23T10:18:15.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:15.496+0000 7feb01f9c700 1 -- 172.21.15.69:0/2137506229 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi146", "target": ["mon-mgr", ""]}) -- 0x7feafc076290 con 0x7feae80396b0 2024-04-23T10:18:16.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:16 smithi069 ceph-mon[29593]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi146", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:18:17.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:17 smithi069 ceph-mon[29593]: Deploying cephadm binary to smithi146 2024-04-23T10:18:19.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:19.568+0000 7feaf97fa700 1 -- 172.21.15.69:0/2137506229 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7feafc076290 con 0x7feae80396b0 2024-04-23T10:18:19.567 INFO:teuthology.orchestra.run.smithi069.stdout:Added host 'smithi146' with addr '172.21.15.146' 2024-04-23T10:18:19.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:19.570+0000 7feb01f9c700 1 -- 172.21.15.69:0/2137506229 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feae80396b0 msgr2=0x7feae803bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:19.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:19.570+0000 7feb01f9c700 1 --2- 172.21.15.69:0/2137506229 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feae80396b0 0x7feae803bb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feae4006fd0 tx=0x7feae4006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:19.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:19.570+0000 7feb01f9c700 1 -- 172.21.15.69:0/2137506229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feafc1084e0 msgr2=0x7feafc074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:19.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:19.570+0000 7feb01f9c700 1 --2- 172.21.15.69:0/2137506229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feafc1084e0 0x7feafc074d40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feaec005780 tx=0x7feaec0057b0 comp rx=0 tx=0).stop 2024-04-23T10:18:19.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:19.570+0000 7feb01f9c700 1 -- 172.21.15.69:0/2137506229 shutdown_connections 2024-04-23T10:18:19.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:19.570+0000 7feb01f9c700 1 --2- 172.21.15.69:0/2137506229 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feae80396b0 0x7feae803bb70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:19.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:19.570+0000 7feb01f9c700 1 --2- 172.21.15.69:0/2137506229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feafc1084e0 0x7feafc074d40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:19.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:19.570+0000 7feb01f9c700 1 -- 172.21.15.69:0/2137506229 >> 172.21.15.69:0/2137506229 conn(0x7feafc0fdf80 msgr2=0x7feafc109f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:19.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:19.570+0000 7feb01f9c700 1 -- 172.21.15.69:0/2137506229 shutdown_connections 2024-04-23T10:18:19.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:19.570+0000 7feb01f9c700 1 -- 172.21.15.69:0/2137506229 wait complete. 2024-04-23T10:18:20.118 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:19 smithi069 ceph-mon[29593]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:20.119 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:20.119 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:18:20.120 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-23T10:18:20.351 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:18:20.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:20 smithi069 ceph-mon[29593]: Added host smithi146 2024-04-23T10:18:20.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:20 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:20.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:20 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.689+0000 7f556aaa7700 1 -- 172.21.15.69:0/3351290673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5564108550 msgr2=0x7f5564108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.689+0000 7f556aaa7700 1 --2- 172.21.15.69:0/3351290673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5564108550 0x7f5564108930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5558009910 tx=0x7f5558009c20 comp rx=0 tx=0).stop 2024-04-23T10:18:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.689+0000 7f556aaa7700 1 -- 172.21.15.69:0/3351290673 shutdown_connections 2024-04-23T10:18:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.689+0000 7f556aaa7700 1 --2- 172.21.15.69:0/3351290673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5564108550 0x7f5564108930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.689+0000 7f556aaa7700 1 -- 172.21.15.69:0/3351290673 >> 172.21.15.69:0/3351290673 conn(0x7f5564077ac0 msgr2=0x7f5564077ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.690+0000 7f556aaa7700 1 -- 172.21.15.69:0/3351290673 shutdown_connections 2024-04-23T10:18:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.690+0000 7f556aaa7700 1 -- 172.21.15.69:0/3351290673 wait complete. 2024-04-23T10:18:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.690+0000 7f556aaa7700 1 Processor -- start 2024-04-23T10:18:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.690+0000 7f556aaa7700 1 -- start start 2024-04-23T10:18:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.690+0000 7f556aaa7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5564108550 0x7f556419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.690+0000 7f556aaa7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f556410caf0 con 0x7f5564108550 2024-04-23T10:18:21.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.690+0000 7f5568843700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5564108550 0x7f556419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:21.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.690+0000 7f5568843700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5564108550 0x7f556419a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33918/0 (socket says 172.21.15.69:33918) 2024-04-23T10:18:21.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.690+0000 7f5568843700 1 -- 172.21.15.69:0/1019107214 learned_addr learned my addr 172.21.15.69:0/1019107214 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:21.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.691+0000 7f5568843700 1 -- 172.21.15.69:0/1019107214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556419a6b0 con 0x7f5564108550 2024-04-23T10:18:21.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.691+0000 7f5568843700 1 --2- 172.21.15.69:0/1019107214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5564108550 0x7f556419a170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5558005780 tx=0x7f55580057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:21.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.691+0000 7f5561ffb700 1 -- 172.21.15.69:0/1019107214 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5558026070 con 0x7f5564108550 2024-04-23T10:18:21.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.691+0000 7f556aaa7700 1 -- 172.21.15.69:0/1019107214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556419a9a0 con 0x7f5564108550 2024-04-23T10:18:21.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.691+0000 7f5561ffb700 1 -- 172.21.15.69:0/1019107214 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5558004370 con 0x7f5564108550 2024-04-23T10:18:21.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.691+0000 7f5561ffb700 1 -- 172.21.15.69:0/1019107214 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5558003a30 con 0x7f5564108550 2024-04-23T10:18:21.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.691+0000 7f556aaa7700 1 -- 172.21.15.69:0/1019107214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f556419ea40 con 0x7f5564108550 2024-04-23T10:18:21.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.692+0000 7f556aaa7700 1 -- 172.21.15.69:0/1019107214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5564103cf0 con 0x7f5564108550 2024-04-23T10:18:21.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.692+0000 7f5561ffb700 1 -- 172.21.15.69:0/1019107214 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f5558029070 con 0x7f5564108550 2024-04-23T10:18:21.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.692+0000 7f5561ffb700 1 --2- 172.21.15.69:0/1019107214 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f55540396b0 0x7f555403bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:21.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.693+0000 7f5561ffb700 1 -- 172.21.15.69:0/1019107214 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f555801e070 con 0x7f5564108550 2024-04-23T10:18:21.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.693+0000 7f5563fff700 1 --2- 172.21.15.69:0/1019107214 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f55540396b0 0x7f555403bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:21.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.693+0000 7f5563fff700 1 --2- 172.21.15.69:0/1019107214 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f55540396b0 0x7f555403bb70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5550006fd0 tx=0x7f5550006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:21.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.697+0000 7f5561ffb700 1 -- 172.21.15.69:0/1019107214 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5558013070 con 0x7f5564108550 2024-04-23T10:18:21.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.903+0000 7f556aaa7700 1 -- 172.21.15.69:0/1019107214 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f556419b4d0 con 0x7f55540396b0 2024-04-23T10:18:21.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.904+0000 7f5561ffb700 1 -- 172.21.15.69:0/1019107214 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f556419b4d0 con 0x7f55540396b0 2024-04-23T10:18:21.903 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:21.903 INFO:teuthology.orchestra.run.smithi069.stdout:[{"addr": "172.21.15.69", "hostname": "smithi069", "labels": [], "status": ""}, {"addr": "172.21.15.146", "hostname": "smithi146", "labels": [], "status": ""}] 2024-04-23T10:18:21.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.907+0000 7f556aaa7700 1 -- 172.21.15.69:0/1019107214 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f55540396b0 msgr2=0x7f555403bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:21.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.907+0000 7f556aaa7700 1 --2- 172.21.15.69:0/1019107214 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f55540396b0 0x7f555403bb70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5550006fd0 tx=0x7f5550006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:21.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.907+0000 7f556aaa7700 1 -- 172.21.15.69:0/1019107214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5564108550 msgr2=0x7f556419a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:21.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.907+0000 7f556aaa7700 1 --2- 172.21.15.69:0/1019107214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5564108550 0x7f556419a170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5558005780 tx=0x7f55580057b0 comp rx=0 tx=0).stop 2024-04-23T10:18:21.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.907+0000 7f556aaa7700 1 -- 172.21.15.69:0/1019107214 shutdown_connections 2024-04-23T10:18:21.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.907+0000 7f556aaa7700 1 --2- 172.21.15.69:0/1019107214 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f55540396b0 0x7f555403bb70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:21.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.907+0000 7f556aaa7700 1 --2- 172.21.15.69:0/1019107214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5564108550 0x7f556419a170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:21.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.907+0000 7f556aaa7700 1 -- 172.21.15.69:0/1019107214 >> 172.21.15.69:0/1019107214 conn(0x7f5564077ac0 msgr2=0x7f55640ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:21.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.907+0000 7f556aaa7700 1 -- 172.21.15.69:0/1019107214 shutdown_connections 2024-04-23T10:18:21.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:21.907+0000 7f556aaa7700 1 -- 172.21.15.69:0/1019107214 wait complete. 2024-04-23T10:18:22.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:21 smithi069 ceph-mon[29593]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:22.562 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi167 2024-04-23T10:18:22.563 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-23T10:18:22.563 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.conf 2024-04-23T10:18:22.581 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-23T10:18:22.581 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:18:22.639 INFO:tasks.cephadm:Adding host smithi167 to orchestrator... 2024-04-23T10:18:22.640 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch host add smithi167 2024-04-23T10:18:22.870 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:18:23.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:22 smithi069 ceph-mon[29593]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:18:23.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:24.126 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:23 smithi069 ceph-mon[29593]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:24.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.351+0000 7f919b9b8700 1 -- 172.21.15.69:0/4190823365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194103670 msgr2=0x7f9194103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:24.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.351+0000 7f919b9b8700 1 --2- 172.21.15.69:0/4190823365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194103670 0x7f9194103a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9190009910 tx=0x7f9190009c20 comp rx=0 tx=0).stop 2024-04-23T10:18:24.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.352+0000 7f919b9b8700 1 -- 172.21.15.69:0/4190823365 shutdown_connections 2024-04-23T10:18:24.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.352+0000 7f919b9b8700 1 --2- 172.21.15.69:0/4190823365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194103670 0x7f9194103a50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:24.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.352+0000 7f919b9b8700 1 -- 172.21.15.69:0/4190823365 >> 172.21.15.69:0/4190823365 conn(0x7f91940fce60 msgr2=0x7f91940ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:24.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.352+0000 7f919b9b8700 1 -- 172.21.15.69:0/4190823365 shutdown_connections 2024-04-23T10:18:24.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.352+0000 7f919b9b8700 1 -- 172.21.15.69:0/4190823365 wait complete. 2024-04-23T10:18:24.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.352+0000 7f919b9b8700 1 Processor -- start 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.352+0000 7f919b9b8700 1 -- start start 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.352+0000 7f919b9b8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194103670 0x7f9194197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.352+0000 7f919b9b8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f919410cae0 con 0x7f9194103670 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.353+0000 7f9199754700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194103670 0x7f9194197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.353+0000 7f9199754700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194103670 0x7f9194197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33940/0 (socket says 172.21.15.69:33940) 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.353+0000 7f9199754700 1 -- 172.21.15.69:0/3664642997 learned_addr learned my addr 172.21.15.69:0/3664642997 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.353+0000 7f9199754700 1 -- 172.21.15.69:0/3664642997 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9194198470 con 0x7f9194103670 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.353+0000 7f9199754700 1 --2- 172.21.15.69:0/3664642997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194103670 0x7f9194197f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91900057a0 tx=0x7f9190005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.353+0000 7f918a7fc700 1 -- 172.21.15.69:0/3664642997 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9190026070 con 0x7f9194103670 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.353+0000 7f918a7fc700 1 -- 172.21.15.69:0/3664642997 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9190004370 con 0x7f9194103670 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.353+0000 7f919b9b8700 1 -- 172.21.15.69:0/3664642997 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9194198700 con 0x7f9194103670 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.353+0000 7f918a7fc700 1 -- 172.21.15.69:0/3664642997 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9190003b90 con 0x7f9194103670 2024-04-23T10:18:24.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.353+0000 7f919b9b8700 1 -- 172.21.15.69:0/3664642997 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9194198b60 con 0x7f9194103670 2024-04-23T10:18:24.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.354+0000 7f918a7fc700 1 -- 172.21.15.69:0/3664642997 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f9190029070 con 0x7f9194103670 2024-04-23T10:18:24.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.354+0000 7f918a7fc700 1 --2- 172.21.15.69:0/3664642997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f91800396b0 0x7f918003bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:24.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.354+0000 7f918a7fc700 1 -- 172.21.15.69:0/3664642997 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f919001e070 con 0x7f9194103670 2024-04-23T10:18:24.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.354+0000 7f919b9b8700 1 -- 172.21.15.69:0/3664642997 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919406b170 con 0x7f9194103670 2024-04-23T10:18:24.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.354+0000 7f9198f53700 1 --2- 172.21.15.69:0/3664642997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f91800396b0 0x7f918003bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:24.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.355+0000 7f9198f53700 1 --2- 172.21.15.69:0/3664642997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f91800396b0 0x7f918003bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9184006fd0 tx=0x7f9184006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:24.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.359+0000 7f918a7fc700 1 -- 172.21.15.69:0/3664642997 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9190030020 con 0x7f9194103670 2024-04-23T10:18:24.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:24.561+0000 7f919b9b8700 1 -- 172.21.15.69:0/3664642997 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}) -- 0x7f9194199290 con 0x7f91800396b0 2024-04-23T10:18:26.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:25 smithi069 ceph-mon[29593]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:18:26.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:25 smithi069 ceph-mon[29593]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:26.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:26.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:26.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:26.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:26.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi146", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:18:26.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:26.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:18:27.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:26 smithi069 ceph-mon[29593]: Deploying cephadm binary to smithi167 2024-04-23T10:18:27.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:26 smithi069 ceph-mon[29593]: Updating smithi146:/etc/ceph/ceph.conf 2024-04-23T10:18:27.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:26 smithi069 ceph-mon[29593]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:28.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:27 smithi069 ceph-mon[29593]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:28.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:28.638+0000 7f918a7fc700 1 -- 172.21.15.69:0/3664642997 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f9194199290 con 0x7f91800396b0 2024-04-23T10:18:28.638 INFO:teuthology.orchestra.run.smithi069.stdout:Added host 'smithi167' with addr '172.21.15.167' 2024-04-23T10:18:28.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:28.640+0000 7f919b9b8700 1 -- 172.21.15.69:0/3664642997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f91800396b0 msgr2=0x7f918003bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:28.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:28.640+0000 7f919b9b8700 1 --2- 172.21.15.69:0/3664642997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f91800396b0 0x7f918003bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9184006fd0 tx=0x7f9184006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:28.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:28.641+0000 7f919b9b8700 1 -- 172.21.15.69:0/3664642997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194103670 msgr2=0x7f9194197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:28.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:28.641+0000 7f919b9b8700 1 --2- 172.21.15.69:0/3664642997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194103670 0x7f9194197f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91900057a0 tx=0x7f9190005dc0 comp rx=0 tx=0).stop 2024-04-23T10:18:28.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:28.641+0000 7f919b9b8700 1 -- 172.21.15.69:0/3664642997 shutdown_connections 2024-04-23T10:18:28.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:28.641+0000 7f919b9b8700 1 --2- 172.21.15.69:0/3664642997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f91800396b0 0x7f918003bb70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:28.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:28.641+0000 7f919b9b8700 1 --2- 172.21.15.69:0/3664642997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194103670 0x7f9194197f30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:28.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:28.641+0000 7f919b9b8700 1 -- 172.21.15.69:0/3664642997 >> 172.21.15.69:0/3664642997 conn(0x7f91940fce60 msgr2=0x7f9194104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:28.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:28.641+0000 7f919b9b8700 1 -- 172.21.15.69:0/3664642997 shutdown_connections 2024-04-23T10:18:28.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:28.641+0000 7f919b9b8700 1 -- 172.21.15.69:0/3664642997 wait complete. 2024-04-23T10:18:29.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:28 smithi069 ceph-mon[29593]: Updating smithi146:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:18:29.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:28 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:29.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:28 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:29.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:28 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:29.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:28 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:29.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:28 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:18:29.304 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-23T10:18:29.536 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:18:30.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:29 smithi069 ceph-mon[29593]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:18:30.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:29 smithi069 ceph-mon[29593]: Added host smithi167 2024-04-23T10:18:30.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:29 smithi069 ceph-mon[29593]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:30.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:30.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.971+0000 7f86c43f8700 1 -- 172.21.15.69:0/2416692217 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86bc1036a0 msgr2=0x7f86bc103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.971+0000 7f86c43f8700 1 --2- 172.21.15.69:0/2416692217 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86bc1036a0 0x7f86bc103a80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009910 tx=0x7f86b8009c20 comp rx=0 tx=0).stop 2024-04-23T10:18:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.971+0000 7f86c43f8700 1 -- 172.21.15.69:0/2416692217 shutdown_connections 2024-04-23T10:18:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.971+0000 7f86c43f8700 1 --2- 172.21.15.69:0/2416692217 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86bc1036a0 0x7f86bc103a80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.971+0000 7f86c43f8700 1 -- 172.21.15.69:0/2416692217 >> 172.21.15.69:0/2416692217 conn(0x7f86bc0fced0 msgr2=0x7f86bc0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.971+0000 7f86c43f8700 1 -- 172.21.15.69:0/2416692217 shutdown_connections 2024-04-23T10:18:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.971+0000 7f86c43f8700 1 -- 172.21.15.69:0/2416692217 wait complete. 2024-04-23T10:18:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.972+0000 7f86c43f8700 1 Processor -- start 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.972+0000 7f86c43f8700 1 -- start start 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.972+0000 7f86c43f8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86bc1036a0 0x7f86bc197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.972+0000 7f86c43f8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc10cb10 con 0x7f86bc1036a0 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.972+0000 7f86c2194700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86bc1036a0 0x7f86bc197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.972+0000 7f86c2194700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86bc1036a0 0x7f86bc197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50844/0 (socket says 172.21.15.69:50844) 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.972+0000 7f86c2194700 1 -- 172.21.15.69:0/1490438798 learned_addr learned my addr 172.21.15.69:0/1490438798 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.972+0000 7f86c2194700 1 -- 172.21.15.69:0/1490438798 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc198450 con 0x7f86bc1036a0 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.973+0000 7f86c2194700 1 --2- 172.21.15.69:0/1490438798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86bc1036a0 0x7f86bc197f10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f86b80057a0 tx=0x7f86b8005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.973+0000 7f86b37fe700 1 -- 172.21.15.69:0/1490438798 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86b8026070 con 0x7f86bc1036a0 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.973+0000 7f86b37fe700 1 -- 172.21.15.69:0/1490438798 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86b8004370 con 0x7f86bc1036a0 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.973+0000 7f86c43f8700 1 -- 172.21.15.69:0/1490438798 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86bc1986e0 con 0x7f86bc1036a0 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.973+0000 7f86b37fe700 1 -- 172.21.15.69:0/1490438798 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86b8003b90 con 0x7f86bc1036a0 2024-04-23T10:18:30.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.973+0000 7f86c43f8700 1 -- 172.21.15.69:0/1490438798 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86bc198b40 con 0x7f86bc1036a0 2024-04-23T10:18:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.974+0000 7f86b37fe700 1 -- 172.21.15.69:0/1490438798 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f86b8029070 con 0x7f86bc1036a0 2024-04-23T10:18:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.974+0000 7f86c43f8700 1 -- 172.21.15.69:0/1490438798 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86bc06b150 con 0x7f86bc1036a0 2024-04-23T10:18:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.974+0000 7f86b37fe700 1 --2- 172.21.15.69:0/1490438798 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a80396b0 0x7f86a803bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.974+0000 7f86b37fe700 1 -- 172.21.15.69:0/1490438798 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f86b801e070 con 0x7f86bc1036a0 2024-04-23T10:18:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.974+0000 7f86c1993700 1 --2- 172.21.15.69:0/1490438798 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a80396b0 0x7f86a803bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.974+0000 7f86c1993700 1 --2- 172.21.15.69:0/1490438798 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a80396b0 0x7f86a803bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f86ac006fd0 tx=0x7f86ac006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:30.979+0000 7f86b37fe700 1 -- 172.21.15.69:0/1490438798 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f86b8013070 con 0x7f86bc1036a0 2024-04-23T10:18:31.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.185+0000 7f86c43f8700 1 -- 172.21.15.69:0/1490438798 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86bc1992e0 con 0x7f86a80396b0 2024-04-23T10:18:31.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.187+0000 7f86b37fe700 1 -- 172.21.15.69:0/1490438798 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f86bc1992e0 con 0x7f86a80396b0 2024-04-23T10:18:31.186 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:18:31.186 INFO:teuthology.orchestra.run.smithi069.stdout:[{"addr": "172.21.15.69", "hostname": "smithi069", "labels": [], "status": ""}, {"addr": "172.21.15.146", "hostname": "smithi146", "labels": [], "status": ""}, {"addr": "172.21.15.167", "hostname": "smithi167", "labels": [], "status": ""}] 2024-04-23T10:18:31.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.189+0000 7f86c43f8700 1 -- 172.21.15.69:0/1490438798 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a80396b0 msgr2=0x7f86a803bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:31.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.189+0000 7f86c43f8700 1 --2- 172.21.15.69:0/1490438798 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a80396b0 0x7f86a803bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f86ac006fd0 tx=0x7f86ac006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:31.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.189+0000 7f86c43f8700 1 -- 172.21.15.69:0/1490438798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86bc1036a0 msgr2=0x7f86bc197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:31.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.189+0000 7f86c43f8700 1 --2- 172.21.15.69:0/1490438798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86bc1036a0 0x7f86bc197f10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f86b80057a0 tx=0x7f86b8005dc0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.189+0000 7f86c43f8700 1 -- 172.21.15.69:0/1490438798 shutdown_connections 2024-04-23T10:18:31.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.189+0000 7f86c43f8700 1 --2- 172.21.15.69:0/1490438798 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a80396b0 0x7f86a803bb70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.189+0000 7f86c43f8700 1 --2- 172.21.15.69:0/1490438798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86bc1036a0 0x7f86bc197f10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.189+0000 7f86c43f8700 1 -- 172.21.15.69:0/1490438798 >> 172.21.15.69:0/1490438798 conn(0x7f86bc0fced0 msgr2=0x7f86bc104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:31.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.189+0000 7f86c43f8700 1 -- 172.21.15.69:0/1490438798 shutdown_connections 2024-04-23T10:18:31.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:31.189+0000 7f86c43f8700 1 -- 172.21.15.69:0/1490438798 wait complete. 2024-04-23T10:18:31.826 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-23T10:18:31.827 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-23T10:18:32.064 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:18:32.165 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:31 smithi069 ceph-mon[29593]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:32.165 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:33.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:32 smithi069 ceph-mon[29593]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:18:33.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.592+0000 7f451e5c3700 1 -- 172.21.15.69:0/2802676979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4518101200 msgr2=0x7f45181015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:33.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.592+0000 7f451e5c3700 1 --2- 172.21.15.69:0/2802676979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4518101200 0x7f45181015e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4508009910 tx=0x7f4508009c20 comp rx=0 tx=0).stop 2024-04-23T10:18:33.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.592+0000 7f451e5c3700 1 -- 172.21.15.69:0/2802676979 shutdown_connections 2024-04-23T10:18:33.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.592+0000 7f451e5c3700 1 --2- 172.21.15.69:0/2802676979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4518101200 0x7f45181015e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:33.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.592+0000 7f451e5c3700 1 -- 172.21.15.69:0/2802676979 >> 172.21.15.69:0/2802676979 conn(0x7f45180fce40 msgr2=0x7f45180ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:33.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.592+0000 7f451e5c3700 1 -- 172.21.15.69:0/2802676979 shutdown_connections 2024-04-23T10:18:33.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.592+0000 7f451e5c3700 1 -- 172.21.15.69:0/2802676979 wait complete. 2024-04-23T10:18:33.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.593+0000 7f451e5c3700 1 Processor -- start 2024-04-23T10:18:33.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.593+0000 7f451e5c3700 1 -- start start 2024-04-23T10:18:33.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.593+0000 7f451e5c3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4518101200 0x7f451819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:33.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.593+0000 7f451e5c3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f451810ecc0 con 0x7f4518101200 2024-04-23T10:18:33.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.593+0000 7f4517fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4518101200 0x7f451819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:33.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.593+0000 7f4517fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4518101200 0x7f451819a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50868/0 (socket says 172.21.15.69:50868) 2024-04-23T10:18:33.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.593+0000 7f4517fff700 1 -- 172.21.15.69:0/937720477 learned_addr learned my addr 172.21.15.69:0/937720477 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:33.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.593+0000 7f4517fff700 1 -- 172.21.15.69:0/937720477 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451819a6c0 con 0x7f4518101200 2024-04-23T10:18:33.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.593+0000 7f4517fff700 1 --2- 172.21.15.69:0/937720477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4518101200 0x7f451819a180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4508005780 tx=0x7f45080057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:33.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.594+0000 7f45157fa700 1 -- 172.21.15.69:0/937720477 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4508026070 con 0x7f4518101200 2024-04-23T10:18:33.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.594+0000 7f45157fa700 1 -- 172.21.15.69:0/937720477 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4508004370 con 0x7f4518101200 2024-04-23T10:18:33.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.594+0000 7f45157fa700 1 -- 172.21.15.69:0/937720477 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4508003af0 con 0x7f4518101200 2024-04-23T10:18:33.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.594+0000 7f451e5c3700 1 -- 172.21.15.69:0/937720477 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451819a950 con 0x7f4518101200 2024-04-23T10:18:33.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.594+0000 7f451e5c3700 1 -- 172.21.15.69:0/937720477 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451819adb0 con 0x7f4518101200 2024-04-23T10:18:33.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.595+0000 7f45157fa700 1 -- 172.21.15.69:0/937720477 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f4508029070 con 0x7f4518101200 2024-04-23T10:18:33.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.595+0000 7f451e5c3700 1 -- 172.21.15.69:0/937720477 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f451806af50 con 0x7f4518101200 2024-04-23T10:18:33.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.595+0000 7f45157fa700 1 --2- 172.21.15.69:0/937720477 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4500039650 0x7f450003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:33.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.595+0000 7f45157fa700 1 -- 172.21.15.69:0/937720477 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f450801e070 con 0x7f4518101200 2024-04-23T10:18:33.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.595+0000 7f45177fe700 1 --2- 172.21.15.69:0/937720477 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4500039650 0x7f450003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:33.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.595+0000 7f45177fe700 1 --2- 172.21.15.69:0/937720477 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4500039650 0x7f450003bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f450c006fd0 tx=0x7f450c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:33.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.600+0000 7f45157fa700 1 -- 172.21.15.69:0/937720477 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4508013070 con 0x7f4518101200 2024-04-23T10:18:33.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.804+0000 7f451e5c3700 1 -- 172.21.15.69:0/937720477 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f451819b4e0 con 0x7f4518101200 2024-04-23T10:18:33.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.944+0000 7f45157fa700 1 -- 172.21.15.69:0/937720477 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f450800d340 con 0x7f4518101200 2024-04-23T10:18:33.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.947+0000 7f451e5c3700 1 -- 172.21.15.69:0/937720477 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4500039650 msgr2=0x7f450003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:33.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.947+0000 7f451e5c3700 1 --2- 172.21.15.69:0/937720477 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4500039650 0x7f450003bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f450c006fd0 tx=0x7f450c006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:33.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.947+0000 7f451e5c3700 1 -- 172.21.15.69:0/937720477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4518101200 msgr2=0x7f451819a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:33.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.947+0000 7f451e5c3700 1 --2- 172.21.15.69:0/937720477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4518101200 0x7f451819a180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4508005780 tx=0x7f45080057b0 comp rx=0 tx=0).stop 2024-04-23T10:18:33.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.947+0000 7f451e5c3700 1 -- 172.21.15.69:0/937720477 shutdown_connections 2024-04-23T10:18:33.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.947+0000 7f451e5c3700 1 --2- 172.21.15.69:0/937720477 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4500039650 0x7f450003bb10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:33.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.947+0000 7f451e5c3700 1 --2- 172.21.15.69:0/937720477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4518101200 0x7f451819a180 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:33.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.947+0000 7f451e5c3700 1 -- 172.21.15.69:0/937720477 >> 172.21.15.69:0/937720477 conn(0x7f45180fce40 msgr2=0x7f45180fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:33.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.947+0000 7f451e5c3700 1 -- 172.21.15.69:0/937720477 shutdown_connections 2024-04-23T10:18:33.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:33.947+0000 7f451e5c3700 1 -- 172.21.15.69:0/937720477 wait complete. 2024-04-23T10:18:33.948 INFO:teuthology.orchestra.run.smithi069.stderr:adjusted tunables profile to default 2024-04-23T10:18:34.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:33 smithi069 ceph-mon[29593]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:34.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:33 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/937720477' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-23T10:18:34.503 INFO:tasks.cephadm:Adding mon.a on smithi069 2024-04-23T10:18:34.504 INFO:tasks.cephadm:Adding mon.b on smithi146 2024-04-23T10:18:34.504 INFO:tasks.cephadm:Adding mon.c on smithi167 2024-04-23T10:18:34.504 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi069:172.21.15.69=a;smithi146:172.21.15.146=b;smithi167:172.21.15.167=c' 2024-04-23T10:18:34.739 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-23T10:18:34.787 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:35.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:34 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/937720477' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-23T10:18:35.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:34 smithi069 ceph-mon[29593]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T10:18:35.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:35.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:35.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:35.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:35.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:18:35.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:35.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:18:36.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:35 smithi069 ceph-mon[29593]: Updating smithi167:/etc/ceph/ceph.conf 2024-04-23T10:18:36.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:35 smithi069 ceph-mon[29593]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:36.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:35 smithi069 ceph-mon[29593]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:18:36.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:35 smithi069 ceph-mon[29593]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:36.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:35 smithi069 ceph-mon[29593]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:18:36.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:35 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:36.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:35 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:36.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:35 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:36.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.244+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/285774835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cc8100e90 msgr2=0x7f4cc8101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:36.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.244+0000 7f4ccf5d2700 1 --2- 172.21.15.167:0/285774835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cc8100e90 0x7f4cc8101270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009910 tx=0x7f4cb8009c20 comp rx=0 tx=0).stop 2024-04-23T10:18:36.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.244+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/285774835 shutdown_connections 2024-04-23T10:18:36.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.244+0000 7f4ccf5d2700 1 --2- 172.21.15.167:0/285774835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cc8100e90 0x7f4cc8101270 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:36.245 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.244+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/285774835 >> 172.21.15.167:0/285774835 conn(0x7f4cc80fc5b0 msgr2=0x7f4cc80fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.244+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/285774835 shutdown_connections 2024-04-23T10:18:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.244+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/285774835 wait complete. 2024-04-23T10:18:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.245+0000 7f4ccf5d2700 1 Processor -- start 2024-04-23T10:18:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.245+0000 7f4ccf5d2700 1 -- start start 2024-04-23T10:18:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.245+0000 7f4ccf5d2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cc8100e90 0x7f4cc8198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.245+0000 7f4ccf5d2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc810b1f0 con 0x7f4cc8100e90 2024-04-23T10:18:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.245+0000 7f4ccd36e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cc8100e90 0x7f4cc8198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.245+0000 7f4ccd36e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cc8100e90 0x7f4cc8198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.167:56842/0 (socket says 172.21.15.167:56842) 2024-04-23T10:18:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.245+0000 7f4ccd36e700 1 -- 172.21.15.167:0/3167451543 learned_addr learned my addr 172.21.15.167:0/3167451543 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-23T10:18:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.245+0000 7f4ccd36e700 1 -- 172.21.15.167:0/3167451543 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc8199330 con 0x7f4cc8100e90 2024-04-23T10:18:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.246+0000 7f4ccd36e700 1 --2- 172.21.15.167:0/3167451543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cc8100e90 0x7f4cc8198df0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8006010 tx=0x7f4cb8009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:36.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.246+0000 7f4cbe7fc700 1 -- 172.21.15.167:0/3167451543 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb8027070 con 0x7f4cc8100e90 2024-04-23T10:18:36.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.246+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/3167451543 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc8199620 con 0x7f4cc8100e90 2024-04-23T10:18:36.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.246+0000 7f4cbe7fc700 1 -- 172.21.15.167:0/3167451543 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4cb8022470 con 0x7f4cc8100e90 2024-04-23T10:18:36.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.246+0000 7f4cbe7fc700 1 -- 172.21.15.167:0/3167451543 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb800f5f0 con 0x7f4cc8100e90 2024-04-23T10:18:36.247 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.246+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/3167451543 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc8199ae0 con 0x7f4cc8100e90 2024-04-23T10:18:36.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.247+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/3167451543 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc81021e0 con 0x7f4cc8100e90 2024-04-23T10:18:36.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.247+0000 7f4cbe7fc700 1 -- 172.21.15.167:0/3167451543 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f4cb802a070 con 0x7f4cc8100e90 2024-04-23T10:18:36.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.247+0000 7f4cbe7fc700 1 --2- 172.21.15.167:0/3167451543 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4cb4039650 0x7f4cb403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:36.248 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.247+0000 7f4cbe7fc700 1 -- 172.21.15.167:0/3167451543 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4cb801e030 con 0x7f4cc8100e90 2024-04-23T10:18:36.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.247+0000 7f4cccb6d700 1 --2- 172.21.15.167:0/3167451543 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4cb4039650 0x7f4cb403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:36.249 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.248+0000 7f4cccb6d700 1 --2- 172.21.15.167:0/3167451543 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4cb4039650 0x7f4cb403bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4006fd0 tx=0x7f4cc4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:36.251 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.252+0000 7f4cbe7fc700 1 -- 172.21.15.167:0/3167451543 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4cb8013070 con 0x7f4cc8100e90 2024-04-23T10:18:36.462 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.463+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/3167451543 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi146:172.21.15.146=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}) -- 0x7f4cc80640a0 con 0x7f4cb4039650 2024-04-23T10:18:36.469 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.470+0000 7f4cbe7fc700 1 -- 172.21.15.167:0/3167451543 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4cc80640a0 con 0x7f4cb4039650 2024-04-23T10:18:36.469 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mon update... 2024-04-23T10:18:36.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.472+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/3167451543 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4cb4039650 msgr2=0x7f4cb403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:36.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.472+0000 7f4ccf5d2700 1 --2- 172.21.15.167:0/3167451543 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4cb4039650 0x7f4cb403bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4006fd0 tx=0x7f4cc4006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:36.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.472+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/3167451543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cc8100e90 msgr2=0x7f4cc8198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:36.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.472+0000 7f4ccf5d2700 1 --2- 172.21.15.167:0/3167451543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cc8100e90 0x7f4cc8198df0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8006010 tx=0x7f4cb8009f30 comp rx=0 tx=0).stop 2024-04-23T10:18:36.471 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.472+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/3167451543 shutdown_connections 2024-04-23T10:18:36.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.472+0000 7f4ccf5d2700 1 --2- 172.21.15.167:0/3167451543 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4cb4039650 0x7f4cb403bb10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:36.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.472+0000 7f4ccf5d2700 1 --2- 172.21.15.167:0/3167451543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4cc8100e90 0x7f4cc8198df0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:36.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.472+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/3167451543 >> 172.21.15.167:0/3167451543 conn(0x7f4cc80fc5b0 msgr2=0x7f4cc8104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:36.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.472+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/3167451543 shutdown_connections 2024-04-23T10:18:36.472 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:36.472+0000 7f4ccf5d2700 1 -- 172.21.15.167:0/3167451543 wait complete. 2024-04-23T10:18:37.098 DEBUG:teuthology.orchestra.run.smithi146:mon.b> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.b.service 2024-04-23T10:18:37.100 DEBUG:teuthology.orchestra.run.smithi167:mon.c> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.c.service 2024-04-23T10:18:37.103 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-23T10:18:37.103 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T10:18:37.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:37 smithi069 ceph-mon[29593]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi146:172.21.15.146=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:18:37.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:37 smithi069 ceph-mon[29593]: Saving service mon spec with placement smithi069:172.21.15.69=a;smithi146:172.21.15.146=b;smithi167:172.21.15.167=c;count:3 2024-04-23T10:18:37.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:37.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:18:37.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:37.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:18:37.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:37.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:18:37.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:37.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:37 smithi069 ceph-mon[29593]: Deploying daemon mon.c on smithi167 2024-04-23T10:18:37.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:37 smithi069 ceph-mon[29593]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:38.742 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:40.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:39 smithi069 ceph-mon[29593]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.881+0000 7f5dc56d4700 1 -- 172.21.15.167:0/1951210549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dc01084f0 msgr2=0x7f5dc01088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.881+0000 7f5dc56d4700 1 --2- 172.21.15.167:0/1951210549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dc01084f0 0x7f5dc01088d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009910 tx=0x7f5db4009c20 comp rx=0 tx=0).stop 2024-04-23T10:18:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.881+0000 7f5dc56d4700 1 -- 172.21.15.167:0/1951210549 shutdown_connections 2024-04-23T10:18:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.881+0000 7f5dc56d4700 1 --2- 172.21.15.167:0/1951210549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dc01084f0 0x7f5dc01088d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.881+0000 7f5dc56d4700 1 -- 172.21.15.167:0/1951210549 >> 172.21.15.167:0/1951210549 conn(0x7f5dc00fdf70 msgr2=0x7f5dc0100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.881+0000 7f5dc56d4700 1 -- 172.21.15.167:0/1951210549 shutdown_connections 2024-04-23T10:18:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.881+0000 7f5dc56d4700 1 -- 172.21.15.167:0/1951210549 wait complete. 2024-04-23T10:18:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.882+0000 7f5dc56d4700 1 Processor -- start 2024-04-23T10:18:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.882+0000 7f5dc56d4700 1 -- start start 2024-04-23T10:18:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.882+0000 7f5dc56d4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dc01084f0 0x7f5dc0197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.882+0000 7f5dc56d4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc010ca90 con 0x7f5dc01084f0 2024-04-23T10:18:40.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.883+0000 7f5dbeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dc01084f0 0x7f5dc0197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:40.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.883+0000 7f5dbeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dc01084f0 0x7f5dc0197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.167:60868/0 (socket says 172.21.15.167:60868) 2024-04-23T10:18:40.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.883+0000 7f5dbeffd700 1 -- 172.21.15.167:0/2080950661 learned_addr learned my addr 172.21.15.167:0/2080950661 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-23T10:18:40.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.883+0000 7f5dbeffd700 1 -- 172.21.15.167:0/2080950661 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc0198430 con 0x7f5dc01084f0 2024-04-23T10:18:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.883+0000 7f5dbeffd700 1 --2- 172.21.15.167:0/2080950661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dc01084f0 0x7f5dc0197ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5db4005780 tx=0x7f5db40057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.883+0000 7f5da7fff700 1 -- 172.21.15.167:0/2080950661 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5db4026070 con 0x7f5dc01084f0 2024-04-23T10:18:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.883+0000 7f5dc56d4700 1 -- 172.21.15.167:0/2080950661 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc0198720 con 0x7f5dc01084f0 2024-04-23T10:18:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.883+0000 7f5da7fff700 1 -- 172.21.15.167:0/2080950661 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5db4004370 con 0x7f5dc01084f0 2024-04-23T10:18:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.883+0000 7f5da7fff700 1 -- 172.21.15.167:0/2080950661 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5db4003a30 con 0x7f5dc01084f0 2024-04-23T10:18:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.883+0000 7f5dc56d4700 1 -- 172.21.15.167:0/2080950661 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc019c7c0 con 0x7f5dc01084f0 2024-04-23T10:18:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.884+0000 7f5dc56d4700 1 -- 172.21.15.167:0/2080950661 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc0103ba0 con 0x7f5dc01084f0 2024-04-23T10:18:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.884+0000 7f5da7fff700 1 -- 172.21.15.167:0/2080950661 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f5db4029070 con 0x7f5dc01084f0 2024-04-23T10:18:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.885+0000 7f5da7fff700 1 --2- 172.21.15.167:0/2080950661 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5da8039650 0x7f5da803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.885+0000 7f5da7fff700 1 -- 172.21.15.167:0/2080950661 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5db401e070 con 0x7f5dc01084f0 2024-04-23T10:18:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.885+0000 7f5dbe7fc700 1 --2- 172.21.15.167:0/2080950661 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5da8039650 0x7f5da803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.885+0000 7f5dbe7fc700 1 --2- 172.21.15.167:0/2080950661 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5da8039650 0x7f5da803bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5db0006fd0 tx=0x7f5db0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:40.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:40.890+0000 7f5da7fff700 1 -- 172.21.15.167:0/2080950661 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5db4013070 con 0x7f5dc01084f0 2024-04-23T10:18:41.176 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.177+0000 7f5dc56d4700 1 -- 172.21.15.167:0/2080950661 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5dc00640d0 con 0x7f5dc01084f0 2024-04-23T10:18:41.177 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.178+0000 7f5da7fff700 1 -- 172.21.15.167:0/2080950661 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f5dc00640d0 con 0x7f5dc01084f0 2024-04-23T10:18:41.177 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:18:41.177 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","modified":"2024-04-23T10:17:03.719203Z","created":"2024-04-23T10:17:03.719203Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-23T10:18:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.180+0000 7f5dc56d4700 1 -- 172.21.15.167:0/2080950661 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5da8039650 msgr2=0x7f5da803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.180+0000 7f5dc56d4700 1 --2- 172.21.15.167:0/2080950661 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5da8039650 0x7f5da803bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5db0006fd0 tx=0x7f5db0006e40 comp rx=0 tx=0).stop 2024-04-23T10:18:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.180+0000 7f5dc56d4700 1 -- 172.21.15.167:0/2080950661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dc01084f0 msgr2=0x7f5dc0197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.180+0000 7f5dc56d4700 1 --2- 172.21.15.167:0/2080950661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dc01084f0 0x7f5dc0197ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5db4005780 tx=0x7f5db40057b0 comp rx=0 tx=0).stop 2024-04-23T10:18:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.180+0000 7f5dc56d4700 1 -- 172.21.15.167:0/2080950661 shutdown_connections 2024-04-23T10:18:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.180+0000 7f5dc56d4700 1 --2- 172.21.15.167:0/2080950661 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5da8039650 0x7f5da803bb10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.180+0000 7f5dc56d4700 1 --2- 172.21.15.167:0/2080950661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dc01084f0 0x7f5dc0197ef0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.180+0000 7f5dc56d4700 1 -- 172.21.15.167:0/2080950661 >> 172.21.15.167:0/2080950661 conn(0x7f5dc00fdf70 msgr2=0x7f5dc0109f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.180+0000 7f5dc56d4700 1 -- 172.21.15.167:0/2080950661 shutdown_connections 2024-04-23T10:18:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:41.180+0000 7f5dc56d4700 1 -- 172.21.15.167:0/2080950661 wait complete. 2024-04-23T10:18:41.180 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-04-23T10:18:41.220 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.db_log_dir: 2024-04-23T10:18:41.220 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.wal_dir: 2024-04-23T10:18:41.220 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-23T10:18:41.220 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-23T10:18:41.220 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-23T10:18:41.220 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.advise_random_on_open: 1 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.db_write_buffer_size: 0 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.write_buffer_manager: 0x558e193530e0 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.rate_limiter: (nil) 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.wal_recovery_mode: 2 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.enable_thread_tracking: 0 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.enable_pipelined_write: 0 2024-04-23T10:18:41.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.unordered_write: 0 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.row_cache: None 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.wal_filter: None 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.allow_ingest_behind: 0 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.two_write_queues: 0 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.manual_wal_flush: 0 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.wal_compression: 0 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.atomic_flush: 0 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-23T10:18:41.222 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.log_readahead_size: 0 2024-04-23T10:18:41.223 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-23T10:18:41.223 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.best_efforts_recovery: 0 2024-04-23T10:18:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-23T10:18:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-23T10:18:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.allow_data_in_errors: 0 2024-04-23T10:18:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.db_host_id: __hostname__ 2024-04-23T10:18:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-23T10:18:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_background_jobs: 2 2024-04-23T10:18:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_background_compactions: -1 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_subcompactions: 1 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_total_wal_size: 0 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_open_files: -1 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bytes_per_sync: 0 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-23T10:18:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_readahead_size: 0 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_background_flushes: -1 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Compression algorithms supported: 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: kZSTD supported: 0 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: kXpressCompression supported: 0 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: kLZ4HCCompression supported: 1 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: kZlibCompression supported: 1 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: kSnappyCompression supported: 1 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: kLZ4Compression supported: 1 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: kBZip2Compression supported: 0 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-23T10:18:41.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.merge_operator: 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_filter: None 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_filter_factory: None 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.sst_partitioner_factory: None 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558e193bfdc0) 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout: cache_index_and_filter_blocks: 1 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout: pin_top_level_index_and_filter: 1 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_type: 0 2024-04-23T10:18:41.586 INFO:journalctl@ceph.mon.c.smithi167.stdout: data_block_index_type: 0 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_shortening: 1 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: checksum: 4 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: no_block_cache: 0 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache: 0x558e193851f0 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_name: BinnedLRUCache 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_options: 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: capacity : 536870912 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: num_shard_bits : 4 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: strict_capacity_limit : 0 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: high_pri_pool_ratio: 0.000 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_compressed: (nil) 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: persistent_cache: (nil) 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_size: 4096 2024-04-23T10:18:41.587 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_size_deviation: 10 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_restart_interval: 16 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_block_restart_interval: 1 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: metadata_block_size: 4096 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: partition_filters: 0 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: use_delta_encoding: 1 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: filter_policy: bloomfilter 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: whole_key_filtering: 1 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: verify_compression: 0 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: read_amp_bytes_per_bit: 0 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: format_version: 5 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: enable_index_compression: 1 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_align: 0 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: max_auto_readahead_size: 262144 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: prepopulate_block_cache: 0 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: initial_auto_readahead_size: 8192 2024-04-23T10:18:41.588 INFO:journalctl@ceph.mon.c.smithi167.stdout: num_file_reads_for_auto_readahead: 2 2024-04-23T10:18:41.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.write_buffer_size: 33554432 2024-04-23T10:18:41.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_write_buffer_number: 2 2024-04-23T10:18:41.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compression: NoCompression 2024-04-23T10:18:41.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bottommost_compression: Disabled 2024-04-23T10:18:41.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.prefix_extractor: nullptr 2024-04-23T10:18:41.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-23T10:18:41.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.num_levels: 7 2024-04-23T10:18:41.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-23T10:18:41.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-23T10:18:41.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-23T10:18:41.589 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-23T10:18:41.590 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-23T10:18:41.590 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-23T10:18:41.590 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compression_opts.level: 32767 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compression_opts.strategy: 0 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compression_opts.enabled: false 2024-04-23T10:18:41.591 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.target_file_size_base: 67108864 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-23T10:18:41.592 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.arena_block_size: 1048576 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.disable_auto_compactions: 0 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-23T10:18:41.593 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.inplace_update_support: 0 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.bloom_locality: 0 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.max_successive_merges: 0 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.paranoid_file_checks: 0 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.force_consistency_checks: 1 2024-04-23T10:18:41.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.report_bg_io_stats: 0 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.ttl: 2592000 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.enable_blob_files: false 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.min_blob_size: 0 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.blob_file_size: 268435456 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.blob_file_starting_level: 0 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-23T10:18:41.595 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 228e890b-c665-492a-b5cd-4ced83e85573 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713867521222070, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713867521222500, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713867521, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "228e890b-c665-492a-b5cd-4ced83e85573", "db_session_id": "HLEB74HLOYJQTVRF30VZ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713867521222582, "job": 1, "event": "recovery_finished"} 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558e1949a000 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: DB pointer 0x558e19484000 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** DB Stats ** 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-23T10:18:41.596 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** Compaction Stats [default] ** 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** Compaction Stats [default] ** 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-23T10:18:41.597 INFO:journalctl@ceph.mon.c.smithi167.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: Block cache BinnedLRUCache@0x558e193851f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-04-23T10:18:41.598 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: using public_addr v2:172.21.15.167:0/0 -> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: starting mon.c rank -1 at public addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] at bind addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(???) e0 preinit fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).mds e1 new map 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout: e1 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout: legacy client fscid: -1 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout: No filesystems configured 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-23T10:18:41.599 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi146", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:18:41.600 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Deploying cephadm binary to smithi167 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Updating smithi146:/etc/ceph/ceph.conf 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Updating smithi146:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Added host smithi167 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.601 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/937720477' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/937720477' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Updating smithi167:/etc/ceph/ceph.conf 2024-04-23T10:18:41.602 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi146:172.21.15.146=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Saving service mon spec with placement smithi069:172.21.15.69=a;smithi146:172.21.15.146=b;smithi167:172.21.15.167=c;count:3 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:18:41.603 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:41.604 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: Deploying daemon mon.c on smithi167 2024-04-23T10:18:41.604 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:41.604 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:41.604 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 ceph-mon[32940]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-23T10:18:41.604 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 bash[32900]: c50689af9ecddcff9a8c4c961778e6e6b6ff717c8855c6e23d9de43edb61b851 2024-04-23T10:18:41.604 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:41 smithi167 systemd[1]: Started Ceph mon.c for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:18:42.875 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-23T10:18:42.876 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T10:18:43.122 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:18:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:18:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: mon.a calling monitor election 2024-04-23T10:18:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: mon.c calling monitor election 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: monmap epoch 2 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: last_changed 2024-04-23T10:18:41.250897+0000 2024-04-23T10:18:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: created 2024-04-23T10:17:03.719203+0000 2024-04-23T10:18:46.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: min_mon_release 19 (squid) 2024-04-23T10:18:46.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: election_strategy: 1 2024-04-23T10:18:46.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-04-23T10:18:46.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-04-23T10:18:46.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: fsmap 2024-04-23T10:18:46.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T10:18:46.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: mgrmap e13: x(active, since 47s) 2024-04-23T10:18:46.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: overall HEALTH_OK 2024-04-23T10:18:46.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:46.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:46.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:18:46.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: mon.a calling monitor election 2024-04-23T10:18:46.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:46.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: mon.c calling monitor election 2024-04-23T10:18:46.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:46.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: monmap epoch 2 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: last_changed 2024-04-23T10:18:41.250897+0000 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: created 2024-04-23T10:17:03.719203+0000 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: min_mon_release 19 (squid) 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: election_strategy: 1 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: fsmap 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: mgrmap e13: x(active, since 47s) 2024-04-23T10:18:46.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: overall HEALTH_OK 2024-04-23T10:18:46.745 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:46.745 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:47.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.558+0000 7f076d83b700 1 -- 172.21.15.167:0/3517984459 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07500035c0 msgr2=0x7f0750005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:47.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.558+0000 7f076d83b700 1 --2- 172.21.15.167:0/3517984459 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07500035c0 0x7f0750005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f076806ac90 tx=0x7f075800feb0 comp rx=0 tx=0).stop 2024-04-23T10:18:47.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.558+0000 7f076d83b700 1 -- 172.21.15.167:0/3517984459 shutdown_connections 2024-04-23T10:18:47.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.558+0000 7f076d83b700 1 --2- 172.21.15.167:0/3517984459 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07500035c0 0x7f0750005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:47.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.559+0000 7f076d83b700 1 -- 172.21.15.167:0/3517984459 >> 172.21.15.167:0/3517984459 conn(0x7f07680fcf80 msgr2=0x7f07680ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:47.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.559+0000 7f076d83b700 1 -- 172.21.15.167:0/3517984459 shutdown_connections 2024-04-23T10:18:47.559 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.559+0000 7f076d83b700 1 -- 172.21.15.167:0/3517984459 wait complete. 2024-04-23T10:18:47.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.559+0000 7f076d83b700 1 Processor -- start 2024-04-23T10:18:47.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.560+0000 7f076d83b700 1 -- start start 2024-04-23T10:18:47.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.560+0000 7f076d83b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07500035c0 0x7f0768198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:47.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.560+0000 7f076d83b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07681986b0 0x7f076819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:47.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.560+0000 7f076d83b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f076810a5f0 con 0x7f07500035c0 2024-04-23T10:18:47.560 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.560+0000 7f076d83b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f076810a470 con 0x7f07681986b0 2024-04-23T10:18:47.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.560+0000 7f07667fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07681986b0 0x7f076819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:47.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.560+0000 7f07667fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07681986b0 0x7f076819c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58634/0 (socket says 172.21.15.167:58634) 2024-04-23T10:18:47.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.560+0000 7f07667fc700 1 -- 172.21.15.167:0/613610871 learned_addr learned my addr 172.21.15.167:0/613610871 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-23T10:18:47.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.560+0000 7f0766ffd700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07500035c0 0x7f0768198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:47.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f07667fc700 1 -- 172.21.15.167:0/613610871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07681986b0 msgr2=0x7f076819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-23T10:18:47.562 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f07667fc700 1 -- 172.21.15.167:0/613610871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07681986b0 msgr2=0x7f076819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f07667fc700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07681986b0 0x7f076819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f07667fc700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07681986b0 0x7f076819c9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f0766ffd700 1 -- 172.21.15.167:0/613610871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07681986b0 msgr2=0x7f076819c9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f0766ffd700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07681986b0 0x7f076819c9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f0766ffd700 1 -- 172.21.15.167:0/613610871 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0768198cf0 con 0x7f07500035c0 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f0766ffd700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07500035c0 0x7f0768198170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f076806ac90 tx=0x7f0758004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f076c839700 1 -- 172.21.15.167:0/613610871 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0758005170 con 0x7f07500035c0 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f076d83b700 1 -- 172.21.15.167:0/613610871 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f076819cee0 con 0x7f07500035c0 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f076d83b700 1 -- 172.21.15.167:0/613610871 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f076819d440 con 0x7f07500035c0 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f076c839700 1 -- 172.21.15.167:0/613610871 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0758004030 con 0x7f07500035c0 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.561+0000 7f076c839700 1 -- 172.21.15.167:0/613610871 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0758011a80 con 0x7f07500035c0 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.562+0000 7f076c839700 1 -- 172.21.15.167:0/613610871 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f0758023070 con 0x7f07500035c0 2024-04-23T10:18:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.562+0000 7f076d83b700 1 -- 172.21.15.167:0/613610871 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f076806b490 con 0x7f07500035c0 2024-04-23T10:18:47.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.563+0000 7f076c839700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f07540393f0 0x7f075403b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:47.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.563+0000 7f076c839700 1 -- 172.21.15.167:0/613610871 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0758020050 con 0x7f07500035c0 2024-04-23T10:18:47.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.563+0000 7f07667fc700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f07540393f0 0x7f075403b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:47.564 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.563+0000 7f07667fc700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f07540393f0 0x7f075403b8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f075c009180 tx=0x7f075c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:47.567 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.568+0000 7f076c839700 1 -- 172.21.15.167:0/613610871 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0758028020 con 0x7f07500035c0 2024-04-23T10:18:47.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:18:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:47 smithi167 ceph-mon[32940]: Deploying daemon mon.b on smithi146 2024-04-23T10:18:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:47 smithi167 ceph-mon[32940]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:47.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:47.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:18:47.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:47.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:47 smithi069 ceph-mon[29593]: Deploying daemon mon.b on smithi146 2024-04-23T10:18:47.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:47 smithi069 ceph-mon[29593]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:47.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:47.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.853+0000 7f076d83b700 1 -- 172.21.15.167:0/613610871 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f076819d6c0 con 0x7f07500035c0 2024-04-23T10:18:47.853 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.854+0000 7f076c839700 1 -- 172.21.15.167:0/613610871 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f075800f8b0 con 0x7f07500035c0 2024-04-23T10:18:47.853 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:18:47.853 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":2,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","modified":"2024-04-23T10:18:41.250897Z","created":"2024-04-23T10:17:03.719203Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-23T10:18:47.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.856+0000 7f076d83b700 1 -- 172.21.15.167:0/613610871 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f07540393f0 msgr2=0x7f075403b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:47.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.856+0000 7f076d83b700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f07540393f0 0x7f075403b8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f075c009180 tx=0x7f075c008040 comp rx=0 tx=0).stop 2024-04-23T10:18:47.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.856+0000 7f076d83b700 1 -- 172.21.15.167:0/613610871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07500035c0 msgr2=0x7f0768198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:47.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.856+0000 7f076d83b700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07500035c0 0x7f0768198170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f076806ac90 tx=0x7f0758004f60 comp rx=0 tx=0).stop 2024-04-23T10:18:47.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.856+0000 7f076d83b700 1 -- 172.21.15.167:0/613610871 shutdown_connections 2024-04-23T10:18:47.855 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.856+0000 7f076d83b700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f07540393f0 0x7f075403b8b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:47.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.856+0000 7f076d83b700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07500035c0 0x7f0768198170 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:47.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.856+0000 7f076d83b700 1 --2- 172.21.15.167:0/613610871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07681986b0 0x7f076819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:47.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.856+0000 7f076d83b700 1 -- 172.21.15.167:0/613610871 >> 172.21.15.167:0/613610871 conn(0x7f07680fcf80 msgr2=0x7f07680fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:47.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.856+0000 7f076d83b700 1 -- 172.21.15.167:0/613610871 shutdown_connections 2024-04-23T10:18:47.856 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:47.856+0000 7f076d83b700 1 -- 172.21.15.167:0/613610871 wait complete. 2024-04-23T10:18:47.856 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 2 2024-04-23T10:18:48.519 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:48 smithi167 ceph-mon[32940]: from='client.? 172.21.15.167:0/613610871' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T10:18:48.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:48 smithi069 ceph-mon[29593]: from='client.? 172.21.15.167:0/613610871' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T10:18:49.549 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-23T10:18:49.549 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-23T10:18:49.572 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:49 smithi167 ceph-mon[32940]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:49.660 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:49 smithi069 ceph-mon[29593]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:49.784 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:18:50.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:50 smithi146 systemd[1]: Started Ceph mon.b for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:18:55.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.601+0000 7f4c0ae50700 1 -- 172.21.15.167:0/1711813243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bec0035c0 msgr2=0x7f4bec005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:55.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.601+0000 7f4c0ae50700 1 --2- 172.21.15.167:0/1711813243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bec0035c0 0x7f4bec005a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c04102490 tx=0x7f4bfc009e80 comp rx=0 tx=0).stop 2024-04-23T10:18:55.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.601+0000 7f4c0ae50700 1 -- 172.21.15.167:0/1711813243 shutdown_connections 2024-04-23T10:18:55.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.601+0000 7f4c0ae50700 1 --2- 172.21.15.167:0/1711813243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bec0035c0 0x7f4bec005a50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:55.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.601+0000 7f4c0ae50700 1 -- 172.21.15.167:0/1711813243 >> 172.21.15.167:0/1711813243 conn(0x7f4c040fe050 msgr2=0x7f4c04100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:55.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.601+0000 7f4c0ae50700 1 -- 172.21.15.167:0/1711813243 shutdown_connections 2024-04-23T10:18:55.600 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.601+0000 7f4c0ae50700 1 -- 172.21.15.167:0/1711813243 wait complete. 2024-04-23T10:18:55.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.601+0000 7f4c0ae50700 1 Processor -- start 2024-04-23T10:18:55.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c0ae50700 1 -- start start 2024-04-23T10:18:55.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c0ae50700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bec0035c0 0x7f4c04074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:55.602 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c0ae50700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c04075280 0x7f4c04075700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c0ae50700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041a43b0 0x7f4c041a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c0ae50700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0410a5c0 con 0x7f4c04075280 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c0ae50700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0410a440 con 0x7f4c041a43b0 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c0ae50700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0410a740 con 0x7f4bec0035c0 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c08bec700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bec0035c0 0x7f4c04074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c03fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c04075280 0x7f4c04075700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c03fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c04075280 0x7f4c04075700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.167:37050/0 (socket says 172.21.15.167:37050) 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c03fff700 1 -- 172.21.15.167:0/936872386 learned_addr learned my addr 172.21.15.167:0/936872386 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c093ed700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041a43b0 0x7f4c041a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c08bec700 1 -- 172.21.15.167:0/936872386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bec0035c0 msgr2=0x7f4c04074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c08bec700 1 -- 172.21.15.167:0/936872386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bec0035c0 msgr2=0x7f4c04074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c08bec700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bec0035c0 0x7f4c04074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c08bec700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bec0035c0 0x7f4c04074d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c093ed700 1 -- 172.21.15.167:0/936872386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041a43b0 msgr2=0x7f4c041a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-04-23T10:18:55.603 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c093ed700 1 -- 172.21.15.167:0/936872386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041a43b0 msgr2=0x7f4c041a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c093ed700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041a43b0 0x7f4c041a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c093ed700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041a43b0 0x7f4c041a67a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c03fff700 1 -- 172.21.15.167:0/936872386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bec0035c0 msgr2=0x7f4c04074d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c03fff700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bec0035c0 0x7f4c04074d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c03fff700 1 -- 172.21.15.167:0/936872386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041a43b0 msgr2=0x7f4c041a67a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c03fff700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041a43b0 0x7f4c041a67a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.602+0000 7f4c03fff700 1 -- 172.21.15.167:0/936872386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c041a6ed0 con 0x7f4c04075280 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.603+0000 7f4c03fff700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c04075280 0x7f4c04075700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800b780 tx=0x7f4bf800bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.603+0000 7f4c01ffb700 1 -- 172.21.15.167:0/936872386 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8004230 con 0x7f4c04075280 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.603+0000 7f4c01ffb700 1 -- 172.21.15.167:0/936872386 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4bf80043d0 con 0x7f4c04075280 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.603+0000 7f4c0ae50700 1 -- 172.21.15.167:0/936872386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c041a71c0 con 0x7f4c04075280 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.603+0000 7f4c01ffb700 1 -- 172.21.15.167:0/936872386 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8011c30 con 0x7f4c04075280 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.603+0000 7f4c0ae50700 1 -- 172.21.15.167:0/936872386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c041a7700 con 0x7f4c04075280 2024-04-23T10:18:55.604 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.604+0000 7f4c01ffb700 1 -- 172.21.15.167:0/936872386 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f4bf801a400 con 0x7f4c04075280 2024-04-23T10:18:55.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.604+0000 7f4c01ffb700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4bf0039ae0 0x7f4bf003bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:55.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.604+0000 7f4c01ffb700 1 -- 172.21.15.167:0/936872386 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4bf804c470 con 0x7f4c04075280 2024-04-23T10:18:55.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.604+0000 7f4c08bec700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4bf0039ae0 0x7f4bf003bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:55.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.604+0000 7f4c0ae50700 1 -- 172.21.15.167:0/936872386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c040640a0 con 0x7f4c04075280 2024-04-23T10:18:55.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.605+0000 7f4c08bec700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4bf0039ae0 0x7f4bf003bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009a30 tx=0x7f4bfc00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:55.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.610+0000 7f4c01ffb700 1 -- 172.21.15.167:0/936872386 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4bf8018750 con 0x7f4c04075280 2024-04-23T10:18:55.609 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:18:55.609 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: mon.c calling monitor election 2024-04-23T10:18:55.609 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: mon.a calling monitor election 2024-04-23T10:18:55.609 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.609 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:55.609 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:55.609 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.609 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: monmap epoch 3 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: last_changed 2024-04-23T10:18:50.296919+0000 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: created 2024-04-23T10:17:03.719203+0000 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: min_mon_release 19 (squid) 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: election_strategy: 1 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-04-23T10:18:55.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: fsmap 2024-04-23T10:18:55.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T10:18:55.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: mgrmap e13: x(active, since 56s) 2024-04-23T10:18:55.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: overall HEALTH_OK 2024-04-23T10:18:55.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:55.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:18:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: mon.c calling monitor election 2024-04-23T10:18:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: mon.a calling monitor election 2024-04-23T10:18:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: monmap epoch 3 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: last_changed 2024-04-23T10:18:50.296919+0000 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: created 2024-04-23T10:17:03.719203+0000 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: min_mon_release 19 (squid) 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: election_strategy: 1 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-04-23T10:18:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-04-23T10:18:55.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: fsmap 2024-04-23T10:18:55.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T10:18:55.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: mgrmap e13: x(active, since 56s) 2024-04-23T10:18:55.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: overall HEALTH_OK 2024-04-23T10:18:55.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:55.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:55.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.899+0000 7f4c0ae50700 1 -- 172.21.15.167:0/936872386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4c041a79c0 con 0x7f4c04075280 2024-04-23T10:18:55.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.900+0000 7f4c01ffb700 1 -- 172.21.15.167:0/936872386 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7f4bf8003c90 con 0x7f4c04075280 2024-04-23T10:18:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-23T10:18:55.899 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":3,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","modified":"2024-04-23T10:18:50.296919Z","created":"2024-04-23T10:17:03.719203Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:3300","nonce":0},{"type":"v1","addr":"172.21.15.146:6789","nonce":0}]},"addr":"172.21.15.146:6789/0","public_addr":"172.21.15.146:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-23T10:18:55.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 -- 172.21.15.167:0/936872386 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4bf0039ae0 msgr2=0x7f4bf003bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:55.901 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4bf0039ae0 0x7f4bf003bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009a30 tx=0x7f4bfc00b040 comp rx=0 tx=0).stop 2024-04-23T10:18:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 -- 172.21.15.167:0/936872386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c04075280 msgr2=0x7f4c04075700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c04075280 0x7f4c04075700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800b780 tx=0x7f4bf800bb40 comp rx=0 tx=0).stop 2024-04-23T10:18:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 -- 172.21.15.167:0/936872386 shutdown_connections 2024-04-23T10:18:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4bf0039ae0 0x7f4bf003bfa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041a43b0 0x7f4c041a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bec0035c0 0x7f4c04074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 --2- 172.21.15.167:0/936872386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c04075280 0x7f4c04075700 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 -- 172.21.15.167:0/936872386 >> 172.21.15.167:0/936872386 conn(0x7f4c040fe050 msgr2=0x7f4c040ffe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 -- 172.21.15.167:0/936872386 shutdown_connections 2024-04-23T10:18:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:18:55.902+0000 7f4c0ae50700 1 -- 172.21.15.167:0/936872386 wait complete. 2024-04-23T10:18:55.903 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 3 2024-04-23T10:18:56.465 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:56.465 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:56.465 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:18:56.465 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:56 smithi167 ceph-mon[32940]: from='client.? 172.21.15.167:0/936872386' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T10:18:56.465 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:56.491 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-23T10:18:56.492 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-23T10:18:56.740 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:18:56.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:56.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:56.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:18:56.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:56 smithi069 ceph-mon[29593]: from='client.? 172.21.15.167:0/936872386' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T10:18:56.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:57.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:18:57.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: mon.c calling monitor election 2024-04-23T10:18:57.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: mon.a calling monitor election 2024-04-23T10:18:57.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:57.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:18:57.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:57.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:57.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: monmap epoch 3 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: last_changed 2024-04-23T10:18:50.296919+0000 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: created 2024-04-23T10:17:03.719203+0000 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: min_mon_release 19 (squid) 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: election_strategy: 1 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-04-23T10:18:57.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-04-23T10:18:57.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: fsmap 2024-04-23T10:18:57.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T10:18:57.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: mgrmap e13: x(active, since 56s) 2024-04-23T10:18:57.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: overall HEALTH_OK 2024-04-23T10:18:57.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:57.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:57.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:57.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:57.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:18:57.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='client.? 172.21.15.167:0/936872386' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-23T10:18:57.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:58.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.397+0000 7f863a024700 1 -- 172.21.15.69:0/1861852052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8634101590 msgr2=0x7f8634101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:58.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.397+0000 7f863a024700 1 --2- 172.21.15.69:0/1861852052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8634101590 0x7f8634101970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8624009910 tx=0x7f8624009c20 comp rx=0 tx=0).stop 2024-04-23T10:18:58.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.397+0000 7f863a024700 1 -- 172.21.15.69:0/1861852052 shutdown_connections 2024-04-23T10:18:58.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.397+0000 7f863a024700 1 --2- 172.21.15.69:0/1861852052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8634101590 0x7f8634101970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.397+0000 7f863a024700 1 -- 172.21.15.69:0/1861852052 >> 172.21.15.69:0/1861852052 conn(0x7f86340fce40 msgr2=0x7f86340ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:58.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.397+0000 7f863a024700 1 -- 172.21.15.69:0/1861852052 shutdown_connections 2024-04-23T10:18:58.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.397+0000 7f863a024700 1 -- 172.21.15.69:0/1861852052 wait complete. 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f863a024700 1 Processor -- start 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f863a024700 1 -- start start 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f863a024700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8634101590 0x7f8634196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f863a024700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8634197360 0x7f86341977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f863a024700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86341a4490 0x7f86341a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f863a024700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f863410b910 con 0x7f8634101590 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f863a024700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f863410b790 con 0x7f86341a4490 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f863a024700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f863410ba90 con 0x7f8634197360 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f86337fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8634101590 0x7f8634196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f86337fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8634101590 0x7f8634196e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55764/0 (socket says 172.21.15.69:55764) 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f86337fe700 1 -- 172.21.15.69:0/3332312155 learned_addr learned my addr 172.21.15.69:0/3332312155 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f8632ffd700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8634197360 0x7f86341977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f86337fe700 1 -- 172.21.15.69:0/3332312155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8634197360 msgr2=0x7f86341977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f86337fe700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8634197360 0x7f86341977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f86337fe700 1 -- 172.21.15.69:0/3332312155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86341a4490 msgr2=0x7f86341a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f86337fe700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86341a4490 0x7f86341a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.398+0000 7f86337fe700 1 -- 172.21.15.69:0/3332312155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86341a6e40 con 0x7f8634101590 2024-04-23T10:18:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.399+0000 7f86337fe700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8634101590 0x7f8634196e20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f862400bdf0 tx=0x7f862400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.399+0000 7f8630ff9700 1 -- 172.21.15.69:0/3332312155 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624027070 con 0x7f8634101590 2024-04-23T10:18:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.399+0000 7f8630ff9700 1 -- 172.21.15.69:0/3332312155 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8624005da0 con 0x7f8634101590 2024-04-23T10:18:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.399+0000 7f863a024700 1 -- 172.21.15.69:0/3332312155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86341a7130 con 0x7f8634101590 2024-04-23T10:18:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.399+0000 7f8630ff9700 1 -- 172.21.15.69:0/3332312155 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862400f460 con 0x7f8634101590 2024-04-23T10:18:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.399+0000 7f863a024700 1 -- 172.21.15.69:0/3332312155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86341a76c0 con 0x7f8634101590 2024-04-23T10:18:58.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.400+0000 7f8630ff9700 1 -- 172.21.15.69:0/3332312155 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f862402a070 con 0x7f8634101590 2024-04-23T10:18:58.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.400+0000 7f863a024700 1 -- 172.21.15.69:0/3332312155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86340640a0 con 0x7f8634101590 2024-04-23T10:18:58.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.400+0000 7f8630ff9700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f861c039ae0 0x7f861c03bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:58.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.400+0000 7f8630ff9700 1 -- 172.21.15.69:0/3332312155 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f862404d8d0 con 0x7f8634101590 2024-04-23T10:18:58.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.400+0000 7f8632ffd700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f861c039ae0 0x7f861c03bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:58.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.400+0000 7f8632ffd700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f861c039ae0 0x7f861c03bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8628009850 tx=0x7f8628008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:58.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.405+0000 7f8630ff9700 1 -- 172.21.15.69:0/3332312155 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8624013070 con 0x7f8634101590 2024-04-23T10:18:58.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: mon.b calling monitor election 2024-04-23T10:18:58.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-23T10:18:58.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: Updating smithi146:/etc/ceph/ceph.conf 2024-04-23T10:18:58.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: Updating smithi167:/etc/ceph/ceph.conf 2024-04-23T10:18:58.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: mon.b calling monitor election 2024-04-23T10:18:58.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: mon.c calling monitor election 2024-04-23T10:18:58.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: mon.a calling monitor election 2024-04-23T10:18:58.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-23T10:18:58.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: monmap epoch 3 2024-04-23T10:18:58.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: last_changed 2024-04-23T10:18:50.296919+0000 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: created 2024-04-23T10:17:03.719203+0000 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: min_mon_release 19 (squid) 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: election_strategy: 1 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: fsmap 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: mgrmap e13: x(active, since 58s) 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: overall HEALTH_OK 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: Updating smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:58.494 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: Reconfiguring mon.a (unknown last config time)... 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:58.495 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:58 smithi069 ceph-mon[29593]: Reconfiguring daemon mon.a on smithi069 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: mon.b calling monitor election 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: Updating smithi146:/etc/ceph/ceph.conf 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: Updating smithi167:/etc/ceph/ceph.conf 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: mon.b calling monitor election 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: mon.c calling monitor election 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: mon.a calling monitor election 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: monmap epoch 3 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: last_changed 2024-04-23T10:18:50.296919+0000 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: created 2024-04-23T10:17:03.719203+0000 2024-04-23T10:18:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: min_mon_release 19 (squid) 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: election_strategy: 1 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: fsmap 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: mgrmap e13: x(active, since 58s) 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: overall HEALTH_OK 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: Updating smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: Reconfiguring mon.a (unknown last config time)... 2024-04-23T10:18:58.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:18:58.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T10:18:58.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:58.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:58 smithi167 ceph-mon[32940]: Reconfiguring daemon mon.a on smithi069 2024-04-23T10:18:58.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.617+0000 7f863a024700 1 -- 172.21.15.69:0/3332312155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f86341a79c0 con 0x7f8634101590 2024-04-23T10:18:58.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.617+0000 7f8630ff9700 1 -- 172.21.15.69:0/3332312155 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f8624031020 con 0x7f8634101590 2024-04-23T10:18:58.616 INFO:teuthology.orchestra.run.smithi069.stdout:# minimal ceph.conf for ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:58.616 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2024-04-23T10:18:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: mon_host = [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.619+0000 7f863a024700 1 -- 172.21.15.69:0/3332312155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f861c039ae0 msgr2=0x7f861c03bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.619+0000 7f863a024700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f861c039ae0 0x7f861c03bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8628009850 tx=0x7f8628008040 comp rx=0 tx=0).stop 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.619+0000 7f863a024700 1 -- 172.21.15.69:0/3332312155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8634101590 msgr2=0x7f8634196e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.619+0000 7f863a024700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8634101590 0x7f8634196e20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f862400bdf0 tx=0x7f862400bed0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.619+0000 7f863a024700 1 -- 172.21.15.69:0/3332312155 shutdown_connections 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.619+0000 7f863a024700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f861c039ae0 0x7f861c03bfa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.619+0000 7f863a024700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86341a4490 0x7f86341a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.619+0000 7f863a024700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8634101590 0x7f8634196e20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.619+0000 7f863a024700 1 --2- 172.21.15.69:0/3332312155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8634197360 0x7f86341977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.619+0000 7f863a024700 1 -- 172.21.15.69:0/3332312155 >> 172.21.15.69:0/3332312155 conn(0x7f86340fce40 msgr2=0x7f8634102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.620+0000 7f863a024700 1 -- 172.21.15.69:0/3332312155 shutdown_connections 2024-04-23T10:18:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:18:58.620+0000 7f863a024700 1 -- 172.21.15.69:0/3332312155 wait complete. 2024-04-23T10:18:58.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: mon.b calling monitor election 2024-04-23T10:18:58.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-23T10:18:58.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: Updating smithi146:/etc/ceph/ceph.conf 2024-04-23T10:18:58.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: Updating smithi167:/etc/ceph/ceph.conf 2024-04-23T10:18:58.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: mon.b calling monitor election 2024-04-23T10:18:58.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: mon.c calling monitor election 2024-04-23T10:18:58.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: mon.a calling monitor election 2024-04-23T10:18:58.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-23T10:18:58.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: monmap epoch 3 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: last_changed 2024-04-23T10:18:50.296919+0000 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: created 2024-04-23T10:17:03.719203+0000 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: min_mon_release 19 (squid) 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: election_strategy: 1 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: fsmap 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: osdmap e4: 0 total, 0 up, 0 in 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: mgrmap e13: x(active, since 58s) 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: overall HEALTH_OK 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: Updating smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:18:58.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: Reconfiguring mon.a (unknown last config time)... 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:58.680 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:58 smithi146 ceph-mon[32800]: Reconfiguring daemon mon.a on smithi069 2024-04-23T10:18:59.150 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-23T10:18:59.150 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:18:59.150 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.conf 2024-04-23T10:18:59.175 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:18:59.175 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:18:59.238 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-23T10:18:59.239 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.conf 2024-04-23T10:18:59.271 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-23T10:18:59.271 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:18:59.340 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-23T10:18:59.340 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.conf 2024-04-23T10:18:59.370 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-23T10:18:59.370 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:18:59.423 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:59.423 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:59 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3332312155' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:59.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:59 smithi069 ceph-mon[29593]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:59.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:18:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:59.438 INFO:tasks.cephadm:Adding mgr.x on smithi069 2024-04-23T10:18:59.438 INFO:tasks.cephadm:Adding mgr.y on smithi146 2024-04-23T10:18:59.439 INFO:tasks.cephadm:Adding mgr.z on smithi167 2024-04-23T10:18:59.439 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi069=x;smithi146=y;smithi167=z' 2024-04-23T10:18:59.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:59.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:59 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3332312155' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:59.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:59 smithi167 ceph-mon[32940]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:59.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:18:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:59.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:18:59.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:59 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3332312155' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:18:59.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:59 smithi146 ceph-mon[32800]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:18:59.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:18:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:18:59.714 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:19:01.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.076+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1627825464 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2dc1014e0 msgr2=0x7fb2dc101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:01.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.076+0000 7fb2e3ddc700 1 --2- 172.21.15.167:0/1627825464 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2dc1014e0 0x7fb2dc101900 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009910 tx=0x7fb2d8009c20 comp rx=0 tx=0).stop 2024-04-23T10:19:01.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.076+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1627825464 shutdown_connections 2024-04-23T10:19:01.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.076+0000 7fb2e3ddc700 1 --2- 172.21.15.167:0/1627825464 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2dc1014e0 0x7fb2dc101900 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:01.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.076+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1627825464 >> 172.21.15.167:0/1627825464 conn(0x7fb2dc0fca80 msgr2=0x7fb2dc0feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:01.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.076+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1627825464 shutdown_connections 2024-04-23T10:19:01.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.076+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1627825464 wait complete. 2024-04-23T10:19:01.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e3ddc700 1 Processor -- start 2024-04-23T10:19:01.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e3ddc700 1 -- start start 2024-04-23T10:19:01.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e3ddc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2dc1014e0 0x7fb2dc0fea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:01.078 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e3ddc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2dc0fd070 0x7fb2dc0fd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e3ddc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2dc0fda30 0x7fb2dc1a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e3ddc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc107510 con 0x7fb2dc0fd070 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e3ddc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc107390 con 0x7fb2dc0fda30 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e3ddc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc107690 con 0x7fb2dc1014e0 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e1b78700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2dc1014e0 0x7fb2dc0fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e1b78700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2dc1014e0 0x7fb2dc0fea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58742/0 (socket says 172.21.15.167:58742) 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e1b78700 1 -- 172.21.15.167:0/1957850722 learned_addr learned my addr 172.21.15.167:0/1957850722 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e1377700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2dc0fd070 0x7fb2dc0fd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e2379700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2dc0fda30 0x7fb2dc1a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e1b78700 1 -- 172.21.15.167:0/1957850722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2dc0fda30 msgr2=0x7fb2dc1a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e1b78700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2dc0fda30 0x7fb2dc1a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e1b78700 1 -- 172.21.15.167:0/1957850722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2dc0fd070 msgr2=0x7fb2dc0fd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e1b78700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2dc0fd070 0x7fb2dc0fd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:01.079 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e1b78700 1 -- 172.21.15.167:0/1957850722 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2dc1a2470 con 0x7fb2dc1014e0 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e2379700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2dc0fda30 0x7fb2dc1a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.077+0000 7fb2e1377700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2dc0fd070 0x7fb2dc0fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.078+0000 7fb2e1b78700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2dc1014e0 0x7fb2dc0fea20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800be40 tx=0x7fb2d800be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.078+0000 7fb2d2ffd700 1 -- 172.21.15.167:0/1957850722 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8027070 con 0x7fb2dc1014e0 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.078+0000 7fb2d2ffd700 1 -- 172.21.15.167:0/1957850722 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2d8005da0 con 0x7fb2dc1014e0 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.078+0000 7fb2d2ffd700 1 -- 172.21.15.167:0/1957850722 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800f460 con 0x7fb2dc1014e0 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.078+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1957850722 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2dc1a2700 con 0x7fb2dc1014e0 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.078+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1957850722 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2dc1a2c60 con 0x7fb2dc1014e0 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.079+0000 7fb2d2ffd700 1 -- 172.21.15.167:0/1957850722 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fb2d802a070 con 0x7fb2dc1014e0 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.079+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1957850722 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2dc0640a0 con 0x7fb2dc1014e0 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.079+0000 7fb2d2ffd700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb2c8039ae0 0x7fb2c803bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.079+0000 7fb2d2ffd700 1 -- 172.21.15.167:0/1957850722 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb2d804db70 con 0x7fb2dc1014e0 2024-04-23T10:19:01.080 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.079+0000 7fb2e1377700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb2c8039ae0 0x7fb2c803bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:01.081 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.080+0000 7fb2e1377700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb2c8039ae0 0x7fb2c803bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009ec0 tx=0x7fb2cc009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:01.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.084+0000 7fb2d2ffd700 1 -- 172.21.15.167:0/1957850722 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb2d8013070 con 0x7fb2dc1014e0 2024-04-23T10:19:01.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.292+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1957850722 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi146=y;smithi167=z", "target": ["mon-mgr", ""]}) -- 0x7fb2dc062e80 con 0x7fb2c8039ae0 2024-04-23T10:19:01.292 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:01 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:01.292 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:01 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:01.292 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:01 smithi167 ceph-mon[32940]: Reconfiguring mon.b (monmap changed)... 2024-04-23T10:19:01.293 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:01 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:19:01.293 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:01 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T10:19:01.293 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:01 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:01.293 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:01 smithi167 ceph-mon[32940]: Reconfiguring daemon mon.b on smithi146 2024-04-23T10:19:01.299 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.299+0000 7fb2d2ffd700 1 -- 172.21.15.167:0/1957850722 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb2dc062e80 con 0x7fb2c8039ae0 2024-04-23T10:19:01.299 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mgr update... 2024-04-23T10:19:01.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.301+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1957850722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb2c8039ae0 msgr2=0x7fb2c803bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:01.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.302+0000 7fb2e3ddc700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb2c8039ae0 0x7fb2c803bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009ec0 tx=0x7fb2cc009210 comp rx=0 tx=0).stop 2024-04-23T10:19:01.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.302+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1957850722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2dc1014e0 msgr2=0x7fb2dc0fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:01.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.302+0000 7fb2e3ddc700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2dc1014e0 0x7fb2dc0fea20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800be40 tx=0x7fb2d800be70 comp rx=0 tx=0).stop 2024-04-23T10:19:01.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.302+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1957850722 shutdown_connections 2024-04-23T10:19:01.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.302+0000 7fb2e3ddc700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb2c8039ae0 0x7fb2c803bfa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:01.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.302+0000 7fb2e3ddc700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2dc0fda30 0x7fb2dc1a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:01.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.302+0000 7fb2e3ddc700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2dc1014e0 0x7fb2dc0fea20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:01.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.302+0000 7fb2e3ddc700 1 --2- 172.21.15.167:0/1957850722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2dc0fd070 0x7fb2dc0fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:01.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.302+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1957850722 >> 172.21.15.167:0/1957850722 conn(0x7fb2dc0fca80 msgr2=0x7fb2dc06b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:01.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.302+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1957850722 shutdown_connections 2024-04-23T10:19:01.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:01.302+0000 7fb2e3ddc700 1 -- 172.21.15.167:0/1957850722 wait complete. 2024-04-23T10:19:01.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:01 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:01.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:01 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:01.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:01 smithi146 ceph-mon[32800]: Reconfiguring mon.b (monmap changed)... 2024-04-23T10:19:01.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:01 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:19:01.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:01 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T10:19:01.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:01 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:01.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:01 smithi146 ceph-mon[32800]: Reconfiguring daemon mon.b on smithi146 2024-04-23T10:19:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:01 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:01 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:01 smithi069 ceph-mon[29593]: Reconfiguring mon.b (monmap changed)... 2024-04-23T10:19:01.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:01 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:19:01.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:01 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T10:19:01.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:01 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:01.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:01 smithi069 ceph-mon[29593]: Reconfiguring daemon mon.b on smithi146 2024-04-23T10:19:01.910 DEBUG:teuthology.orchestra.run.smithi146:mgr.y> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.y.service 2024-04-23T10:19:01.913 DEBUG:teuthology.orchestra.run.smithi167:mgr.z> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.z.service 2024-04-23T10:19:01.915 INFO:tasks.cephadm:Deploying OSDs... 2024-04-23T10:19:01.915 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:19:01.916 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T10:19:01.935 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T10:19:01.935 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_1 2024-04-23T10:19:01.992 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T10:19:01.992 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:01.993 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-23T10:19:01.993 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:01.993 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:01.993 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-04-23 10:18:08.566338877 +0000 2024-04-23T10:19:01.993 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-04-23 10:03:58.979048367 +0000 2024-04-23T10:19:01.993 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-04-23 10:03:58.979048367 +0000 2024-04-23T10:19:01.993 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-04-23 10:03:58.979048367 +0000 2024-04-23T10:19:01.993 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T10:19:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-04-23T10:19:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-04-23T10:19:02.061 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.00020552 s, 2.5 MB/s 2024-04-23T10:19:02.062 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T10:19:02.120 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_2 2024-04-23T10:19:02.176 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T10:19:02.176 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:02.176 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-23T10:19:02.177 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:02.177 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:02.177 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-04-23 10:18:08.599338096 +0000 2024-04-23T10:19:02.177 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-04-23 10:03:59.351039596 +0000 2024-04-23T10:19:02.177 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-04-23 10:03:59.351039596 +0000 2024-04-23T10:19:02.177 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-04-23 10:03:59.351039596 +0000 2024-04-23T10:19:02.177 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T10:19:02.201 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:02 smithi167 ceph-mon[32940]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:02.201 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:02 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:02.201 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:02 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:02.201 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:02 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:02.201 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:02 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:19:02.201 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:02 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T10:19:02.201 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:02 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-04-23T10:19:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-04-23T10:19:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.00022227 s, 2.3 MB/s 2024-04-23T10:19:02.243 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T10:19:02.300 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_3 2024-04-23T10:19:02.357 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T10:19:02.357 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:02.357 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-23T10:19:02.357 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:02.357 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:02.357 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-04-23 10:18:08.631337339 +0000 2024-04-23T10:19:02.357 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-04-23 10:03:59.708031176 +0000 2024-04-23T10:19:02.357 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-04-23 10:03:59.708031176 +0000 2024-04-23T10:19:02.357 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-04-23 10:03:59.708031176 +0000 2024-04-23T10:19:02.358 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T10:19:02.417 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:02 smithi069 ceph-mon[29593]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:02.418 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:02 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:02.418 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:02 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:02.418 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:02 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:02.418 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:02 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:19:02.418 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:02 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T10:19:02.418 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:02 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:02.420 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-04-23T10:19:02.420 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-04-23T10:19:02.420 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000239958 s, 2.1 MB/s 2024-04-23T10:19:02.421 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T10:19:02.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:02 smithi146 ceph-mon[32800]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:02 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:02 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:02 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:02 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-23T10:19:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:02 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-23T10:19:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:02 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:02.478 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_4 2024-04-23T10:19:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T10:19:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:02.534 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-23T10:19:02.534 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:02.534 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:02.534 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-04-23 10:18:08.664336558 +0000 2024-04-23T10:19:02.534 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-04-23 10:04:00.055022993 +0000 2024-04-23T10:19:02.534 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-04-23 10:04:00.055022993 +0000 2024-04-23T10:19:02.534 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-04-23 10:04:00.055022993 +0000 2024-04-23T10:19:02.534 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T10:19:02.596 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-04-23T10:19:02.596 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-04-23T10:19:02.596 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000198528 s, 2.6 MB/s 2024-04-23T10:19:02.598 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T10:19:02.654 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-04-23T10:19:02.654 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T10:19:02.673 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T10:19:02.673 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2024-04-23T10:19:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T10:19:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:02.731 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-23T10:19:02.731 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:02.731 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:02.731 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-04-23 10:18:49.768239145 +0000 2024-04-23T10:19:02.731 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-04-23 10:04:19.122473230 +0000 2024-04-23T10:19:02.731 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-04-23 10:04:19.122473230 +0000 2024-04-23T10:19:02.731 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-04-23 10:04:19.122473230 +0000 2024-04-23T10:19:02.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T10:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-04-23T10:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-04-23T10:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000288168 s, 1.8 MB/s 2024-04-23T10:19:02.800 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T10:19:02.858 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2024-04-23T10:19:02.916 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T10:19:02.916 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:02.916 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-23T10:19:02.916 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:02.916 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:02.916 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-04-23 10:18:49.768239145 +0000 2024-04-23T10:19:02.916 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-04-23 10:04:19.491467098 +0000 2024-04-23T10:19:02.917 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-04-23 10:04:19.491467098 +0000 2024-04-23T10:19:02.917 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-04-23 10:04:19.491467098 +0000 2024-04-23T10:19:02.917 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T10:19:02.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-04-23T10:19:02.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-04-23T10:19:02.982 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000232593 s, 2.2 MB/s 2024-04-23T10:19:02.983 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T10:19:03.041 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2024-04-23T10:19:03.097 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T10:19:03.097 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:03.097 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-23T10:19:03.097 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:03.097 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:03.097 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-04-23 10:18:49.769239128 +0000 2024-04-23T10:19:03.097 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-04-23 10:04:19.827461514 +0000 2024-04-23T10:19:03.097 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-04-23 10:04:19.827461514 +0000 2024-04-23T10:19:03.097 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-04-23 10:04:19.827461514 +0000 2024-04-23T10:19:03.098 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T10:19:03.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-04-23T10:19:03.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-04-23T10:19:03.162 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.00025048 s, 2.0 MB/s 2024-04-23T10:19:03.163 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T10:19:03.220 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2024-04-23T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-23T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-04-23 10:18:49.769239128 +0000 2024-04-23T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-04-23 10:04:20.168455848 +0000 2024-04-23T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-04-23 10:04:20.168455848 +0000 2024-04-23T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-04-23 10:04:20.168455848 +0000 2024-04-23T10:19:03.276 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T10:19:03.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:03 smithi167 ceph-mon[32940]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi146=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:03.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:03 smithi167 ceph-mon[32940]: Saving service mgr spec with placement smithi069=x;smithi146=y;smithi167=z;count:3 2024-04-23T10:19:03.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:03 smithi167 ceph-mon[32940]: Reconfiguring mon.c (monmap changed)... 2024-04-23T10:19:03.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:03 smithi167 ceph-mon[32940]: Reconfiguring daemon mon.c on smithi167 2024-04-23T10:19:03.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:03 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:03.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:03 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:03.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:03 smithi146 ceph-mon[32800]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi146=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:03.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:03 smithi146 ceph-mon[32800]: Saving service mgr spec with placement smithi069=x;smithi146=y;smithi167=z;count:3 2024-04-23T10:19:03.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:03 smithi146 ceph-mon[32800]: Reconfiguring mon.c (monmap changed)... 2024-04-23T10:19:03.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:03 smithi146 ceph-mon[32800]: Reconfiguring daemon mon.c on smithi167 2024-04-23T10:19:03.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:03 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:03.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:03 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:03.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-04-23T10:19:03.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-04-23T10:19:03.339 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000199117 s, 2.6 MB/s 2024-04-23T10:19:03.340 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T10:19:03.395 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-23T10:19:03.395 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T10:19:03.413 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T10:19:03.414 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-04-23T10:19:03.470 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T10:19:03.470 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:03.471 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-23T10:19:03.471 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:03.471 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:03.471 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-23 10:18:40.027379626 +0000 2024-04-23T10:19:03.471 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-23 10:04:54.946435751 +0000 2024-04-23T10:19:03.471 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-23 10:04:54.946435751 +0000 2024-04-23T10:19:03.471 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-23 10:04:54.946435751 +0000 2024-04-23T10:19:03.471 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T10:19:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:03 smithi069 ceph-mon[29593]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi146=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:03 smithi069 ceph-mon[29593]: Saving service mgr spec with placement smithi069=x;smithi146=y;smithi167=z;count:3 2024-04-23T10:19:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:03 smithi069 ceph-mon[29593]: Reconfiguring mon.c (monmap changed)... 2024-04-23T10:19:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:03 smithi069 ceph-mon[29593]: Reconfiguring daemon mon.c on smithi167 2024-04-23T10:19:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:03 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:03 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:03.536 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-23T10:19:03.536 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-23T10:19:03.536 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000279937 s, 1.8 MB/s 2024-04-23T10:19:03.537 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T10:19:03.594 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-04-23T10:19:03.650 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T10:19:03.650 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:03.650 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-23T10:19:03.650 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:03.650 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:03.650 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-23 10:18:40.027379626 +0000 2024-04-23T10:19:03.650 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-23 10:04:55.286429704 +0000 2024-04-23T10:19:03.650 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-23 10:04:55.286429704 +0000 2024-04-23T10:19:03.650 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-23 10:04:55.286429704 +0000 2024-04-23T10:19:03.650 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T10:19:03.712 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-23T10:19:03.712 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-23T10:19:03.712 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000186422 s, 2.7 MB/s 2024-04-23T10:19:03.714 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T10:19:03.769 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-04-23T10:19:03.823 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T10:19:03.823 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:03.823 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-23T10:19:03.823 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:03.823 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:03.823 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-23 10:18:40.028379608 +0000 2024-04-23T10:19:03.823 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-23 10:04:55.647423284 +0000 2024-04-23T10:19:03.823 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-23 10:04:55.648423266 +0000 2024-04-23T10:19:03.824 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-23 10:04:55.647423284 +0000 2024-04-23T10:19:03.824 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T10:19:03.886 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-23T10:19:03.886 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-23T10:19:03.886 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000225895 s, 2.3 MB/s 2024-04-23T10:19:03.887 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T10:19:03.943 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-04-23T10:19:03.997 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T10:19:03.997 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:19:03.997 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-23T10:19:03.997 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:19:03.997 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T10:19:03.997 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-23 10:18:40.028379608 +0000 2024-04-23T10:19:03.998 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-23 10:04:55.982417326 +0000 2024-04-23T10:19:03.998 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-23 10:04:55.982417326 +0000 2024-04-23T10:19:03.998 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-23 10:04:55.982417326 +0000 2024-04-23T10:19:03.998 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T10:19:04.060 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-23T10:19:04.060 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-23T10:19:04.061 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000170093 s, 3.0 MB/s 2024-04-23T10:19:04.062 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T10:19:04.119 INFO:tasks.cephadm:Deploying osd.0 on smithi069 with /dev/vg_nvme/lv_4... 2024-04-23T10:19:04.119 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-23T10:19:04.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:04 smithi167 ceph-mon[32940]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:04.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:04 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:04.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:04 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:04.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:04 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:04.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:04 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:04.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:04 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T10:19:04.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:04 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T10:19:04.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:04 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T10:19:04.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:04 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:04.351 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:19:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:04 smithi146 ceph-mon[32800]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:04 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:04 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:04 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:04 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:04 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T10:19:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:04 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T10:19:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:04 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T10:19:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:04 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:04.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:04 smithi069 ceph-mon[29593]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:04.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:04.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:04.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:04.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:04.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T10:19:04.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T10:19:04.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T10:19:04.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:05.277 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:05 smithi167 ceph-mon[32940]: Deploying daemon mgr.z on smithi167 2024-04-23T10:19:05.417 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:05 smithi069 ceph-mon[29593]: Deploying daemon mgr.z on smithi167 2024-04-23T10:19:05.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:05 smithi146 ceph-mon[32800]: Deploying daemon mgr.z on smithi167 2024-04-23T10:19:06.223 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:06 smithi167 ceph-mon[32940]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:06.224 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:06 smithi167 systemd[1]: Started Ceph mgr.z for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:19:06.231 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-23T10:19:06.231 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-23T10:19:06.232 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2024-04-23T10:19:06.232 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2024-04-23T10:19:06.232 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115813 s, 905 MB/s 2024-04-23T10:19:06.232 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2024-04-23T10:19:06.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:06 smithi146 ceph-mon[32800]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:06.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:06 smithi069 ceph-mon[29593]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:06.511 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:06.223+0000 7fc33f3db200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:19:06.511 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:06.410+0000 7fc33f3db200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:19:06.511 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:06.511+0000 7fc33f3db200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:19:06.767 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi069:vg_nvme/lv_4 2024-04-23T10:19:07.002 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:19:07.082 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:06.821+0000 7fc33f3db200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:19:07.082 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:06.906+0000 7fc33f3db200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:19:07.426 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:07.426 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:07.426 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:07.426 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T10:19:07.426 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T10:19:07.426 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T10:19:07.426 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:07.426 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:07 smithi069 ceph-mon[29593]: Deploying daemon mgr.y on smithi146 2024-04-23T10:19:07.426 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:07 smithi069 ceph-mon[29593]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T10:19:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T10:19:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T10:19:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:07 smithi146 ceph-mon[32800]: Deploying daemon mgr.y on smithi146 2024-04-23T10:19:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:07 smithi146 ceph-mon[32800]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:07.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:07.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:07.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:07.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T10:19:07.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-23T10:19:07.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T10:19:07.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:07.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:07 smithi167 ceph-mon[32940]: Deploying daemon mgr.y on smithi146 2024-04-23T10:19:07.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:07 smithi167 ceph-mon[32940]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:08.428 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:08 smithi146 systemd[1]: Starting Ceph mgr.y for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.470+0000 7f3821d59700 1 -- 172.21.15.69:0/2771843639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381c103ca0 msgr2=0x7f381c104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.470+0000 7f3821d59700 1 --2- 172.21.15.69:0/2771843639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381c103ca0 0x7f381c104100 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f38100099c0 tx=0x7f3810009cd0 comp rx=0 tx=0).stop 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.470+0000 7f3821d59700 1 -- 172.21.15.69:0/2771843639 shutdown_connections 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.470+0000 7f3821d59700 1 --2- 172.21.15.69:0/2771843639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381c104640 0x7f381c10aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.470+0000 7f3821d59700 1 --2- 172.21.15.69:0/2771843639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381c102aa0 0x7f381c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.470+0000 7f3821d59700 1 --2- 172.21.15.69:0/2771843639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381c103ca0 0x7f381c104100 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.470+0000 7f3821d59700 1 -- 172.21.15.69:0/2771843639 >> 172.21.15.69:0/2771843639 conn(0x7f381c0fe040 msgr2=0x7f381c100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.470+0000 7f3821d59700 1 -- 172.21.15.69:0/2771843639 shutdown_connections 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.470+0000 7f3821d59700 1 -- 172.21.15.69:0/2771843639 wait complete. 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f3821d59700 1 Processor -- start 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f3821d59700 1 -- start start 2024-04-23T10:19:08.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f3821d59700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381c102aa0 0x7f381c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f3821d59700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381c103ca0 0x7f381c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f3821d59700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381c104640 0x7f381c1a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f3821d59700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f381c10e6a0 con 0x7f381c104640 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f3821d59700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f381c10e520 con 0x7f381c102aa0 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f3821d59700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f381c10e820 con 0x7f381c103ca0 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f381bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381c104640 0x7f381c1a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f381b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381c102aa0 0x7f381c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f381bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381c104640 0x7f381c1a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43764/0 (socket says 172.21.15.69:43764) 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f381bfff700 1 -- 172.21.15.69:0/1260075848 learned_addr learned my addr 172.21.15.69:0/1260075848 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.471+0000 7f381affd700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381c103ca0 0x7f381c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f381bfff700 1 -- 172.21.15.69:0/1260075848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381c103ca0 msgr2=0x7f381c199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:08.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f381bfff700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381c103ca0 0x7f381c199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f381bfff700 1 -- 172.21.15.69:0/1260075848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381c102aa0 msgr2=0x7f381c198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f381bfff700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381c102aa0 0x7f381c198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f381bfff700 1 -- 172.21.15.69:0/1260075848 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c1a0960 con 0x7f381c104640 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f381b7fe700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381c102aa0 0x7f381c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f381bfff700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381c104640 0x7f381c1a0290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3814007ee0 tx=0x7f381400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f3818ff9700 1 -- 172.21.15.69:0/1260075848 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814004bb0 con 0x7f381c104640 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f3821d59700 1 -- 172.21.15.69:0/1260075848 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381c1a0c50 con 0x7f381c104640 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f3818ff9700 1 -- 172.21.15.69:0/1260075848 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3814004d50 con 0x7f381c104640 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f3818ff9700 1 -- 172.21.15.69:0/1260075848 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38140059e0 con 0x7f381c104640 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.472+0000 7f3821d59700 1 -- 172.21.15.69:0/1260075848 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f381c1a1190 con 0x7f381c104640 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.473+0000 7f3818ff9700 1 -- 172.21.15.69:0/1260075848 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f381401a020 con 0x7f381c104640 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.473+0000 7f3818ff9700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3804039890 0x7f380403bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.473+0000 7f3818ff9700 1 -- 172.21.15.69:0/1260075848 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f381404d070 con 0x7f381c104640 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.473+0000 7f381b7fe700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3804039890 0x7f380403bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:08.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.473+0000 7f3821d59700 1 -- 172.21.15.69:0/1260075848 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381c069730 con 0x7f381c104640 2024-04-23T10:19:08.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.474+0000 7f381b7fe700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3804039890 0x7f380403bd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f381c19a1f0 tx=0x7f380c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:08.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.478+0000 7f3818ff9700 1 -- 172.21.15.69:0/1260075848 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3814010070 con 0x7f381c104640 2024-04-23T10:19:08.503 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:08 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:08.156+0000 7fc33f3db200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:19:08.503 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:08 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:08.329+0000 7fc33f3db200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:19:08.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:08.684+0000 7f3821d59700 1 -- 172.21.15.69:0/1260075848 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f381c062e80 con 0x7f3804039890 2024-04-23T10:19:08.739 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:08 smithi146 podman[34162]: 2024-04-23 10:19:08.487868986 +0000 UTC m=+0.114405805 container create 0677732d84785d1d15672de37ad6fb2c6aaca69e317129ebb24f7ba9eb3e9642 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:19:08.739 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:08 smithi146 podman[34162]: 2024-04-23 10:19:08.391446627 +0000 UTC m=+0.017983413 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:19:08.739 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:08 smithi146 podman[34162]: 2024-04-23 10:19:08.698446293 +0000 UTC m=+0.324983077 container init 0677732d84785d1d15672de37ad6fb2c6aaca69e317129ebb24f7ba9eb3e9642 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:19:08.739 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:08 smithi146 podman[34162]: 2024-04-23 10:19:08.701192658 +0000 UTC m=+0.327729437 container start 0677732d84785d1d15672de37ad6fb2c6aaca69e317129ebb24f7ba9eb3e9642 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:19:08.739 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:08 smithi146 ceph-mgr[34181]: -- 172.21.15.146:0/765251031 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5624e18285a0 con 0x5624e17fc800 2024-04-23T10:19:08.812 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:19:08.812 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:19:08.812 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:08.812 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:08 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:08.508+0000 7fc33f3db200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:19:08.812 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:08 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:08.812+0000 7fc33f3db200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:19:08.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:19:08.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:19:08.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:09.053 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:19:09.053 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:19:09.053 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:09.053 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:08 smithi146 bash[34162]: 0677732d84785d1d15672de37ad6fb2c6aaca69e317129ebb24f7ba9eb3e9642 2024-04-23T10:19:09.053 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:08 smithi146 systemd[1]: Started Ceph mgr.y for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:19:09.053 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:08 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:08.862+0000 7f2e26efc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:19:09.053 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:09.053+0000 7f2e26efc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:19:09.082 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:08 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:08.906+0000 7fc33f3db200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:19:09.427 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:09.161+0000 7f2e26efc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:19:09.582 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:09 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:09.121+0000 7fc33f3db200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:19:09.583 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:09 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:09.323+0000 7fc33f3db200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:19:09.778 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:09.489+0000 7f2e26efc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:19:09.778 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:09.588+0000 7f2e26efc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:19:09.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:09 smithi069 ceph-mon[29593]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:09.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:09.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:09.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:09.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:09.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:09 smithi069 ceph-mon[29593]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:09.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:09.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:10.083 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:09 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:09.979+0000 7fc33f3db200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T10:19:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:09 smithi167 ceph-mon[32940]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:09 smithi167 ceph-mon[32940]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:10.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:10.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-mon[32800]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:10.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:10.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:10.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:10.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:10.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-mon[32800]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:10.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:10.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:10.720 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:10 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:10.421+0000 7fc33f3db200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:19:10.720 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:10 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:10.517+0000 7fc33f3db200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:19:10.720 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:10 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:10.720+0000 7fc33f3db200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T10:19:11.150 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:10 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:10.813+0000 7f2e26efc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:19:11.151 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:10 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:10.980+0000 7f2e26efc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:19:11.428 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:11.151+0000 7f2e26efc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:19:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:11.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:11.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: Reconfiguring mgr.x (unknown last config time)... 2024-04-23T10:19:11.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T10:19:11.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T10:19:11.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:11.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: Reconfiguring daemon mgr.x on smithi069 2024-04-23T10:19:11.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-mon[32800]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:11.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:11.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: Reconfiguring mgr.x (unknown last config time)... 2024-04-23T10:19:11.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T10:19:11.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T10:19:11.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:11.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: Reconfiguring daemon mgr.x on smithi069 2024-04-23T10:19:11.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:11 smithi069 ceph-mon[29593]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:11.583 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:11.260+0000 7fc33f3db200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:19:11.583 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:11.353+0000 7fc33f3db200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:19:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:11.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:11.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: Reconfiguring mgr.x (unknown last config time)... 2024-04-23T10:19:11.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-23T10:19:11.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-23T10:19:11.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:11.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: Reconfiguring daemon mgr.x on smithi069 2024-04-23T10:19:11.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-mon[32940]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:11.735 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:11.439+0000 7f2e26efc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:19:11.735 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:11.531+0000 7f2e26efc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:19:11.735 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:11.734+0000 7f2e26efc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:19:11.941 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:11.596+0000 7fc33f3db200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:19:11.941 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:11.730+0000 7fc33f3db200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:19:11.941 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:11.825+0000 7fc33f3db200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:19:11.941 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:11.941+0000 7fc33f3db200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:19:12.177 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:11.926+0000 7f2e26efc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:19:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:12 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2733675364' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "923a3db0-8499-4796-95e0-e95c2edfe544"}]: dispatch 2024-04-23T10:19:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:12 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2733675364' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "923a3db0-8499-4796-95e0-e95c2edfe544"}]': finished 2024-04-23T10:19:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:12 smithi069 ceph-mon[29593]: osdmap e5: 1 total, 0 up, 1 in 2024-04-23T10:19:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:12 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:12 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1623690839' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:19:12.521 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:12 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2733675364' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "923a3db0-8499-4796-95e0-e95c2edfe544"}]: dispatch 2024-04-23T10:19:12.521 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:12 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2733675364' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "923a3db0-8499-4796-95e0-e95c2edfe544"}]': finished 2024-04-23T10:19:12.521 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:12 smithi146 ceph-mon[32800]: osdmap e5: 1 total, 0 up, 1 in 2024-04-23T10:19:12.521 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:12 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:12.522 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:12 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1623690839' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:19:12.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:12 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2733675364' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "923a3db0-8499-4796-95e0-e95c2edfe544"}]: dispatch 2024-04-23T10:19:12.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:12 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2733675364' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "923a3db0-8499-4796-95e0-e95c2edfe544"}]': finished 2024-04-23T10:19:12.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:12 smithi167 ceph-mon[32940]: osdmap e5: 1 total, 0 up, 1 in 2024-04-23T10:19:12.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:12 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:12.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:12 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1623690839' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:19:12.583 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:12 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:12.245+0000 7fc33f3db200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:19:12.927 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:12 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:12.521+0000 7f2e26efc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T10:19:13.211 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:12 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:12.850+0000 7fc33f3db200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:19:13.212 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:19:13 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:19:13.066+0000 7fc33f3db200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:19:13.212 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:12 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:12.939+0000 7f2e26efc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:19:13.212 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:13 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:13.034+0000 7f2e26efc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:19:13.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:13.219+0000 7f3818ff9700 1 -- 172.21.15.69:0/1260075848 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 14) ==== 92602+0+0 (secure 0 0 0) 0x7f38140133f0 con 0x7f381c104640 2024-04-23T10:19:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:13 smithi069 ceph-mon[29593]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:13 smithi069 ceph-mon[29593]: Standby manager daemon z started 2024-04-23T10:19:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:13 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T10:19:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:13 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:19:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:13 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T10:19:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:13 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:19:13.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:13 smithi167 ceph-mon[32940]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:13.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:13 smithi167 ceph-mon[32940]: Standby manager daemon z started 2024-04-23T10:19:13.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:13 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T10:19:13.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:13 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:19:13.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:13 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T10:19:13.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:13 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:19:13.677 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:13 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:13.234+0000 7f2e26efc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T10:19:13.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:13 smithi146 ceph-mon[32800]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:13.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:13 smithi146 ceph-mon[32800]: Standby manager daemon z started 2024-04-23T10:19:13.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:13 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T10:19:13.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:13 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:19:13.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:13 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T10:19:13.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:13 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.167:0/950551032' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:19:14.090 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:13 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:13.756+0000 7f2e26efc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:19:14.091 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:13 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:13.848+0000 7f2e26efc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:19:14.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:14 smithi146 ceph-mon[32800]: mgrmap e14: x(active, since 74s), standbys: z 2024-04-23T10:19:14.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:14 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T10:19:14.428 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:14 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:14.090+0000 7f2e26efc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:19:14.428 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:14 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:14.224+0000 7f2e26efc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:19:14.428 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:14 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:14.318+0000 7f2e26efc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:19:14.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:14 smithi069 ceph-mon[29593]: mgrmap e14: x(active, since 74s), standbys: z 2024-04-23T10:19:14.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:14 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T10:19:14.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:14 smithi167 ceph-mon[32940]: mgrmap e14: x(active, since 74s), standbys: z 2024-04-23T10:19:14.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:14 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T10:19:14.736 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:14 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:14.434+0000 7f2e26efc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:19:14.736 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:14 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:14.736+0000 7f2e26efc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:19:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:15 smithi069 ceph-mon[29593]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:15.551 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:15 smithi146 ceph-mon[32800]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:15.551 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:15 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:15.338+0000 7f2e26efc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:19:15.552 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:19:15 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:19:15.551+0000 7f2e26efc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:19:15.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:15 smithi167 ceph-mon[32940]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:16.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:16.232+0000 7f3818ff9700 1 -- 172.21.15.69:0/1260075848 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f381401a310 con 0x7f381c104640 2024-04-23T10:19:16.434 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:16 smithi069 ceph-mon[29593]: Standby manager daemon y started 2024-04-23T10:19:16.434 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:16 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T10:19:16.434 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:16 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:19:16.434 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:16 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T10:19:16.435 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:16 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:19:16.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:16 smithi167 ceph-mon[32940]: Standby manager daemon y started 2024-04-23T10:19:16.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:16 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T10:19:16.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:16 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:19:16.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:16 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T10:19:16.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:16 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:19:16.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:16 smithi146 ceph-mon[32800]: Standby manager daemon y started 2024-04-23T10:19:16.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:16 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T10:19:16.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:16 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:19:16.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:16 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T10:19:16.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:16 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.146:0/34289249' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:19:17.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:17 smithi069 ceph-mon[29593]: mgrmap e15: x(active, since 77s), standbys: z, y 2024-04-23T10:19:17.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T10:19:17.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:17.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:17.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:17.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:17.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:17.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:17.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:17 smithi069 ceph-mon[29593]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:17.579 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:17 smithi146 ceph-mon[32800]: mgrmap e15: x(active, since 77s), standbys: z, y 2024-04-23T10:19:17.580 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T10:19:17.580 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:17.580 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:17.580 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:17.580 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:17.580 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:17.580 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:17.580 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:17 smithi146 ceph-mon[32800]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:17.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:17 smithi167 ceph-mon[32940]: mgrmap e15: x(active, since 77s), standbys: z, y 2024-04-23T10:19:17.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T10:19:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:17 smithi167 ceph-mon[32940]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:19.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:18 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T10:19:19.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:18 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:19.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:18 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T10:19:19.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:18 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:19.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:18 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-23T10:19:19.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:18 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:20.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:19 smithi146 ceph-mon[32800]: Deploying daemon osd.0 on smithi069 2024-04-23T10:19:20.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:19 smithi146 ceph-mon[32800]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:20.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:19 smithi069 ceph-mon[29593]: Deploying daemon osd.0 on smithi069 2024-04-23T10:19:20.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:19 smithi069 ceph-mon[29593]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:20.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:19 smithi167 ceph-mon[32940]: Deploying daemon osd.0 on smithi069 2024-04-23T10:19:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:19 smithi167 ceph-mon[32940]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:22.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:21 smithi069 ceph-mon[29593]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:22.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:21 smithi167 ceph-mon[32940]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:22.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:21 smithi146 ceph-mon[32800]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:24.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:23 smithi069 ceph-mon[29593]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:24.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:23 smithi167 ceph-mon[32940]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:24.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:23 smithi146 ceph-mon[32800]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:25.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:25.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:25.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:25.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:25 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:25.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:25 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:25.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:25 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:25.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:25 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:25.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:25 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:25.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:25 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:26.169 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:26 smithi069 ceph-mon[29593]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:26.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:26 smithi167 ceph-mon[32940]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:26.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:26 smithi146 ceph-mon[32800]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:27.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.651+0000 7f3818ff9700 1 -- 172.21.15.69:0/1260075848 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f381c062e80 con 0x7f3804039890 2024-04-23T10:19:27.651 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 0 on host 'smithi069' 2024-04-23T10:19:27.652 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:27 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:27.652 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:27 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:27.652 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:27 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:27.652 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:27 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:27.652 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:27 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:27.652 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:27 smithi069 ceph-mon[29593]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:27.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 -- 172.21.15.69:0/1260075848 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3804039890 msgr2=0x7f380403bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:27.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3804039890 0x7f380403bd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f381c19a1f0 tx=0x7f380c00b410 comp rx=0 tx=0).stop 2024-04-23T10:19:27.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 -- 172.21.15.69:0/1260075848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381c104640 msgr2=0x7f381c1a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:27.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381c104640 0x7f381c1a0290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3814007ee0 tx=0x7f381400d3b0 comp rx=0 tx=0).stop 2024-04-23T10:19:27.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 -- 172.21.15.69:0/1260075848 shutdown_connections 2024-04-23T10:19:27.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3804039890 0x7f380403bd50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:27.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381c104640 0x7f381c1a0290 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:27.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381c102aa0 0x7f381c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:27.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 --2- 172.21.15.69:0/1260075848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381c103ca0 0x7f381c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:27.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 -- 172.21.15.69:0/1260075848 >> 172.21.15.69:0/1260075848 conn(0x7f381c0fe040 msgr2=0x7f381c106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:27.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 -- 172.21.15.69:0/1260075848 shutdown_connections 2024-04-23T10:19:27.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:19:27.654+0000 7f3821d59700 1 -- 172.21.15.69:0/1260075848 wait complete. 2024-04-23T10:19:27.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:27 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:27.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:27 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:27.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:27 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:27.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:27 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:27.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:27 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:27.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:27 smithi167 ceph-mon[32940]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:27.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:27 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:27.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:27 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:27.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:27 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:27.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:27 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:27.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:27 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:27.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:27 smithi146 ceph-mon[32800]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:28.268 DEBUG:teuthology.orchestra.run.smithi069:osd.0> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.0.service 2024-04-23T10:19:28.270 INFO:tasks.cephadm:Deploying osd.1 on smithi146 with /dev/vg_nvme/lv_4... 2024-04-23T10:19:28.271 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-23T10:19:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:19:28.910 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:28 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:28.910 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:28 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:28.910 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:28 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:28.910 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:28 smithi146 ceph-mon[32800]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-23T10:19:28.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:28 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:28.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:28 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:28.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:28 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:28.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:28 smithi069 ceph-mon[29593]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-23T10:19:29.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:28 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:29.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:28 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:29.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:28 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:29.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:28 smithi167 ceph-mon[32940]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-23T10:19:29.620 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:19:29 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0[42126]: 2024-04-23T10:19:29.613+0000 7f7ada679700 -1 osd.0 0 waiting for initial osdmap 2024-04-23T10:19:29.620 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:19:29 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0[42126]: 2024-04-23T10:19:29.615+0000 7f7ad646c700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:19:29.621 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:29 smithi069 ceph-mon[29593]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-23T10:19:29.621 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:29 smithi069 ceph-mon[29593]: osdmap e6: 1 total, 0 up, 1 in 2024-04-23T10:19:29.621 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:29 smithi069 ceph-mon[29593]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:19:29.621 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:29.621 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:29 smithi069 ceph-mon[29593]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:29.886 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:29 smithi146 ceph-mon[32800]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-23T10:19:29.886 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:29 smithi146 ceph-mon[32800]: osdmap e6: 1 total, 0 up, 1 in 2024-04-23T10:19:29.886 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:29 smithi146 ceph-mon[32800]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:19:29.886 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:29 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:29.886 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:29 smithi146 ceph-mon[32800]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:30.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:29 smithi167 ceph-mon[32940]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-23T10:19:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:29 smithi167 ceph-mon[32940]: osdmap e6: 1 total, 0 up, 1 in 2024-04-23T10:19:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:29 smithi167 ceph-mon[32940]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:19:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:29 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:29 smithi167 ceph-mon[32940]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:30.560 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-23T10:19:30.560 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-23T10:19:30.560 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-04-23T10:19:30.560 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-04-23T10:19:30.560 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115775 s, 906 MB/s 2024-04-23T10:19:30.560 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-04-23T10:19:30.683 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:30 smithi069 ceph-mon[29593]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:19:30.683 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:30 smithi069 ceph-mon[29593]: osdmap e7: 1 total, 0 up, 1 in 2024-04-23T10:19:30.684 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:30 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:30.684 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:30 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:30.917 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:30 smithi146 ceph-mon[32800]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:19:30.917 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:30 smithi146 ceph-mon[32800]: osdmap e7: 1 total, 0 up, 1 in 2024-04-23T10:19:30.918 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:30 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:30.918 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:30 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:31.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:30 smithi167 ceph-mon[32940]: from='osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:19:31.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:30 smithi167 ceph-mon[32940]: osdmap e7: 1 total, 0 up, 1 in 2024-04-23T10:19:31.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:30 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:31.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:30 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:31.221 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_4 2024-04-23T10:19:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:19:31.788 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:19:31.788 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:19:31.788 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384] boot 2024-04-23T10:19:31.788 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: osdmap e8: 1 total, 1 up, 1 in 2024-04-23T10:19:31.788 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:31.788 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:31.788 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi069 2024-04-23T10:19:31.788 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:31.788 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:31.788 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:19:31.789 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi069 to 17088M 2024-04-23T10:19:31.789 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:31.789 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:31.789 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:31.789 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384] boot 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: osdmap e8: 1 total, 1 up, 1 in 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi069 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi069 to 17088M 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:31.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:31.994 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: osd.0 [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384] boot 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: osdmap e8: 1 total, 1 up, 1 in 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi069 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi069 to 17088M 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:32.791 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:32 smithi146 ceph-mon[32800]: osdmap e9: 1 total, 1 up, 1 in 2024-04-23T10:19:32.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:32 smithi069 ceph-mon[29593]: osdmap e9: 1 total, 1 up, 1 in 2024-04-23T10:19:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:32.999+0000 7f95c6682700 1 -- 172.21.15.146:0/500712859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c0103550 msgr2=0x7f95c0109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:32.999+0000 7f95c6682700 1 --2- 172.21.15.146:0/500712859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c0103550 0x7f95c0109e00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f95b800b0d0 tx=0x7f95b800b3e0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:32.999+0000 7f95c6682700 1 -- 172.21.15.146:0/500712859 shutdown_connections 2024-04-23T10:19:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:32.999+0000 7f95c6682700 1 --2- 172.21.15.146:0/500712859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c0103550 0x7f95c0109e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:32.999+0000 7f95c6682700 1 --2- 172.21.15.146:0/500712859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c01019b0 0x7f95c0101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:32.999+0000 7f95c6682700 1 --2- 172.21.15.146:0/500712859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95c0102bb0 0x7f95c0103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:32.999+0000 7f95c6682700 1 -- 172.21.15.146:0/500712859 >> 172.21.15.146:0/500712859 conn(0x7f95c00fcf70 msgr2=0x7f95c00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:32.999+0000 7f95c6682700 1 -- 172.21.15.146:0/500712859 shutdown_connections 2024-04-23T10:19:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:32.999+0000 7f95c6682700 1 -- 172.21.15.146:0/500712859 wait complete. 2024-04-23T10:19:33.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.000+0000 7f95c6682700 1 Processor -- start 2024-04-23T10:19:33.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.000+0000 7f95c6682700 1 -- start start 2024-04-23T10:19:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.000+0000 7f95c6682700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c01019b0 0x7f95c0105940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.000+0000 7f95c6682700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c0102bb0 0x7f95c0103f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.000+0000 7f95c6682700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95c0103550 0x7f95c01044d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.000+0000 7f95c6682700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f95c010d570 con 0x7f95c0103550 2024-04-23T10:19:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.000+0000 7f95c6682700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f95c010d3f0 con 0x7f95c01019b0 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.000+0000 7f95c6682700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f95c010d6f0 con 0x7f95c0102bb0 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c01019b0 0x7f95c0105940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c01019b0 0x7f95c0105940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51446/0 (socket says 172.21.15.146:51446) 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bf7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c0102bb0 0x7f95c0103f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bffff700 1 -- 172.21.15.146:0/1900684685 learned_addr learned my addr 172.21.15.146:0/1900684685 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95c4c1f700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95c0103550 0x7f95c01044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bffff700 1 -- 172.21.15.146:0/1900684685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c0102bb0 msgr2=0x7f95c0103f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bffff700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c0102bb0 0x7f95c0103f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bffff700 1 -- 172.21.15.146:0/1900684685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95c0103550 msgr2=0x7f95c01044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bffff700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95c0103550 0x7f95c01044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bffff700 1 -- 172.21.15.146:0/1900684685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c0104d80 con 0x7f95c01019b0 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bffff700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c01019b0 0x7f95c0105940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c970 tx=0x7f95b000cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bd7fa700 1 -- 172.21.15.146:0/1900684685 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0004220 con 0x7f95c01019b0 2024-04-23T10:19:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bd7fa700 1 -- 172.21.15.146:0/1900684685 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f95b00043c0 con 0x7f95c01019b0 2024-04-23T10:19:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95c6682700 1 -- 172.21.15.146:0/1900684685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c01a2e30 con 0x7f95c01019b0 2024-04-23T10:19:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95bd7fa700 1 -- 172.21.15.146:0/1900684685 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0003cd0 con 0x7f95c01019b0 2024-04-23T10:19:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.001+0000 7f95c6682700 1 -- 172.21.15.146:0/1900684685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c01a3230 con 0x7f95c01019b0 2024-04-23T10:19:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.002+0000 7f95c6682700 1 -- 172.21.15.146:0/1900684685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c0069730 con 0x7f95c01019b0 2024-04-23T10:19:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.003+0000 7f95bd7fa700 1 -- 172.21.15.146:0/1900684685 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f95b00076d0 con 0x7f95c01019b0 2024-04-23T10:19:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.004+0000 7f95bd7fa700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f95a80a3bb0 0x7f95a80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:33.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.004+0000 7f95bd7fa700 1 -- 172.21.15.146:0/1900684685 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f95b00ce4b0 con 0x7f95c01019b0 2024-04-23T10:19:33.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.004+0000 7f95bf7fe700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f95a80a3bb0 0x7f95a80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:33.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.005+0000 7f95bf7fe700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f95a80a3bb0 0x7f95a80a6070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95b4005950 tx=0x7f95b400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.009+0000 7f95bd7fa700 1 -- 172.21.15.146:0/1900684685 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f95b0014030 con 0x7f95c01019b0 2024-04-23T10:19:33.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:32 smithi167 ceph-mon[32940]: osdmap e9: 1 total, 1 up, 1 in 2024-04-23T10:19:33.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:33.215+0000 7f95c6682700 1 -- 172.21.15.146:0/1900684685 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f95c00ff100 con 0x7f95a80a3bb0 2024-04-23T10:19:33.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:33 smithi146 ceph-mon[32800]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:33.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:33 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:19:33.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:33 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:19:33.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:33 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:33.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:33 smithi069 ceph-mon[29593]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:33.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:33 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:19:33.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:33 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:19:33.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:33 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:34.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:33 smithi167 ceph-mon[32940]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:34.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:33 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:19:34.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:33 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:19:34.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:33 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:34.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:34 smithi146 ceph-mon[32800]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:34.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:34 smithi069 ceph-mon[29593]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:35.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:34 smithi167 ceph-mon[32940]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:35.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:35 smithi146 ceph-mon[32800]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:35.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:35 smithi069 ceph-mon[29593]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:36.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:35 smithi167 ceph-mon[32940]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:36.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:36 smithi146 ceph-mon[32800]: from='client.? 172.21.15.146:0/3938440855' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17631476-4d26-4024-8f2c-189f271784e2"}]: dispatch 2024-04-23T10:19:36.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:36 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17631476-4d26-4024-8f2c-189f271784e2"}]: dispatch 2024-04-23T10:19:36.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:36 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17631476-4d26-4024-8f2c-189f271784e2"}]': finished 2024-04-23T10:19:36.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:36 smithi146 ceph-mon[32800]: osdmap e10: 2 total, 1 up, 2 in 2024-04-23T10:19:36.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:36 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:36.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:36 smithi146 ceph-mon[32800]: from='client.? 172.21.15.146:0/2570834390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:19:36.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:36 smithi069 ceph-mon[29593]: from='client.? 172.21.15.146:0/3938440855' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17631476-4d26-4024-8f2c-189f271784e2"}]: dispatch 2024-04-23T10:19:36.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:36 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17631476-4d26-4024-8f2c-189f271784e2"}]: dispatch 2024-04-23T10:19:36.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:36 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17631476-4d26-4024-8f2c-189f271784e2"}]': finished 2024-04-23T10:19:36.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:36 smithi069 ceph-mon[29593]: osdmap e10: 2 total, 1 up, 2 in 2024-04-23T10:19:36.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:36 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:36.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:36 smithi069 ceph-mon[29593]: from='client.? 172.21.15.146:0/2570834390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:19:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:36 smithi167 ceph-mon[32940]: from='client.? 172.21.15.146:0/3938440855' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17631476-4d26-4024-8f2c-189f271784e2"}]: dispatch 2024-04-23T10:19:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:36 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17631476-4d26-4024-8f2c-189f271784e2"}]: dispatch 2024-04-23T10:19:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:36 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17631476-4d26-4024-8f2c-189f271784e2"}]': finished 2024-04-23T10:19:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:36 smithi167 ceph-mon[32940]: osdmap e10: 2 total, 1 up, 2 in 2024-04-23T10:19:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:36 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:36 smithi167 ceph-mon[32940]: from='client.? 172.21.15.146:0/2570834390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:19:37.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:37 smithi146 ceph-mon[32800]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:37.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:37 smithi069 ceph-mon[29593]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:38.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:37 smithi167 ceph-mon[32940]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:40.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:39 smithi167 ceph-mon[32940]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:40.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:39 smithi146 ceph-mon[32800]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:40.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:39 smithi069 ceph-mon[29593]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:42.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:41 smithi146 ceph-mon[32800]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:42.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:41 smithi167 ceph-mon[32940]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:42.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:41 smithi069 ceph-mon[29593]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:43.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T10:19:43.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:43.393 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T10:19:43.393 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:43.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-23T10:19:43.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:44.299 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:44 smithi146 ceph-mon[32800]: Deploying daemon osd.1 on smithi146 2024-04-23T10:19:44.299 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:44 smithi146 ceph-mon[32800]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:44.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:44 smithi167 ceph-mon[32940]: Deploying daemon osd.1 on smithi146 2024-04-23T10:19:44.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:44 smithi167 ceph-mon[32940]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:44.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:44 smithi069 ceph-mon[29593]: Deploying daemon osd.1 on smithi146 2024-04-23T10:19:44.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:44 smithi069 ceph-mon[29593]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:46.321 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:46 smithi146 ceph-mon[32800]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:46.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:46 smithi167 ceph-mon[32940]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:46.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:46 smithi069 ceph-mon[29593]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:48.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:48 smithi146 ceph-mon[32800]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:48.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:48 smithi167 ceph-mon[32940]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:48.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:48 smithi069 ceph-mon[29593]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:49.359 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:49.359 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:49.360 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:49.360 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:49 smithi146 ceph-mon[32800]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:49 smithi069 ceph-mon[29593]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:49.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:49.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:49.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:49.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:49 smithi167 ceph-mon[32940]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.532+0000 7f95bd7fa700 1 -- 172.21.15.146:0/1900684685 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f95c00ff100 con 0x7f95a80a3bb0 2024-04-23T10:19:51.532 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 1 on host 'smithi146' 2024-04-23T10:19:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 -- 172.21.15.146:0/1900684685 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f95a80a3bb0 msgr2=0x7f95a80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f95a80a3bb0 0x7f95a80a6070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95b4005950 tx=0x7f95b400b410 comp rx=0 tx=0).stop 2024-04-23T10:19:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 -- 172.21.15.146:0/1900684685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c01019b0 msgr2=0x7f95c0105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c01019b0 0x7f95c0105940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c970 tx=0x7f95b000cc80 comp rx=0 tx=0).stop 2024-04-23T10:19:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 -- 172.21.15.146:0/1900684685 shutdown_connections 2024-04-23T10:19:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f95a80a3bb0 0x7f95a80a6070 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95c0103550 0x7f95c01044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c01019b0 0x7f95c0105940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 --2- 172.21.15.146:0/1900684685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c0102bb0 0x7f95c0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 -- 172.21.15.146:0/1900684685 >> 172.21.15.146:0/1900684685 conn(0x7f95c00fcf70 msgr2=0x7f95c00fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 -- 172.21.15.146:0/1900684685 shutdown_connections 2024-04-23T10:19:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:19:51.535+0000 7f95c6682700 1 -- 172.21.15.146:0/1900684685 wait complete. 2024-04-23T10:19:52.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:52 smithi146 ceph-mon[32800]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:52.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:52 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:52.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:52 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:52.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:52 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:52.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:52 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:52.203 DEBUG:teuthology.orchestra.run.smithi146:osd.1> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.1.service 2024-04-23T10:19:52.205 INFO:tasks.cephadm:Deploying osd.2 on smithi167 with /dev/vg_nvme/lv_4... 2024-04-23T10:19:52.205 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-23T10:19:52.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:52 smithi167 ceph-mon[32940]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:52.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:52 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:52.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:52 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:52.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:52 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:52 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:52.451 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:19:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:52 smithi069 ceph-mon[29593]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:52 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:52 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:52 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:52 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:53.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:53 smithi167 ceph-mon[32940]: from='osd.1 [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T10:19:53.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:53 smithi167 ceph-mon[32940]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T10:19:53.374 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:53 smithi146 ceph-mon[32800]: from='osd.1 [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T10:19:53.374 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:53 smithi146 ceph-mon[32800]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T10:19:53.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:53 smithi069 ceph-mon[29593]: from='osd.1 [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T10:19:53.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:53 smithi069 ceph-mon[29593]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-23T10:19:54.223 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-23T10:19:54.224 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-23T10:19:54.224 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2024-04-23T10:19:54.224 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2024-04-23T10:19:54.224 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114084 s, 919 MB/s 2024-04-23T10:19:54.224 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2024-04-23T10:19:54.274 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:54 smithi167 ceph-mon[32940]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:54.274 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:54 smithi167 ceph-mon[32940]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-23T10:19:54.274 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:54 smithi167 ceph-mon[32940]: from='osd.1 [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:19:54.274 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:54 smithi167 ceph-mon[32940]: osdmap e11: 2 total, 1 up, 2 in 2024-04-23T10:19:54.274 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:54 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:54.274 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:54 smithi167 ceph-mon[32940]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:19:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:54 smithi146 ceph-mon[32800]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:54 smithi146 ceph-mon[32800]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-23T10:19:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:54 smithi146 ceph-mon[32800]: from='osd.1 [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:19:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:54 smithi146 ceph-mon[32800]: osdmap e11: 2 total, 1 up, 2 in 2024-04-23T10:19:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:54 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:54 smithi146 ceph-mon[32800]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:19:54.428 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:19:54 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1[37368]: 2024-04-23T10:19:54.015+0000 7fc34d964700 -1 osd.1 0 waiting for initial osdmap 2024-04-23T10:19:54.429 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:19:54 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1[37368]: 2024-04-23T10:19:54.018+0000 7fc349757700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:19:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:54 smithi069 ceph-mon[29593]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:54 smithi069 ceph-mon[29593]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-23T10:19:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:54 smithi069 ceph-mon[29593]: from='osd.1 [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:19:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:54 smithi069 ceph-mon[29593]: osdmap e11: 2 total, 1 up, 2 in 2024-04-23T10:19:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:54 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:54 smithi069 ceph-mon[29593]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:19:54.816 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_4 2024-04-23T10:19:55.057 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:19:55.155 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:55 smithi146 ceph-mon[32800]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:19:55.155 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:55 smithi146 ceph-mon[32800]: osdmap e12: 2 total, 1 up, 2 in 2024-04-23T10:19:55.155 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:55 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:55.156 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:55 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:55.156 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:55 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:55.179 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:55 smithi167 ceph-mon[32940]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:19:55.179 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:55 smithi167 ceph-mon[32940]: osdmap e12: 2 total, 1 up, 2 in 2024-04-23T10:19:55.179 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:55.179 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:55.179 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:55.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:55 smithi069 ceph-mon[29593]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:19:55.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:55 smithi069 ceph-mon[29593]: osdmap e12: 2 total, 1 up, 2 in 2024-04-23T10:19:55.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:55.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:55.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:56.246 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:19:56.246 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:19:56.246 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:56.246 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: osd.1 [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957] boot 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: osdmap e13: 2 total, 2 up, 2 in 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:56.247 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: osd.1 [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957] boot 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: osdmap e13: 2 total, 2 up, 2 in 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:56.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:56.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:19:56.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:19:56.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-23T10:19:56.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: osd.1 [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957] boot 2024-04-23T10:19:56.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: osdmap e13: 2 total, 2 up, 2 in 2024-04-23T10:19:56.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:19:56.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:19:56.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:56.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:56.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:19:56.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:56.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:19:56.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:19:56.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.535+0000 7f1dc8104700 1 -- 172.21.15.167:0/2780308457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dc0104640 msgr2=0x7f1dc010aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.535+0000 7f1dc8104700 1 --2- 172.21.15.167:0/2780308457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dc0104640 0x7f1dc010aef0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1db800b0a0 tx=0x7f1db800b3b0 comp rx=0 tx=0).stop 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.535+0000 7f1dc8104700 1 -- 172.21.15.167:0/2780308457 shutdown_connections 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.535+0000 7f1dc8104700 1 --2- 172.21.15.167:0/2780308457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dc0104640 0x7f1dc010aef0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.535+0000 7f1dc8104700 1 --2- 172.21.15.167:0/2780308457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1dc0102aa0 0x7f1dc0102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.535+0000 7f1dc8104700 1 --2- 172.21.15.167:0/2780308457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0103ca0 0x7f1dc0104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.535+0000 7f1dc8104700 1 -- 172.21.15.167:0/2780308457 >> 172.21.15.167:0/2780308457 conn(0x7f1dc00fe040 msgr2=0x7f1dc0100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.535+0000 7f1dc8104700 1 -- 172.21.15.167:0/2780308457 shutdown_connections 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.535+0000 7f1dc8104700 1 -- 172.21.15.167:0/2780308457 wait complete. 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc8104700 1 Processor -- start 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc8104700 1 -- start start 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc8104700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0102aa0 0x7f1dc0198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc8104700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1dc0103ca0 0x7f1dc0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc8104700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dc0104640 0x7f1dc01a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc8104700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc010e770 con 0x7f1dc0103ca0 2024-04-23T10:19:56.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc8104700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc010e5f0 con 0x7f1dc0102aa0 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc8104700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc010e8f0 con 0x7f1dc0104640 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc66a1700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dc0104640 0x7f1dc01a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc66a1700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dc0104640 0x7f1dc01a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60670/0 (socket says 172.21.15.167:60670) 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc66a1700 1 -- 172.21.15.167:0/4025643169 learned_addr learned my addr 172.21.15.167:0/4025643169 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc569f700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1dc0103ca0 0x7f1dc0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.536+0000 7f1dc66a1700 1 -- 172.21.15.167:0/4025643169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0102aa0 msgr2=0x7f1dc0198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1dc5ea0700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0102aa0 0x7f1dc0198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1dc66a1700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0102aa0 0x7f1dc0198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1dc66a1700 1 -- 172.21.15.167:0/4025643169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1dc0103ca0 msgr2=0x7f1dc0199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1dc66a1700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1dc0103ca0 0x7f1dc0199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1dc66a1700 1 -- 172.21.15.167:0/4025643169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc01a09b0 con 0x7f1dc0104640 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1dc569f700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1dc0103ca0 0x7f1dc0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1dc5ea0700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0102aa0 0x7f1dc0198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:19:56.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1dc66a1700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dc0104640 0x7f1dc01a0310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1db8009be0 tx=0x7f1db8007770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:56.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1db2ffd700 1 -- 172.21.15.167:0/4025643169 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8021070 con 0x7f1dc0104640 2024-04-23T10:19:56.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1db2ffd700 1 -- 172.21.15.167:0/4025643169 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1db8004020 con 0x7f1dc0104640 2024-04-23T10:19:56.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1dc8104700 1 -- 172.21.15.167:0/4025643169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc01a0c40 con 0x7f1dc0104640 2024-04-23T10:19:56.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1db2ffd700 1 -- 172.21.15.167:0/4025643169 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db80052a0 con 0x7f1dc0104640 2024-04-23T10:19:56.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.537+0000 7f1dc8104700 1 -- 172.21.15.167:0/4025643169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc01a1090 con 0x7f1dc0104640 2024-04-23T10:19:56.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.538+0000 7f1dc8104700 1 -- 172.21.15.167:0/4025643169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc002df80 con 0x7f1dc0104640 2024-04-23T10:19:56.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.539+0000 7f1db2ffd700 1 -- 172.21.15.167:0/4025643169 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f1db8004580 con 0x7f1dc0104640 2024-04-23T10:19:56.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.540+0000 7f1db2ffd700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1dac0a3bb0 0x7f1dac0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:19:56.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.540+0000 7f1db2ffd700 1 -- 172.21.15.167:0/4025643169 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f1db800f020 con 0x7f1dc0104640 2024-04-23T10:19:56.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.540+0000 7f1dc5ea0700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1dac0a3bb0 0x7f1dac0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:19:56.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.540+0000 7f1dc5ea0700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1dac0a3bb0 0x7f1dac0a6070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0103b00 tx=0x7f1db4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:19:56.542 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.544+0000 7f1db2ffd700 1 -- 172.21.15.167:0/4025643169 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1db802a020 con 0x7f1dc0104640 2024-04-23T10:19:56.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:19:56.746+0000 7f1dc8104700 1 -- 172.21.15.167:0/4025643169 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1dc0062e80 con 0x7f1dac0a3bb0 2024-04-23T10:19:57.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:57 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi146 2024-04-23T10:19:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:57 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi146 to 17088M 2024-04-23T10:19:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:57 smithi167 ceph-mon[32940]: osdmap e14: 2 total, 2 up, 2 in 2024-04-23T10:19:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:57 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:19:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:57 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:19:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:57 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:57.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:57 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi146 2024-04-23T10:19:57.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:57 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi146 to 17088M 2024-04-23T10:19:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:57 smithi146 ceph-mon[32800]: osdmap e14: 2 total, 2 up, 2 in 2024-04-23T10:19:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:19:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:19:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:57 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:57.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:57 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi146 2024-04-23T10:19:57.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:57 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi146 to 17088M 2024-04-23T10:19:57.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:57 smithi069 ceph-mon[29593]: osdmap e14: 2 total, 2 up, 2 in 2024-04-23T10:19:57.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:57 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:19:57.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:57 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:19:57.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:57 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:19:58.297 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:58 smithi167 ceph-mon[32940]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:58.297 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:19:58 smithi167 ceph-mon[32940]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:19:58.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:58 smithi146 ceph-mon[32800]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:58.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:19:58 smithi146 ceph-mon[32800]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:19:58.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:58 smithi069 ceph-mon[29593]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:19:58.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:19:58 smithi069 ceph-mon[29593]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:00.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:00 smithi069 ceph-mon[29593]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:00.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:00 smithi069 ceph-mon[29593]: from='client.? 172.21.15.167:0/2074715536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8acd12b7-4162-4f91-b3c6-772c8602c23c"}]: dispatch 2024-04-23T10:20:00.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:00 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8acd12b7-4162-4f91-b3c6-772c8602c23c"}]: dispatch 2024-04-23T10:20:00.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:00 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8acd12b7-4162-4f91-b3c6-772c8602c23c"}]': finished 2024-04-23T10:20:00.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:00 smithi069 ceph-mon[29593]: osdmap e15: 3 total, 2 up, 3 in 2024-04-23T10:20:00.313 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:00.314 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:00 smithi069 ceph-mon[29593]: from='client.? 172.21.15.167:0/2900637999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:20:00.314 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:00 smithi069 ceph-mon[29593]: overall HEALTH_OK 2024-04-23T10:20:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:00 smithi167 ceph-mon[32940]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:00 smithi167 ceph-mon[32940]: from='client.? 172.21.15.167:0/2074715536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8acd12b7-4162-4f91-b3c6-772c8602c23c"}]: dispatch 2024-04-23T10:20:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:00 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8acd12b7-4162-4f91-b3c6-772c8602c23c"}]: dispatch 2024-04-23T10:20:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:00 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8acd12b7-4162-4f91-b3c6-772c8602c23c"}]': finished 2024-04-23T10:20:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:00 smithi167 ceph-mon[32940]: osdmap e15: 3 total, 2 up, 3 in 2024-04-23T10:20:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:00 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:00 smithi167 ceph-mon[32940]: from='client.? 172.21.15.167:0/2900637999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:20:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:00 smithi167 ceph-mon[32940]: overall HEALTH_OK 2024-04-23T10:20:00.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:00 smithi146 ceph-mon[32800]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:00 smithi146 ceph-mon[32800]: from='client.? 172.21.15.167:0/2074715536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8acd12b7-4162-4f91-b3c6-772c8602c23c"}]: dispatch 2024-04-23T10:20:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:00 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8acd12b7-4162-4f91-b3c6-772c8602c23c"}]: dispatch 2024-04-23T10:20:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:00 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8acd12b7-4162-4f91-b3c6-772c8602c23c"}]': finished 2024-04-23T10:20:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:00 smithi146 ceph-mon[32800]: osdmap e15: 3 total, 2 up, 3 in 2024-04-23T10:20:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:00 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:00 smithi146 ceph-mon[32800]: from='client.? 172.21.15.167:0/2900637999' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:20:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:00 smithi146 ceph-mon[32800]: overall HEALTH_OK 2024-04-23T10:20:02.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:02 smithi167 ceph-mon[32940]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:02.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:02 smithi146 ceph-mon[32800]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:02.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:02 smithi069 ceph-mon[29593]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:04.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:04 smithi167 ceph-mon[32940]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:04.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:04 smithi146 ceph-mon[32800]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:04.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:04 smithi069 ceph-mon[29593]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:06.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:06 smithi167 ceph-mon[32940]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:06.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:06 smithi146 ceph-mon[32800]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:06.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:06 smithi069 ceph-mon[29593]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:07.241 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T10:20:07.241 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T10:20:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-23T10:20:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:08.114 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:08 smithi167 ceph-mon[32940]: Deploying daemon osd.2 on smithi167 2024-04-23T10:20:08.114 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:08 smithi167 ceph-mon[32940]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:08 smithi146 ceph-mon[32800]: Deploying daemon osd.2 on smithi167 2024-04-23T10:20:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:08 smithi146 ceph-mon[32800]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:08 smithi069 ceph-mon[29593]: Deploying daemon osd.2 on smithi167 2024-04-23T10:20:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:08 smithi069 ceph-mon[29593]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:10 smithi167 ceph-mon[32940]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:10.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:10 smithi146 ceph-mon[32800]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:10.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:10 smithi069 ceph-mon[29593]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:12.179 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:12 smithi167 ceph-mon[32940]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:12.179 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:12 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:12.179 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:12 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:12.179 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:12 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:12 smithi146 ceph-mon[32800]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:12 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:12 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:12 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:12 smithi069 ceph-mon[29593]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:12 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:12 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:12 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:14.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:14 smithi167 ceph-mon[32940]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:14.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:14 smithi146 ceph-mon[32800]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:14.457 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.458+0000 7f1db2ffd700 1 -- 172.21.15.167:0/4025643169 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1dc0062e80 con 0x7f1dac0a3bb0 2024-04-23T10:20:14.457 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 2 on host 'smithi167' 2024-04-23T10:20:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.460+0000 7f1dc8104700 1 -- 172.21.15.167:0/4025643169 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1dac0a3bb0 msgr2=0x7f1dac0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.461+0000 7f1dc8104700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1dac0a3bb0 0x7f1dac0a6070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0103b00 tx=0x7f1db4008040 comp rx=0 tx=0).stop 2024-04-23T10:20:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.461+0000 7f1dc8104700 1 -- 172.21.15.167:0/4025643169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dc0104640 msgr2=0x7f1dc01a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.461+0000 7f1dc8104700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dc0104640 0x7f1dc01a0310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1db8009be0 tx=0x7f1db8007770 comp rx=0 tx=0).stop 2024-04-23T10:20:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.461+0000 7f1dc8104700 1 -- 172.21.15.167:0/4025643169 shutdown_connections 2024-04-23T10:20:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.461+0000 7f1dc8104700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f1dac0a3bb0 0x7f1dac0a6070 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.461+0000 7f1dc8104700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dc0104640 0x7f1dc01a0310 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.461+0000 7f1dc8104700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0102aa0 0x7f1dc0198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.461+0000 7f1dc8104700 1 --2- 172.21.15.167:0/4025643169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1dc0103ca0 0x7f1dc0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.461+0000 7f1dc8104700 1 -- 172.21.15.167:0/4025643169 >> 172.21.15.167:0/4025643169 conn(0x7f1dc00fe040 msgr2=0x7f1dc0106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.461+0000 7f1dc8104700 1 -- 172.21.15.167:0/4025643169 shutdown_connections 2024-04-23T10:20:14.461 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:20:14.461+0000 7f1dc8104700 1 -- 172.21.15.167:0/4025643169 wait complete. 2024-04-23T10:20:14.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:14 smithi069 ceph-mon[29593]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:15.347 DEBUG:teuthology.orchestra.run.smithi167:osd.2> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.2.service 2024-04-23T10:20:15.349 INFO:tasks.cephadm:Deploying osd.3 on smithi069 with /dev/vg_nvme/lv_3... 2024-04-23T10:20:15.349 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-23T10:20:15.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:15.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:15.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:15 smithi167 ceph-mon[32940]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:15.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:15.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:15.583 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:20:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2[38099]: 2024-04-23T10:20:15.454+0000 7f9e26e9e7c0 -1 osd.2 0 log_to_monitors true 2024-04-23T10:20:15.601 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:20:15.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:15.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:15.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:15 smithi069 ceph-mon[29593]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:15.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:15.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:15.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:15.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:15.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:15 smithi146 ceph-mon[32800]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:15.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:15.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:16.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:16 smithi167 ceph-mon[32940]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T10:20:16.737 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:16 smithi069 ceph-mon[29593]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T10:20:16.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:16 smithi146 ceph-mon[32800]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-23T10:20:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:17 smithi167 ceph-mon[32940]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-23T10:20:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:17 smithi167 ceph-mon[32940]: osdmap e16: 3 total, 2 up, 3 in 2024-04-23T10:20:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:17 smithi167 ceph-mon[32940]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:20:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:17 smithi167 ceph-mon[32940]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:17.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:17 smithi069 ceph-mon[29593]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-23T10:20:17.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:17 smithi069 ceph-mon[29593]: osdmap e16: 3 total, 2 up, 3 in 2024-04-23T10:20:17.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:17 smithi069 ceph-mon[29593]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:20:17.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:17.604 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:17 smithi069 ceph-mon[29593]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:17.604 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-23T10:20:17.604 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-23T10:20:17.604 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2024-04-23T10:20:17.605 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2024-04-23T10:20:17.605 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110995 s, 945 MB/s 2024-04-23T10:20:17.605 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2024-04-23T10:20:17.829 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:17 smithi146 ceph-mon[32800]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-23T10:20:17.829 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:17 smithi146 ceph-mon[32800]: osdmap e16: 3 total, 2 up, 3 in 2024-04-23T10:20:17.829 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:17 smithi146 ceph-mon[32800]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:20:17.829 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:17.829 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:17 smithi146 ceph-mon[32800]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:18.133 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:20:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2[38099]: 2024-04-23T10:20:17.869+0000 7f9e1c503700 -1 osd.2 0 waiting for initial osdmap 2024-04-23T10:20:18.133 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:20:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2[38099]: 2024-04-23T10:20:17.876+0000 7f9e142ee700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:20:18.299 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi069:vg_nvme/lv_3 2024-04-23T10:20:18.552 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:20:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:18 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:20:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:18 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:20:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:18 smithi069 ceph-mon[29593]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:20:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:18 smithi069 ceph-mon[29593]: osdmap e17: 3 total, 2 up, 3 in 2024-04-23T10:20:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:18 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:18 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:18.587 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:18 smithi069 ceph-mon[29593]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' 2024-04-23T10:20:18.729 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:18 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:20:18.729 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:18 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:20:18.729 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:18 smithi167 ceph-mon[32940]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:20:18.729 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:18 smithi167 ceph-mon[32940]: osdmap e17: 3 total, 2 up, 3 in 2024-04-23T10:20:18.729 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:18 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:18.729 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:18 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:18.729 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:18 smithi167 ceph-mon[32940]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' 2024-04-23T10:20:18.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:18 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:20:18.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:18 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:20:18.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:18 smithi146 ceph-mon[32800]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:20:18.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:18 smithi146 ceph-mon[32800]: osdmap e17: 3 total, 2 up, 3 in 2024-04-23T10:20:18.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:18 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:18.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:18 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:18.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:18 smithi146 ceph-mon[32800]: from='osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644]' entity='osd.2' 2024-04-23T10:20:19.654 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:19.654 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi167 2024-04-23T10:20:19.654 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.654 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.654 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:20:19.654 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi167 to 17088M 2024-04-23T10:20:19.654 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.654 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:19.654 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:19.654 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.654 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644] boot 2024-04-23T10:20:19.655 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: osdmap e18: 3 total, 3 up, 3 in 2024-04-23T10:20:19.655 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:19.655 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:19.655 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:19.655 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:19.655 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:19.655 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-23T10:20:19.655 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi167 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi167 to 17088M 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644] boot 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: osdmap e18: 3 total, 3 up, 3 in 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:19.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:19.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:19.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:19.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-23T10:20:19.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:19.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi167 2024-04-23T10:20:19.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:20:19.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi167 to 17088M 2024-04-23T10:20:19.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:19.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:19.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:19.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: osd.2 [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644] boot 2024-04-23T10:20:19.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: osdmap e18: 3 total, 3 up, 3 in 2024-04-23T10:20:19.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:20:19.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-23T10:20:19.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:19.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:19.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:19.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-23T10:20:19.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:20.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.110+0000 7fb0d89bf700 1 -- 172.21.15.69:0/2784760928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0d4102400 msgr2=0x7fb0d4102860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:20.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.110+0000 7fb0d89bf700 1 --2- 172.21.15.69:0/2784760928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0d4102400 0x7fb0d4102860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0099c0 tx=0x7fb0bc009cd0 comp rx=0 tx=0).stop 2024-04-23T10:20:20.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.110+0000 7fb0d89bf700 1 -- 172.21.15.69:0/2784760928 shutdown_connections 2024-04-23T10:20:20.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.110+0000 7fb0d89bf700 1 --2- 172.21.15.69:0/2784760928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d4102da0 0x7fb0d4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:20.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.110+0000 7fb0d89bf700 1 --2- 172.21.15.69:0/2784760928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0d4101200 0x7fb0d4101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:20.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.110+0000 7fb0d89bf700 1 --2- 172.21.15.69:0/2784760928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0d4102400 0x7fb0d4102860 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:20.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.110+0000 7fb0d89bf700 1 -- 172.21.15.69:0/2784760928 >> 172.21.15.69:0/2784760928 conn(0x7fb0d40fc7a0 msgr2=0x7fb0d40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:20.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.110+0000 7fb0d89bf700 1 -- 172.21.15.69:0/2784760928 shutdown_connections 2024-04-23T10:20:20.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.110+0000 7fb0d89bf700 1 -- 172.21.15.69:0/2784760928 wait complete. 2024-04-23T10:20:20.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d89bf700 1 Processor -- start 2024-04-23T10:20:20.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d89bf700 1 -- start start 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d89bf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d4101200 0x7fb0d4198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d89bf700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0d4102400 0x7fb0d41991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d89bf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0d4102da0 0x7fb0d41a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d89bf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d410ce30 con 0x7fb0d4102da0 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d89bf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d410ccb0 con 0x7fb0d4101200 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d89bf700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d410cfb0 con 0x7fb0d4102400 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0d4102da0 0x7fb0d41a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0d4102da0 0x7fb0d41a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50880/0 (socket says 172.21.15.69:50880) 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d2d9d700 1 -- 172.21.15.69:0/4135884249 learned_addr learned my addr 172.21.15.69:0/4135884249 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d1d9b700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0d4102400 0x7fb0d41991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d259c700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d4101200 0x7fb0d4198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:20.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d2d9d700 1 -- 172.21.15.69:0/4135884249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0d4102400 msgr2=0x7fb0d41991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:20.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d2d9d700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0d4102400 0x7fb0d41991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:20.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d2d9d700 1 -- 172.21.15.69:0/4135884249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d4101200 msgr2=0x7fb0d4198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:20.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d2d9d700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d4101200 0x7fb0d4198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:20.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.111+0000 7fb0d2d9d700 1 -- 172.21.15.69:0/4135884249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d41a08c0 con 0x7fb0d4102da0 2024-04-23T10:20:20.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.112+0000 7fb0d2d9d700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0d4102da0 0x7fb0d41a01f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c900 tx=0x7fb0cc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:20.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.112+0000 7fb0cb7fe700 1 -- 172.21.15.69:0/4135884249 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc007b00 con 0x7fb0d4102da0 2024-04-23T10:20:20.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.112+0000 7fb0d89bf700 1 -- 172.21.15.69:0/4135884249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d41a0bb0 con 0x7fb0d4102da0 2024-04-23T10:20:20.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.112+0000 7fb0cb7fe700 1 -- 172.21.15.69:0/4135884249 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb0cc00ce50 con 0x7fb0d4102da0 2024-04-23T10:20:20.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.112+0000 7fb0cb7fe700 1 -- 172.21.15.69:0/4135884249 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc018660 con 0x7fb0d4102da0 2024-04-23T10:20:20.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.112+0000 7fb0d89bf700 1 -- 172.21.15.69:0/4135884249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d41a10a0 con 0x7fb0d4102da0 2024-04-23T10:20:20.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.113+0000 7fb0d89bf700 1 -- 172.21.15.69:0/4135884249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d4069730 con 0x7fb0d4102da0 2024-04-23T10:20:20.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.114+0000 7fb0cb7fe700 1 -- 172.21.15.69:0/4135884249 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7fb0cc00f450 con 0x7fb0d4102da0 2024-04-23T10:20:20.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.115+0000 7fb0cb7fe700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb0c00a3bb0 0x7fb0c00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:20.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.115+0000 7fb0d259c700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb0c00a3bb0 0x7fb0c00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:20.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.115+0000 7fb0cb7fe700 1 -- 172.21.15.69:0/4135884249 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3226+0+0 (secure 0 0 0) 0x7fb0cc0cee30 con 0x7fb0d4102da0 2024-04-23T10:20:20.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.115+0000 7fb0d259c700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb0c00a3bb0 0x7fb0c00a6070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0d419a150 tx=0x7fb0c4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:20.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.119+0000 7fb0cb7fe700 1 -- 172.21.15.69:0/4135884249 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb0cc014030 con 0x7fb0d4102da0 2024-04-23T10:20:20.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:20.326+0000 7fb0d89bf700 1 -- 172.21.15.69:0/4135884249 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb0d41a12d0 con 0x7fb0c00a3bb0 2024-04-23T10:20:21.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:20 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-23T10:20:21.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:20 smithi146 ceph-mon[32800]: osdmap e19: 3 total, 3 up, 3 in 2024-04-23T10:20:21.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:20 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T10:20:21.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:20 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:20:21.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:20 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:20:21.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:20 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:21.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:20 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-23T10:20:21.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:20 smithi069 ceph-mon[29593]: osdmap e19: 3 total, 3 up, 3 in 2024-04-23T10:20:21.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:20 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T10:20:21.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:20 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:20:21.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:20 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:20:21.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:20 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:21.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:20 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-23T10:20:21.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:20 smithi167 ceph-mon[32940]: osdmap e19: 3 total, 3 up, 3 in 2024-04-23T10:20:21.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:20 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T10:20:21.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:20 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:20:21.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:20 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:20:21.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:20 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:22.113 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:20:21 smithi069 sudo[46716]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T10:20:22.139 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:20:21 smithi069 sudo[46716]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.139 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:20:21 smithi069 sudo[46716]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.139 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:20:21 smithi069 sudo[46716]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:22.140 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:20:21 smithi069 sudo[46733]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T10:20:22.140 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:20:21 smithi069 sudo[46733]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.140 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:20:21 smithi069 sudo[46733]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.140 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:20:21 smithi069 sudo[46733]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:22.140 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:21 smithi069 ceph-mon[29593]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:20:22.140 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:21 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-23T10:20:22.141 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:21 smithi069 ceph-mon[29593]: osdmap e20: 3 total, 3 up, 3 in 2024-04-23T10:20:22.141 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:21 smithi069 ceph-mon[29593]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:22.141 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 sudo[46738]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T10:20:22.141 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 sudo[46738]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.141 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 sudo[46738]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.141 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 sudo[46738]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:22.141 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 sudo[46741]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T10:20:22.149 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:21 smithi167 ceph-mon[32940]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:20:22.150 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:21 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-23T10:20:22.150 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:21 smithi167 ceph-mon[32940]: osdmap e20: 3 total, 3 up, 3 in 2024-04-23T10:20:22.150 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:21 smithi167 ceph-mon[32940]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:22.150 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41757]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T10:20:22.150 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41757]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.150 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41757]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.150 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41757]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:22.151 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41751]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T10:20:22.151 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41751]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.151 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41751]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.151 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41751]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:22.151 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41754]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T10:20:22.151 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41754]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.151 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41754]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.151 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41754]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:22.164 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:21 smithi146 ceph-mon[32800]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:20:22.165 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:21 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-23T10:20:22.165 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:21 smithi146 ceph-mon[32800]: osdmap e20: 3 total, 3 up, 3 in 2024-04-23T10:20:22.165 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:21 smithi146 ceph-mon[32800]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:22.165 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:20:21 smithi146 sudo[41240]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T10:20:22.165 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:20:21 smithi146 sudo[41240]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.165 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:20:21 smithi146 sudo[41240]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.166 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:20:21 smithi146 sudo[41240]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:22.166 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:20:21 smithi146 sudo[41243]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T10:20:22.166 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:20:21 smithi146 sudo[41243]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.166 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:20:21 smithi146 sudo[41243]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.166 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:20:21 smithi146 sudo[41243]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 sudo[41246]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-23T10:20:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 sudo[41246]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 sudo[41246]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 sudo[41246]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 sudo[41249]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T10:20:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 sudo[41249]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 sudo[41249]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 sudo[41249]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:22.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 sudo[46741]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 sudo[46741]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 sudo[46741]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:22.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41760]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-23T10:20:22.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41760]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-23T10:20:22.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41760]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-23T10:20:22.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 sudo[41760]: pam_unix(sudo:session): session closed for user root 2024-04-23T10:20:23.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: osdmap e21: 3 total, 3 up, 3 in 2024-04-23T10:20:23.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:23.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:23.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:23.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T10:20:23.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T10:20:23.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:20:23.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:20:23.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:20:23.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T10:20:23.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:20:23.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:20:23.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:20:23.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T10:20:23.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T10:20:23.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:20:23.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:20:23.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:20:23.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:22 smithi146 ceph-mon[32800]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T10:20:23.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: osdmap e21: 3 total, 3 up, 3 in 2024-04-23T10:20:23.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:23.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:23.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:23.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T10:20:23.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T10:20:23.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:20:23.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:20:23.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:20:23.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T10:20:23.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:20:23.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:20:23.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:20:23.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T10:20:23.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T10:20:23.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:20:23.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:20:23.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:20:23.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:22 smithi069 ceph-mon[29593]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T10:20:23.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: osdmap e21: 3 total, 3 up, 3 in 2024-04-23T10:20:23.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:23.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:23.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:23.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T10:20:23.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:20:23.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:22 smithi167 ceph-mon[32940]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-23T10:20:23.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:23.904+0000 7fb0cb7fe700 1 -- 172.21.15.69:0/4135884249 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb0cc098cd0 con 0x7fb0d4102da0 2024-04-23T10:20:24.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:23 smithi146 ceph-mon[32800]: pgmap v83: 1 pgs: 1 creating+activating; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:24.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:23 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/905175037' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98a9cc15-ea9d-49a8-9173-3011a6547589"}]: dispatch 2024-04-23T10:20:24.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:23 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/905175037' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98a9cc15-ea9d-49a8-9173-3011a6547589"}]': finished 2024-04-23T10:20:24.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:23 smithi146 ceph-mon[32800]: osdmap e22: 4 total, 3 up, 4 in 2024-04-23T10:20:24.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:24.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:23 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3357930889' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:20:24.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:23 smithi069 ceph-mon[29593]: pgmap v83: 1 pgs: 1 creating+activating; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:24.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:23 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/905175037' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98a9cc15-ea9d-49a8-9173-3011a6547589"}]: dispatch 2024-04-23T10:20:24.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:23 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/905175037' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98a9cc15-ea9d-49a8-9173-3011a6547589"}]': finished 2024-04-23T10:20:24.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:23 smithi069 ceph-mon[29593]: osdmap e22: 4 total, 3 up, 4 in 2024-04-23T10:20:24.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:24.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:23 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3357930889' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:20:24.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:23 smithi167 ceph-mon[32940]: pgmap v83: 1 pgs: 1 creating+activating; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:24.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:23 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/905175037' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98a9cc15-ea9d-49a8-9173-3011a6547589"}]: dispatch 2024-04-23T10:20:24.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:23 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/905175037' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98a9cc15-ea9d-49a8-9173-3011a6547589"}]': finished 2024-04-23T10:20:24.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:23 smithi167 ceph-mon[32940]: osdmap e22: 4 total, 3 up, 4 in 2024-04-23T10:20:24.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:24.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:23 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3357930889' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:20:25.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:24 smithi146 ceph-mon[32800]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-23T10:20:25.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:24 smithi069 ceph-mon[29593]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-23T10:20:25.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:24 smithi167 ceph-mon[32940]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-23T10:20:26.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:25 smithi146 ceph-mon[32800]: pgmap v85: 1 pgs: 1 creating+activating; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:26.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:25 smithi069 ceph-mon[29593]: pgmap v85: 1 pgs: 1 creating+activating; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:26.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:25 smithi167 ceph-mon[32940]: pgmap v85: 1 pgs: 1 creating+activating; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:28.142 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:28 smithi069 ceph-mon[29593]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:28 smithi167 ceph-mon[32940]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:28.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:28 smithi146 ceph-mon[32800]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:30.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:30 smithi167 ceph-mon[32940]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:30.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:30 smithi146 ceph-mon[32800]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:30.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:30 smithi069 ceph-mon[29593]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:31.093 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T10:20:31.093 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:31.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T10:20:31.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:31.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-23T10:20:31.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:32.331 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:32 smithi069 ceph-mon[29593]: Deploying daemon osd.3 on smithi069 2024-04-23T10:20:32.331 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:32 smithi069 ceph-mon[29593]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:32.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:32 smithi167 ceph-mon[32940]: Deploying daemon osd.3 on smithi069 2024-04-23T10:20:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:32 smithi167 ceph-mon[32940]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:32 smithi146 ceph-mon[32800]: Deploying daemon osd.3 on smithi069 2024-04-23T10:20:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:32 smithi146 ceph-mon[32800]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:34.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:34 smithi167 ceph-mon[32940]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:34.413 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:34 smithi069 ceph-mon[29593]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:34.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:34 smithi146 ceph-mon[32800]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:36.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:36 smithi069 ceph-mon[29593]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:36.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:36 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:36.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:36 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:36.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:36 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:36.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:36 smithi167 ceph-mon[32940]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:36.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:36 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:36.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:36 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:36.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:36 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:36.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:36 smithi146 ceph-mon[32800]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:36.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:36 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:36.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:36 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:36.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:36 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:38.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:38 smithi167 ceph-mon[32940]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:38.401 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:38 smithi069 ceph-mon[29593]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:38.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:38 smithi146 ceph-mon[32800]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:38.968 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 3 on host 'smithi069' 2024-04-23T10:20:38.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.969+0000 7fb0cb7fe700 1 -- 172.21.15.69:0/4135884249 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb0d41a12d0 con 0x7fb0c00a3bb0 2024-04-23T10:20:38.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 -- 172.21.15.69:0/4135884249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb0c00a3bb0 msgr2=0x7fb0c00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:38.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb0c00a3bb0 0x7fb0c00a6070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0d419a150 tx=0x7fb0c4009040 comp rx=0 tx=0).stop 2024-04-23T10:20:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 -- 172.21.15.69:0/4135884249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0d4102da0 msgr2=0x7fb0d41a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0d4102da0 0x7fb0d41a01f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c900 tx=0x7fb0cc00cc10 comp rx=0 tx=0).stop 2024-04-23T10:20:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 -- 172.21.15.69:0/4135884249 shutdown_connections 2024-04-23T10:20:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb0c00a3bb0 0x7fb0c00a6070 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0d4102da0 0x7fb0d41a01f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d4101200 0x7fb0d4198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 --2- 172.21.15.69:0/4135884249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0d4102400 0x7fb0d41991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 -- 172.21.15.69:0/4135884249 >> 172.21.15.69:0/4135884249 conn(0x7fb0d40fc7a0 msgr2=0x7fb0d40fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 -- 172.21.15.69:0/4135884249 shutdown_connections 2024-04-23T10:20:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:20:38.971+0000 7fb0d89bf700 1 -- 172.21.15.69:0/4135884249 wait complete. 2024-04-23T10:20:39.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:39 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:39 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:39 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:39.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:39 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:39.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:39 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:39 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:39 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:39 smithi146 ceph-mon[32800]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:39.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:39 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:39.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:39 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:39 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:39 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:39.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:39 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:39.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:39 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:39 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:39 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:39 smithi069 ceph-mon[29593]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:39.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:39 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:39.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:39 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:39 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:39 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:39 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:39 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:39 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:39 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:39 smithi167 ceph-mon[32940]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:39 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:20:39.643 DEBUG:teuthology.orchestra.run.smithi069:osd.3> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.3.service 2024-04-23T10:20:39.645 INFO:tasks.cephadm:Deploying osd.4 on smithi146 with /dev/vg_nvme/lv_3... 2024-04-23T10:20:39.645 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-23T10:20:39.889 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:20:40.297 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:40 smithi146 ceph-mon[32800]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T10:20:40.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:40 smithi069 ceph-mon[29593]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T10:20:40.484 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:40 smithi167 ceph-mon[32940]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-23T10:20:41.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:41 smithi069 ceph-mon[29593]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-23T10:20:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:41 smithi069 ceph-mon[29593]: osdmap e23: 4 total, 3 up, 4 in 2024-04-23T10:20:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:41 smithi069 ceph-mon[29593]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:20:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:41 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:41 smithi069 ceph-mon[29593]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:41.282 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:41 smithi146 ceph-mon[32800]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-23T10:20:41.283 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:41 smithi146 ceph-mon[32800]: osdmap e23: 4 total, 3 up, 4 in 2024-04-23T10:20:41.283 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:41 smithi146 ceph-mon[32800]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:20:41.283 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:41 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:41.283 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:41 smithi146 ceph-mon[32800]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:41 smithi167 ceph-mon[32940]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-23T10:20:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:41 smithi167 ceph-mon[32940]: osdmap e23: 4 total, 3 up, 4 in 2024-04-23T10:20:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:41 smithi167 ceph-mon[32940]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:20:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:41 smithi167 ceph-mon[32940]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:41.949 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-23T10:20:41.949 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-23T10:20:41.949 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-04-23T10:20:41.949 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-04-23T10:20:41.949 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128193 s, 818 MB/s 2024-04-23T10:20:41.949 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-04-23T10:20:41.993 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:20:41 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3[48850]: 2024-04-23T10:20:41.615+0000 7f7fa6f53700 -1 osd.3 0 waiting for initial osdmap 2024-04-23T10:20:41.993 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:20:41 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3[48850]: 2024-04-23T10:20:41.620+0000 7f7f9ed3e700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:20:42.282 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:42 smithi146 ceph-mon[32800]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:20:42.282 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:42 smithi146 ceph-mon[32800]: osdmap e24: 4 total, 3 up, 4 in 2024-04-23T10:20:42.282 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:42 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:42.283 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:42 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:42.283 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:42 smithi146 ceph-mon[32800]: osdmap e25: 4 total, 3 up, 4 in 2024-04-23T10:20:42.283 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:42 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:42.283 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:42 smithi146 ceph-mon[32800]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' 2024-04-23T10:20:42.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:42 smithi069 ceph-mon[29593]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:20:42.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:42 smithi069 ceph-mon[29593]: osdmap e24: 4 total, 3 up, 4 in 2024-04-23T10:20:42.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:42 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:42.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:42 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:42.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:42 smithi069 ceph-mon[29593]: osdmap e25: 4 total, 3 up, 4 in 2024-04-23T10:20:42.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:42 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:42.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:42 smithi069 ceph-mon[29593]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' 2024-04-23T10:20:42.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:42 smithi167 ceph-mon[32940]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:20:42.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:42 smithi167 ceph-mon[32940]: osdmap e24: 4 total, 3 up, 4 in 2024-04-23T10:20:42.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:42 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:42.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:42 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:42.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:42 smithi167 ceph-mon[32940]: osdmap e25: 4 total, 3 up, 4 in 2024-04-23T10:20:42.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:42 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:42.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:42 smithi167 ceph-mon[32940]: from='osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719]' entity='osd.3' 2024-04-23T10:20:42.627 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_3 2024-04-23T10:20:42.870 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:20:43.227 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:20:43.227 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:20:43.227 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:43.227 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719] boot 2024-04-23T10:20:43.227 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: osdmap e26: 4 total, 4 up, 4 in 2024-04-23T10:20:43.227 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:43.227 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi069 2024-04-23T10:20:43.227 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.228 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.228 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:20:43.228 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:20:43.228 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi069 to 8544M 2024-04-23T10:20:43.228 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.228 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:43.228 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:43.228 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.228 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:43 smithi146 ceph-mon[32800]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:43.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:20:43.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:20:43.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:43.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719] boot 2024-04-23T10:20:43.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: osdmap e26: 4 total, 4 up, 4 in 2024-04-23T10:20:43.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:43.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi069 2024-04-23T10:20:43.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:20:43.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:20:43.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi069 to 8544M 2024-04-23T10:20:43.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:43.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:43.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:43 smithi069 ceph-mon[29593]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: osd.3 [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719] boot 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: osdmap e26: 4 total, 4 up, 4 in 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi069 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi069 to 8544M 2024-04-23T10:20:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:43.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:20:43.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:20:43.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:43 smithi167 ceph-mon[32940]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-23T10:20:44.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.397+0000 7f8a27b69700 1 -- 172.21.15.146:0/866861554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a201019a0 msgr2=0x7f8a20101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:44.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.397+0000 7f8a27b69700 1 --2- 172.21.15.146:0/866861554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a201019a0 0x7f8a20101dc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0099c0 tx=0x7f8a1c009cd0 comp rx=0 tx=0).stop 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.397+0000 7f8a27b69700 1 -- 172.21.15.146:0/866861554 shutdown_connections 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.397+0000 7f8a27b69700 1 --2- 172.21.15.146:0/866861554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20103540 0x7f8a20109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.397+0000 7f8a27b69700 1 --2- 172.21.15.146:0/866861554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a201019a0 0x7f8a20101dc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.397+0000 7f8a27b69700 1 --2- 172.21.15.146:0/866861554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20102ba0 0x7f8a20103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.397+0000 7f8a27b69700 1 -- 172.21.15.146:0/866861554 >> 172.21.15.146:0/866861554 conn(0x7f8a200fcf40 msgr2=0x7f8a200ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.397+0000 7f8a27b69700 1 -- 172.21.15.146:0/866861554 shutdown_connections 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.397+0000 7f8a27b69700 1 -- 172.21.15.146:0/866861554 wait complete. 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a27b69700 1 Processor -- start 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a27b69700 1 -- start start 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a27b69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a201019a0 0x7f8a2006b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a27b69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20102ba0 0x7f8a2019dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a27b69700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20103540 0x7f8a201a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a27b69700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2010d5f0 con 0x7f8a20102ba0 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a27b69700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2010d470 con 0x7f8a201019a0 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a27b69700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2010d770 con 0x7f8a20103540 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a25905700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a201019a0 0x7f8a2006b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a25905700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a201019a0 0x7f8a2006b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57102/0 (socket says 172.21.15.146:57102) 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a25905700 1 -- 172.21.15.146:0/2738095912 learned_addr learned my addr 172.21.15.146:0/2738095912 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a26106700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20103540 0x7f8a201a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a25104700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20102ba0 0x7f8a2019dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a25905700 1 -- 172.21.15.146:0/2738095912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20103540 msgr2=0x7f8a201a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a25905700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20103540 0x7f8a201a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a25905700 1 -- 172.21.15.146:0/2738095912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20102ba0 msgr2=0x7f8a2019dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a25905700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20102ba0 0x7f8a2019dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.398+0000 7f8a25905700 1 -- 172.21.15.146:0/2738095912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a201a0a10 con 0x7f8a201019a0 2024-04-23T10:20:44.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.399+0000 7f8a25905700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a201019a0 0x7f8a2006b2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009f50 tx=0x7f8a1c0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:44.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.399+0000 7f8a16ffd700 1 -- 172.21.15.146:0/2738095912 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c027070 con 0x7f8a201019a0 2024-04-23T10:20:44.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.399+0000 7f8a16ffd700 1 -- 172.21.15.146:0/2738095912 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8a1c004110 con 0x7f8a201019a0 2024-04-23T10:20:44.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.399+0000 7f8a16ffd700 1 -- 172.21.15.146:0/2738095912 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00f460 con 0x7f8a201019a0 2024-04-23T10:20:44.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.399+0000 7f8a27b69700 1 -- 172.21.15.146:0/2738095912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a201a0ca0 con 0x7f8a201019a0 2024-04-23T10:20:44.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.399+0000 7f8a27b69700 1 -- 172.21.15.146:0/2738095912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a201a1150 con 0x7f8a201019a0 2024-04-23T10:20:44.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.400+0000 7f8a27b69700 1 -- 172.21.15.146:0/2738095912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a20069730 con 0x7f8a201019a0 2024-04-23T10:20:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.401+0000 7f8a16ffd700 1 -- 172.21.15.146:0/2738095912 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f8a1c005030 con 0x7f8a201019a0 2024-04-23T10:20:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.402+0000 7f8a16ffd700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8a0c0a3cc0 0x7f8a0c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.402+0000 7f8a16ffd700 1 -- 172.21.15.146:0/2738095912 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3698+0+0 (secure 0 0 0) 0x7f8a1c0d05d0 con 0x7f8a201019a0 2024-04-23T10:20:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.402+0000 7f8a25104700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8a0c0a3cc0 0x7f8a0c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.403+0000 7f8a25104700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8a0c0a3cc0 0x7f8a0c0a6180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a10006fd0 tx=0x7f8a10008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:44.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.406+0000 7f8a16ffd700 1 -- 172.21.15.146:0/2738095912 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8a1c031020 con 0x7f8a201019a0 2024-04-23T10:20:44.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:44 smithi167 ceph-mon[32940]: osdmap e27: 4 total, 4 up, 4 in 2024-04-23T10:20:44.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:20:44.611+0000 7f8a27b69700 1 -- 172.21.15.146:0/2738095912 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8a20062e80 con 0x7f8a0c0a3cc0 2024-04-23T10:20:44.610 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:44 smithi146 ceph-mon[32800]: osdmap e27: 4 total, 4 up, 4 in 2024-04-23T10:20:44.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:44 smithi069 ceph-mon[29593]: osdmap e27: 4 total, 4 up, 4 in 2024-04-23T10:20:45.487 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:45 smithi146 ceph-mon[32800]: osdmap e28: 4 total, 4 up, 4 in 2024-04-23T10:20:45.487 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:45 smithi146 ceph-mon[32800]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:20:45.487 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:45 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:20:45.487 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:45 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:20:45.487 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:45 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:45.487 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:45 smithi146 ceph-mon[32800]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:20:45.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:45 smithi167 ceph-mon[32940]: osdmap e28: 4 total, 4 up, 4 in 2024-04-23T10:20:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:45 smithi167 ceph-mon[32940]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:20:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:45 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:20:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:45 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:20:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:45 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:45 smithi167 ceph-mon[32940]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:20:45.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:45 smithi069 ceph-mon[29593]: osdmap e28: 4 total, 4 up, 4 in 2024-04-23T10:20:45.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:45 smithi069 ceph-mon[29593]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:20:45.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:45 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:20:45.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:45 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:20:45.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:45 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:45.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:45 smithi069 ceph-mon[29593]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:20:46.551 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:46 smithi146 ceph-mon[32800]: osdmap e29: 4 total, 4 up, 4 in 2024-04-23T10:20:46.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:46 smithi167 ceph-mon[32940]: osdmap e29: 4 total, 4 up, 4 in 2024-04-23T10:20:46.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:46 smithi069 ceph-mon[29593]: osdmap e29: 4 total, 4 up, 4 in 2024-04-23T10:20:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:47 smithi167 ceph-mon[32940]: osdmap e30: 4 total, 4 up, 4 in 2024-04-23T10:20:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:47 smithi167 ceph-mon[32940]: pgmap v104: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-23T10:20:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:47 smithi167 ceph-mon[32940]: from='client.? 172.21.15.146:0/348570016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "510df960-9801-46ba-8a2d-c4e89df94af9"}]: dispatch 2024-04-23T10:20:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:47 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "510df960-9801-46ba-8a2d-c4e89df94af9"}]: dispatch 2024-04-23T10:20:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:47 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "510df960-9801-46ba-8a2d-c4e89df94af9"}]': finished 2024-04-23T10:20:47.642 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:47 smithi146 ceph-mon[32800]: osdmap e30: 4 total, 4 up, 4 in 2024-04-23T10:20:47.642 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:47 smithi146 ceph-mon[32800]: pgmap v104: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-23T10:20:47.642 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:47 smithi146 ceph-mon[32800]: from='client.? 172.21.15.146:0/348570016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "510df960-9801-46ba-8a2d-c4e89df94af9"}]: dispatch 2024-04-23T10:20:47.642 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:47 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "510df960-9801-46ba-8a2d-c4e89df94af9"}]: dispatch 2024-04-23T10:20:47.642 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:47 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "510df960-9801-46ba-8a2d-c4e89df94af9"}]': finished 2024-04-23T10:20:47.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:47 smithi069 ceph-mon[29593]: osdmap e30: 4 total, 4 up, 4 in 2024-04-23T10:20:47.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:47 smithi069 ceph-mon[29593]: pgmap v104: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-23T10:20:47.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:47 smithi069 ceph-mon[29593]: from='client.? 172.21.15.146:0/348570016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "510df960-9801-46ba-8a2d-c4e89df94af9"}]: dispatch 2024-04-23T10:20:47.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:47 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "510df960-9801-46ba-8a2d-c4e89df94af9"}]: dispatch 2024-04-23T10:20:47.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:47 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "510df960-9801-46ba-8a2d-c4e89df94af9"}]': finished 2024-04-23T10:20:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:48 smithi167 ceph-mon[32940]: osdmap e31: 5 total, 4 up, 5 in 2024-04-23T10:20:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:48 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:20:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:48 smithi167 ceph-mon[32940]: from='client.? 172.21.15.146:0/178955139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:20:48.653 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:48 smithi146 ceph-mon[32800]: osdmap e31: 5 total, 4 up, 5 in 2024-04-23T10:20:48.653 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:48 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:20:48.653 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:48 smithi146 ceph-mon[32800]: from='client.? 172.21.15.146:0/178955139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:20:48.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:48 smithi069 ceph-mon[29593]: osdmap e31: 5 total, 4 up, 5 in 2024-04-23T10:20:48.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:48 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:20:48.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:48 smithi069 ceph-mon[29593]: from='client.? 172.21.15.146:0/178955139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:20:49.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:49 smithi167 ceph-mon[32940]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-23T10:20:49.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:49 smithi146 ceph-mon[32800]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-23T10:20:49.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:49 smithi069 ceph-mon[29593]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-23T10:20:52.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:52 smithi146 ceph-mon[32800]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T10:20:52.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:52 smithi167 ceph-mon[32940]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T10:20:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:52 smithi069 ceph-mon[29593]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T10:20:54.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:54 smithi167 ceph-mon[32940]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-23T10:20:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:54 smithi146 ceph-mon[32800]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-23T10:20:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:54 smithi069 ceph-mon[29593]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-23T10:20:55.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T10:20:55.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:55.352 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:55 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T10:20:55.352 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:55 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:55.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-23T10:20:55.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:20:56.250 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:56 smithi146 ceph-mon[32800]: Deploying daemon osd.4 on smithi146 2024-04-23T10:20:56.250 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:56 smithi146 ceph-mon[32800]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:20:56.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:56 smithi167 ceph-mon[32940]: Deploying daemon osd.4 on smithi146 2024-04-23T10:20:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:56 smithi167 ceph-mon[32940]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:20:56.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:56 smithi069 ceph-mon[29593]: Deploying daemon osd.4 on smithi146 2024-04-23T10:20:56.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:56 smithi069 ceph-mon[29593]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:20:58.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:20:58 smithi146 ceph-mon[32800]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:20:58.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:20:58 smithi167 ceph-mon[32940]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:20:58.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:20:58 smithi069 ceph-mon[29593]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:00.144 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:00 smithi146 ceph-mon[32800]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:00.294 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:00 smithi069 ceph-mon[29593]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:00.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:00 smithi167 ceph-mon[32940]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:01.581 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:01 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:01.582 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:01 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:01.582 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:01 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:01.582 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:01 smithi069 ceph-mon[29593]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:01.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:01 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:01.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:01 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:01.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:01 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:01.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:01 smithi146 ceph-mon[32800]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:01.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:01 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:01.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:01 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:01.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:01 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:01 smithi167 ceph-mon[32940]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:03.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:03 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:03.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:03 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:03.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:03 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:03.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:03 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:03.930 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:03 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:03.930 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:03 smithi146 ceph-mon[32800]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.078+0000 7f8a16ffd700 1 -- 172.21.15.146:0/2738095912 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8a20062e80 con 0x7f8a0c0a3cc0 2024-04-23T10:21:04.078 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 4 on host 'smithi146' 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 -- 172.21.15.146:0/2738095912 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8a0c0a3cc0 msgr2=0x7f8a0c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8a0c0a3cc0 0x7f8a0c0a6180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a10006fd0 tx=0x7f8a10008040 comp rx=0 tx=0).stop 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 -- 172.21.15.146:0/2738095912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a201019a0 msgr2=0x7f8a2006b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a201019a0 0x7f8a2006b2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009f50 tx=0x7f8a1c0057c0 comp rx=0 tx=0).stop 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 -- 172.21.15.146:0/2738095912 shutdown_connections 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8a0c0a3cc0 0x7f8a0c0a6180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20103540 0x7f8a201a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a201019a0 0x7f8a2006b2e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 --2- 172.21.15.146:0/2738095912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a20102ba0 0x7f8a2019dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 -- 172.21.15.146:0/2738095912 >> 172.21.15.146:0/2738095912 conn(0x7f8a200fcf40 msgr2=0x7f8a20105f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 -- 172.21.15.146:0/2738095912 shutdown_connections 2024-04-23T10:21:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:04.080+0000 7f8a27b69700 1 -- 172.21.15.146:0/2738095912 wait complete. 2024-04-23T10:21:04.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:03 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:04.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:03 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:04.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:03 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:04.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:03 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:04.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:03 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:04.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:03 smithi069 ceph-mon[29593]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:04.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:03 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:03 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:03 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:03 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:03 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:03 smithi167 ceph-mon[32940]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:04.705 DEBUG:teuthology.orchestra.run.smithi146:osd.4> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.4.service 2024-04-23T10:21:04.707 INFO:tasks.cephadm:Deploying osd.5 on smithi167 with /dev/vg_nvme/lv_3... 2024-04-23T10:21:04.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-23T10:21:04.951 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:21:05.312 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:05 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:05.312 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:05 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:05.312 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:05 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:05.312 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:05 smithi167 ceph-mon[32940]: from='osd.4 [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T10:21:05.312 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:05 smithi167 ceph-mon[32940]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T10:21:05.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:05 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:05.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:05 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:05.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:05 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:05.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:05 smithi146 ceph-mon[32800]: from='osd.4 [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T10:21:05.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:05 smithi146 ceph-mon[32800]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T10:21:05.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:05 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:05.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:05 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:05.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:05 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:05.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:05 smithi069 ceph-mon[29593]: from='osd.4 [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T10:21:05.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:05 smithi069 ceph-mon[29593]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-23T10:21:06.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:06 smithi146 ceph-mon[32800]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:06.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:06 smithi146 ceph-mon[32800]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-23T10:21:06.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:06 smithi146 ceph-mon[32800]: osdmap e32: 5 total, 4 up, 5 in 2024-04-23T10:21:06.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:06 smithi146 ceph-mon[32800]: from='osd.4 [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:21:06.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:06 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:06.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:06 smithi146 ceph-mon[32800]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:21:06.179 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:21:06 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4[44061]: 2024-04-23T10:21:06.049+0000 7efc7bbd3700 -1 osd.4 0 waiting for initial osdmap 2024-04-23T10:21:06.179 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:21:06 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4[44061]: 2024-04-23T10:21:06.054+0000 7efc779c6700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:21:06.277 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:06 smithi167 ceph-mon[32940]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:06.277 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:06 smithi167 ceph-mon[32940]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-23T10:21:06.277 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:06 smithi167 ceph-mon[32940]: osdmap e32: 5 total, 4 up, 5 in 2024-04-23T10:21:06.277 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:06 smithi167 ceph-mon[32940]: from='osd.4 [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:21:06.277 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:06 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:06.277 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:06 smithi167 ceph-mon[32940]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:21:06.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:06 smithi069 ceph-mon[29593]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:06.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:06 smithi069 ceph-mon[29593]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-23T10:21:06.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:06 smithi069 ceph-mon[29593]: osdmap e32: 5 total, 4 up, 5 in 2024-04-23T10:21:06.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:06 smithi069 ceph-mon[29593]: from='osd.4 [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:21:06.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:06 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:06.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:06 smithi069 ceph-mon[29593]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:21:06.812 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-23T10:21:06.813 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-23T10:21:06.813 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2024-04-23T10:21:06.813 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2024-04-23T10:21:06.813 INFO:teuthology.orchestra.run.smithi167.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112183 s, 935 MB/s 2024-04-23T10:21:06.813 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2024-04-23T10:21:07.160 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:07 smithi167 ceph-mon[32940]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:21:07.160 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:07 smithi167 ceph-mon[32940]: osdmap e33: 5 total, 4 up, 5 in 2024-04-23T10:21:07.160 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:07.160 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:07.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:07 smithi146 ceph-mon[32800]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:21:07.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:07 smithi146 ceph-mon[32800]: osdmap e33: 5 total, 4 up, 5 in 2024-04-23T10:21:07.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:07.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:07.366 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_3 2024-04-23T10:21:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:07 smithi069 ceph-mon[29593]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:21:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:07 smithi069 ceph-mon[29593]: osdmap e33: 5 total, 4 up, 5 in 2024-04-23T10:21:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:07.615 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:21:08.270 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:21:08.270 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:21:08.270 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:08.271 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: osd.4 [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598] boot 2024-04-23T10:21:08.271 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: osdmap e34: 5 total, 5 up, 5 in 2024-04-23T10:21:08.271 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:08.271 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:08.271 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:08.271 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:08.271 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:08.271 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:08.271 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:08.271 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:08.271 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: osd.4 [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598] boot 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: osdmap e34: 5 total, 5 up, 5 in 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:08.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:08.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:08.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:21:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:21:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-23T10:21:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: osd.4 [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598] boot 2024-04-23T10:21:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: osdmap e34: 5 total, 5 up, 5 in 2024-04-23T10:21:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:21:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:08.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:08.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:08.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:09.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.103+0000 7f4caca6c700 1 -- 172.21.15.167:0/1335828408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca8102bc0 msgr2=0x7f4ca8103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:09.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.103+0000 7f4caca6c700 1 --2- 172.21.15.167:0/1335828408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca8102bc0 0x7f4ca8103020 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009990 tx=0x7f4c9c009ca0 comp rx=0 tx=0).stop 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.104+0000 7f4caca6c700 1 -- 172.21.15.167:0/1335828408 shutdown_connections 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.104+0000 7f4caca6c700 1 --2- 172.21.15.167:0/1335828408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ca8103560 0x7f4ca8109e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.104+0000 7f4caca6c700 1 --2- 172.21.15.167:0/1335828408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca81019c0 0x7f4ca8101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.104+0000 7f4caca6c700 1 --2- 172.21.15.167:0/1335828408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca8102bc0 0x7f4ca8103020 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.104+0000 7f4caca6c700 1 -- 172.21.15.167:0/1335828408 >> 172.21.15.167:0/1335828408 conn(0x7f4ca80fcfa0 msgr2=0x7f4ca80ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.104+0000 7f4caca6c700 1 -- 172.21.15.167:0/1335828408 shutdown_connections 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.104+0000 7f4caca6c700 1 -- 172.21.15.167:0/1335828408 wait complete. 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.104+0000 7f4caca6c700 1 Processor -- start 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.104+0000 7f4caca6c700 1 -- start start 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4caca6c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca81019c0 0x7f4ca806bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4caca6c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca8102bc0 0x7f4ca819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4caca6c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ca8103560 0x7f4ca81a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4caca6c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca810d690 con 0x7f4ca8102bc0 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4caca6c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca810d510 con 0x7f4ca8103560 2024-04-23T10:21:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4caca6c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca810d810 con 0x7f4ca81019c0 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca81019c0 0x7f4ca806bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca81019c0 0x7f4ca806bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59546/0 (socket says 172.21.15.167:59546) 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca659c700 1 -- 172.21.15.167:0/2914784572 learned_addr learned my addr 172.21.15.167:0/2914784572 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca6d9d700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ca8103560 0x7f4ca81a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca5d9b700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca8102bc0 0x7f4ca819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca659c700 1 -- 172.21.15.167:0/2914784572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ca8103560 msgr2=0x7f4ca81a01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca659c700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ca8103560 0x7f4ca81a01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca659c700 1 -- 172.21.15.167:0/2914784572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca8102bc0 msgr2=0x7f4ca819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca659c700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca8102bc0 0x7f4ca819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca659c700 1 -- 172.21.15.167:0/2914784572 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca81a0a90 con 0x7f4ca81019c0 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca6d9d700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ca8103560 0x7f4ca81a01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4ca659c700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca81019c0 0x7f4ca806bd30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800b500 tx=0x7f4c9800b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4c977fe700 1 -- 172.21.15.167:0/2914784572 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98015020 con 0x7f4ca81019c0 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4c977fe700 1 -- 172.21.15.167:0/2914784572 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4c98011d00 con 0x7f4ca81019c0 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4caca6c700 1 -- 172.21.15.167:0/2914784572 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca81a0d80 con 0x7f4ca81019c0 2024-04-23T10:21:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.105+0000 7f4c977fe700 1 -- 172.21.15.167:0/2914784572 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98010e10 con 0x7f4ca81019c0 2024-04-23T10:21:09.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.106+0000 7f4caca6c700 1 -- 172.21.15.167:0/2914784572 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca81a1280 con 0x7f4ca81019c0 2024-04-23T10:21:09.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.107+0000 7f4caca6c700 1 -- 172.21.15.167:0/2914784572 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca802df80 con 0x7f4ca81019c0 2024-04-23T10:21:09.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.108+0000 7f4c977fe700 1 -- 172.21.15.167:0/2914784572 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f4c98018020 con 0x7f4ca81019c0 2024-04-23T10:21:09.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.108+0000 7f4c977fe700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4c900a3c40 0x7f4c900a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:09.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.108+0000 7f4c977fe700 1 -- 172.21.15.167:0/2914784572 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4101+0+0 (secure 0 0 0) 0x7f4c980cebf0 con 0x7f4ca81019c0 2024-04-23T10:21:09.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.108+0000 7f4ca5d9b700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4c900a3c40 0x7f4c900a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:09.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.109+0000 7f4ca5d9b700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4c900a3c40 0x7f4c900a6100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0039a0 tx=0x7f4c9c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:09.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.113+0000 7f4c977fe700 1 -- 172.21.15.167:0/2914784572 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4c9801f020 con 0x7f4ca81019c0 2024-04-23T10:21:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:09.318+0000 7f4caca6c700 1 -- 172.21.15.167:0/2914784572 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4ca8062e80 con 0x7f4c900a3c40 2024-04-23T10:21:09.317 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:09 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi146 2024-04-23T10:21:09.318 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:09 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi146 to 8544M 2024-04-23T10:21:09.318 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:09 smithi167 ceph-mon[32940]: osdmap e35: 5 total, 5 up, 5 in 2024-04-23T10:21:09.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:09 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi146 2024-04-23T10:21:09.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:09 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi146 to 8544M 2024-04-23T10:21:09.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:09 smithi146 ceph-mon[32800]: osdmap e35: 5 total, 5 up, 5 in 2024-04-23T10:21:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:09 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi146 2024-04-23T10:21:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:09 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi146 to 8544M 2024-04-23T10:21:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:09 smithi069 ceph-mon[29593]: osdmap e35: 5 total, 5 up, 5 in 2024-04-23T10:21:10.193 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:10 smithi167 ceph-mon[32940]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:10.193 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:10 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:21:10.194 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:10 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:21:10.194 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:10 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:10.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:10 smithi146 ceph-mon[32800]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:10.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:10 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:21:10.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:10 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:21:10.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:10 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:10.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:10 smithi069 ceph-mon[29593]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:10.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:21:10.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:21:10.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:11.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:11 smithi167 ceph-mon[32940]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:21:11.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:11 smithi146 ceph-mon[32800]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:21:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:11 smithi069 ceph-mon[29593]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:21:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:12 smithi167 ceph-mon[32940]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:12 smithi167 ceph-mon[32940]: from='client.? 172.21.15.167:0/2563905396' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d20822f-0707-4836-96ac-f7dde45401f3"}]: dispatch 2024-04-23T10:21:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:12 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d20822f-0707-4836-96ac-f7dde45401f3"}]: dispatch 2024-04-23T10:21:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:12 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d20822f-0707-4836-96ac-f7dde45401f3"}]': finished 2024-04-23T10:21:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:12 smithi167 ceph-mon[32940]: osdmap e36: 6 total, 5 up, 6 in 2024-04-23T10:21:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:12 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:12 smithi146 ceph-mon[32800]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:12 smithi146 ceph-mon[32800]: from='client.? 172.21.15.167:0/2563905396' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d20822f-0707-4836-96ac-f7dde45401f3"}]: dispatch 2024-04-23T10:21:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:12 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d20822f-0707-4836-96ac-f7dde45401f3"}]: dispatch 2024-04-23T10:21:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:12 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d20822f-0707-4836-96ac-f7dde45401f3"}]': finished 2024-04-23T10:21:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:12 smithi146 ceph-mon[32800]: osdmap e36: 6 total, 5 up, 6 in 2024-04-23T10:21:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:12 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:12 smithi069 ceph-mon[29593]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:12 smithi069 ceph-mon[29593]: from='client.? 172.21.15.167:0/2563905396' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d20822f-0707-4836-96ac-f7dde45401f3"}]: dispatch 2024-04-23T10:21:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:12 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d20822f-0707-4836-96ac-f7dde45401f3"}]: dispatch 2024-04-23T10:21:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:12 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d20822f-0707-4836-96ac-f7dde45401f3"}]': finished 2024-04-23T10:21:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:12 smithi069 ceph-mon[29593]: osdmap e36: 6 total, 5 up, 6 in 2024-04-23T10:21:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:12 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:13.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:13 smithi146 ceph-mon[32800]: from='client.? 172.21.15.167:0/4005707503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:21:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:13 smithi069 ceph-mon[29593]: from='client.? 172.21.15.167:0/4005707503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:21:13.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:13 smithi167 ceph-mon[32940]: from='client.? 172.21.15.167:0/4005707503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:21:14.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:14 smithi146 ceph-mon[32800]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:14.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:14 smithi069 ceph-mon[29593]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:14.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:14 smithi167 ceph-mon[32940]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:16.172 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:16 smithi167 ceph-mon[32940]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:16.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:16 smithi146 ceph-mon[32800]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:16.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:16 smithi069 ceph-mon[29593]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:18.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:18 smithi167 ceph-mon[32940]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:18.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:18 smithi146 ceph-mon[32800]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:18.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:18 smithi069 ceph-mon[29593]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:19.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T10:21:19.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:19.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T10:21:19.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-23T10:21:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:20 smithi167 ceph-mon[32940]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:20 smithi167 ceph-mon[32940]: Deploying daemon osd.5 on smithi167 2024-04-23T10:21:20.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:20 smithi146 ceph-mon[32800]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:20.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:20 smithi146 ceph-mon[32800]: Deploying daemon osd.5 on smithi167 2024-04-23T10:21:20.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:20 smithi069 ceph-mon[29593]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:20.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:20 smithi069 ceph-mon[29593]: Deploying daemon osd.5 on smithi167 2024-04-23T10:21:22.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:22 smithi167 ceph-mon[32940]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:22 smithi146 ceph-mon[32800]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:22.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:22 smithi069 ceph-mon[29593]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:24.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:24 smithi167 ceph-mon[32940]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:24.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:24 smithi146 ceph-mon[32800]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:24.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:24 smithi069 ceph-mon[29593]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:25.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:25.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:25.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:25 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:25.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:25 smithi069 ceph-mon[29593]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:25.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:25 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:25.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:25 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:25.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:25 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:25.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:25 smithi167 ceph-mon[32940]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:25.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:25 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:25.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:25 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:25.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:25 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:25.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:25 smithi146 ceph-mon[32800]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:27.830 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 5 on host 'smithi167' 2024-04-23T10:21:27.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.831+0000 7f4c977fe700 1 -- 172.21.15.167:0/2914784572 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4ca8062e80 con 0x7f4c900a3c40 2024-04-23T10:21:27.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 -- 172.21.15.167:0/2914784572 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4c900a3c40 msgr2=0x7f4c900a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:27.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4c900a3c40 0x7f4c900a6100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0039a0 tx=0x7f4c9c005fb0 comp rx=0 tx=0).stop 2024-04-23T10:21:27.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 -- 172.21.15.167:0/2914784572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca81019c0 msgr2=0x7f4ca806bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:27.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca81019c0 0x7f4ca806bd30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800b500 tx=0x7f4c9800b8c0 comp rx=0 tx=0).stop 2024-04-23T10:21:27.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 -- 172.21.15.167:0/2914784572 shutdown_connections 2024-04-23T10:21:27.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4c900a3c40 0x7f4c900a6100 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:27.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ca8103560 0x7f4ca81a01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:27.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca81019c0 0x7f4ca806bd30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:27.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 --2- 172.21.15.167:0/2914784572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ca8102bc0 0x7f4ca819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:27.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 -- 172.21.15.167:0/2914784572 >> 172.21.15.167:0/2914784572 conn(0x7f4ca80fcfa0 msgr2=0x7f4ca8105f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:27.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 -- 172.21.15.167:0/2914784572 shutdown_connections 2024-04-23T10:21:27.833 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:21:27.833+0000 7f4caca6c700 1 -- 172.21.15.167:0/2914784572 wait complete. 2024-04-23T10:21:28.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:28 smithi167 ceph-mon[32940]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:28 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:28 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:28.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:28 smithi146 ceph-mon[32800]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:28.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:28 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:28.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:28 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:28.455 DEBUG:teuthology.orchestra.run.smithi167:osd.5> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.5.service 2024-04-23T10:21:28.457 INFO:tasks.cephadm:Deploying osd.6 on smithi069 with /dev/vg_nvme/lv_2... 2024-04-23T10:21:28.458 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-23T10:21:28.484 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:28 smithi069 ceph-mon[29593]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:28.548 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:28 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:28.549 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:28 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:28.707 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:21:29.140 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:29 smithi069 ceph-mon[29593]: from='osd.5 [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T10:21:29.140 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:29 smithi069 ceph-mon[29593]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T10:21:29.140 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:29.140 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:29.296 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:29 smithi167 ceph-mon[32940]: from='osd.5 [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T10:21:29.296 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:29 smithi167 ceph-mon[32940]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T10:21:29.296 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:29 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:29.296 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:29 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:29.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:29 smithi146 ceph-mon[32800]: from='osd.5 [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T10:21:29.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:29 smithi146 ceph-mon[32800]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-23T10:21:29.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:29 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:29.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:29 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:30.185 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:30 smithi069 ceph-mon[29593]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:30.186 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:30 smithi069 ceph-mon[29593]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-23T10:21:30.186 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:30 smithi069 ceph-mon[29593]: osdmap e37: 6 total, 5 up, 6 in 2024-04-23T10:21:30.186 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:30 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:30.186 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:30 smithi069 ceph-mon[29593]: from='osd.5 [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:21:30.186 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:30 smithi069 ceph-mon[29593]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:21:30.313 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:30 smithi167 ceph-mon[32940]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:30.314 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:30 smithi167 ceph-mon[32940]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-23T10:21:30.314 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:30 smithi167 ceph-mon[32940]: osdmap e37: 6 total, 5 up, 6 in 2024-04-23T10:21:30.314 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:30 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:30.314 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:30 smithi167 ceph-mon[32940]: from='osd.5 [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:21:30.314 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:30 smithi167 ceph-mon[32940]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:21:30.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:30 smithi146 ceph-mon[32800]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:30.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:30 smithi146 ceph-mon[32800]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-23T10:21:30.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:30 smithi146 ceph-mon[32800]: osdmap e37: 6 total, 5 up, 6 in 2024-04-23T10:21:30.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:30 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:30.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:30 smithi146 ceph-mon[32800]: from='osd.5 [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:21:30.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:30 smithi146 ceph-mon[32800]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:21:30.574 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:21:30 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:21:30.464+0000 7f581b490700 -1 osd.5 0 waiting for initial osdmap 2024-04-23T10:21:30.574 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:21:30 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:21:30.470+0000 7f581327b700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:21:30.780 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-23T10:21:30.780 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-23T10:21:30.780 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2024-04-23T10:21:30.780 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2024-04-23T10:21:30.780 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122418 s, 857 MB/s 2024-04-23T10:21:30.780 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2024-04-23T10:21:31.300 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:31 smithi167 ceph-mon[32940]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:21:31.301 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:31 smithi167 ceph-mon[32940]: osdmap e38: 6 total, 5 up, 6 in 2024-04-23T10:21:31.301 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:31.301 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:31.301 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:31 smithi167 ceph-mon[32940]: from='osd.5 ' entity='osd.5' 2024-04-23T10:21:31.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:31 smithi069 ceph-mon[29593]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:21:31.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:31 smithi069 ceph-mon[29593]: osdmap e38: 6 total, 5 up, 6 in 2024-04-23T10:21:31.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:31.416 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:31.416 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:31 smithi069 ceph-mon[29593]: from='osd.5 ' entity='osd.5' 2024-04-23T10:21:31.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:31 smithi146 ceph-mon[32800]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:21:31.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:31 smithi146 ceph-mon[32800]: osdmap e38: 6 total, 5 up, 6 in 2024-04-23T10:21:31.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:31.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:31.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:31 smithi146 ceph-mon[32800]: from='osd.5 ' entity='osd.5' 2024-04-23T10:21:31.446 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi069:vg_nvme/lv_2 2024-04-23T10:21:31.730 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:21:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:21:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:21:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: osd.5 [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496] boot 2024-04-23T10:21:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: osdmap e39: 6 total, 6 up, 6 in 2024-04-23T10:21:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: osdmap e40: 6 total, 6 up, 6 in 2024-04-23T10:21:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:32.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:32.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:32.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:32.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:32.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:32.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:32 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:21:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:21:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: osd.5 [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496] boot 2024-04-23T10:21:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: osdmap e39: 6 total, 6 up, 6 in 2024-04-23T10:21:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: osdmap e40: 6 total, 6 up, 6 in 2024-04-23T10:21:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:32.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:32.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:32.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:32.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:32.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:32 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:32.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:21:32.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:21:32.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-04-23T10:21:32.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:32.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: osd.5 [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496] boot 2024-04-23T10:21:32.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: osdmap e39: 6 total, 6 up, 6 in 2024-04-23T10:21:32.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:21:32.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: osdmap e40: 6 total, 6 up, 6 in 2024-04-23T10:21:32.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:32.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:32.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:32.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:32.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:32.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:32.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:32.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:32 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:33.288 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:33 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi167 2024-04-23T10:21:33.288 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:33 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi167 to 8544M 2024-04-23T10:21:33.288 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:33 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:33.289 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:33 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:33.289 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:33 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:33.289 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:33 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:33.289 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:33 smithi069 ceph-mon[29593]: osdmap e41: 6 total, 6 up, 6 in 2024-04-23T10:21:33.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:33 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi167 2024-04-23T10:21:33.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:33 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi167 to 8544M 2024-04-23T10:21:33.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:33 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:33.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:33 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:33.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:33 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:33.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:33 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:33.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:33 smithi167 ceph-mon[32940]: osdmap e41: 6 total, 6 up, 6 in 2024-04-23T10:21:33.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.336+0000 7f0dc6120700 1 -- 172.21.15.69:0/1310344648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc0102ba0 msgr2=0x7f0dc0103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.336+0000 7f0dc6120700 1 --2- 172.21.15.69:0/1310344648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc0102ba0 0x7f0dc0103000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0db40099c0 tx=0x7f0db4009cd0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.336+0000 7f0dc6120700 1 -- 172.21.15.69:0/1310344648 shutdown_connections 2024-04-23T10:21:33.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.336+0000 7f0dc6120700 1 --2- 172.21.15.69:0/1310344648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc0103540 0x7f0dc0109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.336+0000 7f0dc6120700 1 --2- 172.21.15.69:0/1310344648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dc01019a0 0x7f0dc0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.336+0000 7f0dc6120700 1 --2- 172.21.15.69:0/1310344648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc0102ba0 0x7f0dc0103000 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.336+0000 7f0dc6120700 1 -- 172.21.15.69:0/1310344648 >> 172.21.15.69:0/1310344648 conn(0x7f0dc00fcf40 msgr2=0x7f0dc00ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:33.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.336+0000 7f0dc6120700 1 -- 172.21.15.69:0/1310344648 shutdown_connections 2024-04-23T10:21:33.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.336+0000 7f0dc6120700 1 -- 172.21.15.69:0/1310344648 wait complete. 2024-04-23T10:21:33.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.336+0000 7f0dc6120700 1 Processor -- start 2024-04-23T10:21:33.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dc6120700 1 -- start start 2024-04-23T10:21:33.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dc6120700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dc01019a0 0x7f0dc01058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dc6120700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc0102ba0 0x7f0dc0103f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dc6120700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc0103540 0x7f0dc01044c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dc6120700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc010d640 con 0x7f0dc0102ba0 2024-04-23T10:21:33.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dc6120700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc010d4c0 con 0x7f0dc0103540 2024-04-23T10:21:33.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dc6120700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc010d7c0 con 0x7f0dc01019a0 2024-04-23T10:21:33.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc0102ba0 0x7f0dc0103f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc0102ba0 0x7f0dc0103f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52314/0 (socket says 172.21.15.69:52314) 2024-04-23T10:21:33.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbeffd700 1 -- 172.21.15.69:0/869613777 learned_addr learned my addr 172.21.15.69:0/869613777 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:21:33.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbf7fe700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dc01019a0 0x7f0dc01058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbffff700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc0103540 0x7f0dc01044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbeffd700 1 -- 172.21.15.69:0/869613777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dc01019a0 msgr2=0x7f0dc01058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbeffd700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dc01019a0 0x7f0dc01058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbeffd700 1 -- 172.21.15.69:0/869613777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc0103540 msgr2=0x7f0dc01044c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:33.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbeffd700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc0103540 0x7f0dc01044c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:33.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbeffd700 1 -- 172.21.15.69:0/869613777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc0104d90 con 0x7f0dc0102ba0 2024-04-23T10:21:33.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbffff700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc0103540 0x7f0dc01044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:21:33.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.337+0000 7f0dbeffd700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc0102ba0 0x7f0dc0103f80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009990 tx=0x7f0db40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.338+0000 7f0dbcff9700 1 -- 172.21.15.69:0/869613777 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4003e00 con 0x7f0dc0102ba0 2024-04-23T10:21:33.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.338+0000 7f0dc6120700 1 -- 172.21.15.69:0/869613777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc01a2ee0 con 0x7f0dc0102ba0 2024-04-23T10:21:33.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.338+0000 7f0dbcff9700 1 -- 172.21.15.69:0/869613777 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0db4004d00 con 0x7f0dc0102ba0 2024-04-23T10:21:33.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.338+0000 7f0dbcff9700 1 -- 172.21.15.69:0/869613777 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4005650 con 0x7f0dc0102ba0 2024-04-23T10:21:33.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.338+0000 7f0dc6120700 1 -- 172.21.15.69:0/869613777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc01a3280 con 0x7f0dc0102ba0 2024-04-23T10:21:33.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.339+0000 7f0dc6120700 1 -- 172.21.15.69:0/869613777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc0069730 con 0x7f0dc0102ba0 2024-04-23T10:21:33.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.340+0000 7f0dbcff9700 1 -- 172.21.15.69:0/869613777 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0db4029060 con 0x7f0dc0102ba0 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.340+0000 7f0dbcff9700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0da80a3c40 0x7f0da80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.340+0000 7f0dbf7fe700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0da80a3c40 0x7f0da80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.340+0000 7f0dbcff9700 1 -- 172.21.15.69:0/869613777 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4533+0+0 (secure 0 0 0) 0x7f0db40d0300 con 0x7f0dc0102ba0 2024-04-23T10:21:33.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.341+0000 7f0dbf7fe700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0da80a3c40 0x7f0da80a6100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0db0005950 tx=0x7f0db000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:33.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.345+0000 7f0dbcff9700 1 -- 172.21.15.69:0/869613777 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0db4013070 con 0x7f0dc0102ba0 2024-04-23T10:21:33.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:33 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi167 2024-04-23T10:21:33.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:33 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi167 to 8544M 2024-04-23T10:21:33.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:33 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:33.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:33 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:33.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:33 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:33.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:33 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:33.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:33 smithi146 ceph-mon[32800]: osdmap e41: 6 total, 6 up, 6 in 2024-04-23T10:21:33.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:33.552+0000 7f0dc6120700 1 -- 172.21.15.69:0/869613777 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0dc00ff150 con 0x7f0da80a3c40 2024-04-23T10:21:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:34 smithi167 ceph-mon[32940]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:34 smithi167 ceph-mon[32940]: osdmap e42: 6 total, 6 up, 6 in 2024-04-23T10:21:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:34 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:21:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:34 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:21:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:34 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:34.398 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:34 smithi069 ceph-mon[29593]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:34.399 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:34 smithi069 ceph-mon[29593]: osdmap e42: 6 total, 6 up, 6 in 2024-04-23T10:21:34.399 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:21:34.399 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:21:34.399 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:34.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:34 smithi146 ceph-mon[32800]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:34.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:34 smithi146 ceph-mon[32800]: osdmap e42: 6 total, 6 up, 6 in 2024-04-23T10:21:34.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:34 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:21:34.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:34 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:21:34.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:34 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:35.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:35 smithi167 ceph-mon[32940]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:21:35.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:35 smithi167 ceph-mon[32940]: osdmap e43: 6 total, 6 up, 6 in 2024-04-23T10:21:35.354 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:35 smithi069 ceph-mon[29593]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:21:35.354 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:35 smithi069 ceph-mon[29593]: osdmap e43: 6 total, 6 up, 6 in 2024-04-23T10:21:35.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:35 smithi146 ceph-mon[32800]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:21:35.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:35 smithi146 ceph-mon[32800]: osdmap e43: 6 total, 6 up, 6 in 2024-04-23T10:21:36.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:36 smithi167 ceph-mon[32940]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:36.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:36 smithi146 ceph-mon[32800]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:36.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:36 smithi069 ceph-mon[29593]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:37 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3363009890' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6e4d748-c616-4ae4-a9ad-96a45037a58d"}]: dispatch 2024-04-23T10:21:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:37 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3363009890' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6e4d748-c616-4ae4-a9ad-96a45037a58d"}]': finished 2024-04-23T10:21:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:37 smithi167 ceph-mon[32940]: osdmap e44: 7 total, 6 up, 7 in 2024-04-23T10:21:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:37 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/624273822' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:21:37.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:37 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3363009890' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6e4d748-c616-4ae4-a9ad-96a45037a58d"}]: dispatch 2024-04-23T10:21:37.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:37 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3363009890' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6e4d748-c616-4ae4-a9ad-96a45037a58d"}]': finished 2024-04-23T10:21:37.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:37 smithi146 ceph-mon[32800]: osdmap e44: 7 total, 6 up, 7 in 2024-04-23T10:21:37.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:37.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:37 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/624273822' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:21:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:37 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3363009890' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6e4d748-c616-4ae4-a9ad-96a45037a58d"}]: dispatch 2024-04-23T10:21:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:37 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3363009890' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6e4d748-c616-4ae4-a9ad-96a45037a58d"}]': finished 2024-04-23T10:21:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:37 smithi069 ceph-mon[29593]: osdmap e44: 7 total, 6 up, 7 in 2024-04-23T10:21:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:37 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/624273822' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:21:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:38 smithi167 ceph-mon[32940]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-23T10:21:38.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:38 smithi146 ceph-mon[32800]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-23T10:21:38.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:38 smithi069 ceph-mon[29593]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-23T10:21:40.202 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:40 smithi069 ceph-mon[29593]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T10:21:40.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:40 smithi167 ceph-mon[32940]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T10:21:40.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:40 smithi146 ceph-mon[32800]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-23T10:21:42.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:42 smithi167 ceph-mon[32940]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-23T10:21:42.384 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:42 smithi069 ceph-mon[29593]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-23T10:21:42.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:42 smithi146 ceph-mon[32800]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-04-23T10:21:44.319 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:44 smithi069 ceph-mon[29593]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-23T10:21:44.319 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:44 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-23T10:21:44.319 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:44 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:44.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:44 smithi167 ceph-mon[32940]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-23T10:21:44.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:44 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-23T10:21:44.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:44 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:44.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:44 smithi146 ceph-mon[32800]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-23T10:21:44.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:44 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-23T10:21:44.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:44 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:45.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:45 smithi069 ceph-mon[29593]: Deploying daemon osd.6 on smithi069 2024-04-23T10:21:45.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:45 smithi167 ceph-mon[32940]: Deploying daemon osd.6 on smithi069 2024-04-23T10:21:45.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:45 smithi146 ceph-mon[32800]: Deploying daemon osd.6 on smithi069 2024-04-23T10:21:46.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:46 smithi167 ceph-mon[32940]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T10:21:46.384 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:46 smithi069 ceph-mon[29593]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T10:21:46.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:46 smithi146 ceph-mon[32800]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T10:21:48.175 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:48 smithi069 ceph-mon[29593]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:48.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:48 smithi167 ceph-mon[32940]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:48.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:48 smithi146 ceph-mon[32800]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:50.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:50 smithi069 ceph-mon[29593]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:50.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:50 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:50.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:50 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:50.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:50 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:50.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:50 smithi167 ceph-mon[32940]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:50.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:50 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:50.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:50 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:50.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:50 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:50.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:50 smithi146 ceph-mon[32800]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:50.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:50 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:50.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:50 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:50.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:50 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:52 smithi167 ceph-mon[32940]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:52 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:52 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:52 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:52 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:52 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:52.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:52 smithi146 ceph-mon[32800]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:52.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:52 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:52.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:52 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:52.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:52 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:52.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:52 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:52.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:52 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:52 smithi069 ceph-mon[29593]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:52 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:52 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:52 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:52 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:52 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:52.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.958+0000 7f0dbcff9700 1 -- 172.21.15.69:0/869613777 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0dc00ff150 con 0x7f0da80a3c40 2024-04-23T10:21:52.959 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 6 on host 'smithi069' 2024-04-23T10:21:52.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 -- 172.21.15.69:0/869613777 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0da80a3c40 msgr2=0x7f0da80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:52.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0da80a3c40 0x7f0da80a6100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0db0005950 tx=0x7f0db000a300 comp rx=0 tx=0).stop 2024-04-23T10:21:52.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 -- 172.21.15.69:0/869613777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc0102ba0 msgr2=0x7f0dc0103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:52.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc0102ba0 0x7f0dc0103f80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009990 tx=0x7f0db40047b0 comp rx=0 tx=0).stop 2024-04-23T10:21:52.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 -- 172.21.15.69:0/869613777 shutdown_connections 2024-04-23T10:21:52.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0da80a3c40 0x7f0da80a6100 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:52.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dc0103540 0x7f0dc01044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:52.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dc01019a0 0x7f0dc01058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:52.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 --2- 172.21.15.69:0/869613777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc0102ba0 0x7f0dc0103f80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:52.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 -- 172.21.15.69:0/869613777 >> 172.21.15.69:0/869613777 conn(0x7f0dc00fcf40 msgr2=0x7f0dc00fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:52.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 -- 172.21.15.69:0/869613777 shutdown_connections 2024-04-23T10:21:52.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:21:52.961+0000 7f0dc6120700 1 -- 172.21.15.69:0/869613777 wait complete. 2024-04-23T10:21:53.690 DEBUG:teuthology.orchestra.run.smithi069:osd.6> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.6.service 2024-04-23T10:21:53.693 INFO:tasks.cephadm:Deploying osd.7 on smithi146 with /dev/vg_nvme/lv_2... 2024-04-23T10:21:53.693 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-23T10:21:53.941 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:21:54.063 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:54.063 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:54.063 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:54.063 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:53 smithi146 ceph-mon[32800]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:54.063 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:53 smithi146 ceph-mon[32800]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-23T10:21:54.195 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:54.195 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:54.195 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:54.195 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:53 smithi069 ceph-mon[29593]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:54.195 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:53 smithi069 ceph-mon[29593]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-23T10:21:54.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:21:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:53 smithi167 ceph-mon[32940]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:53 smithi167 ceph-mon[32940]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-23T10:21:55.149 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:54 smithi069 ceph-mon[29593]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-23T10:21:55.149 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:54 smithi069 ceph-mon[29593]: osdmap e45: 7 total, 6 up, 7 in 2024-04-23T10:21:55.149 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:54 smithi069 ceph-mon[29593]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:21:55.149 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:54 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:55.149 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:21:54 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:21:54.940+0000 7f1d18b1d700 -1 osd.6 0 waiting for initial osdmap 2024-04-23T10:21:55.150 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:21:54 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:21:54.951+0000 7f1d14910700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:21:55.305 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:54 smithi146 ceph-mon[32800]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-23T10:21:55.305 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:54 smithi146 ceph-mon[32800]: osdmap e45: 7 total, 6 up, 7 in 2024-04-23T10:21:55.305 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:54 smithi146 ceph-mon[32800]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:21:55.305 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:54 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:55.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:54 smithi167 ceph-mon[32940]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-23T10:21:55.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:54 smithi167 ceph-mon[32940]: osdmap e45: 7 total, 6 up, 7 in 2024-04-23T10:21:55.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:54 smithi167 ceph-mon[32940]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:21:55.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:54 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:56.152 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-23T10:21:56.153 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-23T10:21:56.153 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-04-23T10:21:56.153 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-04-23T10:21:56.153 INFO:teuthology.orchestra.run.smithi146.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115798 s, 906 MB/s 2024-04-23T10:21:56.153 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 2024-04-23T10:21:56.153 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-04-23T10:21:56.202 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:55 smithi146 ceph-mon[32800]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:21:56.202 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:55 smithi146 ceph-mon[32800]: osdmap e46: 7 total, 6 up, 7 in 2024-04-23T10:21:56.202 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:55 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:56.202 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:55 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:56.202 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:55 smithi146 ceph-mon[32800]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:56.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:55 smithi069 ceph-mon[29593]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:21:56.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:55 smithi069 ceph-mon[29593]: osdmap e46: 7 total, 6 up, 7 in 2024-04-23T10:21:56.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:56.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:56.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:55 smithi069 ceph-mon[29593]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:55 smithi167 ceph-mon[32940]: from='osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:21:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:55 smithi167 ceph-mon[32940]: osdmap e46: 7 total, 6 up, 7 in 2024-04-23T10:21:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:55 smithi167 ceph-mon[32940]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-23T10:21:56.841 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_2 2024-04-23T10:21:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:21:57.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:21:57.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:21:57.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:57.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413] boot 2024-04-23T10:21:57.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: osdmap e47: 7 total, 7 up, 7 in 2024-04-23T10:21:57.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:57.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:57.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:57.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:57.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:57.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:57.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:57.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:57.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:57.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:56 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:21:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:21:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413] boot 2024-04-23T10:21:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: osdmap e47: 7 total, 7 up, 7 in 2024-04-23T10:21:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:56 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:57.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: osd.6 [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413] boot 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: osdmap e47: 7 total, 7 up, 7 in 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:21:57.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:56 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:21:58.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:57 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi069 2024-04-23T10:21:58.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:57 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi069 to 5696M 2024-04-23T10:21:58.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:57 smithi146 ceph-mon[32800]: osdmap e48: 7 total, 7 up, 7 in 2024-04-23T10:21:58.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:57 smithi146 ceph-mon[32800]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:21:58.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:57 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi069 2024-04-23T10:21:58.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:57 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi069 to 5696M 2024-04-23T10:21:58.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:57 smithi069 ceph-mon[29593]: osdmap e48: 7 total, 7 up, 7 in 2024-04-23T10:21:58.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:57 smithi069 ceph-mon[29593]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:21:58.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:57 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi069 2024-04-23T10:21:58.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:57 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi069 to 5696M 2024-04-23T10:21:58.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:57 smithi167 ceph-mon[32940]: osdmap e48: 7 total, 7 up, 7 in 2024-04-23T10:21:58.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:57 smithi167 ceph-mon[32940]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:21:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.764+0000 7fea917ad700 1 -- 172.21.15.146:0/3599656202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea8c102aa0 msgr2=0x7fea8c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.764+0000 7fea917ad700 1 --2- 172.21.15.146:0/3599656202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea8c102aa0 0x7fea8c102ec0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0099c0 tx=0x7fea7c009cd0 comp rx=0 tx=0).stop 2024-04-23T10:21:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.764+0000 7fea917ad700 1 -- 172.21.15.146:0/3599656202 shutdown_connections 2024-04-23T10:21:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.764+0000 7fea917ad700 1 --2- 172.21.15.146:0/3599656202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea8c104640 0x7fea8c10aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.764+0000 7fea917ad700 1 --2- 172.21.15.146:0/3599656202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea8c102aa0 0x7fea8c102ec0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:58.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.764+0000 7fea917ad700 1 --2- 172.21.15.146:0/3599656202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea8c103ca0 0x7fea8c104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:58.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.764+0000 7fea917ad700 1 -- 172.21.15.146:0/3599656202 >> 172.21.15.146:0/3599656202 conn(0x7fea8c0fe040 msgr2=0x7fea8c100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:58.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.764+0000 7fea917ad700 1 -- 172.21.15.146:0/3599656202 shutdown_connections 2024-04-23T10:21:58.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.764+0000 7fea917ad700 1 -- 172.21.15.146:0/3599656202 wait complete. 2024-04-23T10:21:58.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.764+0000 7fea917ad700 1 Processor -- start 2024-04-23T10:21:58.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea917ad700 1 -- start start 2024-04-23T10:21:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea917ad700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea8c102aa0 0x7fea8c0767e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea917ad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea8c103ca0 0x7fea8c074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea917ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea8c104640 0x7fea8c075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea917ad700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c10e670 con 0x7fea8c103ca0 2024-04-23T10:21:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea917ad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c10e4f0 con 0x7fea8c104640 2024-04-23T10:21:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea917ad700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c10e7f0 con 0x7fea8c102aa0 2024-04-23T10:21:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea8b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea8c104640 0x7fea8c075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea8b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea8c104640 0x7fea8c075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50436/0 (socket says 172.21.15.146:50436) 2024-04-23T10:21:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea8b7fe700 1 -- 172.21.15.146:0/2130091329 learned_addr learned my addr 172.21.15.146:0/2130091329 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-23T10:21:58.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea8affd700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea8c102aa0 0x7fea8c0767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea8a7fc700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea8c103ca0 0x7fea8c074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea8b7fe700 1 -- 172.21.15.146:0/2130091329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea8c102aa0 msgr2=0x7fea8c0767e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea8b7fe700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea8c102aa0 0x7fea8c0767e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea8b7fe700 1 -- 172.21.15.146:0/2130091329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea8c103ca0 msgr2=0x7fea8c074e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea8b7fe700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea8c103ca0 0x7fea8c074e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea8b7fe700 1 -- 172.21.15.146:0/2130091329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8c075c20 con 0x7fea8c104640 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.765+0000 7fea8b7fe700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea8c104640 0x7fea8c075370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fea84007ee0 tx=0x7fea8400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.766+0000 7fea73fff700 1 -- 172.21.15.146:0/2130091329 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84004bb0 con 0x7fea8c104640 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.766+0000 7fea73fff700 1 -- 172.21.15.146:0/2130091329 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fea84004d50 con 0x7fea8c104640 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.766+0000 7fea917ad700 1 -- 172.21.15.146:0/2130091329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8c1a2e80 con 0x7fea8c104640 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.766+0000 7fea73fff700 1 -- 172.21.15.146:0/2130091329 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea840059e0 con 0x7fea8c104640 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.766+0000 7fea917ad700 1 -- 172.21.15.146:0/2130091329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea8c1a32e0 con 0x7fea8c104640 2024-04-23T10:21:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.767+0000 7fea917ad700 1 -- 172.21.15.146:0/2130091329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8c069730 con 0x7fea8c104640 2024-04-23T10:21:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.768+0000 7fea73fff700 1 -- 172.21.15.146:0/2130091329 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fea8401a020 con 0x7fea8c104640 2024-04-23T10:21:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.768+0000 7fea73fff700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea740a3c40 0x7fea740a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.768+0000 7fea73fff700 1 -- 172.21.15.146:0/2130091329 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4965+0+0 (secure 0 0 0) 0x7fea840ced80 con 0x7fea8c104640 2024-04-23T10:21:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.769+0000 7fea8affd700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea740a3c40 0x7fea740a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.769+0000 7fea8affd700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea740a3c40 0x7fea740a6100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea7c009990 tx=0x7fea7c005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.773+0000 7fea73fff700 1 -- 172.21.15.146:0/2130091329 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fea84010070 con 0x7fea8c104640 2024-04-23T10:21:58.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:21:58.982+0000 7fea917ad700 1 -- 172.21.15.146:0/2130091329 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fea8c062e80 con 0x7fea740a3c40 2024-04-23T10:21:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:21:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:21:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:21:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:59.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:21:59.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:21:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:21:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:21:59.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:21:59.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:21:59.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:21:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:00.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:00 smithi146 ceph-mon[32800]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:00.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:00 smithi146 ceph-mon[32800]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:22:00.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:00 smithi167 ceph-mon[32940]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:00.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:00 smithi167 ceph-mon[32940]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:22:00.393 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:00 smithi069 ceph-mon[29593]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:00.393 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:00 smithi069 ceph-mon[29593]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:22:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:02 smithi167 ceph-mon[32940]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:02 smithi167 ceph-mon[32940]: from='client.? 172.21.15.146:0/3390062413' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7ee0b7c-ea72-4bbc-9b24-543d6925263c"}]: dispatch 2024-04-23T10:22:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:02 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7ee0b7c-ea72-4bbc-9b24-543d6925263c"}]: dispatch 2024-04-23T10:22:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:02 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7ee0b7c-ea72-4bbc-9b24-543d6925263c"}]': finished 2024-04-23T10:22:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:02 smithi167 ceph-mon[32940]: osdmap e49: 8 total, 7 up, 8 in 2024-04-23T10:22:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:02 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:02 smithi146 ceph-mon[32800]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:02 smithi146 ceph-mon[32800]: from='client.? 172.21.15.146:0/3390062413' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7ee0b7c-ea72-4bbc-9b24-543d6925263c"}]: dispatch 2024-04-23T10:22:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:02 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7ee0b7c-ea72-4bbc-9b24-543d6925263c"}]: dispatch 2024-04-23T10:22:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:02 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7ee0b7c-ea72-4bbc-9b24-543d6925263c"}]': finished 2024-04-23T10:22:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:02 smithi146 ceph-mon[32800]: osdmap e49: 8 total, 7 up, 8 in 2024-04-23T10:22:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:02 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:02.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:02 smithi069 ceph-mon[29593]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:02.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:02 smithi069 ceph-mon[29593]: from='client.? 172.21.15.146:0/3390062413' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7ee0b7c-ea72-4bbc-9b24-543d6925263c"}]: dispatch 2024-04-23T10:22:02.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:02 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7ee0b7c-ea72-4bbc-9b24-543d6925263c"}]: dispatch 2024-04-23T10:22:02.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:02 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7ee0b7c-ea72-4bbc-9b24-543d6925263c"}]': finished 2024-04-23T10:22:02.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:02 smithi069 ceph-mon[29593]: osdmap e49: 8 total, 7 up, 8 in 2024-04-23T10:22:02.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:02 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:03.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:03 smithi167 ceph-mon[32940]: from='client.? 172.21.15.146:0/562916648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:22:03.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:03 smithi146 ceph-mon[32800]: from='client.? 172.21.15.146:0/562916648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:22:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:03 smithi069 ceph-mon[29593]: from='client.? 172.21.15.146:0/562916648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:22:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:04 smithi167 ceph-mon[32940]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:04 smithi146 ceph-mon[32800]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:04.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:04 smithi069 ceph-mon[29593]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:06.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:06 smithi167 ceph-mon[32940]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:06.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:06 smithi146 ceph-mon[32800]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:06.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:06 smithi069 ceph-mon[29593]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:08.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:08 smithi167 ceph-mon[32940]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:08.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:08 smithi146 ceph-mon[32800]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:08 smithi069 ceph-mon[29593]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:09.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-23T10:22:09.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:09.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-23T10:22:09.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-23T10:22:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:10.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:10 smithi146 ceph-mon[32800]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:10.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:10 smithi146 ceph-mon[32800]: Deploying daemon osd.7 on smithi146 2024-04-23T10:22:10.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:10 smithi167 ceph-mon[32940]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:10.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:10 smithi167 ceph-mon[32940]: Deploying daemon osd.7 on smithi146 2024-04-23T10:22:10.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:10 smithi069 ceph-mon[29593]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:10.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:10 smithi069 ceph-mon[29593]: Deploying daemon osd.7 on smithi146 2024-04-23T10:22:12.159 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:12 smithi146 ceph-mon[32800]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:12.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:12 smithi167 ceph-mon[32940]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:12.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:12 smithi069 ceph-mon[29593]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:14.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:14 smithi167 ceph-mon[32940]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:14.348 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:14 smithi146 ceph-mon[32800]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:14.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:14 smithi069 ceph-mon[29593]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:15.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:15.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:15.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:15.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:15 smithi146 ceph-mon[32800]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:16.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:16.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:16.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:16.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:15 smithi167 ceph-mon[32940]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:16.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:16.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:16.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:16.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:15 smithi069 ceph-mon[29593]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:18.224 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:18 smithi146 ceph-mon[32800]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:18.297 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 7 on host 'smithi146' 2024-04-23T10:22:18.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.298+0000 7fea73fff700 1 -- 172.21.15.146:0/2130091329 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fea8c062e80 con 0x7fea740a3c40 2024-04-23T10:22:18.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 -- 172.21.15.146:0/2130091329 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea740a3c40 msgr2=0x7fea740a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea740a3c40 0x7fea740a6100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea7c009990 tx=0x7fea7c005ab0 comp rx=0 tx=0).stop 2024-04-23T10:22:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 -- 172.21.15.146:0/2130091329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea8c104640 msgr2=0x7fea8c075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea8c104640 0x7fea8c075370 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fea84007ee0 tx=0x7fea8400d3b0 comp rx=0 tx=0).stop 2024-04-23T10:22:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 -- 172.21.15.146:0/2130091329 shutdown_connections 2024-04-23T10:22:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea740a3c40 0x7fea740a6100 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea8c104640 0x7fea8c075370 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea8c102aa0 0x7fea8c0767e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 --2- 172.21.15.146:0/2130091329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea8c103ca0 0x7fea8c074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 -- 172.21.15.146:0/2130091329 >> 172.21.15.146:0/2130091329 conn(0x7fea8c0fe040 msgr2=0x7fea8c1070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 -- 172.21.15.146:0/2130091329 shutdown_connections 2024-04-23T10:22:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:22:18.300+0000 7fea917ad700 1 -- 172.21.15.146:0/2130091329 wait complete. 2024-04-23T10:22:18.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:18 smithi167 ceph-mon[32940]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:18.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:18 smithi069 ceph-mon[29593]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:18.962 DEBUG:teuthology.orchestra.run.smithi146:osd.7> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.7.service 2024-04-23T10:22:18.964 INFO:tasks.cephadm:Deploying osd.8 on smithi167 with /dev/vg_nvme/lv_2... 2024-04-23T10:22:18.964 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-23T10:22:19.213 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:22:19.523 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:19.523 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:19.523 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:19 smithi146 ceph-mon[32800]: from='osd.7 [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T10:22:19.523 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:19 smithi146 ceph-mon[32800]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T10:22:19.523 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:19 smithi146 ceph-mon[32800]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:19.523 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:19.523 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:19 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:19.578 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:19.578 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:19.578 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:19 smithi167 ceph-mon[32940]: from='osd.7 [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T10:22:19.578 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:19 smithi167 ceph-mon[32940]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T10:22:19.578 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:19 smithi167 ceph-mon[32940]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:19.578 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:19.578 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:19 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:19.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:19.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:19.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:19 smithi069 ceph-mon[29593]: from='osd.7 [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T10:22:19.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:19 smithi069 ceph-mon[29593]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-23T10:22:19.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:19 smithi069 ceph-mon[29593]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:19.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:19.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:19 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:20.534 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:20 smithi167 ceph-mon[32940]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-23T10:22:20.534 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:20 smithi167 ceph-mon[32940]: osdmap e50: 8 total, 7 up, 8 in 2024-04-23T10:22:20.534 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:20 smithi167 ceph-mon[32940]: from='osd.7 [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:22:20.534 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:20 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:20.534 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:20 smithi167 ceph-mon[32940]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:22:20.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:20 smithi146 ceph-mon[32800]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-23T10:22:20.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:20 smithi146 ceph-mon[32800]: osdmap e50: 8 total, 7 up, 8 in 2024-04-23T10:22:20.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:20 smithi146 ceph-mon[32800]: from='osd.7 [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:22:20.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:20 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:20.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:20 smithi146 ceph-mon[32800]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:22:20.678 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:22:20 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:22:20.274+0000 7f4ee3479700 -1 osd.7 0 waiting for initial osdmap 2024-04-23T10:22:20.679 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:22:20 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:22:20.286+0000 7f4edf26c700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:22:20.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:20 smithi069 ceph-mon[29593]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-23T10:22:20.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:20 smithi069 ceph-mon[29593]: osdmap e50: 8 total, 7 up, 8 in 2024-04-23T10:22:20.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:20 smithi069 ceph-mon[29593]: from='osd.7 [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:22:20.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:20 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:20.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:20 smithi069 ceph-mon[29593]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:22:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-23T10:22:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-23T10:22:21.121 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2024-04-23T10:22:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2024-04-23T10:22:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0118358 s, 886 MB/s 2024-04-23T10:22:21.121 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 2024-04-23T10:22:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2024-04-23T10:22:21.427 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:21 smithi167 ceph-mon[32940]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:22:21.427 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:21 smithi167 ceph-mon[32940]: osdmap e51: 8 total, 7 up, 8 in 2024-04-23T10:22:21.427 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:21 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:21.427 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:21 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:21.427 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:21 smithi167 ceph-mon[32940]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:21.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:21 smithi146 ceph-mon[32800]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:22:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:21 smithi146 ceph-mon[32800]: osdmap e51: 8 total, 7 up, 8 in 2024-04-23T10:22:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:21 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:21 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:21 smithi146 ceph-mon[32800]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:21.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:21 smithi069 ceph-mon[29593]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:22:21.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:21 smithi069 ceph-mon[29593]: osdmap e51: 8 total, 7 up, 8 in 2024-04-23T10:22:21.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:21 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:21.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:21 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:21.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:21 smithi069 ceph-mon[29593]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-23T10:22:21.802 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_2 2024-04-23T10:22:22.049 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:22:22.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:22 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:22:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:22 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:22:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:22 smithi146 ceph-mon[32800]: osd.7 [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604] boot 2024-04-23T10:22:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:22 smithi146 ceph-mon[32800]: osdmap e52: 8 total, 8 up, 8 in 2024-04-23T10:22:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:22 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:22.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:22 smithi146 ceph-mon[32800]: osdmap e53: 8 total, 8 up, 8 in 2024-04-23T10:22:22.468 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:22 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:22:22.468 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:22 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:22:22.468 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:22 smithi167 ceph-mon[32940]: osd.7 [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604] boot 2024-04-23T10:22:22.468 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:22 smithi167 ceph-mon[32940]: osdmap e52: 8 total, 8 up, 8 in 2024-04-23T10:22:22.468 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:22 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:22.468 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:22 smithi167 ceph-mon[32940]: osdmap e53: 8 total, 8 up, 8 in 2024-04-23T10:22:22.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:22 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:22:22.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:22 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:22:22.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:22 smithi069 ceph-mon[29593]: osd.7 [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604] boot 2024-04-23T10:22:22.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:22 smithi069 ceph-mon[29593]: osdmap e52: 8 total, 8 up, 8 in 2024-04-23T10:22:22.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:22 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:22:22.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:22 smithi069 ceph-mon[29593]: osdmap e53: 8 total, 8 up, 8 in 2024-04-23T10:22:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.672+0000 7f426fe5b700 1 -- 172.21.15.167:0/285020654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268102aa0 msgr2=0x7f4268102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.672+0000 7f426fe5b700 1 --2- 172.21.15.167:0/285020654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268102aa0 0x7f4268102ec0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4264009990 tx=0x7f4264009ca0 comp rx=0 tx=0).stop 2024-04-23T10:22:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.673+0000 7f426fe5b700 1 -- 172.21.15.167:0/285020654 shutdown_connections 2024-04-23T10:22:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.673+0000 7f426fe5b700 1 --2- 172.21.15.167:0/285020654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4268104640 0x7f426810aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:23.673 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.673+0000 7f426fe5b700 1 --2- 172.21.15.167:0/285020654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268102aa0 0x7f4268102ec0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.673+0000 7f426fe5b700 1 --2- 172.21.15.167:0/285020654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4268103ca0 0x7f4268104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.673+0000 7f426fe5b700 1 -- 172.21.15.167:0/285020654 >> 172.21.15.167:0/285020654 conn(0x7f42680fe040 msgr2=0x7f4268100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.673+0000 7f426fe5b700 1 -- 172.21.15.167:0/285020654 shutdown_connections 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.673+0000 7f426fe5b700 1 -- 172.21.15.167:0/285020654 wait complete. 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.673+0000 7f426fe5b700 1 Processor -- start 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.673+0000 7f426fe5b700 1 -- start start 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426fe5b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268102aa0 0x7f42680767e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426fe5b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4268103ca0 0x7f4268074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426fe5b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4268104640 0x7f4268075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426fe5b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f426810e670 con 0x7f4268103ca0 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426fe5b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f426810e4f0 con 0x7f4268104640 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426fe5b700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f426810e7f0 con 0x7f4268102aa0 2024-04-23T10:22:23.674 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426dbf7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268102aa0 0x7f42680767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426dbf7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268102aa0 0x7f42680767e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35788/0 (socket says 172.21.15.167:35788) 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426dbf7700 1 -- 172.21.15.167:0/1660334624 learned_addr learned my addr 172.21.15.167:0/1660334624 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426d3f6700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4268103ca0 0x7f4268074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426e3f8700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4268104640 0x7f4268075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426dbf7700 1 -- 172.21.15.167:0/1660334624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4268104640 msgr2=0x7f4268075370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426dbf7700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4268104640 0x7f4268075370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426dbf7700 1 -- 172.21.15.167:0/1660334624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4268103ca0 msgr2=0x7f4268074e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426dbf7700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4268103ca0 0x7f4268074e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426dbf7700 1 -- 172.21.15.167:0/1660334624 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4268075c20 con 0x7f4268102aa0 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426e3f8700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4268104640 0x7f4268075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426dbf7700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268102aa0 0x7f42680767e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f42640039a0 tx=0x7f42640047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f425effd700 1 -- 172.21.15.167:0/1660334624 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264003c50 con 0x7f4268102aa0 2024-04-23T10:22:23.675 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f425effd700 1 -- 172.21.15.167:0/1660334624 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4264004830 con 0x7f4268102aa0 2024-04-23T10:22:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426fe5b700 1 -- 172.21.15.167:0/1660334624 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42681a2e00 con 0x7f4268102aa0 2024-04-23T10:22:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f425effd700 1 -- 172.21.15.167:0/1660334624 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264005450 con 0x7f4268102aa0 2024-04-23T10:22:23.676 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.674+0000 7f426fe5b700 1 -- 172.21.15.167:0/1660334624 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42681a31a0 con 0x7f4268102aa0 2024-04-23T10:22:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.675+0000 7f426fe5b700 1 -- 172.21.15.167:0/1660334624 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426802df80 con 0x7f4268102aa0 2024-04-23T10:22:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.676+0000 7f425effd700 1 -- 172.21.15.167:0/1660334624 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f42640049e0 con 0x7f4268102aa0 2024-04-23T10:22:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.677+0000 7f425effd700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42540a3cc0 0x7f42540a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.677+0000 7f425effd700 1 -- 172.21.15.167:0/1660334624 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5426+0+0 (secure 0 0 0) 0x7f42640d0cd0 con 0x7f4268102aa0 2024-04-23T10:22:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.677+0000 7f426d3f6700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42540a3cc0 0x7f42540a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:23.677 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.678+0000 7f426d3f6700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42540a3cc0 0x7f42540a6180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4258005950 tx=0x7f425800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:23.680 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.681+0000 7f425effd700 1 -- 172.21.15.167:0/1660334624 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4264013070 con 0x7f4268102aa0 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi146 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi146 to 5696M 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:23.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:23.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:23 smithi167 ceph-mon[32940]: osdmap e54: 8 total, 8 up, 8 in 2024-04-23T10:22:23.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:23.889+0000 7f426fe5b700 1 -- 172.21.15.167:0/1660334624 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4268062e80 con 0x7f42540a3cc0 2024-04-23T10:22:23.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi146 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi146 to 5696M 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:23.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:23 smithi146 ceph-mon[32800]: osdmap e54: 8 total, 8 up, 8 in 2024-04-23T10:22:23.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi146 2024-04-23T10:22:23.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi146 to 5696M 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:23.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:23 smithi069 ceph-mon[29593]: osdmap e54: 8 total, 8 up, 8 in 2024-04-23T10:22:25.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:24 smithi167 ceph-mon[32940]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:22:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:24 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:22:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:24 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:22:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:24 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:24 smithi167 ceph-mon[32940]: osdmap e55: 8 total, 8 up, 8 in 2024-04-23T10:22:25.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:24 smithi146 ceph-mon[32800]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:22:25.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:24 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:22:25.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:24 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:22:25.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:24 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:25.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:24 smithi146 ceph-mon[32800]: osdmap e55: 8 total, 8 up, 8 in 2024-04-23T10:22:25.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:24 smithi069 ceph-mon[29593]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:22:25.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:24 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:22:25.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:24 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:22:25.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:24 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:25.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:24 smithi069 ceph-mon[29593]: osdmap e55: 8 total, 8 up, 8 in 2024-04-23T10:22:26.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:25 smithi167 ceph-mon[32940]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:25 smithi167 ceph-mon[32940]: osdmap e56: 8 total, 8 up, 8 in 2024-04-23T10:22:26.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:25 smithi146 ceph-mon[32800]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:26.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:25 smithi146 ceph-mon[32800]: osdmap e56: 8 total, 8 up, 8 in 2024-04-23T10:22:26.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:25 smithi069 ceph-mon[29593]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:26.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:25 smithi069 ceph-mon[29593]: osdmap e56: 8 total, 8 up, 8 in 2024-04-23T10:22:27.058 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:26 smithi167 ceph-mon[32940]: from='client.? 172.21.15.167:0/3539844543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "517269ab-67bb-46bf-9033-10bc65126107"}]: dispatch 2024-04-23T10:22:27.058 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:26 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "517269ab-67bb-46bf-9033-10bc65126107"}]: dispatch 2024-04-23T10:22:27.058 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:26 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "517269ab-67bb-46bf-9033-10bc65126107"}]': finished 2024-04-23T10:22:27.059 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:26 smithi167 ceph-mon[32940]: osdmap e57: 9 total, 8 up, 9 in 2024-04-23T10:22:27.059 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:26 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:27.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:26 smithi146 ceph-mon[32800]: from='client.? 172.21.15.167:0/3539844543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "517269ab-67bb-46bf-9033-10bc65126107"}]: dispatch 2024-04-23T10:22:27.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:26 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "517269ab-67bb-46bf-9033-10bc65126107"}]: dispatch 2024-04-23T10:22:27.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:26 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "517269ab-67bb-46bf-9033-10bc65126107"}]': finished 2024-04-23T10:22:27.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:26 smithi146 ceph-mon[32800]: osdmap e57: 9 total, 8 up, 9 in 2024-04-23T10:22:27.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:26 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:27.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:26 smithi069 ceph-mon[29593]: from='client.? 172.21.15.167:0/3539844543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "517269ab-67bb-46bf-9033-10bc65126107"}]: dispatch 2024-04-23T10:22:27.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:26 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "517269ab-67bb-46bf-9033-10bc65126107"}]: dispatch 2024-04-23T10:22:27.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:26 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "517269ab-67bb-46bf-9033-10bc65126107"}]': finished 2024-04-23T10:22:27.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:26 smithi069 ceph-mon[29593]: osdmap e57: 9 total, 8 up, 9 in 2024-04-23T10:22:27.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:26 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:28.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:27 smithi167 ceph-mon[32940]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:27 smithi167 ceph-mon[32940]: from='client.? 172.21.15.167:0/2187631703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:22:28.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:27 smithi146 ceph-mon[32800]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:28.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:27 smithi146 ceph-mon[32800]: from='client.? 172.21.15.167:0/2187631703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:22:28.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:27 smithi069 ceph-mon[29593]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:28.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:27 smithi069 ceph-mon[29593]: from='client.? 172.21.15.167:0/2187631703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:22:30.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:30 smithi146 ceph-mon[32800]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:30.315 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:30 smithi069 ceph-mon[29593]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:30.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:30 smithi167 ceph-mon[32940]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:32 smithi167 ceph-mon[32940]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:32.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:32 smithi146 ceph-mon[32800]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:32.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:32 smithi069 ceph-mon[29593]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:34 smithi167 ceph-mon[32940]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:34 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-23T10:22:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:34 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:34.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:34 smithi146 ceph-mon[32800]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:34.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:34 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-23T10:22:34.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:34 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:34.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:34 smithi069 ceph-mon[29593]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:34.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-23T10:22:34.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:34 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:35.221 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:35 smithi167 ceph-mon[32940]: Deploying daemon osd.8 on smithi167 2024-04-23T10:22:35.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:35 smithi146 ceph-mon[32800]: Deploying daemon osd.8 on smithi167 2024-04-23T10:22:35.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:35 smithi069 ceph-mon[29593]: Deploying daemon osd.8 on smithi167 2024-04-23T10:22:36.187 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:36 smithi167 ceph-mon[32940]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:36.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:36 smithi146 ceph-mon[32800]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:36.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:36 smithi069 ceph-mon[29593]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:38.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:38 smithi167 ceph-mon[32940]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:38.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:38 smithi146 ceph-mon[32800]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:38.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:38 smithi069 ceph-mon[29593]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:40.239 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:40 smithi167 ceph-mon[32940]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:40.239 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:40.240 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:40.240 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:40.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:40 smithi146 ceph-mon[32800]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:40.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:40.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:40.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:40.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:40 smithi069 ceph-mon[29593]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:40.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:40.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:40.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:42.323 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:42 smithi167 ceph-mon[32940]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:42.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:42 smithi146 ceph-mon[32800]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:42.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:42 smithi069 ceph-mon[29593]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:43.605 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.605+0000 7f425effd700 1 -- 172.21.15.167:0/1660334624 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4268062e80 con 0x7f42540a3cc0 2024-04-23T10:22:43.606 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 8 on host 'smithi167' 2024-04-23T10:22:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 -- 172.21.15.167:0/1660334624 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42540a3cc0 msgr2=0x7f42540a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42540a3cc0 0x7f42540a6180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4258005950 tx=0x7f425800b410 comp rx=0 tx=0).stop 2024-04-23T10:22:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 -- 172.21.15.167:0/1660334624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268102aa0 msgr2=0x7f42680767e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268102aa0 0x7f42680767e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f42640039a0 tx=0x7f42640047b0 comp rx=0 tx=0).stop 2024-04-23T10:22:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 -- 172.21.15.167:0/1660334624 shutdown_connections 2024-04-23T10:22:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42540a3cc0 0x7f42540a6180 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4268104640 0x7f4268075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268102aa0 0x7f42680767e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 --2- 172.21.15.167:0/1660334624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4268103ca0 0x7f4268074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 -- 172.21.15.167:0/1660334624 >> 172.21.15.167:0/1660334624 conn(0x7f42680fe040 msgr2=0x7f4268107040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 -- 172.21.15.167:0/1660334624 shutdown_connections 2024-04-23T10:22:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:22:43.608+0000 7f426fe5b700 1 -- 172.21.15.167:0/1660334624 wait complete. 2024-04-23T10:22:43.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:43.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:43.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:43.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:43.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:43.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:43 smithi167 ceph-mon[32940]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:43.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:43 smithi167 ceph-mon[32940]: from='osd.8 [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T10:22:43.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:43 smithi167 ceph-mon[32940]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T10:22:43.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:43.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:43.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:43.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:43.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:43.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:43.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:43.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:43.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:43 smithi069 ceph-mon[29593]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:43.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:43 smithi069 ceph-mon[29593]: from='osd.8 [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T10:22:43.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:43 smithi069 ceph-mon[29593]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T10:22:43.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:43.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:43.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:44.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:44.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:44.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:44.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:44.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:44.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:43 smithi146 ceph-mon[32800]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:44.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:43 smithi146 ceph-mon[32800]: from='osd.8 [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T10:22:44.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:43 smithi146 ceph-mon[32800]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-23T10:22:44.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:44.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:44.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:22:44.252 DEBUG:teuthology.orchestra.run.smithi167:osd.8> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.8.service 2024-04-23T10:22:44.255 INFO:tasks.cephadm:Deploying osd.9 on smithi069 with /dev/vg_nvme/lv_1... 2024-04-23T10:22:44.256 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-23T10:22:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:22:44.871 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:44 smithi069 ceph-mon[29593]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-23T10:22:44.871 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:44 smithi069 ceph-mon[29593]: from='osd.8 [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:22:44.871 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:44 smithi069 ceph-mon[29593]: osdmap e58: 9 total, 8 up, 9 in 2024-04-23T10:22:44.871 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:44 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:44.871 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:44 smithi069 ceph-mon[29593]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:22:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:44 smithi167 ceph-mon[32940]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-23T10:22:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:44 smithi167 ceph-mon[32940]: from='osd.8 [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:22:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:44 smithi167 ceph-mon[32940]: osdmap e58: 9 total, 8 up, 9 in 2024-04-23T10:22:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:44 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:44 smithi167 ceph-mon[32940]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:22:45.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:44 smithi146 ceph-mon[32800]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-23T10:22:45.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:44 smithi146 ceph-mon[32800]: from='osd.8 [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:22:45.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:44 smithi146 ceph-mon[32800]: osdmap e58: 9 total, 8 up, 9 in 2024-04-23T10:22:45.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:44 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:45.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:44 smithi146 ceph-mon[32800]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:22:45.425 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:22:45 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:22:45.164+0000 7f9a30d36700 -1 osd.8 0 waiting for initial osdmap 2024-04-23T10:22:45.426 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:22:45 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:22:45.175+0000 7f9a28b21700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:22:45.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:45 smithi069 ceph-mon[29593]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:22:45.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:45 smithi069 ceph-mon[29593]: osdmap e59: 9 total, 8 up, 9 in 2024-04-23T10:22:45.959 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:45 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:45.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:45 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:45.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:45 smithi069 ceph-mon[29593]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:45.960 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:45 smithi069 ceph-mon[29593]: from='osd.8 ' entity='osd.8' 2024-04-23T10:22:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:45 smithi167 ceph-mon[32940]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:22:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:45 smithi167 ceph-mon[32940]: osdmap e59: 9 total, 8 up, 9 in 2024-04-23T10:22:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:45 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:45 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:45 smithi167 ceph-mon[32940]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:45 smithi167 ceph-mon[32940]: from='osd.8 ' entity='osd.8' 2024-04-23T10:22:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:45 smithi146 ceph-mon[32800]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:22:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:45 smithi146 ceph-mon[32800]: osdmap e59: 9 total, 8 up, 9 in 2024-04-23T10:22:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:45 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:45 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:45 smithi146 ceph-mon[32800]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-04-23T10:22:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:45 smithi146 ceph-mon[32800]: from='osd.8 ' entity='osd.8' 2024-04-23T10:22:46.554 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-23T10:22:46.554 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-23T10:22:46.554 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2024-04-23T10:22:46.554 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2024-04-23T10:22:46.555 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113764 s, 922 MB/s 2024-04-23T10:22:46.555 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2024-04-23T10:22:46.879 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:46 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:22:46.879 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:46 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:22:46.879 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:46.879 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:46 smithi069 ceph-mon[29593]: osd.8 [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667] boot 2024-04-23T10:22:46.880 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:46 smithi069 ceph-mon[29593]: osdmap e60: 9 total, 9 up, 9 in 2024-04-23T10:22:46.880 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:46.880 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:46 smithi069 ceph-mon[29593]: osdmap e61: 9 total, 9 up, 9 in 2024-04-23T10:22:47.059 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:46 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:22:47.059 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:46 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:22:47.059 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:47.059 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:46 smithi167 ceph-mon[32940]: osd.8 [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667] boot 2024-04-23T10:22:47.059 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:46 smithi167 ceph-mon[32940]: osdmap e60: 9 total, 9 up, 9 in 2024-04-23T10:22:47.059 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:47.060 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:46 smithi167 ceph-mon[32940]: osdmap e61: 9 total, 9 up, 9 in 2024-04-23T10:22:47.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:46 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:22:47.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:46 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:22:47.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:46 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:47.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:46 smithi146 ceph-mon[32800]: osd.8 [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667] boot 2024-04-23T10:22:47.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:46 smithi146 ceph-mon[32800]: osdmap e60: 9 total, 9 up, 9 in 2024-04-23T10:22:47.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:46 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:22:47.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:46 smithi146 ceph-mon[32800]: osdmap e61: 9 total, 9 up, 9 in 2024-04-23T10:22:47.351 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi069:vg_nvme/lv_1 2024-04-23T10:22:47.596 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:22:47.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:47 smithi069 ceph-mon[29593]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:22:47.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:47 smithi069 ceph-mon[29593]: osdmap e62: 9 total, 9 up, 9 in 2024-04-23T10:22:47.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:47.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:47.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:47.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:47.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:47.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:47.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:47.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:47.985 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:48.079 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:47 smithi146 ceph-mon[32800]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:22:48.079 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:47 smithi146 ceph-mon[32800]: osdmap e62: 9 total, 9 up, 9 in 2024-04-23T10:22:48.079 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:47 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:48.079 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:47 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:48.079 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:47 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:48.079 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:47 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:48.079 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:47 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:48.080 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:47 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:48.080 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:47 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:48.080 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:47 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:48.080 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:47 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:48.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:47 smithi167 ceph-mon[32940]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:22:48.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:47 smithi167 ceph-mon[32940]: osdmap e62: 9 total, 9 up, 9 in 2024-04-23T10:22:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:22:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:22:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:22:49.031 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:48 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi167 2024-04-23T10:22:49.031 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:48 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi167 to 5696M 2024-04-23T10:22:49.031 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:48 smithi069 ceph-mon[29593]: osdmap e63: 9 total, 9 up, 9 in 2024-04-23T10:22:49.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:48 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi167 2024-04-23T10:22:49.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:48 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi167 to 5696M 2024-04-23T10:22:49.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:48 smithi167 ceph-mon[32940]: osdmap e63: 9 total, 9 up, 9 in 2024-04-23T10:22:49.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:48 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi167 2024-04-23T10:22:49.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:48 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi167 to 5696M 2024-04-23T10:22:49.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:48 smithi146 ceph-mon[32800]: osdmap e63: 9 total, 9 up, 9 in 2024-04-23T10:22:49.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.387+0000 7f7270549700 1 -- 172.21.15.69:0/769039316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7268103ca0 msgr2=0x7f7268104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:49.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.387+0000 7f7270549700 1 --2- 172.21.15.69:0/769039316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7268103ca0 0x7f7268104100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f72640099c0 tx=0x7f7264009cd0 comp rx=0 tx=0).stop 2024-04-23T10:22:49.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.387+0000 7f7270549700 1 -- 172.21.15.69:0/769039316 shutdown_connections 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.387+0000 7f7270549700 1 --2- 172.21.15.69:0/769039316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7268104640 0x7f726810aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.387+0000 7f7270549700 1 --2- 172.21.15.69:0/769039316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7268102aa0 0x7f7268102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.387+0000 7f7270549700 1 --2- 172.21.15.69:0/769039316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7268103ca0 0x7f7268104100 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.387+0000 7f7270549700 1 -- 172.21.15.69:0/769039316 >> 172.21.15.69:0/769039316 conn(0x7f72680fe040 msgr2=0x7f7268100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f7270549700 1 -- 172.21.15.69:0/769039316 shutdown_connections 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f7270549700 1 -- 172.21.15.69:0/769039316 wait complete. 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f7270549700 1 Processor -- start 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f7270549700 1 -- start start 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f7270549700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7268102aa0 0x7f72680767e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f7270549700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7268103ca0 0x7f7268074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f7270549700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7268104640 0x7f7268075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f7270549700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f726810e6d0 con 0x7f7268104640 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f7270549700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f726810e550 con 0x7f7268103ca0 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f7270549700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f726810e850 con 0x7f7268102aa0 2024-04-23T10:22:49.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f726eae6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7268104640 0x7f7268075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f726eae6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7268104640 0x7f7268075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50138/0 (socket says 172.21.15.69:50138) 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.388+0000 7f726eae6700 1 -- 172.21.15.69:0/791994892 learned_addr learned my addr 172.21.15.69:0/791994892 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f726e2e5700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7268102aa0 0x7f72680767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f726dae4700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7268103ca0 0x7f7268074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f726eae6700 1 -- 172.21.15.69:0/791994892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7268102aa0 msgr2=0x7f72680767e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f726eae6700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7268102aa0 0x7f72680767e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f726eae6700 1 -- 172.21.15.69:0/791994892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7268103ca0 msgr2=0x7f7268074e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f726eae6700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7268103ca0 0x7f7268074e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f726eae6700 1 -- 172.21.15.69:0/791994892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7268075c20 con 0x7f7268104640 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f726eae6700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7268104640 0x7f7268075370 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f726000b970 tx=0x7f726000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f725f7fe700 1 -- 172.21.15.69:0/791994892 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726000d860 con 0x7f7268104640 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f7270549700 1 -- 172.21.15.69:0/791994892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72681a2ea0 con 0x7f7268104640 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f725f7fe700 1 -- 172.21.15.69:0/791994892 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f726000e430 con 0x7f7268104640 2024-04-23T10:22:49.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f725f7fe700 1 -- 172.21.15.69:0/791994892 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260017660 con 0x7f7268104640 2024-04-23T10:22:49.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.389+0000 7f7270549700 1 -- 172.21.15.69:0/791994892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72681a3300 con 0x7f7268104640 2024-04-23T10:22:49.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.390+0000 7f7270549700 1 -- 172.21.15.69:0/791994892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7268069730 con 0x7f7268104640 2024-04-23T10:22:49.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.391+0000 7f725f7fe700 1 -- 172.21.15.69:0/791994892 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f726000e5e0 con 0x7f7268104640 2024-04-23T10:22:49.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.392+0000 7f725f7fe700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f72540a3c40 0x7f72540a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:22:49.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.392+0000 7f726e2e5700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f72540a3c40 0x7f72540a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:22:49.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.392+0000 7f725f7fe700 1 -- 172.21.15.69:0/791994892 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5829+0+0 (secure 0 0 0) 0x7f72600cf9a0 con 0x7f7268104640 2024-04-23T10:22:49.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.392+0000 7f726e2e5700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f72540a3c40 0x7f72540a6100 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7268103b00 tx=0x7f725800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:22:49.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.396+0000 7f725f7fe700 1 -- 172.21.15.69:0/791994892 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7260013030 con 0x7f7268104640 2024-04-23T10:22:49.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:22:49.605+0000 7f7270549700 1 -- 172.21.15.69:0/791994892 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7268062e80 con 0x7f72540a3c40 2024-04-23T10:22:49.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:49 smithi069 ceph-mon[29593]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:22:49.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:49 smithi069 ceph-mon[29593]: osdmap e64: 9 total, 9 up, 9 in 2024-04-23T10:22:49.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:22:49.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:22:49.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:49 smithi167 ceph-mon[32940]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:22:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:49 smithi167 ceph-mon[32940]: osdmap e64: 9 total, 9 up, 9 in 2024-04-23T10:22:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:22:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:22:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:50.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:49 smithi146 ceph-mon[32800]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:22:50.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:49 smithi146 ceph-mon[32800]: osdmap e64: 9 total, 9 up, 9 in 2024-04-23T10:22:50.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:22:50.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:22:50.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:22:50.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:50 smithi069 ceph-mon[29593]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:22:51.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:50 smithi167 ceph-mon[32940]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:22:51.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:50 smithi146 ceph-mon[32800]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:22:52.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:51 smithi167 ceph-mon[32940]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:22:52.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:51 smithi146 ceph-mon[32800]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:22:52.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:51 smithi069 ceph-mon[29593]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:22:53.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:52 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1519617801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e141cd07-18ba-42c3-b3c8-86b81eee032b"}]: dispatch 2024-04-23T10:22:53.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:52 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1519617801' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e141cd07-18ba-42c3-b3c8-86b81eee032b"}]': finished 2024-04-23T10:22:53.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:52 smithi167 ceph-mon[32940]: osdmap e65: 10 total, 9 up, 10 in 2024-04-23T10:22:53.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:52 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:22:53.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:52 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1519617801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e141cd07-18ba-42c3-b3c8-86b81eee032b"}]: dispatch 2024-04-23T10:22:53.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:52 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1519617801' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e141cd07-18ba-42c3-b3c8-86b81eee032b"}]': finished 2024-04-23T10:22:53.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:52 smithi146 ceph-mon[32800]: osdmap e65: 10 total, 9 up, 10 in 2024-04-23T10:22:53.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:52 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:22:53.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:52 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1519617801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e141cd07-18ba-42c3-b3c8-86b81eee032b"}]: dispatch 2024-04-23T10:22:53.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:52 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1519617801' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e141cd07-18ba-42c3-b3c8-86b81eee032b"}]': finished 2024-04-23T10:22:53.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:52 smithi069 ceph-mon[29593]: osdmap e65: 10 total, 9 up, 10 in 2024-04-23T10:22:53.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:52 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:22:54.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:53 smithi167 ceph-mon[32940]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-04-23T10:22:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:53 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/4015676098' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:22:54.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:53 smithi146 ceph-mon[32800]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-04-23T10:22:54.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:53 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/4015676098' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:22:54.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:53 smithi069 ceph-mon[29593]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-04-23T10:22:54.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:53 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/4015676098' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:22:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:56 smithi167 ceph-mon[32940]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-23T10:22:56.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:56 smithi069 ceph-mon[29593]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-23T10:22:56.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:56 smithi146 ceph-mon[32800]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-23T10:22:58.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:22:58 smithi167 ceph-mon[32940]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-23T10:22:58.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:22:58 smithi146 ceph-mon[32800]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-23T10:22:58.457 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:22:58 smithi069 ceph-mon[29593]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-23T10:23:00.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:00 smithi069 ceph-mon[29593]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-23T10:23:00.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-23T10:23:00.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:00.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:00 smithi167 ceph-mon[32940]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-23T10:23:00.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:00 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-23T10:23:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:00 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:00.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:00 smithi146 ceph-mon[32800]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-23T10:23:00.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:00 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-23T10:23:00.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:00 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:01.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:01 smithi069 ceph-mon[29593]: Deploying daemon osd.9 on smithi069 2024-04-23T10:23:01.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:01 smithi167 ceph-mon[32940]: Deploying daemon osd.9 on smithi069 2024-04-23T10:23:01.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:01 smithi146 ceph-mon[32800]: Deploying daemon osd.9 on smithi069 2024-04-23T10:23:02.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:02 smithi069 ceph-mon[29593]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T10:23:02.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:02 smithi167 ceph-mon[32940]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T10:23:02.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:02 smithi146 ceph-mon[32800]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-23T10:23:04.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:04 smithi069 ceph-mon[29593]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:04.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:04 smithi167 ceph-mon[32940]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:04.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:04 smithi146 ceph-mon[32800]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:06.108 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:06 smithi069 ceph-mon[29593]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:06.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:06 smithi167 ceph-mon[32940]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:06.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:06 smithi146 ceph-mon[32800]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:07.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:07 smithi146 ceph-mon[32800]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:07.438 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:07.438 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:07.438 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:07.438 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:07 smithi069 ceph-mon[29593]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:07.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:07.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:07.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:07.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:07 smithi167 ceph-mon[32940]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:10.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:10 smithi069 ceph-mon[29593]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:10.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:10.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:10.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:10.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:10.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:10 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:10.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:10 smithi069 ceph-mon[29593]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-23T10:23:10.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:10 smithi167 ceph-mon[32940]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:10.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:10 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:10.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:10 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:10.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:10 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:10.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:10 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:10.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:10 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:10.287 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:10 smithi167 ceph-mon[32940]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-23T10:23:10.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.317+0000 7f725f7fe700 1 -- 172.21.15.69:0/791994892 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7268062e80 con 0x7f72540a3c40 2024-04-23T10:23:10.317 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 9 on host 'smithi069' 2024-04-23T10:23:10.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 -- 172.21.15.69:0/791994892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f72540a3c40 msgr2=0x7f72540a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:10.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f72540a3c40 0x7f72540a6100 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7268103b00 tx=0x7f725800a380 comp rx=0 tx=0).stop 2024-04-23T10:23:10.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 -- 172.21.15.69:0/791994892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7268104640 msgr2=0x7f7268075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:10.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7268104640 0x7f7268075370 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f726000b970 tx=0x7f726000bc80 comp rx=0 tx=0).stop 2024-04-23T10:23:10.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 -- 172.21.15.69:0/791994892 shutdown_connections 2024-04-23T10:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f72540a3c40 0x7f72540a6100 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7268104640 0x7f7268075370 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7268102aa0 0x7f72680767e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 --2- 172.21.15.69:0/791994892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7268103ca0 0x7f7268074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 -- 172.21.15.69:0/791994892 >> 172.21.15.69:0/791994892 conn(0x7f72680fe040 msgr2=0x7f7268106ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 -- 172.21.15.69:0/791994892 shutdown_connections 2024-04-23T10:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:23:10.320+0000 7f7270549700 1 -- 172.21.15.69:0/791994892 wait complete. 2024-04-23T10:23:10.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:10 smithi146 ceph-mon[32800]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:10.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:10 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:10.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:10 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:10.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:10 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:10.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:10 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:10.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:10 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:10.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:10 smithi146 ceph-mon[32800]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-23T10:23:11.087 DEBUG:teuthology.orchestra.run.smithi069:osd.9> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.9.service 2024-04-23T10:23:11.090 INFO:tasks.cephadm:Deploying osd.10 on smithi146 with /dev/vg_nvme/lv_1... 2024-04-23T10:23:11.090 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-23T10:23:11.320 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:11.320 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:11.320 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:11.320 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:11 smithi069 ceph-mon[29593]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-23T10:23:11.320 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:11 smithi069 ceph-mon[29593]: osdmap e66: 10 total, 9 up, 10 in 2024-04-23T10:23:11.320 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:11 smithi069 ceph-mon[29593]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:23:11.320 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:11 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:11.321 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:11 smithi069 ceph-mon[29593]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:23:11.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:11.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:11 smithi146 ceph-mon[32800]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-23T10:23:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:11 smithi146 ceph-mon[32800]: osdmap e66: 10 total, 9 up, 10 in 2024-04-23T10:23:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:11 smithi146 ceph-mon[32800]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:23:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:11 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:11 smithi146 ceph-mon[32800]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:11.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:11 smithi167 ceph-mon[32940]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-23T10:23:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:11 smithi167 ceph-mon[32940]: osdmap e66: 10 total, 9 up, 10 in 2024-04-23T10:23:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:11 smithi167 ceph-mon[32940]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-23T10:23:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:11 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:11 smithi167 ceph-mon[32940]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:12.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:23:11 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:23:11.855+0000 7f409eb0e700 -1 osd.9 0 waiting for initial osdmap 2024-04-23T10:23:12.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:23:11 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:23:11.866+0000 7f40968f9700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:23:12.671 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:12 smithi069 ceph-mon[29593]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:23:12.671 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:12 smithi069 ceph-mon[29593]: osdmap e67: 10 total, 9 up, 10 in 2024-04-23T10:23:12.671 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:12 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:12.671 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:12 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:12.671 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:12 smithi069 ceph-mon[29593]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' 2024-04-23T10:23:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:12 smithi146 ceph-mon[32800]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:23:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:12 smithi146 ceph-mon[32800]: osdmap e67: 10 total, 9 up, 10 in 2024-04-23T10:23:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:12 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:12 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:12 smithi146 ceph-mon[32800]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' 2024-04-23T10:23:12.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:12 smithi167 ceph-mon[32940]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-23T10:23:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:12 smithi167 ceph-mon[32940]: osdmap e67: 10 total, 9 up, 10 in 2024-04-23T10:23:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:12 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:12 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:12 smithi167 ceph-mon[32940]: from='osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509]' entity='osd.9' 2024-04-23T10:23:13.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:13 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:23:13.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:13 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:23:13.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:13 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:13.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:13 smithi146 ceph-mon[32800]: osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509] boot 2024-04-23T10:23:13.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:13 smithi146 ceph-mon[32800]: osdmap e68: 10 total, 10 up, 10 in 2024-04-23T10:23:13.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:13 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:13.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:13 smithi146 ceph-mon[32800]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:13.680 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-23T10:23:13.680 INFO:teuthology.orchestra.run.smithi146.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-23T10:23:13.680 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10+0 records in 2024-04-23T10:23:13.680 INFO:teuthology.orchestra.run.smithi146.stderr:10+0 records out 2024-04-23T10:23:13.680 INFO:teuthology.orchestra.run.smithi146.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113712 s, 922 MB/s 2024-04-23T10:23:13.680 INFO:teuthology.orchestra.run.smithi146.stderr:--> Zapping successful for: 2024-04-23T10:23:13.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:13 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:23:13.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:13 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:23:13.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:13 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:13.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:13 smithi069 ceph-mon[29593]: osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509] boot 2024-04-23T10:23:13.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:13 smithi069 ceph-mon[29593]: osdmap e68: 10 total, 10 up, 10 in 2024-04-23T10:23:13.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:13 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:13.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:13 smithi069 ceph-mon[29593]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:13.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:13 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:23:13.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:13 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:23:13.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:13 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:13.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:13 smithi167 ceph-mon[32940]: osd.9 [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509] boot 2024-04-23T10:23:13.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:13 smithi167 ceph-mon[32940]: osdmap e68: 10 total, 10 up, 10 in 2024-04-23T10:23:13.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:13 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:23:13.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:13 smithi167 ceph-mon[32940]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-23T10:23:14.364 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_1 2024-04-23T10:23:14.610 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:23:14.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:14 smithi146 ceph-mon[32800]: osdmap e69: 10 total, 10 up, 10 in 2024-04-23T10:23:14.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:14 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:14.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:14 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:14.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:14 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:14.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:14 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:14.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:14 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:14.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:14 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:14.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:14 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:14.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:14 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:14.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:14 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:14.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:14 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:15.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:14 smithi069 ceph-mon[29593]: osdmap e69: 10 total, 10 up, 10 in 2024-04-23T10:23:15.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:14 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:15.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:14 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:15.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:14 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:15.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:14 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:15.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:14 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:15.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:14 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:15.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:14 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:15.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:14 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:15.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:14 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:15.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:14 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:15.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:14 smithi167 ceph-mon[32940]: osdmap e69: 10 total, 10 up, 10 in 2024-04-23T10:23:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:14 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:14 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:14 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:14 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:14 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:14 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:14 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:14 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:14 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:14 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:16.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:15 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi069 2024-04-23T10:23:16.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:15 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi069 to 4272M 2024-04-23T10:23:16.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:15 smithi146 ceph-mon[32800]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:16.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:15 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi069 2024-04-23T10:23:16.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:15 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi069 to 4272M 2024-04-23T10:23:16.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:15 smithi069 ceph-mon[29593]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.286+0000 7f6961836700 1 -- 172.21.15.146:0/1091304749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c105e60 msgr2=0x7f695c108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.286+0000 7f6961836700 1 --2- 172.21.15.146:0/1091304749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c105e60 0x7f695c108250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6944009990 tx=0x7f6944009ca0 comp rx=0 tx=0).stop 2024-04-23T10:23:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.286+0000 7f6961836700 1 -- 172.21.15.146:0/1091304749 shutdown_connections 2024-04-23T10:23:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.286+0000 7f6961836700 1 --2- 172.21.15.146:0/1091304749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695c108790 0x7f695c10ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.286+0000 7f6961836700 1 --2- 172.21.15.146:0/1091304749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695c103530 0x7f695c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.286+0000 7f6961836700 1 --2- 172.21.15.146:0/1091304749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c105e60 0x7f695c108250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.286+0000 7f6961836700 1 -- 172.21.15.146:0/1091304749 >> 172.21.15.146:0/1091304749 conn(0x7f695c0fcf60 msgr2=0x7f695c0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.286+0000 7f6961836700 1 -- 172.21.15.146:0/1091304749 shutdown_connections 2024-04-23T10:23:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.286+0000 7f6961836700 1 -- 172.21.15.146:0/1091304749 wait complete. 2024-04-23T10:23:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f6961836700 1 Processor -- start 2024-04-23T10:23:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f6961836700 1 -- start start 2024-04-23T10:23:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f6961836700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695c103530 0x7f695c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f6961836700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695c105e60 0x7f695c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f6961836700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c108790 0x7f695c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f6961836700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f695c10e6e0 con 0x7f695c105e60 2024-04-23T10:23:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f6961836700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f695c10e560 con 0x7f695c108790 2024-04-23T10:23:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f6961836700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f695c10e860 con 0x7f695c103530 2024-04-23T10:23:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f695b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c108790 0x7f695c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f695b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c108790 0x7f695c1a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48404/0 (socket says 172.21.15.146:48404) 2024-04-23T10:23:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f695b7fe700 1 -- 172.21.15.146:0/1509870537 learned_addr learned my addr 172.21.15.146:0/1509870537 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-04-23T10:23:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f69527fc700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695c105e60 0x7f695c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.287+0000 7f695affd700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695c103530 0x7f695c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f695b7fe700 1 -- 172.21.15.146:0/1509870537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695c103530 msgr2=0x7f695c198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f695b7fe700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695c103530 0x7f695c198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f695b7fe700 1 -- 172.21.15.146:0/1509870537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695c105e60 msgr2=0x7f695c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f695b7fe700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695c105e60 0x7f695c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f695b7fe700 1 -- 172.21.15.146:0/1509870537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695c1a09b0 con 0x7f695c108790 2024-04-23T10:23:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f695affd700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695c103530 0x7f695c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:23:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f695b7fe700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c108790 0x7f695c1a0310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69540094f0 tx=0x7f695400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f6960834700 1 -- 172.21.15.146:0/1509870537 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695400ddd0 con 0x7f695c108790 2024-04-23T10:23:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f6961836700 1 -- 172.21.15.146:0/1509870537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695c1a0ca0 con 0x7f695c108790 2024-04-23T10:23:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f6960834700 1 -- 172.21.15.146:0/1509870537 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6954009e20 con 0x7f695c108790 2024-04-23T10:23:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f6960834700 1 -- 172.21.15.146:0/1509870537 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954015400 con 0x7f695c108790 2024-04-23T10:23:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.288+0000 7f6961836700 1 -- 172.21.15.146:0/1509870537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f695c1a1190 con 0x7f695c108790 2024-04-23T10:23:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.289+0000 7f6961836700 1 -- 172.21.15.146:0/1509870537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f695c069730 con 0x7f695c108790 2024-04-23T10:23:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.290+0000 7f6960834700 1 -- 172.21.15.146:0/1509870537 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f6954004ad0 con 0x7f695c108790 2024-04-23T10:23:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.291+0000 7f6960834700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f69480a3c40 0x7f69480a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:16.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.291+0000 7f6960834700 1 -- 172.21.15.146:0/1509870537 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6261+0+0 (secure 0 0 0) 0x7f69540cfec0 con 0x7f695c108790 2024-04-23T10:23:16.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.291+0000 7f695affd700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f69480a3c40 0x7f69480a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:16.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.291+0000 7f695affd700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f69480a3c40 0x7f69480a6100 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f694c0099d0 tx=0x7f694c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:16.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.295+0000 7f6960834700 1 -- 172.21.15.146:0/1509870537 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6954010070 con 0x7f695c108790 2024-04-23T10:23:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:15 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi069 2024-04-23T10:23:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:15 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi069 to 4272M 2024-04-23T10:23:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:15 smithi167 ceph-mon[32940]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:16.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:16.500+0000 7f6961836700 1 -- 172.21.15.146:0/1509870537 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f695c062e80 con 0x7f69480a3c40 2024-04-23T10:23:17.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:16 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:23:17.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:16 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:23:17.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:16 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:17.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:16 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:23:17.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:16 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:23:17.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:16 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:17.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:16 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:23:17.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:16 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:23:17.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:16 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:18.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:17 smithi146 ceph-mon[32800]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:23:18.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:17 smithi146 ceph-mon[32800]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:18.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:17 smithi069 ceph-mon[29593]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:23:18.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:17 smithi069 ceph-mon[29593]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:18.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:17 smithi167 ceph-mon[32940]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:23:18.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:17 smithi167 ceph-mon[32940]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:20.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:20 smithi167 ceph-mon[32940]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:20 smithi167 ceph-mon[32940]: from='client.? 172.21.15.146:0/742238820' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b6dcefa-91b3-4973-a57e-bda851fa473e"}]: dispatch 2024-04-23T10:23:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:20 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b6dcefa-91b3-4973-a57e-bda851fa473e"}]: dispatch 2024-04-23T10:23:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:20 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b6dcefa-91b3-4973-a57e-bda851fa473e"}]': finished 2024-04-23T10:23:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:20 smithi167 ceph-mon[32940]: osdmap e70: 11 total, 10 up, 11 in 2024-04-23T10:23:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:20 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:20.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:20 smithi146 ceph-mon[32800]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:20.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:20 smithi146 ceph-mon[32800]: from='client.? 172.21.15.146:0/742238820' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b6dcefa-91b3-4973-a57e-bda851fa473e"}]: dispatch 2024-04-23T10:23:20.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:20 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b6dcefa-91b3-4973-a57e-bda851fa473e"}]: dispatch 2024-04-23T10:23:20.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:20 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b6dcefa-91b3-4973-a57e-bda851fa473e"}]': finished 2024-04-23T10:23:20.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:20 smithi146 ceph-mon[32800]: osdmap e70: 11 total, 10 up, 11 in 2024-04-23T10:23:20.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:20 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:20.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:20 smithi069 ceph-mon[29593]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:20.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:20 smithi069 ceph-mon[29593]: from='client.? 172.21.15.146:0/742238820' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b6dcefa-91b3-4973-a57e-bda851fa473e"}]: dispatch 2024-04-23T10:23:20.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:20 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b6dcefa-91b3-4973-a57e-bda851fa473e"}]: dispatch 2024-04-23T10:23:20.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:20 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b6dcefa-91b3-4973-a57e-bda851fa473e"}]': finished 2024-04-23T10:23:20.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:20 smithi069 ceph-mon[29593]: osdmap e70: 11 total, 10 up, 11 in 2024-04-23T10:23:20.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:20 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:21.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:21 smithi167 ceph-mon[32940]: from='client.? 172.21.15.146:0/646375908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:23:21.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:21 smithi146 ceph-mon[32800]: from='client.? 172.21.15.146:0/646375908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:23:21.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:21 smithi069 ceph-mon[29593]: from='client.? 172.21.15.146:0/646375908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:23:22.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:22 smithi167 ceph-mon[32940]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:22.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:22 smithi146 ceph-mon[32800]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:22.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:22 smithi069 ceph-mon[29593]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:24.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:24 smithi146 ceph-mon[32800]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:24.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:24 smithi167 ceph-mon[32940]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:24.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:24 smithi069 ceph-mon[29593]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:26.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:26 smithi146 ceph-mon[32800]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:26.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:26 smithi167 ceph-mon[32940]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:26.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:26 smithi069 ceph-mon[29593]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:27.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:27 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-23T10:23:27.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:27 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:27.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:27 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-23T10:23:27.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:27 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:27.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:27 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-23T10:23:27.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:27 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:28.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:28 smithi167 ceph-mon[32940]: Deploying daemon osd.10 on smithi146 2024-04-23T10:23:28.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:28 smithi167 ceph-mon[32940]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:28.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:28 smithi146 ceph-mon[32800]: Deploying daemon osd.10 on smithi146 2024-04-23T10:23:28.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:28 smithi146 ceph-mon[32800]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:28.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:28 smithi069 ceph-mon[29593]: Deploying daemon osd.10 on smithi146 2024-04-23T10:23:28.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:28 smithi069 ceph-mon[29593]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:30.154 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:30 smithi146 ceph-mon[32800]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:30.311 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:30 smithi069 ceph-mon[29593]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:30.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:30 smithi167 ceph-mon[32940]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:32.296 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:32 smithi146 ceph-mon[32800]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:32.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:32 smithi167 ceph-mon[32940]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:32.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:32 smithi069 ceph-mon[29593]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:34.019 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:33 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:34.019 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:33 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:34.020 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:33 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:34.020 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:33 smithi146 ceph-mon[32800]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:34.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:33 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:34.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:33 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:34.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:33 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:34.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:33 smithi069 ceph-mon[29593]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:34.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:33 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:34.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:33 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:33 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:33 smithi167 ceph-mon[32940]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:36.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:36 smithi167 ceph-mon[32940]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:36.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:36 smithi146 ceph-mon[32800]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:36.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:36 smithi069 ceph-mon[29593]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:36.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.771+0000 7f6960834700 1 -- 172.21.15.146:0/1509870537 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f695c062e80 con 0x7f69480a3c40 2024-04-23T10:23:36.770 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 10 on host 'smithi146' 2024-04-23T10:23:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.773+0000 7f6961836700 1 -- 172.21.15.146:0/1509870537 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f69480a3c40 msgr2=0x7f69480a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.773+0000 7f6961836700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f69480a3c40 0x7f69480a6100 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f694c0099d0 tx=0x7f694c008040 comp rx=0 tx=0).stop 2024-04-23T10:23:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.773+0000 7f6961836700 1 -- 172.21.15.146:0/1509870537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c108790 msgr2=0x7f695c1a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.773+0000 7f6961836700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c108790 0x7f695c1a0310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69540094f0 tx=0x7f695400d3b0 comp rx=0 tx=0).stop 2024-04-23T10:23:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.774+0000 7f6961836700 1 -- 172.21.15.146:0/1509870537 shutdown_connections 2024-04-23T10:23:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.774+0000 7f6961836700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f69480a3c40 0x7f69480a6100 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.774+0000 7f6961836700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c108790 0x7f695c1a0310 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.774+0000 7f6961836700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695c103530 0x7f695c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.774+0000 7f6961836700 1 --2- 172.21.15.146:0/1509870537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695c105e60 0x7f695c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.774+0000 7f6961836700 1 -- 172.21.15.146:0/1509870537 >> 172.21.15.146:0/1509870537 conn(0x7f695c0fcf60 msgr2=0x7f695c103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.774+0000 7f6961836700 1 -- 172.21.15.146:0/1509870537 shutdown_connections 2024-04-23T10:23:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-04-23T10:23:36.774+0000 7f6961836700 1 -- 172.21.15.146:0/1509870537 wait complete. 2024-04-23T10:23:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:37 smithi167 ceph-mon[32940]: from='osd.10 [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T10:23:37.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:37 smithi167 ceph-mon[32940]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T10:23:37.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:37.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:37.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:37.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:37 smithi146 ceph-mon[32800]: from='osd.10 [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T10:23:37.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:37 smithi146 ceph-mon[32800]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T10:23:37.483 DEBUG:teuthology.orchestra.run.smithi146:osd.10> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.10.service 2024-04-23T10:23:37.485 INFO:tasks.cephadm:Deploying osd.11 on smithi167 with /dev/vg_nvme/lv_1... 2024-04-23T10:23:37.485 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-23T10:23:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:23:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:37 smithi069 ceph-mon[29593]: from='osd.10 [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T10:23:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:37 smithi069 ceph-mon[29593]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-23T10:23:37.733 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:23:38.168 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:38 smithi167 ceph-mon[32940]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:38.168 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:38 smithi167 ceph-mon[32940]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-23T10:23:38.169 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:38 smithi167 ceph-mon[32940]: osdmap e71: 11 total, 10 up, 11 in 2024-04-23T10:23:38.169 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:38 smithi167 ceph-mon[32940]: from='osd.10 [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:23:38.169 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:38 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:38.169 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:38 smithi167 ceph-mon[32940]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:23:38.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:38 smithi146 ceph-mon[32800]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:38.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:38 smithi146 ceph-mon[32800]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-23T10:23:38.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:38 smithi146 ceph-mon[32800]: osdmap e71: 11 total, 10 up, 11 in 2024-04-23T10:23:38.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:38 smithi146 ceph-mon[32800]: from='osd.10 [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:23:38.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:38 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:38.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:38 smithi146 ceph-mon[32800]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:23:38.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:38 smithi069 ceph-mon[29593]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:38.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:38 smithi069 ceph-mon[29593]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-23T10:23:38.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:38 smithi069 ceph-mon[29593]: osdmap e71: 11 total, 10 up, 11 in 2024-04-23T10:23:38.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:38 smithi069 ceph-mon[29593]: from='osd.10 [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:23:38.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:38 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:38.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:38 smithi069 ceph-mon[29593]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-04-23T10:23:39.170 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:23:38 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:23:38.775+0000 7ffa88b4c700 -1 osd.10 0 waiting for initial osdmap 2024-04-23T10:23:39.170 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:23:38 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:23:38.790+0000 7ffa8493f700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:23:39.871 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-23T10:23:39.872 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-23T10:23:39.872 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2024-04-23T10:23:39.872 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2024-04-23T10:23:39.872 INFO:teuthology.orchestra.run.smithi167.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115246 s, 910 MB/s 2024-04-23T10:23:39.872 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2024-04-23T10:23:39.872 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:39 smithi167 ceph-mon[32940]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:23:39.872 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:39 smithi167 ceph-mon[32940]: osdmap e72: 11 total, 10 up, 11 in 2024-04-23T10:23:39.872 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:39 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:39.872 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:39 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:39.872 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:39 smithi167 ceph-mon[32940]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:40.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:39 smithi146 ceph-mon[32800]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:23:40.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:39 smithi146 ceph-mon[32800]: osdmap e72: 11 total, 10 up, 11 in 2024-04-23T10:23:40.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:39 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:40.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:39 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:40.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:39 smithi146 ceph-mon[32800]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:40.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:39 smithi069 ceph-mon[29593]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-04-23T10:23:40.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:39 smithi069 ceph-mon[29593]: osdmap e72: 11 total, 10 up, 11 in 2024-04-23T10:23:40.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:39 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:40.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:39 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:40.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:39 smithi069 ceph-mon[29593]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-23T10:23:40.574 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_1 2024-04-23T10:23:40.778 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:23:40.778 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:23:40.778 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: osd.10 [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302] boot 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: osdmap e73: 11 total, 11 up, 11 in 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:40.779 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:40.819 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:23:40.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:23:40.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:23:40.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: osd.10 [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302] boot 2024-04-23T10:23:40.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: osdmap e73: 11 total, 11 up, 11 in 2024-04-23T10:23:40.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:40.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:40.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:40.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:40.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:40.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:40.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:40.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:40.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:40.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:40.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:41.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:23:41.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:23:41.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: osd.10 [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302] boot 2024-04-23T10:23:41.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: osdmap e73: 11 total, 11 up, 11 in 2024-04-23T10:23:41.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:23:41.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:41.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:23:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:23:41.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:23:41.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:41 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi146 2024-04-23T10:23:41.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:41 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi146 to 4272M 2024-04-23T10:23:41.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:41 smithi069 ceph-mon[29593]: osdmap e74: 11 total, 11 up, 11 in 2024-04-23T10:23:41.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:41 smithi069 ceph-mon[29593]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:42.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:41 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi146 2024-04-23T10:23:42.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:41 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi146 to 4272M 2024-04-23T10:23:42.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:41 smithi167 ceph-mon[32940]: osdmap e74: 11 total, 11 up, 11 in 2024-04-23T10:23:42.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:41 smithi167 ceph-mon[32940]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:42.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:41 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi146 2024-04-23T10:23:42.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:41 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi146 to 4272M 2024-04-23T10:23:42.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:41 smithi146 ceph-mon[32800]: osdmap e74: 11 total, 11 up, 11 in 2024-04-23T10:23:42.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:41 smithi146 ceph-mon[32800]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.492+0000 7ff50e26d700 1 -- 172.21.15.167:0/2096305992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508101c40 msgr2=0x7ff5081020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.492+0000 7ff50e26d700 1 --2- 172.21.15.167:0/2096305992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508101c40 0x7ff5081020c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009990 tx=0x7ff4fc009ca0 comp rx=0 tx=0).stop 2024-04-23T10:23:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.492+0000 7ff50e26d700 1 -- 172.21.15.167:0/2096305992 shutdown_connections 2024-04-23T10:23:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.492+0000 7ff50e26d700 1 --2- 172.21.15.167:0/2096305992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff508102600 0x7ff508109ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.492+0000 7ff50e26d700 1 --2- 172.21.15.167:0/2096305992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff508102fe0 0x7ff508103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.492+0000 7ff50e26d700 1 --2- 172.21.15.167:0/2096305992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508101c40 0x7ff5081020c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.492+0000 7ff50e26d700 1 -- 172.21.15.167:0/2096305992 >> 172.21.15.167:0/2096305992 conn(0x7ff5080fc6f0 msgr2=0x7ff5080feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.492+0000 7ff50e26d700 1 -- 172.21.15.167:0/2096305992 shutdown_connections 2024-04-23T10:23:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.492+0000 7ff50e26d700 1 -- 172.21.15.167:0/2096305992 wait complete. 2024-04-23T10:23:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.493+0000 7ff50e26d700 1 Processor -- start 2024-04-23T10:23:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.493+0000 7ff50e26d700 1 -- start start 2024-04-23T10:23:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.493+0000 7ff50e26d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff508101c40 0x7ff508198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.493+0000 7ff50e26d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508102600 0x7ff508199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.493+0000 7ff50e26d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff508102fe0 0x7ff5081a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.493+0000 7ff50e26d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff50810d5f0 con 0x7ff508101c40 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.493+0000 7ff50e26d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff50810d470 con 0x7ff508102fe0 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.493+0000 7ff50e26d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff50810d770 con 0x7ff508102600 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.493+0000 7ff5077fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508102600 0x7ff508199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.493+0000 7ff5077fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508102600 0x7ff508199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46652/0 (socket says 172.21.15.167:46652) 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff5077fe700 1 -- 172.21.15.167:0/3867069448 learned_addr learned my addr 172.21.15.167:0/3867069448 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff507fff700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff508101c40 0x7ff508198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff5077fe700 1 -- 172.21.15.167:0/3867069448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff508102fe0 msgr2=0x7ff5081a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff50c80a700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff508102fe0 0x7ff5081a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff5077fe700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff508102fe0 0x7ff5081a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff5077fe700 1 -- 172.21.15.167:0/3867069448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff508101c40 msgr2=0x7ff508198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff5077fe700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff508101c40 0x7ff508198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff5077fe700 1 -- 172.21.15.167:0/3867069448 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5081a0960 con 0x7ff508102600 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff5077fe700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508102600 0x7ff508199250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc006010 tx=0x7ff4fc0047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff5057fa700 1 -- 172.21.15.167:0/3867069448 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc027070 con 0x7ff508102600 2024-04-23T10:23:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff50e26d700 1 -- 172.21.15.167:0/3867069448 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5081a0bf0 con 0x7ff508102600 2024-04-23T10:23:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff5057fa700 1 -- 172.21.15.167:0/3867069448 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff4fc022470 con 0x7ff508102600 2024-04-23T10:23:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff5057fa700 1 -- 172.21.15.167:0/3867069448 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00f6c0 con 0x7ff508102600 2024-04-23T10:23:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.494+0000 7ff50e26d700 1 -- 172.21.15.167:0/3867069448 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5081a10a0 con 0x7ff508102600 2024-04-23T10:23:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.495+0000 7ff50e26d700 1 -- 172.21.15.167:0/3867069448 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff508069760 con 0x7ff508102600 2024-04-23T10:23:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.496+0000 7ff5057fa700 1 -- 172.21.15.167:0/3867069448 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7ff4fc02a070 con 0x7ff508102600 2024-04-23T10:23:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.497+0000 7ff5057fa700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4f00a3cc0 0x7ff4f00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.497+0000 7ff5057fa700 1 -- 172.21.15.167:0/3867069448 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6723+0+0 (secure 0 0 0) 0x7ff4fc0d0c00 con 0x7ff508102600 2024-04-23T10:23:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.497+0000 7ff507fff700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4f00a3cc0 0x7ff4f00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.497+0000 7ff507fff700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4f00a3cc0 0x7ff4f00a6180 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8005950 tx=0x7ff4f80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:42.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.501+0000 7ff5057fa700 1 -- 172.21.15.167:0/3867069448 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff4fc05eff0 con 0x7ff508102600 2024-04-23T10:23:42.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:23:42.707+0000 7ff50e26d700 1 -- 172.21.15.167:0/3867069448 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff5080fe860 con 0x7ff4f00a3cc0 2024-04-23T10:23:43.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:42 smithi167 ceph-mon[32940]: osdmap e75: 11 total, 11 up, 11 in 2024-04-23T10:23:43.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:42 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:23:43.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:42 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:23:43.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:42 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:43.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:42 smithi146 ceph-mon[32800]: osdmap e75: 11 total, 11 up, 11 in 2024-04-23T10:23:43.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:42 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:23:43.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:42 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:23:43.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:42 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:43.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:42 smithi069 ceph-mon[29593]: osdmap e75: 11 total, 11 up, 11 in 2024-04-23T10:23:43.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:42 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-23T10:23:43.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:42 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-23T10:23:43.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:42 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:43 smithi167 ceph-mon[32940]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:23:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:43 smithi167 ceph-mon[32940]: osdmap e76: 11 total, 11 up, 11 in 2024-04-23T10:23:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:43 smithi167 ceph-mon[32940]: pgmap v238: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-23T10:23:44.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:43 smithi146 ceph-mon[32800]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:23:44.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:43 smithi146 ceph-mon[32800]: osdmap e76: 11 total, 11 up, 11 in 2024-04-23T10:23:44.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:43 smithi146 ceph-mon[32800]: pgmap v238: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-23T10:23:44.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:43 smithi069 ceph-mon[29593]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:23:44.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:43 smithi069 ceph-mon[29593]: osdmap e76: 11 total, 11 up, 11 in 2024-04-23T10:23:44.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:43 smithi069 ceph-mon[29593]: pgmap v238: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-23T10:23:45.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:44 smithi167 ceph-mon[32940]: osdmap e77: 11 total, 11 up, 11 in 2024-04-23T10:23:45.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:44 smithi146 ceph-mon[32800]: osdmap e77: 11 total, 11 up, 11 in 2024-04-23T10:23:45.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:44 smithi069 ceph-mon[29593]: osdmap e77: 11 total, 11 up, 11 in 2024-04-23T10:23:46.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:45 smithi167 ceph-mon[32940]: pgmap v240: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-04-23T10:23:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:45 smithi167 ceph-mon[32940]: from='client.? 172.21.15.167:0/240485286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0630ee1-83c8-478f-951f-1175ca84eb16"}]: dispatch 2024-04-23T10:23:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:45 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0630ee1-83c8-478f-951f-1175ca84eb16"}]: dispatch 2024-04-23T10:23:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:45 smithi167 ceph-mon[32940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0630ee1-83c8-478f-951f-1175ca84eb16"}]': finished 2024-04-23T10:23:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:45 smithi167 ceph-mon[32940]: osdmap e78: 12 total, 11 up, 12 in 2024-04-23T10:23:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:45 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:23:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:45 smithi146 ceph-mon[32800]: pgmap v240: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-04-23T10:23:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:45 smithi146 ceph-mon[32800]: from='client.? 172.21.15.167:0/240485286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0630ee1-83c8-478f-951f-1175ca84eb16"}]: dispatch 2024-04-23T10:23:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:45 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0630ee1-83c8-478f-951f-1175ca84eb16"}]: dispatch 2024-04-23T10:23:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:45 smithi146 ceph-mon[32800]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0630ee1-83c8-478f-951f-1175ca84eb16"}]': finished 2024-04-23T10:23:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:45 smithi146 ceph-mon[32800]: osdmap e78: 12 total, 11 up, 12 in 2024-04-23T10:23:46.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:45 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:23:46.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:45 smithi069 ceph-mon[29593]: pgmap v240: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-04-23T10:23:46.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:45 smithi069 ceph-mon[29593]: from='client.? 172.21.15.167:0/240485286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0630ee1-83c8-478f-951f-1175ca84eb16"}]: dispatch 2024-04-23T10:23:46.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:45 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0630ee1-83c8-478f-951f-1175ca84eb16"}]: dispatch 2024-04-23T10:23:46.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:45 smithi069 ceph-mon[29593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0630ee1-83c8-478f-951f-1175ca84eb16"}]': finished 2024-04-23T10:23:46.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:45 smithi069 ceph-mon[29593]: osdmap e78: 12 total, 11 up, 12 in 2024-04-23T10:23:46.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:45 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:23:47.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:46 smithi167 ceph-mon[32940]: from='client.? 172.21.15.167:0/2522281535' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:23:47.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:46 smithi146 ceph-mon[32800]: from='client.? 172.21.15.167:0/2522281535' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:23:47.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:46 smithi069 ceph-mon[29593]: from='client.? 172.21.15.167:0/2522281535' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-23T10:23:48.079 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:47 smithi146 ceph-mon[32800]: pgmap v242: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-04-23T10:23:48.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:47 smithi167 ceph-mon[32940]: pgmap v242: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-04-23T10:23:48.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:47 smithi069 ceph-mon[29593]: pgmap v242: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-04-23T10:23:50.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:50 smithi167 ceph-mon[32940]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:50.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:50 smithi146 ceph-mon[32800]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:50.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:50 smithi069 ceph-mon[29593]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:52.177 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:52 smithi167 ceph-mon[32940]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:52.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:52 smithi146 ceph-mon[32800]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:52.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:52 smithi069 ceph-mon[29593]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:54.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:54 smithi167 ceph-mon[32940]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:54.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:54 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-23T10:23:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:54 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:54 smithi167 ceph-mon[32940]: Deploying daemon osd.11 on smithi167 2024-04-23T10:23:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:54 smithi146 ceph-mon[32800]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:54 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-23T10:23:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:54 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:54 smithi146 ceph-mon[32800]: Deploying daemon osd.11 on smithi167 2024-04-23T10:23:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:54 smithi069 ceph-mon[29593]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:54 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-23T10:23:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:54 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:23:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:54 smithi069 ceph-mon[29593]: Deploying daemon osd.11 on smithi167 2024-04-23T10:23:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:56 smithi167 ceph-mon[32940]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:56.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:56 smithi146 ceph-mon[32800]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:56.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:56 smithi069 ceph-mon[29593]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:58.192 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:58 smithi167 ceph-mon[32940]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:58.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:58 smithi146 ceph-mon[32800]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:23:58.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:58 smithi069 ceph-mon[29593]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:00.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:23:59 smithi167 ceph-mon[32940]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:00.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:00.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:00.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:00.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:23:59 smithi146 ceph-mon[32800]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:00.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:00.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:00.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:00.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:23:59 smithi069 ceph-mon[29593]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:02.141 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:02 smithi167 ceph-mon[32940]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:02.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.222+0000 7ff5057fa700 1 -- 172.21.15.167:0/3867069448 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff5080fe860 con 0x7ff4f00a3cc0 2024-04-23T10:24:02.222 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 11 on host 'smithi167' 2024-04-23T10:24:02.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.224+0000 7ff50e26d700 1 -- 172.21.15.167:0/3867069448 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4f00a3cc0 msgr2=0x7ff4f00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.224+0000 7ff50e26d700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4f00a3cc0 0x7ff4f00a6180 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8005950 tx=0x7ff4f80058e0 comp rx=0 tx=0).stop 2024-04-23T10:24:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.224+0000 7ff50e26d700 1 -- 172.21.15.167:0/3867069448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508102600 msgr2=0x7ff508199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.224+0000 7ff50e26d700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508102600 0x7ff508199250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc006010 tx=0x7ff4fc0047b0 comp rx=0 tx=0).stop 2024-04-23T10:24:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.225+0000 7ff50e26d700 1 -- 172.21.15.167:0/3867069448 shutdown_connections 2024-04-23T10:24:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.225+0000 7ff50e26d700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff4f00a3cc0 0x7ff4f00a6180 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.225+0000 7ff50e26d700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff508102fe0 0x7ff5081a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.225+0000 7ff50e26d700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff508101c40 0x7ff508198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.225+0000 7ff50e26d700 1 --2- 172.21.15.167:0/3867069448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508102600 0x7ff508199250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.225+0000 7ff50e26d700 1 -- 172.21.15.167:0/3867069448 >> 172.21.15.167:0/3867069448 conn(0x7ff5080fc6f0 msgr2=0x7ff5080fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.225+0000 7ff50e26d700 1 -- 172.21.15.167:0/3867069448 shutdown_connections 2024-04-23T10:24:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:02.225+0000 7ff50e26d700 1 -- 172.21.15.167:0/3867069448 wait complete. 2024-04-23T10:24:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:02 smithi146 ceph-mon[32800]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:02.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:02 smithi069 ceph-mon[29593]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:03.258 DEBUG:teuthology.orchestra.run.smithi167:osd.11> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.11.service 2024-04-23T10:24:03.261 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-23T10:24:03.261 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-23T10:24:03.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:03 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:03.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:03 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:03.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:03 smithi146 ceph-mon[32800]: from='osd.11 [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T10:24:03.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:03 smithi146 ceph-mon[32800]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T10:24:03.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:03 smithi146 ceph-mon[32800]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:03 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:03 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:03 smithi069 ceph-mon[29593]: from='osd.11 [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T10:24:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:03 smithi069 ceph-mon[29593]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T10:24:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:03 smithi069 ceph-mon[29593]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:03.516 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:24:03.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:03 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:03.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:03 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:03.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:03 smithi167 ceph-mon[32940]: from='osd.11 [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T10:24:03.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:03 smithi167 ceph-mon[32940]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-23T10:24:03.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:03 smithi167 ceph-mon[32940]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:04.394 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:04 smithi167 ceph-mon[32940]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-23T10:24:04.394 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:04 smithi167 ceph-mon[32940]: from='osd.11 [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:24:04.394 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:04 smithi167 ceph-mon[32940]: osdmap e79: 12 total, 11 up, 12 in 2024-04-23T10:24:04.394 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:04 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:04.394 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:04 smithi167 ceph-mon[32940]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:24:04.394 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:04 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:04.394 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:04 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:04.395 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:24:04 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:24:04.199+0000 7fe34de89700 -1 osd.11 0 waiting for initial osdmap 2024-04-23T10:24:04.395 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:24:04 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:24:04.213+0000 7fe349c7c700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:24:04.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:04 smithi069 ceph-mon[29593]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-23T10:24:04.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:04 smithi069 ceph-mon[29593]: from='osd.11 [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:24:04.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:04 smithi069 ceph-mon[29593]: osdmap e79: 12 total, 11 up, 12 in 2024-04-23T10:24:04.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:04.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:04 smithi069 ceph-mon[29593]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:24:04.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:04.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:04 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:04.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:04 smithi146 ceph-mon[32800]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-23T10:24:04.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:04 smithi146 ceph-mon[32800]: from='osd.11 [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:24:04.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:04 smithi146 ceph-mon[32800]: osdmap e79: 12 total, 11 up, 12 in 2024-04-23T10:24:04.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:04 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:04.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:04 smithi146 ceph-mon[32800]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-04-23T10:24:04.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:04 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:04.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:04 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:05.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:05 smithi167 ceph-mon[32940]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:24:05.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:05 smithi167 ceph-mon[32940]: osdmap e80: 12 total, 11 up, 12 in 2024-04-23T10:24:05.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:05 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:05.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:05 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:05.256 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:05 smithi167 ceph-mon[32940]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:05.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.261+0000 7f681d75f700 1 -- 172.21.15.69:0/2533971389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6818103550 msgr2=0x7f6818109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:05.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.261+0000 7f681d75f700 1 --2- 172.21.15.69:0/2533971389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6818103550 0x7f6818109e00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f681000b0d0 tx=0x7f681000b3e0 comp rx=0 tx=0).stop 2024-04-23T10:24:05.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.261+0000 7f681d75f700 1 -- 172.21.15.69:0/2533971389 shutdown_connections 2024-04-23T10:24:05.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.261+0000 7f681d75f700 1 --2- 172.21.15.69:0/2533971389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6818103550 0x7f6818109e00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:05.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.261+0000 7f681d75f700 1 --2- 172.21.15.69:0/2533971389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68181019b0 0x7f6818101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:05.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.261+0000 7f681d75f700 1 --2- 172.21.15.69:0/2533971389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6818102bb0 0x7f6818103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.261+0000 7f681d75f700 1 -- 172.21.15.69:0/2533971389 >> 172.21.15.69:0/2533971389 conn(0x7f68180fcf70 msgr2=0x7f68180ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.261+0000 7f681d75f700 1 -- 172.21.15.69:0/2533971389 shutdown_connections 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.261+0000 7f681d75f700 1 -- 172.21.15.69:0/2533971389 wait complete. 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.262+0000 7f681d75f700 1 Processor -- start 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.262+0000 7f681d75f700 1 -- start start 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.262+0000 7f681d75f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68181019b0 0x7f6818197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.262+0000 7f681d75f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6818102bb0 0x7f6818198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.262+0000 7f681d75f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6818103550 0x7f681819f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.262+0000 7f681d75f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f681810d600 con 0x7f6818102bb0 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.262+0000 7f681d75f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f681810d480 con 0x7f6818103550 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.262+0000 7f681d75f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f681810d780 con 0x7f68181019b0 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f68167fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6818102bb0 0x7f6818198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:05.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f68167fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6818102bb0 0x7f6818198120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36648/0 (socket says 172.21.15.69:36648) 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f68167fc700 1 -- 172.21.15.69:0/1709224299 learned_addr learned my addr 172.21.15.69:0/1709224299 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f6816ffd700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68181019b0 0x7f6818197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f68177fe700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6818103550 0x7f681819f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f68167fc700 1 -- 172.21.15.69:0/1709224299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68181019b0 msgr2=0x7f6818197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f68167fc700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68181019b0 0x7f6818197be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f68167fc700 1 -- 172.21.15.69:0/1709224299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6818103550 msgr2=0x7f681819f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f68167fc700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6818103550 0x7f681819f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f68167fc700 1 -- 172.21.15.69:0/1709224299 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681819f840 con 0x7f6818102bb0 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f68167fc700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6818102bb0 0x7f6818198120 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f680c00b560 tx=0x7f680c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f67fffff700 1 -- 172.21.15.69:0/1709224299 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c015020 con 0x7f6818102bb0 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f67fffff700 1 -- 172.21.15.69:0/1709224299 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f680c011d00 con 0x7f6818102bb0 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f681d75f700 1 -- 172.21.15.69:0/1709224299 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681819fb30 con 0x7f6818102bb0 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f67fffff700 1 -- 172.21.15.69:0/1709224299 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c010e60 con 0x7f6818102bb0 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.263+0000 7f681d75f700 1 -- 172.21.15.69:0/1709224299 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68181a0070 con 0x7f6818102bb0 2024-04-23T10:24:05.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.264+0000 7f681d75f700 1 -- 172.21.15.69:0/1709224299 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6818069730 con 0x7f6818102bb0 2024-04-23T10:24:05.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.265+0000 7f67fffff700 1 -- 172.21.15.69:0/1709224299 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f680c018020 con 0x7f6818102bb0 2024-04-23T10:24:05.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.266+0000 7f67fffff700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f68000a3c40 0x7f68000a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:05.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.266+0000 7f6816ffd700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f68000a3c40 0x7f68000a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:05.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.266+0000 7f67fffff700 1 -- 172.21.15.69:0/1709224299 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f680c0cf5d0 con 0x7f6818102bb0 2024-04-23T10:24:05.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.266+0000 7f6816ffd700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f68000a3c40 0x7f68000a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6818102a10 tx=0x7f680800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:05.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.270+0000 7f67fffff700 1 -- 172.21.15.69:0/1709224299 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f680c01f020 con 0x7f6818102bb0 2024-04-23T10:24:05.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.470+0000 7f681d75f700 1 -- 172.21.15.69:0/1709224299 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f681802df80 con 0x7f6818102bb0 2024-04-23T10:24:05.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:05 smithi069 ceph-mon[29593]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:24:05.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:05 smithi069 ceph-mon[29593]: osdmap e80: 12 total, 11 up, 12 in 2024-04-23T10:24:05.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:05 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:05.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:05 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:05.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:05 smithi069 ceph-mon[29593]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:05.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.470+0000 7f67fffff700 1 -- 172.21.15.69:0/1709224299 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f681802df80 con 0x7f6818102bb0 2024-04-23T10:24:05.470 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:05.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 -- 172.21.15.69:0/1709224299 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f68000a3c40 msgr2=0x7f68000a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:05.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f68000a3c40 0x7f68000a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6818102a10 tx=0x7f680800b410 comp rx=0 tx=0).stop 2024-04-23T10:24:05.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 -- 172.21.15.69:0/1709224299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6818102bb0 msgr2=0x7f6818198120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:05.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6818102bb0 0x7f6818198120 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f680c00b560 tx=0x7f680c00b870 comp rx=0 tx=0).stop 2024-04-23T10:24:05.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 -- 172.21.15.69:0/1709224299 shutdown_connections 2024-04-23T10:24:05.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f68000a3c40 0x7f68000a6100 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:05.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6818103550 0x7f681819f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:05.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68181019b0 0x7f6818197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:05.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 --2- 172.21.15.69:0/1709224299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6818102bb0 0x7f6818198120 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:05.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 -- 172.21.15.69:0/1709224299 >> 172.21.15.69:0/1709224299 conn(0x7f68180fcf70 msgr2=0x7f6818105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:05.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 -- 172.21.15.69:0/1709224299 shutdown_connections 2024-04-23T10:24:05.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:05.473+0000 7f681d75f700 1 -- 172.21.15.69:0/1709224299 wait complete. 2024-04-23T10:24:05.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:05 smithi146 ceph-mon[32800]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-04-23T10:24:05.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:05 smithi146 ceph-mon[32800]: osdmap e80: 12 total, 11 up, 12 in 2024-04-23T10:24:05.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:05 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:05.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:05 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:05.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:05 smithi146 ceph-mon[32800]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-04-23T10:24:06.087 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1713867845,"num_in_osds":12,"osd_in_since":1713867825,"num_remapped_pgs":0} 2024-04-23T10:24:06.088 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-23T10:24:06.328 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:24:06.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:06 smithi167 ceph-mon[32940]: purged_snaps scrub starts 2024-04-23T10:24:06.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:06 smithi167 ceph-mon[32940]: purged_snaps scrub ok 2024-04-23T10:24:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:06 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:06 smithi167 ceph-mon[32940]: osd.11 [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052] boot 2024-04-23T10:24:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:06 smithi167 ceph-mon[32940]: osdmap e81: 12 total, 12 up, 12 in 2024-04-23T10:24:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:06 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:06 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1709224299' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-23T10:24:06.450 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:06 smithi069 ceph-mon[29593]: purged_snaps scrub starts 2024-04-23T10:24:06.450 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:06 smithi069 ceph-mon[29593]: purged_snaps scrub ok 2024-04-23T10:24:06.450 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:06 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:06.450 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:06 smithi069 ceph-mon[29593]: osd.11 [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052] boot 2024-04-23T10:24:06.450 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:06 smithi069 ceph-mon[29593]: osdmap e81: 12 total, 12 up, 12 in 2024-04-23T10:24:06.450 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:06 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:06.450 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:06 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1709224299' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-23T10:24:06.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:06 smithi146 ceph-mon[32800]: purged_snaps scrub starts 2024-04-23T10:24:06.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:06 smithi146 ceph-mon[32800]: purged_snaps scrub ok 2024-04-23T10:24:06.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:06 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:06.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:06 smithi146 ceph-mon[32800]: osd.11 [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052] boot 2024-04-23T10:24:06.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:06 smithi146 ceph-mon[32800]: osdmap e81: 12 total, 12 up, 12 in 2024-04-23T10:24:06.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:06 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:24:06.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:06 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1709224299' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-23T10:24:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: osdmap e82: 12 total, 12 up, 12 in 2024-04-23T10:24:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: Detected new or changed devices on smithi167 2024-04-23T10:24:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi167 to 4272M 2024-04-23T10:24:07.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:07.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:07.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:07.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:07 smithi069 ceph-mon[29593]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:07.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: osdmap e82: 12 total, 12 up, 12 in 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: Detected new or changed devices on smithi167 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi167 to 4272M 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:07 smithi167 ceph-mon[32940]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:07.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: osdmap e82: 12 total, 12 up, 12 in 2024-04-23T10:24:07.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: Detected new or changed devices on smithi167 2024-04-23T10:24:07.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:24:07.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi167 to 4272M 2024-04-23T10:24:07.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:07.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:07.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:07.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:07.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:07 smithi146 ceph-mon[32800]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:08.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.203+0000 7f4600e98700 1 -- 172.21.15.69:0/126937558 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45fc102a90 msgr2=0x7f45fc102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:08.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.203+0000 7f4600e98700 1 --2- 172.21.15.69:0/126937558 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45fc102a90 0x7f45fc102f10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009990 tx=0x7f45ec009ca0 comp rx=0 tx=0).stop 2024-04-23T10:24:08.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.203+0000 7f4600e98700 1 -- 172.21.15.69:0/126937558 shutdown_connections 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.203+0000 7f4600e98700 1 --2- 172.21.15.69:0/126937558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45fc103450 0x7f45fc10f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.203+0000 7f4600e98700 1 --2- 172.21.15.69:0/126937558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45fc108a80 0x7f45fc108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.203+0000 7f4600e98700 1 --2- 172.21.15.69:0/126937558 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45fc102a90 0x7f45fc102f10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.203+0000 7f4600e98700 1 -- 172.21.15.69:0/126937558 >> 172.21.15.69:0/126937558 conn(0x7f45fc079bf0 msgr2=0x7f45fc07a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.203+0000 7f4600e98700 1 -- 172.21.15.69:0/126937558 shutdown_connections 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.203+0000 7f4600e98700 1 -- 172.21.15.69:0/126937558 wait complete. 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f4600e98700 1 Processor -- start 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f4600e98700 1 -- start start 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f4600e98700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45fc102a90 0x7f45fc074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f4600e98700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45fc103450 0x7f45fc075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f4600e98700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45fc108a80 0x7f45fc0757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f4600e98700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc112dd0 con 0x7f45fc102a90 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f4600e98700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc112c50 con 0x7f45fc103450 2024-04-23T10:24:08.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f4600e98700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc112f50 con 0x7f45fc108a80 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f45fa59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45fc102a90 0x7f45fc074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f45fa59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45fc102a90 0x7f45fc074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36674/0 (socket says 172.21.15.69:36674) 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f45fa59c700 1 -- 172.21.15.69:0/1884650527 learned_addr learned my addr 172.21.15.69:0/1884650527 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.204+0000 7f45f9d9b700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45fc103450 0x7f45fc075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f45fad9d700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45fc108a80 0x7f45fc0757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f45fa59c700 1 -- 172.21.15.69:0/1884650527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45fc108a80 msgr2=0x7f45fc0757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f45fa59c700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45fc108a80 0x7f45fc0757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f45fa59c700 1 -- 172.21.15.69:0/1884650527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45fc103450 msgr2=0x7f45fc075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f45fa59c700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45fc103450 0x7f45fc075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f45fa59c700 1 -- 172.21.15.69:0/1884650527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc1a7780 con 0x7f45fc102a90 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f45fa59c700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45fc102a90 0x7f45fc074d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45f000d950 tx=0x7f45f000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f45eb7fe700 1 -- 172.21.15.69:0/1884650527 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0016070 con 0x7f45fc102a90 2024-04-23T10:24:08.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f4600e98700 1 -- 172.21.15.69:0/1884650527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc1a7a70 con 0x7f45fc102a90 2024-04-23T10:24:08.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f45eb7fe700 1 -- 172.21.15.69:0/1884650527 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f45f0009e10 con 0x7f45fc102a90 2024-04-23T10:24:08.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f45eb7fe700 1 -- 172.21.15.69:0/1884650527 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f000f620 con 0x7f45fc102a90 2024-04-23T10:24:08.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.205+0000 7f4600e98700 1 -- 172.21.15.69:0/1884650527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc1a7fd0 con 0x7f45fc102a90 2024-04-23T10:24:08.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.206+0000 7f4600e98700 1 -- 172.21.15.69:0/1884650527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc069730 con 0x7f45fc102a90 2024-04-23T10:24:08.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.207+0000 7f45eb7fe700 1 -- 172.21.15.69:0/1884650527 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f45f0019070 con 0x7f45fc102a90 2024-04-23T10:24:08.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.208+0000 7f45eb7fe700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45e40a3c40 0x7f45e40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:08.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.208+0000 7f45f9d9b700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45e40a3c40 0x7f45e40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:08.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.208+0000 7f45eb7fe700 1 -- 172.21.15.69:0/1884650527 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f45f00cfb10 con 0x7f45fc102a90 2024-04-23T10:24:08.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.208+0000 7f45f9d9b700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45e40a3c40 0x7f45e40a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0098e0 tx=0x7f45ec005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:08.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.212+0000 7f45eb7fe700 1 -- 172.21.15.69:0/1884650527 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f45f009c990 con 0x7f45fc102a90 2024-04-23T10:24:08.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.413+0000 7f4600e98700 1 -- 172.21.15.69:0/1884650527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45fc02df80 con 0x7f45fc102a90 2024-04-23T10:24:08.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.414+0000 7f45eb7fe700 1 -- 172.21.15.69:0/1884650527 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18457 (secure 0 0 0) 0x7f45f009c290 con 0x7f45fc102a90 2024-04-23T10:24:08.413 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:08.414 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":82,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:24:06.204728+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:24:08.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 -- 172.21.15.69:0/1884650527 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45e40a3c40 msgr2=0x7f45e40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:08.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45e40a3c40 0x7f45e40a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0098e0 tx=0x7f45ec005960 comp rx=0 tx=0).stop 2024-04-23T10:24:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 -- 172.21.15.69:0/1884650527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45fc102a90 msgr2=0x7f45fc074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45fc102a90 0x7f45fc074d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45f000d950 tx=0x7f45f000dc60 comp rx=0 tx=0).stop 2024-04-23T10:24:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 -- 172.21.15.69:0/1884650527 shutdown_connections 2024-04-23T10:24:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45e40a3c40 0x7f45e40a6100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45fc108a80 0x7f45fc0757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45fc102a90 0x7f45fc074d40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 --2- 172.21.15.69:0/1884650527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45fc103450 0x7f45fc075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 -- 172.21.15.69:0/1884650527 >> 172.21.15.69:0/1884650527 conn(0x7f45fc079bf0 msgr2=0x7f45fc1016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 -- 172.21.15.69:0/1884650527 shutdown_connections 2024-04-23T10:24:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:08.416+0000 7f4600e98700 1 -- 172.21.15.69:0/1884650527 wait complete. 2024-04-23T10:24:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:08.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:08 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:08.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:08.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:08.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:08 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:08.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:08.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:08.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:08 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:09.048 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:24:09.048 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-23T10:24:09.283 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:24:09.405 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:09 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1884650527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:09.405 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:09 smithi069 ceph-mon[29593]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:09.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:09 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1884650527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:09.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:09 smithi167 ceph-mon[32940]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:09.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:09 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1884650527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:09.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:09 smithi146 ceph-mon[32800]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:11.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.109+0000 7f9535fd8700 1 -- 172.21.15.69:0/2012944254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f953006b0f0 msgr2=0x7f953010f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:11.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.109+0000 7f9535fd8700 1 --2- 172.21.15.69:0/2012944254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f953006b0f0 0x7f953010f900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f952800b0a0 tx=0x7f952800b3b0 comp rx=0 tx=0).stop 2024-04-23T10:24:11.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.109+0000 7f9535fd8700 1 -- 172.21.15.69:0/2012944254 shutdown_connections 2024-04-23T10:24:11.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.109+0000 7f9535fd8700 1 --2- 172.21.15.69:0/2012944254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f953006b0f0 0x7f953010f900 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:11.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.109+0000 7f9535fd8700 1 --2- 172.21.15.69:0/2012944254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9530108a30 0x7f9530108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:11.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.109+0000 7f9535fd8700 1 --2- 172.21.15.69:0/2012944254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953006a750 0x7f953006abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:11.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.109+0000 7f9535fd8700 1 -- 172.21.15.69:0/2012944254 >> 172.21.15.69:0/2012944254 conn(0x7f95300788f0 msgr2=0x7f9530078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:11.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.109+0000 7f9535fd8700 1 -- 172.21.15.69:0/2012944254 shutdown_connections 2024-04-23T10:24:11.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.109+0000 7f9535fd8700 1 -- 172.21.15.69:0/2012944254 wait complete. 2024-04-23T10:24:11.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f9535fd8700 1 Processor -- start 2024-04-23T10:24:11.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f9535fd8700 1 -- start start 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f9535fd8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f953006a750 0x7f9530199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f9535fd8700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953006b0f0 0x7f9530199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f9535fd8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9530108a30 0x7f953019da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f9535fd8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9530112d50 con 0x7f953006a750 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f9535fd8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9530112bd0 con 0x7f9530108a30 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f9535fd8700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9530112ed0 con 0x7f953006b0f0 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f952f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f953006a750 0x7f9530199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f952f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f953006a750 0x7f9530199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51188/0 (socket says 172.21.15.69:51188) 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f952f7fe700 1 -- 172.21.15.69:0/3885954436 learned_addr learned my addr 172.21.15.69:0/3885954436 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.110+0000 7f9526ffd700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953006b0f0 0x7f9530199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f952ffff700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9530108a30 0x7f953019da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f952f7fe700 1 -- 172.21.15.69:0/3885954436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953006b0f0 msgr2=0x7f9530199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:11.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f952f7fe700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953006b0f0 0x7f9530199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:11.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f952f7fe700 1 -- 172.21.15.69:0/3885954436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9530108a30 msgr2=0x7f953019da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:11.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f952f7fe700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9530108a30 0x7f953019da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:11.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f952f7fe700 1 -- 172.21.15.69:0/3885954436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953019e1c0 con 0x7f953006a750 2024-04-23T10:24:11.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f9526ffd700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953006b0f0 0x7f9530199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:24:11.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f952f7fe700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f953006a750 0x7f9530199200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f952000c920 tx=0x7f952000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:11.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f952d7fa700 1 -- 172.21.15.69:0/3885954436 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520004a30 con 0x7f953006a750 2024-04-23T10:24:11.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f9535fd8700 1 -- 172.21.15.69:0/3885954436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953019e4b0 con 0x7f953006a750 2024-04-23T10:24:11.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f9535fd8700 1 -- 172.21.15.69:0/3885954436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95301a5d30 con 0x7f953006a750 2024-04-23T10:24:11.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f952d7fa700 1 -- 172.21.15.69:0/3885954436 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f95200054f0 con 0x7f953006a750 2024-04-23T10:24:11.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.111+0000 7f952d7fa700 1 -- 172.21.15.69:0/3885954436 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520007c80 con 0x7f953006a750 2024-04-23T10:24:11.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.112+0000 7f9535fd8700 1 -- 172.21.15.69:0/3885954436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9510005330 con 0x7f953006a750 2024-04-23T10:24:11.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.113+0000 7f952d7fa700 1 -- 172.21.15.69:0/3885954436 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9520004e60 con 0x7f953006a750 2024-04-23T10:24:11.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.114+0000 7f952d7fa700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f951c0a3cc0 0x7f951c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:11.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.114+0000 7f9526ffd700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f951c0a3cc0 0x7f951c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:11.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.114+0000 7f952d7fa700 1 -- 172.21.15.69:0/3885954436 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f95200cfcb0 con 0x7f953006a750 2024-04-23T10:24:11.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.114+0000 7f9526ffd700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f951c0a3cc0 0x7f951c0a6180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9530078ef0 tx=0x7f951800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:11.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.118+0000 7f952d7fa700 1 -- 172.21.15.69:0/3885954436 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9520014030 con 0x7f953006a750 2024-04-23T10:24:11.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.317+0000 7f9535fd8700 1 -- 172.21.15.69:0/3885954436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f95100058f0 con 0x7f953006a750 2024-04-23T10:24:11.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.317+0000 7f952d7fa700 1 -- 172.21.15.69:0/3885954436 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f952009cbb0 con 0x7f953006a750 2024-04-23T10:24:11.316 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:24:11.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.319+0000 7f9535fd8700 1 -- 172.21.15.69:0/3885954436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f951c0a3cc0 msgr2=0x7f951c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:11.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.319+0000 7f9535fd8700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f951c0a3cc0 0x7f951c0a6180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9530078ef0 tx=0x7f951800a300 comp rx=0 tx=0).stop 2024-04-23T10:24:11.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.319+0000 7f9535fd8700 1 -- 172.21.15.69:0/3885954436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f953006a750 msgr2=0x7f9530199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:11.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.319+0000 7f9535fd8700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f953006a750 0x7f9530199200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f952000c920 tx=0x7f952000cc30 comp rx=0 tx=0).stop 2024-04-23T10:24:11.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.319+0000 7f9535fd8700 1 -- 172.21.15.69:0/3885954436 shutdown_connections 2024-04-23T10:24:11.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.319+0000 7f9535fd8700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f951c0a3cc0 0x7f951c0a6180 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:11.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.319+0000 7f9535fd8700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9530108a30 0x7f953019da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:11.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.319+0000 7f9535fd8700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f953006a750 0x7f9530199200 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:11.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.319+0000 7f9535fd8700 1 --2- 172.21.15.69:0/3885954436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953006b0f0 0x7f9530199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:11.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.319+0000 7f9535fd8700 1 -- 172.21.15.69:0/3885954436 >> 172.21.15.69:0/3885954436 conn(0x7f95300788f0 msgr2=0x7f95300ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:11.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.320+0000 7f9535fd8700 1 -- 172.21.15.69:0/3885954436 shutdown_connections 2024-04-23T10:24:11.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:11.320+0000 7f9535fd8700 1 -- 172.21.15.69:0/3885954436 wait complete. 2024-04-23T10:24:12.001 INFO:tasks.cephadm:Adding mds.a on smithi069 2024-04-23T10:24:12.001 INFO:tasks.cephadm:Adding mds.d on smithi069 2024-04-23T10:24:12.001 INFO:tasks.cephadm:Adding mds.g on smithi069 2024-04-23T10:24:12.001 INFO:tasks.cephadm:Adding mds.j on smithi069 2024-04-23T10:24:12.001 INFO:tasks.cephadm:Adding mds.b on smithi146 2024-04-23T10:24:12.001 INFO:tasks.cephadm:Adding mds.e on smithi146 2024-04-23T10:24:12.001 INFO:tasks.cephadm:Adding mds.h on smithi146 2024-04-23T10:24:12.002 INFO:tasks.cephadm:Adding mds.k on smithi146 2024-04-23T10:24:12.002 INFO:tasks.cephadm:Adding mds.c on smithi167 2024-04-23T10:24:12.002 INFO:tasks.cephadm:Adding mds.f on smithi167 2024-04-23T10:24:12.002 INFO:tasks.cephadm:Adding mds.i on smithi167 2024-04-23T10:24:12.002 INFO:tasks.cephadm:Adding mds.l on smithi167 2024-04-23T10:24:12.002 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l' 2024-04-23T10:24:12.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:12 smithi069 ceph-mon[29593]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:12.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:12 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3885954436' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:24:12.252 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:24:12.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:12 smithi167 ceph-mon[32940]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:12.286 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:12 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3885954436' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:24:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:12 smithi146 ceph-mon[32800]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:12 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3885954436' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:24:13.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.968+0000 7f35f3812700 1 -- 172.21.15.167:0/1075238566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec103c90 msgr2=0x7f35ec1040f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:13.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.968+0000 7f35f3812700 1 --2- 172.21.15.167:0/1075238566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec103c90 0x7f35ec1040f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009990 tx=0x7f35dc009ca0 comp rx=0 tx=0).stop 2024-04-23T10:24:13.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.968+0000 7f35f3812700 1 -- 172.21.15.167:0/1075238566 shutdown_connections 2024-04-23T10:24:13.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.968+0000 7f35f3812700 1 --2- 172.21.15.167:0/1075238566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ec104630 0x7f35ec10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:13.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.968+0000 7f35f3812700 1 --2- 172.21.15.167:0/1075238566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35ec102a90 0x7f35ec102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:13.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.968+0000 7f35f3812700 1 --2- 172.21.15.167:0/1075238566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec103c90 0x7f35ec1040f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:13.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.968+0000 7f35f3812700 1 -- 172.21.15.167:0/1075238566 >> 172.21.15.167:0/1075238566 conn(0x7f35ec0fe030 msgr2=0x7f35ec100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:13.969 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.968+0000 7f35f3812700 1 -- 172.21.15.167:0/1075238566 shutdown_connections 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.968+0000 7f35f3812700 1 -- 172.21.15.167:0/1075238566 wait complete. 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f3812700 1 Processor -- start 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f3812700 1 -- start start 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f3812700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ec102a90 0x7f35ec198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f3812700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35ec103c90 0x7f35ec199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f3812700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec104630 0x7f35ec1a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f3812700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec10e640 con 0x7f35ec103c90 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f3812700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec10e4c0 con 0x7f35ec102a90 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f3812700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec10e7c0 con 0x7f35ec104630 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f1daf700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec104630 0x7f35ec1a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f1daf700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec104630 0x7f35ec1a01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36410/0 (socket says 172.21.15.167:36410) 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f1daf700 1 -- 172.21.15.167:0/1262172470 learned_addr learned my addr 172.21.15.167:0/1262172470 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-23T10:24:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f15ae700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ec102a90 0x7f35ec198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f0dad700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35ec103c90 0x7f35ec199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f1daf700 1 -- 172.21.15.167:0/1262172470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ec102a90 msgr2=0x7f35ec198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f1daf700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ec102a90 0x7f35ec198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f1daf700 1 -- 172.21.15.167:0/1262172470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35ec103c90 msgr2=0x7f35ec199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f1daf700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35ec103c90 0x7f35ec199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f1daf700 1 -- 172.21.15.167:0/1262172470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ec1a0890 con 0x7f35ec104630 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.969+0000 7f35f1daf700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec104630 0x7f35ec1a01c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f35e4007d70 tx=0x7f35e400a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.970+0000 7f35e27fc700 1 -- 172.21.15.167:0/1262172470 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e4016020 con 0x7f35ec104630 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.970+0000 7f35e27fc700 1 -- 172.21.15.167:0/1262172470 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f35e400ac90 con 0x7f35ec104630 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.970+0000 7f35f3812700 1 -- 172.21.15.167:0/1262172470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ec1a0b80 con 0x7f35ec104630 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.970+0000 7f35e27fc700 1 -- 172.21.15.167:0/1262172470 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e40115e0 con 0x7f35ec104630 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.970+0000 7f35f3812700 1 -- 172.21.15.167:0/1262172470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ec1a1070 con 0x7f35ec104630 2024-04-23T10:24:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.970+0000 7f35f3812700 1 -- 172.21.15.167:0/1262172470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ec069730 con 0x7f35ec104630 2024-04-23T10:24:13.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.972+0000 7f35e27fc700 1 -- 172.21.15.167:0/1262172470 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f35e4019020 con 0x7f35ec104630 2024-04-23T10:24:13.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.972+0000 7f35e27fc700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f35d80a3c40 0x7f35d80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:13.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.972+0000 7f35e27fc700 1 -- 172.21.15.167:0/1262172470 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f35e40d02e0 con 0x7f35ec104630 2024-04-23T10:24:13.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.973+0000 7f35f15ae700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f35d80a3c40 0x7f35d80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:13.972 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.973+0000 7f35f15ae700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f35d80a3c40 0x7f35d80a6100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35ec19a120 tx=0x7f35e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:13.975 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:13.976+0000 7f35e27fc700 1 -- 172.21.15.167:0/1262172470 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f35e4020020 con 0x7f35ec104630 2024-04-23T10:24:14.182 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.184+0000 7f35f3812700 1 -- 172.21.15.167:0/1262172470 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}) -- 0x7f35ec063080 con 0x7f35d80a3c40 2024-04-23T10:24:14.190 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.192+0000 7f35e27fc700 1 -- 172.21.15.167:0/1262172470 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f35ec063080 con 0x7f35d80a3c40 2024-04-23T10:24:14.191 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mds.all update... 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 -- 172.21.15.167:0/1262172470 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f35d80a3c40 msgr2=0x7f35d80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f35d80a3c40 0x7f35d80a6100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35ec19a120 tx=0x7f35e8009260 comp rx=0 tx=0).stop 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 -- 172.21.15.167:0/1262172470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec104630 msgr2=0x7f35ec1a01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec104630 0x7f35ec1a01c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f35e4007d70 tx=0x7f35e400a340 comp rx=0 tx=0).stop 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 -- 172.21.15.167:0/1262172470 shutdown_connections 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f35d80a3c40 0x7f35d80a6100 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec104630 0x7f35ec1a01c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ec102a90 0x7f35ec198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 --2- 172.21.15.167:0/1262172470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35ec103c90 0x7f35ec199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 -- 172.21.15.167:0/1262172470 >> 172.21.15.167:0/1262172470 conn(0x7f35ec0fe030 msgr2=0x7f35ec106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 -- 172.21.15.167:0/1262172470 shutdown_connections 2024-04-23T10:24:14.193 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-23T10:24:14.194+0000 7f35f3812700 1 -- 172.21.15.167:0/1262172470 wait complete. 2024-04-23T10:24:14.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:14 smithi167 ceph-mon[32940]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:14.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:14 smithi146 ceph-mon[32800]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:14.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:14 smithi069 ceph-mon[29593]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:14.844 DEBUG:teuthology.orchestra.run.smithi069:mds.a> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.a.service 2024-04-23T10:24:14.847 DEBUG:teuthology.orchestra.run.smithi069:mds.d> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.d.service 2024-04-23T10:24:14.891 DEBUG:teuthology.orchestra.run.smithi069:mds.g> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.g.service 2024-04-23T10:24:14.934 DEBUG:teuthology.orchestra.run.smithi069:mds.j> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.j.service 2024-04-23T10:24:14.977 DEBUG:teuthology.orchestra.run.smithi146:mds.b> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.b.service 2024-04-23T10:24:14.980 DEBUG:teuthology.orchestra.run.smithi146:mds.e> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.e.service 2024-04-23T10:24:15.024 DEBUG:teuthology.orchestra.run.smithi146:mds.h> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.h.service 2024-04-23T10:24:15.066 DEBUG:teuthology.orchestra.run.smithi146:mds.k> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.k.service 2024-04-23T10:24:15.110 DEBUG:teuthology.orchestra.run.smithi167:mds.c> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.c.service 2024-04-23T10:24:15.112 DEBUG:teuthology.orchestra.run.smithi167:mds.f> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.f.service 2024-04-23T10:24:15.155 DEBUG:teuthology.orchestra.run.smithi167:mds.i> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.i.service 2024-04-23T10:24:15.199 DEBUG:teuthology.orchestra.run.smithi167:mds.l> sudo journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.l.service 2024-04-23T10:24:15.241 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-23T10:24:15.241 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:24:15.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:15.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-04-23T10:24:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: Deploying daemon mds.l on smithi167 2024-04-23T10:24:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:15 smithi167 ceph-mon[32940]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:15.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.355+0000 7efea9dc6640 1 -- 172.21.15.69:0/3703135606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efea4101fc0 msgr2=0x7efea41023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.355+0000 7efea9dc6640 1 --2- 172.21.15.69:0/3703135606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efea4101fc0 0x7efea41023e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efe94009900 tx=0x7efe9402a410 comp rx=0 tx=0).stop 2024-04-23T10:24:15.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.355+0000 7efea9dc6640 1 -- 172.21.15.69:0/3703135606 shutdown_connections 2024-04-23T10:24:15.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.355+0000 7efea9dc6640 1 --2- 172.21.15.69:0/3703135606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efea4103b70 0x7efea410a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.355+0000 7efea9dc6640 1 --2- 172.21.15.69:0/3703135606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea41031b0 0x7efea4103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.355+0000 7efea9dc6640 1 --2- 172.21.15.69:0/3703135606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efea4101fc0 0x7efea41023e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.355+0000 7efea9dc6640 1 -- 172.21.15.69:0/3703135606 >> 172.21.15.69:0/3703135606 conn(0x7efea40fd530 msgr2=0x7efea40ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:15.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.355+0000 7efea9dc6640 1 -- 172.21.15.69:0/3703135606 shutdown_connections 2024-04-23T10:24:15.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.355+0000 7efea9dc6640 1 -- 172.21.15.69:0/3703135606 wait complete. 2024-04-23T10:24:15.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.356+0000 7efea9dc6640 1 Processor -- start 2024-04-23T10:24:15.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.356+0000 7efea9dc6640 1 -- start start 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.356+0000 7efea9dc6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea4101fc0 0x7efea4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.356+0000 7efea9dc6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efea41031b0 0x7efea41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.356+0000 7efea9dc6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efea4103b70 0x7efea419f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.356+0000 7efea9dc6640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7efea410dcf0 con 0x7efea4103b70 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.356+0000 7efea9dc6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efea410db70 con 0x7efea4101fc0 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.356+0000 7efea9dc6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efea410de70 con 0x7efea41031b0 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.356+0000 7efea3fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efea4103b70 0x7efea419f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.356+0000 7efea3fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efea4103b70 0x7efea419f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51196/0 (socket says 172.21.15.69:51196) 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.356+0000 7efea3fff640 1 -- 172.21.15.69:0/793387389 learned_addr learned my addr 172.21.15.69:0/793387389 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea37fe640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea4101fc0 0x7efea4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea2ffd640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efea41031b0 0x7efea41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea3fff640 1 -- 172.21.15.69:0/793387389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efea41031b0 msgr2=0x7efea41988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea3fff640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efea41031b0 0x7efea41988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea3fff640 1 -- 172.21.15.69:0/793387389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea4101fc0 msgr2=0x7efea4198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea3fff640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea4101fc0 0x7efea4198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea3fff640 1 -- 172.21.15.69:0/793387389 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea419ffb0 con 0x7efea4103b70 2024-04-23T10:24:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea3fff640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efea4103b70 0x7efea419f940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00eb10 tx=0x7efe9c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea0ff9640 1 -- 172.21.15.69:0/793387389 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00ce20 con 0x7efea4103b70 2024-04-23T10:24:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea0ff9640 1 -- 172.21.15.69:0/793387389 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efe9c005020 con 0x7efea4103b70 2024-04-23T10:24:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea9dc6640 1 -- 172.21.15.69:0/793387389 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea41a02a0 con 0x7efea4103b70 2024-04-23T10:24:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea0ff9640 1 -- 172.21.15.69:0/793387389 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c010670 con 0x7efea4103b70 2024-04-23T10:24:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.357+0000 7efea9dc6640 1 -- 172.21.15.69:0/793387389 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea41a0870 con 0x7efea4103b70 2024-04-23T10:24:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.358+0000 7efea9dc6640 1 -- 172.21.15.69:0/793387389 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea41092e0 con 0x7efea4103b70 2024-04-23T10:24:15.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.359+0000 7efea0ff9640 1 -- 172.21.15.69:0/793387389 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7efe9c005560 con 0x7efea4103b70 2024-04-23T10:24:15.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.360+0000 7efea0ff9640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efe900a3bb0 0x7efe900a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.360+0000 7efea37fe640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efe900a3bb0 0x7efe900a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.360+0000 7efea0ff9640 1 -- 172.21.15.69:0/793387389 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7efe9c0d04b0 con 0x7efea4103b70 2024-04-23T10:24:15.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.360+0000 7efea37fe640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efe900a3bb0 0x7efe900a6070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efe94005ab0 tx=0x7efe94005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:15.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.364+0000 7efea0ff9640 1 -- 172.21.15.69:0/793387389 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efe9c09d330 con 0x7efea4103b70 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: Deploying daemon mds.l on smithi167 2024-04-23T10:24:15.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:15 smithi146 ceph-mon[32800]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: Deploying daemon mds.l on smithi167 2024-04-23T10:24:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:15 smithi069 ceph-mon[29593]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:15.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.544+0000 7efea9dc6640 1 -- 172.21.15.69:0/793387389 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efea4062b50 con 0x7efea4103b70 2024-04-23T10:24:15.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.545+0000 7efea0ff9640 1 -- 172.21.15.69:0/793387389 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18457 (secure 0 0 0) 0x7efe9c09cc30 con 0x7efea4103b70 2024-04-23T10:24:15.544 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:15.544 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":82,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:24:06.204728+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:24:15.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 -- 172.21.15.69:0/793387389 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efe900a3bb0 msgr2=0x7efe900a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efe900a3bb0 0x7efe900a6070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efe94005ab0 tx=0x7efe94005a20 comp rx=0 tx=0).stop 2024-04-23T10:24:15.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 -- 172.21.15.69:0/793387389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efea4103b70 msgr2=0x7efea419f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efea4103b70 0x7efea419f940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00eb10 tx=0x7efe9c00ef10 comp rx=0 tx=0).stop 2024-04-23T10:24:15.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 -- 172.21.15.69:0/793387389 shutdown_connections 2024-04-23T10:24:15.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efe900a3bb0 0x7efe900a6070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efea4103b70 0x7efea419f940 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efea41031b0 0x7efea41988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 --2- 172.21.15.69:0/793387389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea4101fc0 0x7efea4198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 -- 172.21.15.69:0/793387389 >> 172.21.15.69:0/793387389 conn(0x7efea40fd530 msgr2=0x7efea41064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:15.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 -- 172.21.15.69:0/793387389 shutdown_connections 2024-04-23T10:24:15.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.547+0000 7efea9dc6640 1 -- 172.21.15.69:0/793387389 wait complete. 2024-04-23T10:24:15.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:24:15.558 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:24:15.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 -- 172.21.15.69:0/2976470018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53ec100e90 msgr2=0x7f53ec1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 --2- 172.21.15.69:0/2976470018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53ec100e90 0x7f53ec1012b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009900 tx=0x7f53e802a410 comp rx=0 tx=0).stop 2024-04-23T10:24:15.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 -- 172.21.15.69:0/2976470018 shutdown_connections 2024-04-23T10:24:15.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 --2- 172.21.15.69:0/2976470018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ec1029a0 0x7f53ec1092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 --2- 172.21.15.69:0/2976470018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53ec101fe0 0x7f53ec102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 --2- 172.21.15.69:0/2976470018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53ec100e90 0x7f53ec1012b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 -- 172.21.15.69:0/2976470018 >> 172.21.15.69:0/2976470018 conn(0x7f53ec0fc400 msgr2=0x7f53ec0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 -- 172.21.15.69:0/2976470018 shutdown_connections 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 -- 172.21.15.69:0/2976470018 wait complete. 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 Processor -- start 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 -- start start 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53ec100e90 0x7f53ec1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53ec101fe0 0x7f53ec1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ec1029a0 0x7f53ec19f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec10dcc0 con 0x7f53ec100e90 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec10db40 con 0x7f53ec1029a0 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.660+0000 7f53f3f8e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec10de40 con 0x7f53ec101fe0 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f1d2a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53ec100e90 0x7f53ec1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f1d2a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53ec100e90 0x7f53ec1983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51214/0 (socket says 172.21.15.69:51214) 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f1d2a640 1 -- 172.21.15.69:0/1145481031 learned_addr learned my addr 172.21.15.69:0/1145481031 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f252b640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ec1029a0 0x7f53ec19f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f1d2a640 1 -- 172.21.15.69:0/1145481031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53ec101fe0 msgr2=0x7f53ec1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f1529640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53ec101fe0 0x7f53ec1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f1d2a640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53ec101fe0 0x7f53ec1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f1d2a640 1 -- 172.21.15.69:0/1145481031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ec1029a0 msgr2=0x7f53ec19f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f1d2a640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ec1029a0 0x7f53ec19f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f1d2a640 1 -- 172.21.15.69:0/1145481031 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec19ffc0 con 0x7f53ec100e90 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f252b640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ec1029a0 0x7f53ec19f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f1529640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53ec101fe0 0x7f53ec1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f1d2a640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53ec100e90 0x7f53ec1983a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f53e8031570 tx=0x7f53e8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53e2ffd640 1 -- 172.21.15.69:0/1145481031 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e803f030 con 0x7f53ec100e90 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53e2ffd640 1 -- 172.21.15.69:0/1145481031 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f53e8003cd0 con 0x7f53ec100e90 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f3f8e640 1 -- 172.21.15.69:0/1145481031 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ec1a0250 con 0x7f53ec100e90 2024-04-23T10:24:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53e2ffd640 1 -- 172.21.15.69:0/1145481031 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8035070 con 0x7f53ec100e90 2024-04-23T10:24:15.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.661+0000 7f53f3f8e640 1 -- 172.21.15.69:0/1145481031 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ec1a07c0 con 0x7f53ec100e90 2024-04-23T10:24:15.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.662+0000 7f53f3f8e640 1 -- 172.21.15.69:0/1145481031 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ec1081c0 con 0x7f53ec100e90 2024-04-23T10:24:15.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.663+0000 7f53e2ffd640 1 -- 172.21.15.69:0/1145481031 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f53e8003800 con 0x7f53ec100e90 2024-04-23T10:24:15.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.664+0000 7f53e2ffd640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f53d80a3bb0 0x7f53d80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.664+0000 7f53f1529640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f53d80a3bb0 0x7f53d80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.664+0000 7f53e2ffd640 1 -- 172.21.15.69:0/1145481031 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f53e80f0d40 con 0x7f53ec100e90 2024-04-23T10:24:15.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.664+0000 7f53f1529640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f53d80a3bb0 0x7f53d80a6070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f53dc006fd0 tx=0x7f53dc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:15.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.667+0000 7f53e2ffd640 1 -- 172.21.15.69:0/1145481031 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f53e8003af0 con 0x7f53ec100e90 2024-04-23T10:24:15.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.844+0000 7f53f3f8e640 1 -- 172.21.15.69:0/1145481031 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f53ec062b50 con 0x7f53ec100e90 2024-04-23T10:24:15.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.844+0000 7f53e2ffd640 1 -- 172.21.15.69:0/1145481031 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f53e80bdbc0 con 0x7f53ec100e90 2024-04-23T10:24:15.843 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:24:15.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 -- 172.21.15.69:0/1145481031 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f53d80a3bb0 msgr2=0x7f53d80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f53d80a3bb0 0x7f53d80a6070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f53dc006fd0 tx=0x7f53dc008040 comp rx=0 tx=0).stop 2024-04-23T10:24:15.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 -- 172.21.15.69:0/1145481031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53ec100e90 msgr2=0x7f53ec1983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53ec100e90 0x7f53ec1983a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f53e8031570 tx=0x7f53e8004430 comp rx=0 tx=0).stop 2024-04-23T10:24:15.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 -- 172.21.15.69:0/1145481031 shutdown_connections 2024-04-23T10:24:15.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f53d80a3bb0 0x7f53d80a6070 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53ec1029a0 0x7f53ec19f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53ec101fe0 0x7f53ec1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 --2- 172.21.15.69:0/1145481031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53ec100e90 0x7f53ec1983a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 -- 172.21.15.69:0/1145481031 >> 172.21.15.69:0/1145481031 conn(0x7f53ec0fc400 msgr2=0x7f53ec105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:15.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 -- 172.21.15.69:0/1145481031 shutdown_connections 2024-04-23T10:24:15.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.846+0000 7f53f3f8e640 1 -- 172.21.15.69:0/1145481031 wait complete. 2024-04-23T10:24:15.857 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 -- 172.21.15.69:0/1012083547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a4101fa0 msgr2=0x7f12a41023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 --2- 172.21.15.69:0/1012083547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a4101fa0 0x7f12a41023c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1294009900 tx=0x7f129402a410 comp rx=0 tx=0).stop 2024-04-23T10:24:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 -- 172.21.15.69:0/1012083547 shutdown_connections 2024-04-23T10:24:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 --2- 172.21.15.69:0/1012083547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a4103b50 0x7f12a410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 --2- 172.21.15.69:0/1012083547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12a4103190 0x7f12a4103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 --2- 172.21.15.69:0/1012083547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a4101fa0 0x7f12a41023c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 -- 172.21.15.69:0/1012083547 >> 172.21.15.69:0/1012083547 conn(0x7f12a40fd530 msgr2=0x7f12a40ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:15.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 -- 172.21.15.69:0/1012083547 shutdown_connections 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 -- 172.21.15.69:0/1012083547 wait complete. 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 Processor -- start 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 -- start start 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.955+0000 7f12a94e1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a4101fa0 0x7f12a4198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a94e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12a4103190 0x7f12a41987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a94e1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a4103b50 0x7f12a419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a94e1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f12a410dc00 con 0x7f12a4103b50 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a94e1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f12a410da80 con 0x7f12a4101fa0 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a94e1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f12a410dd80 con 0x7f12a4103190 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a37fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a4103b50 0x7f12a419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a37fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a4103b50 0x7f12a419f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51236/0 (socket says 172.21.15.69:51236) 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a37fe640 1 -- 172.21.15.69:0/2331297773 learned_addr learned my addr 172.21.15.69:0/2331297773 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a2ffd640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a4101fa0 0x7f12a4198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f129bfff640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12a4103190 0x7f12a41987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a37fe640 1 -- 172.21.15.69:0/2331297773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12a4103190 msgr2=0x7f12a41987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a37fe640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12a4103190 0x7f12a41987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a37fe640 1 -- 172.21.15.69:0/2331297773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a4101fa0 msgr2=0x7f12a4198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a37fe640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a4101fa0 0x7f12a4198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a37fe640 1 -- 172.21.15.69:0/2331297773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a419fe90 con 0x7f12a4103b50 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f129bfff640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12a4103190 0x7f12a41987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a37fe640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a4103b50 0x7f12a419f820 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f129c00cce0 tx=0x7f129c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a0ff9640 1 -- 172.21.15.69:0/2331297773 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c00f450 con 0x7f12a4103b50 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a0ff9640 1 -- 172.21.15.69:0/2331297773 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f129c00fac0 con 0x7f12a4103b50 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a0ff9640 1 -- 172.21.15.69:0/2331297773 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c018be0 con 0x7f12a4103b50 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a94e1640 1 -- 172.21.15.69:0/2331297773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a41a0180 con 0x7f12a4103b50 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.956+0000 7f12a94e1640 1 -- 172.21.15.69:0/2331297773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a41a0680 con 0x7f12a4103b50 2024-04-23T10:24:15.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.957+0000 7f12a94e1640 1 -- 172.21.15.69:0/2331297773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a41092c0 con 0x7f12a4103b50 2024-04-23T10:24:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.958+0000 7f12a0ff9640 1 -- 172.21.15.69:0/2331297773 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f129c00fc70 con 0x7f12a4103b50 2024-04-23T10:24:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.959+0000 7f12a0ff9640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f12900a3bb0 0x7f12900a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.959+0000 7f12a2ffd640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f12900a3bb0 0x7f12900a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.959+0000 7f12a0ff9640 1 -- 172.21.15.69:0/2331297773 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f129c0d06e0 con 0x7f12a4103b50 2024-04-23T10:24:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.959+0000 7f12a2ffd640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f12900a3bb0 0x7f12900a6070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1294000c00 tx=0x7f1294031c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:15.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:15.963+0000 7f12a0ff9640 1 -- 172.21.15.69:0/2331297773 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f129c014030 con 0x7f12a4103b50 2024-04-23T10:24:16.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.175+0000 7f12a94e1640 1 -- 172.21.15.69:0/2331297773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12a4062b50 con 0x7f12a4103b50 2024-04-23T10:24:16.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.176+0000 7f12a0ff9640 1 -- 172.21.15.69:0/2331297773 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f129c09d560 con 0x7f12a4103b50 2024-04-23T10:24:16.175 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:16.175 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-23T10:24:16.175 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 1 2024-04-23T10:24:16.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 -- 172.21.15.69:0/2331297773 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f12900a3bb0 msgr2=0x7f12900a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:16.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f12900a3bb0 0x7f12900a6070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1294000c00 tx=0x7f1294031c60 comp rx=0 tx=0).stop 2024-04-23T10:24:16.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 -- 172.21.15.69:0/2331297773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a4103b50 msgr2=0x7f12a419f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:16.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a4103b50 0x7f12a419f820 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f129c00cce0 tx=0x7f129c00a620 comp rx=0 tx=0).stop 2024-04-23T10:24:16.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 -- 172.21.15.69:0/2331297773 shutdown_connections 2024-04-23T10:24:16.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f12900a3bb0 0x7f12900a6070 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:16.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a4103b50 0x7f12a419f820 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:16.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12a4103190 0x7f12a41987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:16.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 --2- 172.21.15.69:0/2331297773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a4101fa0 0x7f12a4198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:16.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 -- 172.21.15.69:0/2331297773 >> 172.21.15.69:0/2331297773 conn(0x7f12a40fd530 msgr2=0x7f12a4106490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:16.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 -- 172.21.15.69:0/2331297773 shutdown_connections 2024-04-23T10:24:16.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:16.178+0000 7f12a94e1640 1 -- 172.21.15.69:0/2331297773 wait complete. 2024-04-23T10:24:16.294 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:16 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/793387389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:16.294 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:16 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1145481031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:24:16.295 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:16 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2331297773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:16.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:16 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/793387389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:16.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:16 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1145481031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:24:16.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:16 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2331297773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:16.582 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:24:16 smithi167 systemd[1]: Starting Ceph mds.l for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:24:16.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:16 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/793387389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:16.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:16 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1145481031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:24:16.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:16 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2331297773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:17.014 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:24:16 smithi167 podman[62964]: 2024-04-23 10:24:16.598765297 +0000 UTC m=+0.018946039 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:24:17.015 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:24:16 smithi167 podman[62964]: 2024-04-23 10:24:16.705186658 +0000 UTC m=+0.125367409 container create bdebef762c537a51e2cbc970b2b9a2fa9a6e280ad3f9ff181528c6d0e731ec3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:24:17.015 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:24:16 smithi167 podman[62964]: 2024-04-23 10:24:16.916095006 +0000 UTC m=+0.336275720 container init bdebef762c537a51e2cbc970b2b9a2fa9a6e280ad3f9ff181528c6d0e731ec3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-23T10:24:17.015 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:24:16 smithi167 podman[62964]: 2024-04-23 10:24:16.918773685 +0000 UTC m=+0.338954394 container start bdebef762c537a51e2cbc970b2b9a2fa9a6e280ad3f9ff181528c6d0e731ec3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0) 2024-04-23T10:24:17.015 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:24:16 smithi167 ceph-mds[62983]: -- 172.21.15.167:0/3648300492 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5571e2d43a40 con 0x5571e2d16c00 2024-04-23T10:24:17.015 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:24:16 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l[62979]: starting mds.l at 2024-04-23T10:24:17.015 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:24:17 smithi167 bash[62964]: bdebef762c537a51e2cbc970b2b9a2fa9a6e280ad3f9ff181528c6d0e731ec3e 2024-04-23T10:24:17.332 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:24:17 smithi167 systemd[1]: Started Ceph mds.l for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:18.025 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:17 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] up:boot 2024-04-23T10:24:18.025 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:17 smithi146 ceph-mon[32800]: fsmap 1 up:standby 2024-04-23T10:24:18.026 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T10:24:18.026 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:17 smithi146 ceph-mon[32800]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:18.026 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:18.026 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:18.026 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:18.026 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:18.026 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:18.026 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:17 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:18.026 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:17 smithi146 ceph-mon[32800]: Deploying daemon mds.k on smithi146 2024-04-23T10:24:18.189 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:18.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:17 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] up:boot 2024-04-23T10:24:18.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:17 smithi069 ceph-mon[29593]: fsmap 1 up:standby 2024-04-23T10:24:18.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T10:24:18.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:17 smithi069 ceph-mon[29593]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:18.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:18.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:18.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:18.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:18.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:18.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:17 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:18.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:17 smithi069 ceph-mon[29593]: Deploying daemon mds.k on smithi146 2024-04-23T10:24:18.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.301+0000 7f716a207640 1 -- 172.21.15.69:0/1217303712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7164103190 msgr2=0x7f7164103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:18.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.301+0000 7f716a207640 1 --2- 172.21.15.69:0/1217303712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7164103190 0x7f7164103610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7158009900 tx=0x7f715802a410 comp rx=0 tx=0).stop 2024-04-23T10:24:18.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.301+0000 7f716a207640 1 -- 172.21.15.69:0/1217303712 shutdown_connections 2024-04-23T10:24:18.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.301+0000 7f716a207640 1 --2- 172.21.15.69:0/1217303712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7164103190 0x7f7164103610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:18.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.301+0000 7f716a207640 1 --2- 172.21.15.69:0/1217303712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7164103b50 0x7f716410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:18.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.301+0000 7f716a207640 1 --2- 172.21.15.69:0/1217303712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7164101fa0 0x7f71641023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:18.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.301+0000 7f716a207640 1 -- 172.21.15.69:0/1217303712 >> 172.21.15.69:0/1217303712 conn(0x7f71640fd530 msgr2=0x7f71640ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:18.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.302+0000 7f716a207640 1 -- 172.21.15.69:0/1217303712 shutdown_connections 2024-04-23T10:24:18.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.302+0000 7f716a207640 1 -- 172.21.15.69:0/1217303712 wait complete. 2024-04-23T10:24:18.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.302+0000 7f716a207640 1 Processor -- start 2024-04-23T10:24:18.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.302+0000 7f716a207640 1 -- start start 2024-04-23T10:24:18.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.302+0000 7f716a207640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7164101fa0 0x7f71641982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:18.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.302+0000 7f716a207640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7164103190 0x7f7164198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:18.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f716a207640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7164103b50 0x7f716419f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f716a207640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f716410dc00 con 0x7f7164103b50 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f716a207640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f716410da80 con 0x7f7164103190 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f716a207640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f716410dd80 con 0x7f7164101fa0 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7163fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7164103b50 0x7f716419f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7163fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7164103b50 0x7f716419f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51250/0 (socket says 172.21.15.69:51250) 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7163fff640 1 -- 172.21.15.69:0/3019676613 learned_addr learned my addr 172.21.15.69:0/3019676613 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7162ffd640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7164103190 0x7f7164198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f71637fe640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7164101fa0 0x7f71641982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7163fff640 1 -- 172.21.15.69:0/3019676613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7164101fa0 msgr2=0x7f71641982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7163fff640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7164101fa0 0x7f71641982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7163fff640 1 -- 172.21.15.69:0/3019676613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7164103190 msgr2=0x7f7164198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7163fff640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7164103190 0x7f7164198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7163fff640 1 -- 172.21.15.69:0/3019676613 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716419ff00 con 0x7f7164103b50 2024-04-23T10:24:18.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7163fff640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7164103b50 0x7f716419f890 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f715c009fd0 tx=0x7f715c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:18.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7160ff9640 1 -- 172.21.15.69:0/3019676613 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c017070 con 0x7f7164103b50 2024-04-23T10:24:18.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f716a207640 1 -- 172.21.15.69:0/3019676613 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71641a01f0 con 0x7f7164103b50 2024-04-23T10:24:18.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7160ff9640 1 -- 172.21.15.69:0/3019676613 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f715c003e40 con 0x7f7164103b50 2024-04-23T10:24:18.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f7160ff9640 1 -- 172.21.15.69:0/3019676613 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c004820 con 0x7f7164103b50 2024-04-23T10:24:18.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.303+0000 7f716a207640 1 -- 172.21.15.69:0/3019676613 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71641a06c0 con 0x7f7164103b50 2024-04-23T10:24:18.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.304+0000 7f716a207640 1 -- 172.21.15.69:0/3019676613 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7164109340 con 0x7f7164103b50 2024-04-23T10:24:18.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.305+0000 7f7160ff9640 1 -- 172.21.15.69:0/3019676613 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f715c003970 con 0x7f7164103b50 2024-04-23T10:24:18.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.306+0000 7f7160ff9640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f714c0a3bb0 0x7f714c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:18.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.306+0000 7f71637fe640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f714c0a3bb0 0x7f714c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:18.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.306+0000 7f7160ff9640 1 -- 172.21.15.69:0/3019676613 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f715c0cfcb0 con 0x7f7164103b50 2024-04-23T10:24:18.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.306+0000 7f71637fe640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f714c0a3bb0 0x7f714c0a6070 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f71540058c0 tx=0x7f715400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:18.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.311+0000 7f7160ff9640 1 -- 172.21.15.69:0/3019676613 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f715c003c60 con 0x7f7164103b50 2024-04-23T10:24:18.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:17 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] up:boot 2024-04-23T10:24:18.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:17 smithi167 ceph-mon[32940]: fsmap 1 up:standby 2024-04-23T10:24:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T10:24:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:17 smithi167 ceph-mon[32940]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:17 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:17 smithi167 ceph-mon[32940]: Deploying daemon mds.k on smithi146 2024-04-23T10:24:18.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.527+0000 7f716a207640 1 -- 172.21.15.69:0/3019676613 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f716402d5c0 con 0x7f7164103b50 2024-04-23T10:24:18.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.527+0000 7f7160ff9640 1 -- 172.21.15.69:0/3019676613 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7f715c09c4e0 con 0x7f7164103b50 2024-04-23T10:24:18.526 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:18.527 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-23T10:24:18.527 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 2 2024-04-23T10:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.529+0000 7f716a207640 1 -- 172.21.15.69:0/3019676613 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f714c0a3bb0 msgr2=0x7f714c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.529+0000 7f716a207640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f714c0a3bb0 0x7f714c0a6070 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f71540058c0 tx=0x7f715400a2d0 comp rx=0 tx=0).stop 2024-04-23T10:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.529+0000 7f716a207640 1 -- 172.21.15.69:0/3019676613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7164103b50 msgr2=0x7f716419f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.529+0000 7f716a207640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7164103b50 0x7f716419f890 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f715c009fd0 tx=0x7f715c00b260 comp rx=0 tx=0).stop 2024-04-23T10:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.530+0000 7f716a207640 1 -- 172.21.15.69:0/3019676613 shutdown_connections 2024-04-23T10:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.530+0000 7f716a207640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f714c0a3bb0 0x7f714c0a6070 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.530+0000 7f716a207640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7164103b50 0x7f716419f890 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.530+0000 7f716a207640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7164103190 0x7f7164198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.530+0000 7f716a207640 1 --2- 172.21.15.69:0/3019676613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7164101fa0 0x7f71641982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.530+0000 7f716a207640 1 -- 172.21.15.69:0/3019676613 >> 172.21.15.69:0/3019676613 conn(0x7f71640fd530 msgr2=0x7f7164106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.530+0000 7f716a207640 1 -- 172.21.15.69:0/3019676613 shutdown_connections 2024-04-23T10:24:18.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:18.530+0000 7f716a207640 1 -- 172.21.15.69:0/3019676613 wait complete. 2024-04-23T10:24:19.230 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:18 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3019676613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:19.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:18 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3019676613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:19.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:18 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3019676613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:19.678 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:24:19 smithi146 systemd[1]: Starting Ceph mds.k for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:24:19.949 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:24:19 smithi146 podman[61430]: 2024-04-23 10:24:19.598777345 +0000 UTC m=+0.018435272 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:24:19.949 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:24:19 smithi146 podman[61430]: 2024-04-23 10:24:19.714899173 +0000 UTC m=+0.134557085 container create a4269f1a8f158a08c3732ebe0b65d5711bbf6ae803f0dd50805622dcbb352f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-23T10:24:19.949 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:24:19 smithi146 podman[61430]: 2024-04-23 10:24:19.95087625 +0000 UTC m=+0.370534163 container init a4269f1a8f158a08c3732ebe0b65d5711bbf6ae803f0dd50805622dcbb352f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:24:20.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:19 smithi069 ceph-mon[29593]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:20.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:19 smithi167 ceph-mon[32940]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:20.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:19 smithi146 ceph-mon[32800]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:20.428 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:24:19 smithi146 podman[61430]: 2024-04-23 10:24:19.95389913 +0000 UTC m=+0.373557049 container start a4269f1a8f158a08c3732ebe0b65d5711bbf6ae803f0dd50805622dcbb352f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-23T10:24:20.428 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:24:19 smithi146 ceph-mds[61449]: -- 172.21.15.146:0/3029459886 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e6de44fa40 con 0x55e6de422800 2024-04-23T10:24:20.428 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:24:19 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k[61445]: starting mds.k at 2024-04-23T10:24:20.428 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:24:20 smithi146 bash[61430]: a4269f1a8f158a08c3732ebe0b65d5711bbf6ae803f0dd50805622dcbb352f45 2024-04-23T10:24:20.428 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:24:20 smithi146 systemd[1]: Started Ceph mds.k for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:20.540 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.652+0000 7f70f5b44640 1 -- 172.21.15.69:0/2887926130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f01031b0 msgr2=0x7f70f0103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.652+0000 7f70f5b44640 1 --2- 172.21.15.69:0/2887926130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f01031b0 0x7f70f0103630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009900 tx=0x7f70e402a410 comp rx=0 tx=0).stop 2024-04-23T10:24:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.652+0000 7f70f5b44640 1 -- 172.21.15.69:0/2887926130 shutdown_connections 2024-04-23T10:24:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.652+0000 7f70f5b44640 1 --2- 172.21.15.69:0/2887926130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f01031b0 0x7f70f0103630 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.652+0000 7f70f5b44640 1 --2- 172.21.15.69:0/2887926130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f0103b70 0x7f70f010a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.652+0000 7f70f5b44640 1 --2- 172.21.15.69:0/2887926130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f0101fc0 0x7f70f01023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.652+0000 7f70f5b44640 1 -- 172.21.15.69:0/2887926130 >> 172.21.15.69:0/2887926130 conn(0x7f70f00fd550 msgr2=0x7f70f00ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.653+0000 7f70f5b44640 1 -- 172.21.15.69:0/2887926130 shutdown_connections 2024-04-23T10:24:20.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.653+0000 7f70f5b44640 1 -- 172.21.15.69:0/2887926130 wait complete. 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.653+0000 7f70f5b44640 1 Processor -- start 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.653+0000 7f70f5b44640 1 -- start start 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70f5b44640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f0101fc0 0x7f70f01982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70f5b44640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f01031b0 0x7f70f0198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70f5b44640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f0103b70 0x7f70f019f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70f5b44640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f70f010dc20 con 0x7f70f0101fc0 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70f5b44640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f70f010daa0 con 0x7f70f0103b70 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70f5b44640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70f010dda0 con 0x7f70f01031b0 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ef7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f0101fc0 0x7f70f01982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ef7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f0101fc0 0x7f70f01982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45848/0 (socket says 172.21.15.69:45848) 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ef7fe640 1 -- 172.21.15.69:0/1442627436 learned_addr learned my addr 172.21.15.69:0/1442627436 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:20.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70effff640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f0103b70 0x7f70f019f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70eeffd640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f01031b0 0x7f70f0198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ef7fe640 1 -- 172.21.15.69:0/1442627436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f01031b0 msgr2=0x7f70f0198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ef7fe640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f01031b0 0x7f70f0198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ef7fe640 1 -- 172.21.15.69:0/1442627436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f0103b70 msgr2=0x7f70f019f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ef7fe640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f0103b70 0x7f70f019f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ef7fe640 1 -- 172.21.15.69:0/1442627436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f019ff10 con 0x7f70f0101fc0 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70eeffd640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f01031b0 0x7f70f0198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ef7fe640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f0101fc0 0x7f70f01982f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70e000d950 tx=0x7f70e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ecff9640 1 -- 172.21.15.69:0/1442627436 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0017070 con 0x7f70f0101fc0 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ecff9640 1 -- 172.21.15.69:0/1442627436 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f70e0009c30 con 0x7f70f0101fc0 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70f5b44640 1 -- 172.21.15.69:0/1442627436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f01a0200 con 0x7f70f0101fc0 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.654+0000 7f70ecff9640 1 -- 172.21.15.69:0/1442627436 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e000f620 con 0x7f70f0101fc0 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.655+0000 7f70f5b44640 1 -- 172.21.15.69:0/1442627436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f01a0700 con 0x7f70f0101fc0 2024-04-23T10:24:20.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.656+0000 7f70f5b44640 1 -- 172.21.15.69:0/1442627436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f01092e0 con 0x7f70f0101fc0 2024-04-23T10:24:20.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.657+0000 7f70ecff9640 1 -- 172.21.15.69:0/1442627436 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f70e001a070 con 0x7f70f0101fc0 2024-04-23T10:24:20.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.658+0000 7f70ecff9640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70d80a3bb0 0x7f70d80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:20.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.658+0000 7f70eeffd640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70d80a3bb0 0x7f70d80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:20.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.658+0000 7f70ecff9640 1 -- 172.21.15.69:0/1442627436 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f70e00cf980 con 0x7f70f0101fc0 2024-04-23T10:24:20.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.658+0000 7f70eeffd640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70d80a3bb0 0x7f70d80a6070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70f0199800 tx=0x7f70e4031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:20.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.662+0000 7f70ecff9640 1 -- 172.21.15.69:0/1442627436 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f70e0009de0 con 0x7f70f0101fc0 2024-04-23T10:24:20.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.897+0000 7f70f5b44640 1 -- 172.21.15.69:0/1442627436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70f002d5c0 con 0x7f70f0101fc0 2024-04-23T10:24:20.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.898+0000 7f70ecff9640 1 -- 172.21.15.69:0/1442627436 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7f70e009c800 con 0x7f70f0101fc0 2024-04-23T10:24:20.897 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:20.897 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-23T10:24:20.897 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 2 2024-04-23T10:24:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.899+0000 7f70f5b44640 1 -- 172.21.15.69:0/1442627436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70d80a3bb0 msgr2=0x7f70d80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.899+0000 7f70f5b44640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70d80a3bb0 0x7f70d80a6070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70f0199800 tx=0x7f70e4031510 comp rx=0 tx=0).stop 2024-04-23T10:24:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.899+0000 7f70f5b44640 1 -- 172.21.15.69:0/1442627436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f0101fc0 msgr2=0x7f70f01982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.899+0000 7f70f5b44640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f0101fc0 0x7f70f01982f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70e000d950 tx=0x7f70e000de10 comp rx=0 tx=0).stop 2024-04-23T10:24:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.900+0000 7f70f5b44640 1 -- 172.21.15.69:0/1442627436 shutdown_connections 2024-04-23T10:24:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.900+0000 7f70f5b44640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70d80a3bb0 0x7f70d80a6070 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.900+0000 7f70f5b44640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f0103b70 0x7f70f019f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.900+0000 7f70f5b44640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f01031b0 0x7f70f0198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:20.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.900+0000 7f70f5b44640 1 --2- 172.21.15.69:0/1442627436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f0101fc0 0x7f70f01982f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.900+0000 7f70f5b44640 1 -- 172.21.15.69:0/1442627436 >> 172.21.15.69:0/1442627436 conn(0x7f70f00fd550 msgr2=0x7f70f01064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.900+0000 7f70f5b44640 1 -- 172.21.15.69:0/1442627436 shutdown_connections 2024-04-23T10:24:20.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:20.900+0000 7f70f5b44640 1 -- 172.21.15.69:0/1442627436 wait complete. 2024-04-23T10:24:21.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:21 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:21.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:21 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:21.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:21 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:21.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:21 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:21.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:21 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:21.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:21 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:21.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:21 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1442627436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:21.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:21 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.146:6832/318414865,v1:172.21.15.146:6833/318414865] up:boot 2024-04-23T10:24:21.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:21 smithi069 ceph-mon[29593]: fsmap 2 up:standby 2024-04-23T10:24:21.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:21 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T10:24:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:21 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:21 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:21 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:21 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:21 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:21 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:21 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1442627436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:21 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.146:6832/318414865,v1:172.21.15.146:6833/318414865] up:boot 2024-04-23T10:24:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:21 smithi146 ceph-mon[32800]: fsmap 2 up:standby 2024-04-23T10:24:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:21 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T10:24:21.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:21 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:21.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:21 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:21.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:21 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:21.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:21 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:21.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:21 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:21.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:21 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:21.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:21 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1442627436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:21.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:21 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.146:6832/318414865,v1:172.21.15.146:6833/318414865] up:boot 2024-04-23T10:24:21.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:21 smithi167 ceph-mon[32940]: fsmap 2 up:standby 2024-04-23T10:24:21.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:21 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T10:24:22.376 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:22 smithi069 ceph-mon[29593]: Deploying daemon mds.j on smithi069 2024-04-23T10:24:22.376 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:22 smithi069 ceph-mon[29593]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:22.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:22 smithi146 ceph-mon[32800]: Deploying daemon mds.j on smithi069 2024-04-23T10:24:22.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:22 smithi146 ceph-mon[32800]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:22.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:22 smithi167 ceph-mon[32940]: Deploying daemon mds.j on smithi069 2024-04-23T10:24:22.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:22 smithi167 ceph-mon[32940]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:22.742 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:24:22 smithi069 podman[67657]: 2024-04-23 10:24:22.622446696 +0000 UTC m=+0.141580404 container create b4575144dc0565b588b5287d30d3ea77a8542cc59b92bd38378ee777f7c6b48d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=) 2024-04-23T10:24:22.910 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:23.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.019+0000 7f5e8f060640 1 -- 172.21.15.69:0/589204560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e881031b0 msgr2=0x7f5e88103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.019+0000 7f5e8f060640 1 --2- 172.21.15.69:0/589204560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e881031b0 0x7f5e88103630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009900 tx=0x7f5e7402a410 comp rx=0 tx=0).stop 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.019+0000 7f5e8f060640 1 -- 172.21.15.69:0/589204560 shutdown_connections 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.019+0000 7f5e8f060640 1 --2- 172.21.15.69:0/589204560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e881031b0 0x7f5e88103630 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.019+0000 7f5e8f060640 1 --2- 172.21.15.69:0/589204560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e88103b70 0x7f5e8810a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.019+0000 7f5e8f060640 1 --2- 172.21.15.69:0/589204560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e88101fc0 0x7f5e881023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.019+0000 7f5e8f060640 1 -- 172.21.15.69:0/589204560 >> 172.21.15.69:0/589204560 conn(0x7f5e880fd530 msgr2=0x7f5e880ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.019+0000 7f5e8f060640 1 -- 172.21.15.69:0/589204560 shutdown_connections 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.019+0000 7f5e8f060640 1 -- 172.21.15.69:0/589204560 wait complete. 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8f060640 1 Processor -- start 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8f060640 1 -- start start 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8f060640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e88101fc0 0x7f5e88198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:23.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8f060640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e881031b0 0x7f5e88198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8f060640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e88103b70 0x7f5e8819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8f060640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8810dc20 con 0x7f5e88101fc0 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8f060640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8810daa0 con 0x7f5e881031b0 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8f060640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8810dda0 con 0x7f5e88103b70 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8cdfc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e88101fc0 0x7f5e88198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8cdfc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e88101fc0 0x7f5e88198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45890/0 (socket says 172.21.15.69:45890) 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8cdfc640 1 -- 172.21.15.69:0/803546155 learned_addr learned my addr 172.21.15.69:0/803546155 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8cdfc640 1 -- 172.21.15.69:0/803546155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e88103b70 msgr2=0x7f5e8819f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8cdfc640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e88103b70 0x7f5e8819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8cdfc640 1 -- 172.21.15.69:0/803546155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e881031b0 msgr2=0x7f5e88198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e87fff640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e881031b0 0x7f5e88198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:23.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8cdfc640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e881031b0 0x7f5e88198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:23.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.020+0000 7f5e8cdfc640 1 -- 172.21.15.69:0/803546155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8819fe40 con 0x7f5e88101fc0 2024-04-23T10:24:23.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.021+0000 7f5e8cdfc640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e88101fc0 0x7f5e88198220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00c970 tx=0x7f5e7c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:23.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.021+0000 7f5e85ffb640 1 -- 172.21.15.69:0/803546155 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c007c10 con 0x7f5e88101fc0 2024-04-23T10:24:23.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.021+0000 7f5e85ffb640 1 -- 172.21.15.69:0/803546155 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5e7c007db0 con 0x7f5e88101fc0 2024-04-23T10:24:23.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.021+0000 7f5e8f060640 1 -- 172.21.15.69:0/803546155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e881a0130 con 0x7f5e88101fc0 2024-04-23T10:24:23.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.021+0000 7f5e85ffb640 1 -- 172.21.15.69:0/803546155 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00f880 con 0x7f5e88101fc0 2024-04-23T10:24:23.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.021+0000 7f5e8f060640 1 -- 172.21.15.69:0/803546155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e881a0680 con 0x7f5e88101fc0 2024-04-23T10:24:23.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.022+0000 7f5e8f060640 1 -- 172.21.15.69:0/803546155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e881092e0 con 0x7f5e88101fc0 2024-04-23T10:24:23.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.023+0000 7f5e85ffb640 1 -- 172.21.15.69:0/803546155 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f5e7c00fa40 con 0x7f5e88101fc0 2024-04-23T10:24:23.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.023+0000 7f5e85ffb640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5e780a3bb0 0x7f5e780a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:23.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.024+0000 7f5e87fff640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5e780a3bb0 0x7f5e780a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:23.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.024+0000 7f5e85ffb640 1 -- 172.21.15.69:0/803546155 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f5e7c0d0350 con 0x7f5e88101fc0 2024-04-23T10:24:23.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.024+0000 7f5e87fff640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5e780a3bb0 0x7f5e780a6070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5e74031570 tx=0x7f5e74000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:23.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.028+0000 7f5e85ffb640 1 -- 172.21.15.69:0/803546155 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5e7c09d260 con 0x7f5e88101fc0 2024-04-23T10:24:23.242 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:24:22 smithi069 podman[67657]: 2024-04-23 10:24:22.891730928 +0000 UTC m=+0.410864633 container init b4575144dc0565b588b5287d30d3ea77a8542cc59b92bd38378ee777f7c6b48d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-23T10:24:23.242 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:24:22 smithi069 podman[67657]: 2024-04-23 10:24:22.894388024 +0000 UTC m=+0.413521732 container start b4575144dc0565b588b5287d30d3ea77a8542cc59b92bd38378ee777f7c6b48d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-j, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-04-23T10:24:23.243 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:24:22 smithi069 ceph-mds[67676]: -- 172.21.15.69:0/786512747 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56345fba1a40 con 0x56345fb75000 2024-04-23T10:24:23.243 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:24:22 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-j[67672]: starting mds.j at 2024-04-23T10:24:23.243 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:24:22 smithi069 bash[67657]: b4575144dc0565b588b5287d30d3ea77a8542cc59b92bd38378ee777f7c6b48d 2024-04-23T10:24:23.243 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:24:22 smithi069 systemd[1]: Started Ceph mds.j for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:23.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.261+0000 7f5e8f060640 1 -- 172.21.15.69:0/803546155 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e88062b50 con 0x7f5e88101fc0 2024-04-23T10:24:23.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.262+0000 7f5e85ffb640 1 -- 172.21.15.69:0/803546155 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3040 (secure 0 0 0) 0x7f5e7c09cb60 con 0x7f5e88101fc0 2024-04-23T10:24:23.261 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:23.261 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-23T10:24:23.261 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 4 2024-04-23T10:24:23.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 -- 172.21.15.69:0/803546155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5e780a3bb0 msgr2=0x7f5e780a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:23.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5e780a3bb0 0x7f5e780a6070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5e74031570 tx=0x7f5e74000bc0 comp rx=0 tx=0).stop 2024-04-23T10:24:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 -- 172.21.15.69:0/803546155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e88101fc0 msgr2=0x7f5e88198220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e88101fc0 0x7f5e88198220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00c970 tx=0x7f5e7c00ce30 comp rx=0 tx=0).stop 2024-04-23T10:24:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 -- 172.21.15.69:0/803546155 shutdown_connections 2024-04-23T10:24:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5e780a3bb0 0x7f5e780a6070 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e88103b70 0x7f5e8819f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e881031b0 0x7f5e88198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 --2- 172.21.15.69:0/803546155 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e88101fc0 0x7f5e88198220 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 -- 172.21.15.69:0/803546155 >> 172.21.15.69:0/803546155 conn(0x7f5e880fd530 msgr2=0x7f5e881064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 -- 172.21.15.69:0/803546155 shutdown_connections 2024-04-23T10:24:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:23.264+0000 7f5e8f060640 1 -- 172.21.15.69:0/803546155 wait complete. 2024-04-23T10:24:24.299 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:24.299 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:24.299 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:24.299 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:24.299 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:24.299 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:24.299 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:24.300 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: Deploying daemon mds.d on smithi069 2024-04-23T10:24:24.300 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.69:6834/731475212,v1:172.21.15.69:6835/731475212] up:boot 2024-04-23T10:24:24.300 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: fsmap 3 up:standby 2024-04-23T10:24:24.300 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T10:24:24.300 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:24 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/803546155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:24.407 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:24.407 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:24.407 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:24.407 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:24.407 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:24.407 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:24.407 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:24.407 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: Deploying daemon mds.d on smithi069 2024-04-23T10:24:24.407 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.69:6834/731475212,v1:172.21.15.69:6835/731475212] up:boot 2024-04-23T10:24:24.407 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: fsmap 3 up:standby 2024-04-23T10:24:24.408 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T10:24:24.408 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:24 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/803546155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: Deploying daemon mds.d on smithi069 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.69:6834/731475212,v1:172.21.15.69:6835/731475212] up:boot 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: fsmap 3 up:standby 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T10:24:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:24 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/803546155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:25.275 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.386+0000 7f7ae26ae640 1 -- 172.21.15.69:0/2882940258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7adc100e90 msgr2=0x7f7adc1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.386+0000 7f7ae26ae640 1 --2- 172.21.15.69:0/2882940258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7adc100e90 0x7f7adc1012b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009900 tx=0x7f7acc02a410 comp rx=0 tx=0).stop 2024-04-23T10:24:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.386+0000 7f7ae26ae640 1 -- 172.21.15.69:0/2882940258 shutdown_connections 2024-04-23T10:24:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.386+0000 7f7ae26ae640 1 --2- 172.21.15.69:0/2882940258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7adc1029a0 0x7f7adc1092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.386+0000 7f7ae26ae640 1 --2- 172.21.15.69:0/2882940258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc101fe0 0x7f7adc102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.386+0000 7f7ae26ae640 1 --2- 172.21.15.69:0/2882940258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7adc100e90 0x7f7adc1012b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.386+0000 7f7ae26ae640 1 -- 172.21.15.69:0/2882940258 >> 172.21.15.69:0/2882940258 conn(0x7f7adc0fc400 msgr2=0x7f7adc0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.387+0000 7f7ae26ae640 1 -- 172.21.15.69:0/2882940258 shutdown_connections 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.387+0000 7f7ae26ae640 1 -- 172.21.15.69:0/2882940258 wait complete. 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.387+0000 7f7ae26ae640 1 Processor -- start 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.387+0000 7f7ae26ae640 1 -- start start 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.387+0000 7f7ae26ae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc100e90 0x7f7adc104e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.387+0000 7f7ae26ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7adc101fe0 0x7f7adc103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.387+0000 7f7ae26ae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7adc1029a0 0x7f7adc103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.387+0000 7f7ae26ae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc10cba0 con 0x7f7adc1029a0 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.387+0000 7f7ae26ae640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc10ca20 con 0x7f7adc101fe0 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.387+0000 7f7ae26ae640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc10cd20 con 0x7f7adc100e90 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ae0c4b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7adc1029a0 0x7f7adc103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ae0c4b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7adc1029a0 0x7f7adc103990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45922/0 (socket says 172.21.15.69:45922) 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ae0c4b640 1 -- 172.21.15.69:0/3157401497 learned_addr learned my addr 172.21.15.69:0/3157401497 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7adb7fe640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7adc101fe0 0x7f7adc103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7adbfff640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc100e90 0x7f7adc104e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:25.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ae0c4b640 1 -- 172.21.15.69:0/3157401497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc100e90 msgr2=0x7f7adc104e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:25.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ae0c4b640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc100e90 0x7f7adc104e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:25.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ae0c4b640 1 -- 172.21.15.69:0/3157401497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7adc101fe0 msgr2=0x7f7adc103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:25.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ae0c4b640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7adc101fe0 0x7f7adc103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:25.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ae0c4b640 1 -- 172.21.15.69:0/3157401497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc104220 con 0x7f7adc1029a0 2024-04-23T10:24:25.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ae0c4b640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7adc1029a0 0x7f7adc103990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400b970 tx=0x7f7ad400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:25.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ad97fa640 1 -- 172.21.15.69:0/3157401497 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4019070 con 0x7f7adc1029a0 2024-04-23T10:24:25.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ad97fa640 1 -- 172.21.15.69:0/3157401497 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7ad400cb40 con 0x7f7adc1029a0 2024-04-23T10:24:25.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ae26ae640 1 -- 172.21.15.69:0/3157401497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7adc1a2490 con 0x7f7adc1029a0 2024-04-23T10:24:25.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ad97fa640 1 -- 172.21.15.69:0/3157401497 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4007650 con 0x7f7adc1029a0 2024-04-23T10:24:25.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.388+0000 7f7ae26ae640 1 -- 172.21.15.69:0/3157401497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7adc1a2a10 con 0x7f7adc1029a0 2024-04-23T10:24:25.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.389+0000 7f7ae26ae640 1 -- 172.21.15.69:0/3157401497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7adc1a2d30 con 0x7f7adc1029a0 2024-04-23T10:24:25.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.390+0000 7f7ad97fa640 1 -- 172.21.15.69:0/3157401497 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f7ad401c070 con 0x7f7adc1029a0 2024-04-23T10:24:25.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.391+0000 7f7ad97fa640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ac40a3bb0 0x7f7ac40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:25.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.391+0000 7f7adbfff640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ac40a3bb0 0x7f7ac40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.391+0000 7f7ad97fa640 1 -- 172.21.15.69:0/3157401497 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f7ad40cf560 con 0x7f7adc1029a0 2024-04-23T10:24:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.392+0000 7f7adbfff640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ac40a3bb0 0x7f7ac40a6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.396+0000 7f7ad97fa640 1 -- 172.21.15.69:0/3157401497 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7ad409bd90 con 0x7f7adc1029a0 2024-04-23T10:24:25.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.615+0000 7f7ae26ae640 1 -- 172.21.15.69:0/3157401497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7adc1a3380 con 0x7f7adc1029a0 2024-04-23T10:24:25.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.615+0000 7f7ad97fa640 1 -- 172.21.15.69:0/3157401497 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3040 (secure 0 0 0) 0x7f7ad40a0090 con 0x7f7adc1029a0 2024-04-23T10:24:25.615 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:25.615 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-23T10:24:25.615 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 4 2024-04-23T10:24:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 -- 172.21.15.69:0/3157401497 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ac40a3bb0 msgr2=0x7f7ac40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:25.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ac40a3bb0 0x7f7ac40a6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc031510 comp rx=0 tx=0).stop 2024-04-23T10:24:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 -- 172.21.15.69:0/3157401497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7adc1029a0 msgr2=0x7f7adc103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7adc1029a0 0x7f7adc103990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400b970 tx=0x7f7ad400be30 comp rx=0 tx=0).stop 2024-04-23T10:24:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 -- 172.21.15.69:0/3157401497 shutdown_connections 2024-04-23T10:24:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ac40a3bb0 0x7f7ac40a6070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7adc1029a0 0x7f7adc103990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7adc101fe0 0x7f7adc103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 --2- 172.21.15.69:0/3157401497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc100e90 0x7f7adc104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 -- 172.21.15.69:0/3157401497 >> 172.21.15.69:0/3157401497 conn(0x7f7adc0fc400 msgr2=0x7f7adc0fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 -- 172.21.15.69:0/3157401497 shutdown_connections 2024-04-23T10:24:25.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:25.617+0000 7f7ae26ae640 1 -- 172.21.15.69:0/3157401497 wait complete. 2024-04-23T10:24:25.992 INFO:journalctl@ceph.mds.d.smithi069.stdout:Apr 23 10:24:25 smithi069 systemd[1]: Started Ceph mds.d for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:26 smithi167 ceph-mon[32940]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:26 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3157401497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:26 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:26 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:26 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:26 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:26 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:26 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:26.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:26 smithi146 ceph-mon[32800]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:26.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:26 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3157401497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:26.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:26 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:26.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:26 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:26.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:26 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:26.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:26 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:26.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:26 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:26.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:26 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:26.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:26 smithi069 ceph-mon[29593]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:26.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:26 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3157401497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:26.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:26 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:26.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:26 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:26.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:26 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:26.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:26 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:26.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:26 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:26.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:26 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:27.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:27 smithi146 ceph-mon[32800]: Deploying daemon mds.e on smithi146 2024-04-23T10:24:27.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:27 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.69:6836/3924839786,v1:172.21.15.69:6837/3924839786] up:boot 2024-04-23T10:24:27.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:27 smithi146 ceph-mon[32800]: fsmap 4 up:standby 2024-04-23T10:24:27.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:27 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T10:24:27.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:27 smithi167 ceph-mon[32940]: Deploying daemon mds.e on smithi146 2024-04-23T10:24:27.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:27 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.69:6836/3924839786,v1:172.21.15.69:6837/3924839786] up:boot 2024-04-23T10:24:27.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:27 smithi167 ceph-mon[32940]: fsmap 4 up:standby 2024-04-23T10:24:27.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:27 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T10:24:27.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:27 smithi069 ceph-mon[29593]: Deploying daemon mds.e on smithi146 2024-04-23T10:24:27.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:27 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.69:6836/3924839786,v1:172.21.15.69:6837/3924839786] up:boot 2024-04-23T10:24:27.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:27 smithi069 ceph-mon[29593]: fsmap 4 up:standby 2024-04-23T10:24:27.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:27 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T10:24:27.628 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:27.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.740+0000 7fee844c2640 1 -- 172.21.15.69:0/511226661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7c105350 msgr2=0x7fee7c107740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:27.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.740+0000 7fee844c2640 1 --2- 172.21.15.69:0/511226661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7c105350 0x7fee7c107740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009900 tx=0x7fee6c02a410 comp rx=0 tx=0).stop 2024-04-23T10:24:27.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 -- 172.21.15.69:0/511226661 shutdown_connections 2024-04-23T10:24:27.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 --2- 172.21.15.69:0/511226661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7c105350 0x7fee7c107740 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 --2- 172.21.15.69:0/511226661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee7c107c80 0x7fee7c10a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 --2- 172.21.15.69:0/511226661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7c102a20 0x7fee7c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 -- 172.21.15.69:0/511226661 >> 172.21.15.69:0/511226661 conn(0x7fee7c0fc430 msgr2=0x7fee7c0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:27.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 -- 172.21.15.69:0/511226661 shutdown_connections 2024-04-23T10:24:27.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 -- 172.21.15.69:0/511226661 wait complete. 2024-04-23T10:24:27.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 Processor -- start 2024-04-23T10:24:27.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 -- start start 2024-04-23T10:24:27.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7c102a20 0x7fee7c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:27.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7c105350 0x7fee7c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:27.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee7c107c80 0x7fee7c19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:27.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c10dc00 con 0x7fee7c105350 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c10da80 con 0x7fee7c102a20 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.741+0000 7fee844c2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c10dd80 con 0x7fee7c107c80 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee81a5d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7c105350 0x7fee7c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee81a5d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7c105350 0x7fee7c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45944/0 (socket says 172.21.15.69:45944) 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee81a5d640 1 -- 172.21.15.69:0/2933385563 learned_addr learned my addr 172.21.15.69:0/2933385563 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee8225e640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7c102a20 0x7fee7c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee81a5d640 1 -- 172.21.15.69:0/2933385563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee7c107c80 msgr2=0x7fee7c19f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee82a5f640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee7c107c80 0x7fee7c19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee81a5d640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee7c107c80 0x7fee7c19f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee81a5d640 1 -- 172.21.15.69:0/2933385563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7c102a20 msgr2=0x7fee7c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee81a5d640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7c102a20 0x7fee7c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee81a5d640 1 -- 172.21.15.69:0/2933385563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c19ff20 con 0x7fee7c105350 2024-04-23T10:24:27.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee8225e640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7c102a20 0x7fee7c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:27.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee81a5d640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7c105350 0x7fee7c198840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee6c006010 tx=0x7fee6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:27.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee737fe640 1 -- 172.21.15.69:0/2933385563 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c03f030 con 0x7fee7c105350 2024-04-23T10:24:27.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee737fe640 1 -- 172.21.15.69:0/2933385563 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee6c003cd0 con 0x7fee7c105350 2024-04-23T10:24:27.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee844c2640 1 -- 172.21.15.69:0/2933385563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7c1a01b0 con 0x7fee7c105350 2024-04-23T10:24:27.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee737fe640 1 -- 172.21.15.69:0/2933385563 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c035070 con 0x7fee7c105350 2024-04-23T10:24:27.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.742+0000 7fee844c2640 1 -- 172.21.15.69:0/2933385563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7c1a06f0 con 0x7fee7c105350 2024-04-23T10:24:27.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.743+0000 7fee844c2640 1 -- 172.21.15.69:0/2933385563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7c0fdf20 con 0x7fee7c105350 2024-04-23T10:24:27.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.744+0000 7fee737fe640 1 -- 172.21.15.69:0/2933385563 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fee6c042030 con 0x7fee7c105350 2024-04-23T10:24:27.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.745+0000 7fee737fe640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fee680a3c30 0x7fee680a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:27.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.745+0000 7fee8225e640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fee680a3c30 0x7fee680a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:27.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.745+0000 7fee737fe640 1 -- 172.21.15.69:0/2933385563 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fee6c0f0940 con 0x7fee7c105350 2024-04-23T10:24:27.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.745+0000 7fee8225e640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fee680a3c30 0x7fee680a60f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee78009c20 tx=0x7fee78005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:27.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.749+0000 7fee737fe640 1 -- 172.21.15.69:0/2933385563 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fee6c0bd7c0 con 0x7fee7c105350 2024-04-23T10:24:27.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.963+0000 7fee844c2640 1 -- 172.21.15.69:0/2933385563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee7c02d5c0 con 0x7fee7c105350 2024-04-23T10:24:27.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.963+0000 7fee737fe640 1 -- 172.21.15.69:0/2933385563 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3865 (secure 0 0 0) 0x7fee6c0bd0c0 con 0x7fee7c105350 2024-04-23T10:24:27.962 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:27.962 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-23T10:24:27.962 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 5 2024-04-23T10:24:27.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 -- 172.21.15.69:0/2933385563 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fee680a3c30 msgr2=0x7fee680a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:27.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fee680a3c30 0x7fee680a60f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee78009c20 tx=0x7fee78005f90 comp rx=0 tx=0).stop 2024-04-23T10:24:27.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 -- 172.21.15.69:0/2933385563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7c105350 msgr2=0x7fee7c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:27.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7c105350 0x7fee7c198840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee6c006010 tx=0x7fee6c0042f0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 -- 172.21.15.69:0/2933385563 shutdown_connections 2024-04-23T10:24:27.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fee680a3c30 0x7fee680a60f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7c105350 0x7fee7c198840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee7c107c80 0x7fee7c19f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 --2- 172.21.15.69:0/2933385563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7c102a20 0x7fee7c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:27.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 -- 172.21.15.69:0/2933385563 >> 172.21.15.69:0/2933385563 conn(0x7fee7c0fc430 msgr2=0x7fee7c1034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:27.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 -- 172.21.15.69:0/2933385563 shutdown_connections 2024-04-23T10:24:27.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:27.965+0000 7fee844c2640 1 -- 172.21.15.69:0/2933385563 wait complete. 2024-04-23T10:24:28.067 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:24:27 smithi146 systemd[1]: Starting Ceph mds.e for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:24:28.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:28 smithi069 ceph-mon[29593]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:28.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:28 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2933385563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:28 smithi167 ceph-mon[32940]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:28 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2933385563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:28.351 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:28 smithi146 ceph-mon[32800]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:28.351 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:28 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2933385563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:28.351 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:24:28 smithi146 podman[61739]: 2024-04-23 10:24:28.104061204 +0000 UTC m=+0.018079666 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:24:28.351 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:24:28 smithi146 podman[61739]: 2024-04-23 10:24:28.235922987 +0000 UTC m=+0.149941437 container create b35ec06be20e1d82705247a89928f38ef27ff3ad755c5b46fa17d82b923710ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-23T10:24:28.678 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:24:28 smithi146 podman[61739]: 2024-04-23 10:24:28.471970647 +0000 UTC m=+0.385989095 container init b35ec06be20e1d82705247a89928f38ef27ff3ad755c5b46fa17d82b923710ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-23T10:24:28.678 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:24:28 smithi146 podman[61739]: 2024-04-23 10:24:28.475203394 +0000 UTC m=+0.389221843 container start b35ec06be20e1d82705247a89928f38ef27ff3ad755c5b46fa17d82b923710ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416) 2024-04-23T10:24:28.678 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:24:28 smithi146 ceph-mds[61758]: -- 172.21.15.146:0/1806761504 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56060a077a40 con 0x56060a04b000 2024-04-23T10:24:28.678 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:24:28 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e[61754]: starting mds.e at 2024-04-23T10:24:28.678 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:24:28 smithi146 bash[61739]: b35ec06be20e1d82705247a89928f38ef27ff3ad755c5b46fa17d82b923710ab 2024-04-23T10:24:28.678 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:24:28 smithi146 systemd[1]: Started Ceph mds.e for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:29.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:29 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:29.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:29 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:29.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:29 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:29.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:29 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:29.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:29 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:29.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:29 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:29.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:29 smithi146 ceph-mon[32800]: Deploying daemon mds.f on smithi167 2024-04-23T10:24:29.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:29 smithi146 ceph-mon[32800]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:29.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:29 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] up:boot 2024-04-23T10:24:29.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:29 smithi146 ceph-mon[32800]: fsmap 5 up:standby 2024-04-23T10:24:29.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:29 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T10:24:29.976 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:29.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:29.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:29.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:29.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:29.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:29.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:29.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:29 smithi069 ceph-mon[29593]: Deploying daemon mds.f on smithi167 2024-04-23T10:24:29.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:29 smithi069 ceph-mon[29593]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:29.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:29 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] up:boot 2024-04-23T10:24:29.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:29 smithi069 ceph-mon[29593]: fsmap 5 up:standby 2024-04-23T10:24:29.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:29 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T10:24:30.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:29 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:29 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:29 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:29 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:29 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:29 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:29 smithi167 ceph-mon[32940]: Deploying daemon mds.f on smithi167 2024-04-23T10:24:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:29 smithi167 ceph-mon[32940]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:29 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] up:boot 2024-04-23T10:24:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:29 smithi167 ceph-mon[32940]: fsmap 5 up:standby 2024-04-23T10:24:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:29 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T10:24:30.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.088+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1352120307 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08075f90 msgr2=0x7fbf080743e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.088+0000 7fbf0fb68640 1 --2- 172.21.15.69:0/1352120307 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08075f90 0x7fbf080743e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009900 tx=0x7fbf0402a410 comp rx=0 tx=0).stop 2024-04-23T10:24:30.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.088+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1352120307 shutdown_connections 2024-04-23T10:24:30.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.088+0000 7fbf0fb68640 1 --2- 172.21.15.69:0/1352120307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf08109e60 0x7fbf0810c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.088+0000 7fbf0fb68640 1 --2- 172.21.15.69:0/1352120307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf080749b0 0x7fbf08074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.088+0000 7fbf0fb68640 1 --2- 172.21.15.69:0/1352120307 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08075f90 0x7fbf080743e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.088+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1352120307 >> 172.21.15.69:0/1352120307 conn(0x7fbf080fd530 msgr2=0x7fbf080ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.088+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1352120307 shutdown_connections 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.088+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1352120307 wait complete. 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0fb68640 1 Processor -- start 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0fb68640 1 -- start start 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0fb68640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf080749b0 0x7fbf0819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0fb68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf08075f90 0x7fbf0819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0fb68640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08109e60 0x7fbf081a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0fb68640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0810fdf0 con 0x7fbf08109e60 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0fb68640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0810fc70 con 0x7fbf08075f90 2024-04-23T10:24:30.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0fb68640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0810ff70 con 0x7fbf080749b0 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0e105640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08109e60 0x7fbf081a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0e105640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08109e60 0x7fbf081a1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36120/0 (socket says 172.21.15.69:36120) 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0e105640 1 -- 172.21.15.69:0/1419763759 learned_addr learned my addr 172.21.15.69:0/1419763759 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0d904640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf080749b0 0x7fbf0819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0e105640 1 -- 172.21.15.69:0/1419763759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf080749b0 msgr2=0x7fbf0819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0e105640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf080749b0 0x7fbf0819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0d103640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf08075f90 0x7fbf0819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0e105640 1 -- 172.21.15.69:0/1419763759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf08075f90 msgr2=0x7fbf0819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0e105640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf08075f90 0x7fbf0819aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.089+0000 7fbf0e105640 1 -- 172.21.15.69:0/1419763759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf081a2110 con 0x7fbf08109e60 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.090+0000 7fbf0e105640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08109e60 0x7fbf081a1aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009fd0 tx=0x7fbf0000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.090+0000 7fbefeffd640 1 -- 172.21.15.69:0/1419763759 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00017070 con 0x7fbf08109e60 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.090+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1419763759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf081a2400 con 0x7fbf08109e60 2024-04-23T10:24:30.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.090+0000 7fbefeffd640 1 -- 172.21.15.69:0/1419763759 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf00003e40 con 0x7fbf08109e60 2024-04-23T10:24:30.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.090+0000 7fbefeffd640 1 -- 172.21.15.69:0/1419763759 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00004820 con 0x7fbf08109e60 2024-04-23T10:24:30.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.090+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1419763759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf081a2900 con 0x7fbf08109e60 2024-04-23T10:24:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.091+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1419763759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf08108b90 con 0x7fbf08109e60 2024-04-23T10:24:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.092+0000 7fbefeffd640 1 -- 172.21.15.69:0/1419763759 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fbf00003970 con 0x7fbf08109e60 2024-04-23T10:24:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.093+0000 7fbefeffd640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbef40a3bb0 0x7fbef40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.093+0000 7fbf0d904640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbef40a3bb0 0x7fbef40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.093+0000 7fbefeffd640 1 -- 172.21.15.69:0/1419763759 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fbf000cfdd0 con 0x7fbf08109e60 2024-04-23T10:24:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.093+0000 7fbf0d904640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbef40a3bb0 0x7fbef40a6070 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf04000c00 tx=0x7fbf04031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:30.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.097+0000 7fbefeffd640 1 -- 172.21.15.69:0/1419763759 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbf00003c60 con 0x7fbf08109e60 2024-04-23T10:24:30.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.310+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1419763759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf08062b50 con 0x7fbf08109e60 2024-04-23T10:24:30.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.311+0000 7fbefeffd640 1 -- 172.21.15.69:0/1419763759 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4693 (secure 0 0 0) 0x7fbf0009cc50 con 0x7fbf08109e60 2024-04-23T10:24:30.310 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:30.310 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-23T10:24:30.310 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 6 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1419763759 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbef40a3bb0 msgr2=0x7fbef40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbef40a3bb0 0x7fbef40a6070 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf04000c00 tx=0x7fbf04031510 comp rx=0 tx=0).stop 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1419763759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08109e60 msgr2=0x7fbf081a1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08109e60 0x7fbf081a1aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009fd0 tx=0x7fbf0000b260 comp rx=0 tx=0).stop 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1419763759 shutdown_connections 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbef40a3bb0 0x7fbef40a6070 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08109e60 0x7fbf081a1aa0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf08075f90 0x7fbf0819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 --2- 172.21.15.69:0/1419763759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf080749b0 0x7fbf0819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1419763759 >> 172.21.15.69:0/1419763759 conn(0x7fbf080fd530 msgr2=0x7fbf08105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1419763759 shutdown_connections 2024-04-23T10:24:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:30.313+0000 7fbf0fb68640 1 -- 172.21.15.69:0/1419763759 wait complete. 2024-04-23T10:24:30.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:30 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1419763759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:30.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:30 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1419763759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:31.018 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:30 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1419763759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:31.018 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:24:30 smithi167 systemd[1]: Starting Ceph mds.f for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:24:31.289 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:24:31 smithi167 podman[63267]: 2024-04-23 10:24:30.922924118 +0000 UTC m=+0.018010185 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:24:31.289 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:24:31 smithi167 podman[63267]: 2024-04-23 10:24:31.03807093 +0000 UTC m=+0.133157027 container create e7e7cde3c441e5bbd424fd99a266613e280d3216347c46e2b67d8da9c6d30561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, ceph=True) 2024-04-23T10:24:31.289 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:24:31 smithi167 podman[63267]: 2024-04-23 10:24:31.290863106 +0000 UTC m=+0.385949162 container init e7e7cde3c441e5bbd424fd99a266613e280d3216347c46e2b67d8da9c6d30561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-23T10:24:31.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:24:31 smithi167 podman[63267]: 2024-04-23 10:24:31.294042876 +0000 UTC m=+0.389128943 container start e7e7cde3c441e5bbd424fd99a266613e280d3216347c46e2b67d8da9c6d30561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:24:31.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:24:31 smithi167 ceph-mds[63286]: -- 172.21.15.167:0/455659875 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e1f4f8fa40 con 0x55e1f4f62800 2024-04-23T10:24:31.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:24:31 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: starting mds.f at 2024-04-23T10:24:31.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:24:31 smithi167 bash[63267]: e7e7cde3c441e5bbd424fd99a266613e280d3216347c46e2b67d8da9c6d30561 2024-04-23T10:24:31.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:24:31 smithi167 systemd[1]: Started Ceph mds.f for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:31.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:31 smithi146 ceph-mon[32800]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:31.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:31.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:31.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:31.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:31.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:31.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:31 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:31.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:31 smithi069 ceph-mon[29593]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:31.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:31.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:31.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:31.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:31.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:31.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:31 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:32.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:31 smithi167 ceph-mon[32940]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:31 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:32.323 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:32.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.436+0000 7f26b0fc6640 1 -- 172.21.15.69:0/4213534274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac100ea0 msgr2=0x7f26ac1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.436+0000 7f26b0fc6640 1 --2- 172.21.15.69:0/4213534274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac100ea0 0x7f26ac1012c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f269c009900 tx=0x7f269c02a410 comp rx=0 tx=0).stop 2024-04-23T10:24:32.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.437+0000 7f26b0fc6640 1 -- 172.21.15.69:0/4213534274 shutdown_connections 2024-04-23T10:24:32.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.437+0000 7f26b0fc6640 1 --2- 172.21.15.69:0/4213534274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26ac1029b0 0x7f26ac1092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.437+0000 7f26b0fc6640 1 --2- 172.21.15.69:0/4213534274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26ac101ff0 0x7f26ac102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.437+0000 7f26b0fc6640 1 --2- 172.21.15.69:0/4213534274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac100ea0 0x7f26ac1012c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.437+0000 7f26b0fc6640 1 -- 172.21.15.69:0/4213534274 >> 172.21.15.69:0/4213534274 conn(0x7f26ac0fc430 msgr2=0x7f26ac0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:32.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.437+0000 7f26b0fc6640 1 -- 172.21.15.69:0/4213534274 shutdown_connections 2024-04-23T10:24:32.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.437+0000 7f26b0fc6640 1 -- 172.21.15.69:0/4213534274 wait complete. 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.437+0000 7f26b0fc6640 1 Processor -- start 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.437+0000 7f26b0fc6640 1 -- start start 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26b0fc6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac100ea0 0x7f26ac1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26b0fc6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26ac101ff0 0x7f26ac1976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26b0fc6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26ac1029b0 0x7f26ac19e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26b0fc6640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac10cb30 con 0x7f26ac100ea0 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26b0fc6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac10c9b0 con 0x7f26ac101ff0 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26b0fc6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac10ccb0 con 0x7f26ac1029b0 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26aa59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac100ea0 0x7f26ac1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26aa59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac100ea0 0x7f26ac1971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36126/0 (socket says 172.21.15.69:36126) 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26aa59c640 1 -- 172.21.15.69:0/3475319072 learned_addr learned my addr 172.21.15.69:0/3475319072 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:32.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26a9d9b640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26ac101ff0 0x7f26ac1976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26aa59c640 1 -- 172.21.15.69:0/3475319072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26ac1029b0 msgr2=0x7f26ac19e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26aad9d640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26ac1029b0 0x7f26ac19e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26aa59c640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26ac1029b0 0x7f26ac19e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26aa59c640 1 -- 172.21.15.69:0/3475319072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26ac101ff0 msgr2=0x7f26ac1976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26aa59c640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26ac101ff0 0x7f26ac1976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26aa59c640 1 -- 172.21.15.69:0/3475319072 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac19edd0 con 0x7f26ac100ea0 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26a9d9b640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26ac101ff0 0x7f26ac1976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26aa59c640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac100ea0 0x7f26ac1971b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f269c005940 tx=0x7f269c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f269b7fe640 1 -- 172.21.15.69:0/3475319072 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c046070 con 0x7f26ac100ea0 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f269b7fe640 1 -- 172.21.15.69:0/3475319072 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f269c003ac0 con 0x7f26ac100ea0 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26b0fc6640 1 -- 172.21.15.69:0/3475319072 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ac06a5b0 con 0x7f26ac100ea0 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f269b7fe640 1 -- 172.21.15.69:0/3475319072 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c035050 con 0x7f26ac100ea0 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.438+0000 7f26b0fc6640 1 -- 172.21.15.69:0/3475319072 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ac06aaf0 con 0x7f26ac100ea0 2024-04-23T10:24:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.439+0000 7f26b0fc6640 1 -- 172.21.15.69:0/3475319072 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26ac0691c0 con 0x7f26ac100ea0 2024-04-23T10:24:32.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.440+0000 7f269b7fe640 1 -- 172.21.15.69:0/3475319072 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f269c049070 con 0x7f26ac100ea0 2024-04-23T10:24:32.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.441+0000 7f269b7fe640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f26940a3c30 0x7f26940a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.441+0000 7f26a9d9b640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f26940a3c30 0x7f26940a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.441+0000 7f269b7fe640 1 -- 172.21.15.69:0/3475319072 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f269c0f1c40 con 0x7f26ac100ea0 2024-04-23T10:24:32.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.442+0000 7f26a9d9b640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f26940a3c30 0x7f26940a60f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f26ac1986c0 tx=0x7f26a0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:32.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.446+0000 7f269b7fe640 1 -- 172.21.15.69:0/3475319072 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f269c0beac0 con 0x7f26ac100ea0 2024-04-23T10:24:32.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.662+0000 7f26b0fc6640 1 -- 172.21.15.69:0/3475319072 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26ac107db0 con 0x7f26ac100ea0 2024-04-23T10:24:32.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.663+0000 7f269b7fe640 1 -- 172.21.15.69:0/3475319072 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5521 (secure 0 0 0) 0x7f269c0be3c0 con 0x7f26ac100ea0 2024-04-23T10:24:32.662 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:32.662 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-23T10:24:32.662 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 7 2024-04-23T10:24:32.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 -- 172.21.15.69:0/3475319072 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f26940a3c30 msgr2=0x7f26940a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f26940a3c30 0x7f26940a60f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f26ac1986c0 tx=0x7f26a0005f90 comp rx=0 tx=0).stop 2024-04-23T10:24:32.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 -- 172.21.15.69:0/3475319072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac100ea0 msgr2=0x7f26ac1971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac100ea0 0x7f26ac1971b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f269c005940 tx=0x7f269c004270 comp rx=0 tx=0).stop 2024-04-23T10:24:32.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 -- 172.21.15.69:0/3475319072 shutdown_connections 2024-04-23T10:24:32.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f26940a3c30 0x7f26940a60f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26ac1029b0 0x7f26ac19e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26ac101ff0 0x7f26ac1976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 --2- 172.21.15.69:0/3475319072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac100ea0 0x7f26ac1971b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 -- 172.21.15.69:0/3475319072 >> 172.21.15.69:0/3475319072 conn(0x7f26ac0fc430 msgr2=0x7f26ac105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:32.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 -- 172.21.15.69:0/3475319072 shutdown_connections 2024-04-23T10:24:32.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:32.665+0000 7f26b0fc6640 1 -- 172.21.15.69:0/3475319072 wait complete. 2024-04-23T10:24:32.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:32 smithi167 ceph-mon[32940]: Deploying daemon mds.c on smithi167 2024-04-23T10:24:32.849 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:32 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6834/2993393777,v1:172.21.15.167:6835/2993393777] up:boot 2024-04-23T10:24:32.849 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:32 smithi167 ceph-mon[32940]: fsmap 6 up:standby 2024-04-23T10:24:32.849 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:32 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:24:32.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:32 smithi146 ceph-mon[32800]: Deploying daemon mds.c on smithi167 2024-04-23T10:24:32.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:32 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6834/2993393777,v1:172.21.15.167:6835/2993393777] up:boot 2024-04-23T10:24:32.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:32 smithi146 ceph-mon[32800]: fsmap 6 up:standby 2024-04-23T10:24:32.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:32 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:24:32.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:32 smithi069 ceph-mon[29593]: Deploying daemon mds.c on smithi167 2024-04-23T10:24:32.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:32 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6834/2993393777,v1:172.21.15.167:6835/2993393777] up:boot 2024-04-23T10:24:32.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:32 smithi069 ceph-mon[29593]: fsmap 6 up:standby 2024-04-23T10:24:32.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:32 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:24:33.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:33 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3475319072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:33.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:33 smithi167 ceph-mon[32940]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:33.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:33 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3475319072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:33.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:33 smithi146 ceph-mon[32800]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:33.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:33 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3475319072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:33.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:33 smithi069 ceph-mon[29593]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:34.582 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:24:34 smithi167 systemd[1]: Started Ceph mds.c for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:34.675 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:34.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.787+0000 7f5ad4cae640 1 -- 172.21.15.69:0/1717497426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ad0102a10 msgr2=0x7f5ad0104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.787+0000 7f5ad4cae640 1 --2- 172.21.15.69:0/1717497426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ad0102a10 0x7f5ad0104e00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009900 tx=0x7f5ac402a410 comp rx=0 tx=0).stop 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.787+0000 7f5ad4cae640 1 -- 172.21.15.69:0/1717497426 shutdown_connections 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.787+0000 7f5ad4cae640 1 --2- 172.21.15.69:0/1717497426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad0107c70 0x7f5ad010a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.787+0000 7f5ad4cae640 1 --2- 172.21.15.69:0/1717497426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad0105340 0x7f5ad0107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.787+0000 7f5ad4cae640 1 --2- 172.21.15.69:0/1717497426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ad0102a10 0x7f5ad0104e00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.787+0000 7f5ad4cae640 1 -- 172.21.15.69:0/1717497426 >> 172.21.15.69:0/1717497426 conn(0x7f5ad00fc400 msgr2=0x7f5ad00fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.787+0000 7f5ad4cae640 1 -- 172.21.15.69:0/1717497426 shutdown_connections 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.787+0000 7f5ad4cae640 1 -- 172.21.15.69:0/1717497426 wait complete. 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5ad4cae640 1 Processor -- start 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5ad4cae640 1 -- start start 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5ad4cae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad0102a10 0x7f5ad0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5ad4cae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad0105340 0x7f5ad01987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5ad4cae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ad0107c70 0x7f5ad019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5ad4cae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad010dc00 con 0x7f5ad0107c70 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5ad4cae640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad010da80 con 0x7f5ad0102a10 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5ad4cae640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad010dd80 con 0x7f5ad0105340 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5aced9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ad0107c70 0x7f5ad019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5aced9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ad0107c70 0x7f5ad019f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36134/0 (socket says 172.21.15.69:36134) 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5ace59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad0102a10 0x7f5ad0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5aced9d640 1 -- 172.21.15.69:0/2259350208 learned_addr learned my addr 172.21.15.69:0/2259350208 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5acdd9b640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad0105340 0x7f5ad01987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5aced9d640 1 -- 172.21.15.69:0/2259350208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad0105340 msgr2=0x7f5ad01987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5aced9d640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad0105340 0x7f5ad01987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5aced9d640 1 -- 172.21.15.69:0/2259350208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad0102a10 msgr2=0x7f5ad0198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5aced9d640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad0102a10 0x7f5ad0198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.788+0000 7f5aced9d640 1 -- 172.21.15.69:0/2259350208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad019fea0 con 0x7f5ad0107c70 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.789+0000 7f5aced9d640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ad0107c70 0x7f5ad019f830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800cce0 tx=0x7f5ac800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.789+0000 7f5abf7fe640 1 -- 172.21.15.69:0/2259350208 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800f450 con 0x7f5ad0107c70 2024-04-23T10:24:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.789+0000 7f5ad4cae640 1 -- 172.21.15.69:0/2259350208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad01a0190 con 0x7f5ad0107c70 2024-04-23T10:24:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.789+0000 7f5abf7fe640 1 -- 172.21.15.69:0/2259350208 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5ac800fac0 con 0x7f5ad0107c70 2024-04-23T10:24:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.789+0000 7f5abf7fe640 1 -- 172.21.15.69:0/2259350208 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8018be0 con 0x7f5ad0107c70 2024-04-23T10:24:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.789+0000 7f5ad4cae640 1 -- 172.21.15.69:0/2259350208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad01a0690 con 0x7f5ad0107c70 2024-04-23T10:24:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.790+0000 7f5ad4cae640 1 -- 172.21.15.69:0/2259350208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad00fdef0 con 0x7f5ad0107c70 2024-04-23T10:24:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.791+0000 7f5abf7fe640 1 -- 172.21.15.69:0/2259350208 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f5ac800fc70 con 0x7f5ad0107c70 2024-04-23T10:24:34.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.791+0000 7f5abf7fe640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5ab80a3bb0 0x7f5ab80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:34.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.792+0000 7f5ace59c640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5ab80a3bb0 0x7f5ab80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:34.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.792+0000 7f5abf7fe640 1 -- 172.21.15.69:0/2259350208 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f5ac80d0660 con 0x7f5ad0107c70 2024-04-23T10:24:34.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.792+0000 7f5ace59c640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5ab80a3bb0 0x7f5ab80a6070 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4000c00 tx=0x7f5ac4031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:34.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:34.796+0000 7f5abf7fe640 1 -- 172.21.15.69:0/2259350208 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5ac8014030 con 0x7f5ad0107c70 2024-04-23T10:24:35.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.017+0000 7f5ad4cae640 1 -- 172.21.15.69:0/2259350208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ad0062b50 con 0x7f5ad0107c70 2024-04-23T10:24:35.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.017+0000 7f5abf7fe640 1 -- 172.21.15.69:0/2259350208 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6349 (secure 0 0 0) 0x7f5ac809d4e0 con 0x7f5ad0107c70 2024-04-23T10:24:35.016 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:35.017 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-23T10:24:35.017 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2024-04-23T10:24:35.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.019+0000 7f5ad4cae640 1 -- 172.21.15.69:0/2259350208 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5ab80a3bb0 msgr2=0x7f5ab80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:35.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.019+0000 7f5ad4cae640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5ab80a3bb0 0x7f5ab80a6070 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4000c00 tx=0x7f5ac4031510 comp rx=0 tx=0).stop 2024-04-23T10:24:35.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.019+0000 7f5ad4cae640 1 -- 172.21.15.69:0/2259350208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ad0107c70 msgr2=0x7f5ad019f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:35.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.019+0000 7f5ad4cae640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ad0107c70 0x7f5ad019f830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800cce0 tx=0x7f5ac800a620 comp rx=0 tx=0).stop 2024-04-23T10:24:35.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.019+0000 7f5ad4cae640 1 -- 172.21.15.69:0/2259350208 shutdown_connections 2024-04-23T10:24:35.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.019+0000 7f5ad4cae640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5ab80a3bb0 0x7f5ab80a6070 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:35.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.019+0000 7f5ad4cae640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ad0107c70 0x7f5ad019f830 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.019+0000 7f5ad4cae640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ad0105340 0x7f5ad01987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.019+0000 7f5ad4cae640 1 --2- 172.21.15.69:0/2259350208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad0102a10 0x7f5ad0198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.019+0000 7f5ad4cae640 1 -- 172.21.15.69:0/2259350208 >> 172.21.15.69:0/2259350208 conn(0x7f5ad00fc400 msgr2=0x7f5ad0103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.020+0000 7f5ad4cae640 1 -- 172.21.15.69:0/2259350208 shutdown_connections 2024-04-23T10:24:35.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:35.020+0000 7f5ad4cae640 1 -- 172.21.15.69:0/2259350208 wait complete. 2024-04-23T10:24:35.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:35.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:35.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:35.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:35.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:35.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:35.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: Deploying daemon mds.h on smithi146 2024-04-23T10:24:35.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] up:boot 2024-04-23T10:24:35.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: fsmap 7 up:standby 2024-04-23T10:24:35.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T10:24:35.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:35.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:35 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2259350208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:35.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:35.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:35.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:35.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:35.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:35.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:35.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: Deploying daemon mds.h on smithi146 2024-04-23T10:24:35.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] up:boot 2024-04-23T10:24:35.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: fsmap 7 up:standby 2024-04-23T10:24:35.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T10:24:35.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:35.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:35 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2259350208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:35.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: Deploying daemon mds.h on smithi146 2024-04-23T10:24:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] up:boot 2024-04-23T10:24:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: fsmap 7 up:standby 2024-04-23T10:24:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T10:24:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:35 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2259350208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:36.428 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:24:36 smithi146 systemd[1]: Starting Ceph mds.h for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:24:36.841 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:24:36 smithi146 podman[62051]: 2024-04-23 10:24:36.484512104 +0000 UTC m=+0.018164143 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:24:36.841 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:24:36 smithi146 podman[62051]: 2024-04-23 10:24:36.607286777 +0000 UTC m=+0.140938806 container create 9bad60ebc270b44a055f27253e3b7e945bcd1ea2607f30bf562a3e18939a8335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-23T10:24:37.030 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.138+0000 7f43b03ad640 1 -- 172.21.15.69:0/2641512540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a8103b60 msgr2=0x7f43a810a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.138+0000 7f43b03ad640 1 --2- 172.21.15.69:0/2641512540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a8103b60 0x7f43a810a3f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009900 tx=0x7f43a002a410 comp rx=0 tx=0).stop 2024-04-23T10:24:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 -- 172.21.15.69:0/2641512540 shutdown_connections 2024-04-23T10:24:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 --2- 172.21.15.69:0/2641512540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a8103b60 0x7f43a810a3f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 --2- 172.21.15.69:0/2641512540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a81031a0 0x7f43a8103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 --2- 172.21.15.69:0/2641512540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a8101fb0 0x7f43a81023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:37.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 -- 172.21.15.69:0/2641512540 >> 172.21.15.69:0/2641512540 conn(0x7f43a80fd500 msgr2=0x7f43a80ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 -- 172.21.15.69:0/2641512540 shutdown_connections 2024-04-23T10:24:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 -- 172.21.15.69:0/2641512540 wait complete. 2024-04-23T10:24:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 Processor -- start 2024-04-23T10:24:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 -- start start 2024-04-23T10:24:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a8101fb0 0x7f43a8075d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a81031a0 0x7f43a8074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8103b60 0x7f43a8074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f43a810dc10 con 0x7f43a8101fb0 2024-04-23T10:24:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f43a810da90 con 0x7f43a81031a0 2024-04-23T10:24:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43b03ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43a810dd90 con 0x7f43a8103b60 2024-04-23T10:24:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43ae149640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a8101fb0 0x7f43a8075d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43ae149640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a8101fb0 0x7f43a8075d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36152/0 (socket says 172.21.15.69:36152) 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.139+0000 7f43ae149640 1 -- 172.21.15.69:0/1293009854 learned_addr learned my addr 172.21.15.69:0/1293009854 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f43ad948640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a81031a0 0x7f43a8074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f43ae94a640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8103b60 0x7f43a8074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f43ae149640 1 -- 172.21.15.69:0/1293009854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8103b60 msgr2=0x7f43a8074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f43ae149640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8103b60 0x7f43a8074880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f43ae149640 1 -- 172.21.15.69:0/1293009854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a81031a0 msgr2=0x7f43a8074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f43ae149640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a81031a0 0x7f43a8074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f43ae149640 1 -- 172.21.15.69:0/1293009854 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a8075110 con 0x7f43a8101fb0 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f43ae149640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a8101fb0 0x7f43a8075d00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f43a400ebc0 tx=0x7f43a400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f439f7fe640 1 -- 172.21.15.69:0/1293009854 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4003b70 con 0x7f43a8101fb0 2024-04-23T10:24:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f439f7fe640 1 -- 172.21.15.69:0/1293009854 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f43a4003d10 con 0x7f43a8101fb0 2024-04-23T10:24:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f43b03ad640 1 -- 172.21.15.69:0/1293009854 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a81a2370 con 0x7f43a8101fb0 2024-04-23T10:24:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f439f7fe640 1 -- 172.21.15.69:0/1293009854 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4019850 con 0x7f43a8101fb0 2024-04-23T10:24:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.140+0000 7f43b03ad640 1 -- 172.21.15.69:0/1293009854 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a81a28c0 con 0x7f43a8101fb0 2024-04-23T10:24:37.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.141+0000 7f43b03ad640 1 -- 172.21.15.69:0/1293009854 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a81092d0 con 0x7f43a8101fb0 2024-04-23T10:24:37.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.142+0000 7f439f7fe640 1 -- 172.21.15.69:0/1293009854 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f43a40199f0 con 0x7f43a8101fb0 2024-04-23T10:24:37.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.143+0000 7f439f7fe640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43940a3bb0 0x7f43940a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:37.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.143+0000 7f43ad948640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43940a3bb0 0x7f43940a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:37.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.143+0000 7f439f7fe640 1 -- 172.21.15.69:0/1293009854 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f43a40d07f0 con 0x7f43a8101fb0 2024-04-23T10:24:37.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.143+0000 7f43ad948640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43940a3bb0 0x7f43940a6070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43a8075a70 tx=0x7f4398005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:37.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.147+0000 7f439f7fe640 1 -- 172.21.15.69:0/1293009854 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f43a409d670 con 0x7f43a8101fb0 2024-04-23T10:24:37.177 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:24:36 smithi146 podman[62051]: 2024-04-23 10:24:36.843515901 +0000 UTC m=+0.377167930 container init 9bad60ebc270b44a055f27253e3b7e945bcd1ea2607f30bf562a3e18939a8335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-23T10:24:37.178 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:24:36 smithi146 podman[62051]: 2024-04-23 10:24:36.846230719 +0000 UTC m=+0.379882749 container start 9bad60ebc270b44a055f27253e3b7e945bcd1ea2607f30bf562a3e18939a8335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-23T10:24:37.178 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:24:36 smithi146 ceph-mds[62070]: -- 172.21.15.146:0/2106813190 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aa992b9a40 con 0x55aa9928cc00 2024-04-23T10:24:37.178 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:24:36 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h[62066]: starting mds.h at 2024-04-23T10:24:37.178 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:24:36 smithi146 bash[62051]: 9bad60ebc270b44a055f27253e3b7e945bcd1ea2607f30bf562a3e18939a8335 2024-04-23T10:24:37.178 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:24:36 smithi146 systemd[1]: Started Ceph mds.h for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:37.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.362+0000 7f43b03ad640 1 -- 172.21.15.69:0/1293009854 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43a802d5c0 con 0x7f43a8101fb0 2024-04-23T10:24:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.363+0000 7f439f7fe640 1 -- 172.21.15.69:0/1293009854 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7177 (secure 0 0 0) 0x7f43a409cf70 con 0x7f43a8101fb0 2024-04-23T10:24:37.362 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:37.362 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24416,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-23T10:24:37.363 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 9 2024-04-23T10:24:37.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 -- 172.21.15.69:0/1293009854 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43940a3bb0 msgr2=0x7f43940a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:37.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43940a3bb0 0x7f43940a6070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43a8075a70 tx=0x7f4398005f90 comp rx=0 tx=0).stop 2024-04-23T10:24:37.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 -- 172.21.15.69:0/1293009854 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a8101fb0 msgr2=0x7f43a8075d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:37.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a8101fb0 0x7f43a8075d00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f43a400ebc0 tx=0x7f43a400c6a0 comp rx=0 tx=0).stop 2024-04-23T10:24:37.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 -- 172.21.15.69:0/1293009854 shutdown_connections 2024-04-23T10:24:37.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43940a3bb0 0x7f43940a6070 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:37.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8103b60 0x7f43a8074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:37.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a81031a0 0x7f43a8074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:37.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 --2- 172.21.15.69:0/1293009854 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43a8101fb0 0x7f43a8075d00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:37.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 -- 172.21.15.69:0/1293009854 >> 172.21.15.69:0/1293009854 conn(0x7f43a80fd500 msgr2=0x7f43a81064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:37.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 -- 172.21.15.69:0/1293009854 shutdown_connections 2024-04-23T10:24:37.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:37.365+0000 7f43b03ad640 1 -- 172.21.15.69:0/1293009854 wait complete. 2024-04-23T10:24:38.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] up:boot 2024-04-23T10:24:38.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: fsmap 8 up:standby 2024-04-23T10:24:38.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T10:24:38.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:38.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:38.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:38.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:38.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:38.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:38.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:38.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: Deploying daemon mds.i on smithi167 2024-04-23T10:24:38.179 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:37 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1293009854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:38.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] up:boot 2024-04-23T10:24:38.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: fsmap 8 up:standby 2024-04-23T10:24:38.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T10:24:38.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:38.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:38.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:38.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:38.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:38.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:38.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:38.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: Deploying daemon mds.i on smithi167 2024-04-23T10:24:38.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:37 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1293009854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:38.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] up:boot 2024-04-23T10:24:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: fsmap 8 up:standby 2024-04-23T10:24:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T10:24:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: Deploying daemon mds.i on smithi167 2024-04-23T10:24:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:37 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1293009854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:39.333 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:24:39 smithi167 systemd[1]: Starting Ceph mds.i for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:24:39.375 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.486+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/1948426997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c0103b70 msgr2=0x7fa1c010a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.486+0000 7fa1c5e4e640 1 --2- 172.21.15.69:0/1948426997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c0103b70 0x7fa1c010a400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009ca0 tx=0x7fa1b802a8e0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.486+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/1948426997 shutdown_connections 2024-04-23T10:24:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.486+0000 7fa1c5e4e640 1 --2- 172.21.15.69:0/1948426997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c0103b70 0x7fa1c010a400 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.486+0000 7fa1c5e4e640 1 --2- 172.21.15.69:0/1948426997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1c01031b0 0x7fa1c0103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.486+0000 7fa1c5e4e640 1 --2- 172.21.15.69:0/1948426997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c0101fc0 0x7fa1c01023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.486+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/1948426997 >> 172.21.15.69:0/1948426997 conn(0x7fa1c00fd530 msgr2=0x7fa1c00ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:39.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.486+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/1948426997 shutdown_connections 2024-04-23T10:24:39.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.486+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/1948426997 wait complete. 2024-04-23T10:24:39.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.486+0000 7fa1c5e4e640 1 Processor -- start 2024-04-23T10:24:39.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1c5e4e640 1 -- start start 2024-04-23T10:24:39.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1c5e4e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1c0101fc0 0x7fa1c0198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:39.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1c5e4e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c01031b0 0x7fa1c0198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:39.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1c5e4e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c0103b70 0x7fa1c019f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:39.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1c5e4e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c010dc50 con 0x7fa1c0103b70 2024-04-23T10:24:39.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1c5e4e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c010dad0 con 0x7fa1c0101fc0 2024-04-23T10:24:39.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1c5e4e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c010ddd0 con 0x7fa1c01031b0 2024-04-23T10:24:39.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1bffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c0103b70 0x7fa1c019f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:39.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1bffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c0103b70 0x7fa1c019f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48390/0 (socket says 172.21.15.69:48390) 2024-04-23T10:24:39.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1bffff640 1 -- 172.21.15.69:0/2779650237 learned_addr learned my addr 172.21.15.69:0/2779650237 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:39.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1beffd640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c01031b0 0x7fa1c0198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1bffff640 1 -- 172.21.15.69:0/2779650237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c01031b0 msgr2=0x7fa1c0198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1bffff640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c01031b0 0x7fa1c0198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1bf7fe640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1c0101fc0 0x7fa1c0198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1bffff640 1 -- 172.21.15.69:0/2779650237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1c0101fc0 msgr2=0x7fa1c0198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1bffff640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1c0101fc0 0x7fa1c0198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1bffff640 1 -- 172.21.15.69:0/2779650237 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c019ff20 con 0x7fa1c0103b70 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1bffff640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c0103b70 0x7fa1c019f8b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009dc0 tx=0x7fa1b8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.487+0000 7fa1bcff9640 1 -- 172.21.15.69:0/2779650237 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8004240 con 0x7fa1c0103b70 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.488+0000 7fa1bcff9640 1 -- 172.21.15.69:0/2779650237 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa1b80305e0 con 0x7fa1c0103b70 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.488+0000 7fa1bcff9640 1 -- 172.21.15.69:0/2779650237 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b803b780 con 0x7fa1c0103b70 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.488+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/2779650237 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c01a01b0 con 0x7fa1c0103b70 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.488+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/2779650237 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c01a0780 con 0x7fa1c0103b70 2024-04-23T10:24:39.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.489+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/2779650237 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c01092e0 con 0x7fa1c0103b70 2024-04-23T10:24:39.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.490+0000 7fa1bcff9640 1 -- 172.21.15.69:0/2779650237 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa1b8030b40 con 0x7fa1c0103b70 2024-04-23T10:24:39.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.490+0000 7fa1bcff9640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa1a80a3bb0 0x7fa1a80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:39.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.490+0000 7fa1bf7fe640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa1a80a3bb0 0x7fa1a80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:39.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.490+0000 7fa1bcff9640 1 -- 172.21.15.69:0/2779650237 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fa1b80f1680 con 0x7fa1c0103b70 2024-04-23T10:24:39.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.491+0000 7fa1bf7fe640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa1a80a3bb0 0x7fa1a80a6070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0103010 tx=0x7fa1b0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:39.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.495+0000 7fa1bcff9640 1 -- 172.21.15.69:0/2779650237 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa1b80be500 con 0x7fa1c0103b70 2024-04-23T10:24:39.592 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:24:39 smithi167 podman[63885]: 2024-04-23 10:24:39.240033991 +0000 UTC m=+0.018230229 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:24:39.592 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:24:39 smithi167 podman[63885]: 2024-04-23 10:24:39.3412312 +0000 UTC m=+0.119427424 container create 7c5cf81471dae89bf147492a46581eb53032634e197c9def206d1a3d8d58f6f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-23T10:24:39.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.709+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/2779650237 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1c0062b50 con 0x7fa1c0103b70 2024-04-23T10:24:39.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.709+0000 7fa1bcff9640 1 -- 172.21.15.69:0/2779650237 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7177 (secure 0 0 0) 0x7fa1b80bde00 con 0x7fa1c0103b70 2024-04-23T10:24:39.708 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:39.708 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24416,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-23T10:24:39.709 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 9 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/2779650237 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa1a80a3bb0 msgr2=0x7fa1a80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa1a80a3bb0 0x7fa1a80a6070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0103010 tx=0x7fa1b0008040 comp rx=0 tx=0).stop 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/2779650237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c0103b70 msgr2=0x7fa1c019f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c0103b70 0x7fa1c019f8b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009dc0 tx=0x7fa1b8003ce0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/2779650237 shutdown_connections 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa1a80a3bb0 0x7fa1a80a6070 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c0103b70 0x7fa1c019f8b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c01031b0 0x7fa1c0198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 --2- 172.21.15.69:0/2779650237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1c0101fc0 0x7fa1c0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/2779650237 >> 172.21.15.69:0/2779650237 conn(0x7fa1c00fd530 msgr2=0x7fa1c01064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/2779650237 shutdown_connections 2024-04-23T10:24:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:39.711+0000 7fa1c5e4e640 1 -- 172.21.15.69:0/2779650237 wait complete. 2024-04-23T10:24:40.054 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:24:39 smithi167 podman[63885]: 2024-04-23 10:24:39.593799499 +0000 UTC m=+0.371995729 container init 7c5cf81471dae89bf147492a46581eb53032634e197c9def206d1a3d8d58f6f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD) 2024-04-23T10:24:40.054 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:24:39 smithi167 podman[63885]: 2024-04-23 10:24:39.596692661 +0000 UTC m=+0.374888892 container start 7c5cf81471dae89bf147492a46581eb53032634e197c9def206d1a3d8d58f6f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-23T10:24:40.054 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:24:39 smithi167 ceph-mds[63905]: -- 172.21.15.167:0/3686976526 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a6cbff9a40 con 0x55a6cbfcd000 2024-04-23T10:24:40.054 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:24:39 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i[63901]: starting mds.i at 2024-04-23T10:24:40.054 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:24:39 smithi167 bash[63885]: 7c5cf81471dae89bf147492a46581eb53032634e197c9def206d1a3d8d58f6f4 2024-04-23T10:24:40.054 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:24:39 smithi167 systemd[1]: Started Ceph mds.i for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:40.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:40 smithi167 ceph-mon[32940]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:40 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2779650237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:40 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:40.366 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:40 smithi069 ceph-mon[29593]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:40.366 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:40 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2779650237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:40.366 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:40.366 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:40.366 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:40.366 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:40.366 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:40.366 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:40 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:40.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:40 smithi146 ceph-mon[32800]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:40.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:40 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2779650237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:40.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:40.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:40.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:40.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:40.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:40.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:40 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:41.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:41 smithi167 ceph-mon[32940]: Deploying daemon mds.g on smithi069 2024-04-23T10:24:41.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:41 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] up:boot 2024-04-23T10:24:41.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:41 smithi167 ceph-mon[32940]: fsmap 9 up:standby 2024-04-23T10:24:41.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:41 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T10:24:41.403 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:41 smithi069 ceph-mon[29593]: Deploying daemon mds.g on smithi069 2024-04-23T10:24:41.403 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:41 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] up:boot 2024-04-23T10:24:41.403 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:41 smithi069 ceph-mon[29593]: fsmap 9 up:standby 2024-04-23T10:24:41.403 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:41 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T10:24:41.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:41 smithi146 ceph-mon[32800]: Deploying daemon mds.g on smithi069 2024-04-23T10:24:41.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:41 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] up:boot 2024-04-23T10:24:41.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:41 smithi146 ceph-mon[32800]: fsmap 9 up:standby 2024-04-23T10:24:41.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:41 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T10:24:41.722 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:41.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.868+0000 7fb705b4f640 1 -- 172.21.15.69:0/3797228817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb700105340 msgr2=0x7fb700107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:41.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.868+0000 7fb705b4f640 1 --2- 172.21.15.69:0/3797228817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb700105340 0x7fb700107730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009900 tx=0x7fb6e802a410 comp rx=0 tx=0).stop 2024-04-23T10:24:41.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.868+0000 7fb705b4f640 1 -- 172.21.15.69:0/3797228817 shutdown_connections 2024-04-23T10:24:41.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.868+0000 7fb705b4f640 1 --2- 172.21.15.69:0/3797228817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb700105340 0x7fb700107730 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.868+0000 7fb705b4f640 1 --2- 172.21.15.69:0/3797228817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb700107c70 0x7fb70010a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.868+0000 7fb705b4f640 1 --2- 172.21.15.69:0/3797228817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700102a10 0x7fb700104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.868+0000 7fb705b4f640 1 -- 172.21.15.69:0/3797228817 >> 172.21.15.69:0/3797228817 conn(0x7fb7000fc400 msgr2=0x7fb7000fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.868+0000 7fb705b4f640 1 -- 172.21.15.69:0/3797228817 shutdown_connections 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.868+0000 7fb705b4f640 1 -- 172.21.15.69:0/3797228817 wait complete. 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.868+0000 7fb705b4f640 1 Processor -- start 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb705b4f640 1 -- start start 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb705b4f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb700102a10 0x7fb700198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb705b4f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700105340 0x7fb700198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb705b4f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb700107c70 0x7fb70019f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb705b4f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb70010dc00 con 0x7fb700102a10 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb705b4f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb70010da80 con 0x7fb700107c70 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb705b4f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb70010dd80 con 0x7fb700105340 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6ff7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb700102a10 0x7fb700198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6ff7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb700102a10 0x7fb700198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48406/0 (socket says 172.21.15.69:48406) 2024-04-23T10:24:41.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6ff7fe640 1 -- 172.21.15.69:0/1396478558 learned_addr learned my addr 172.21.15.69:0/1396478558 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6feffd640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700105340 0x7fb700198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6fffff640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb700107c70 0x7fb70019f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6ff7fe640 1 -- 172.21.15.69:0/1396478558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700105340 msgr2=0x7fb700198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6ff7fe640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700105340 0x7fb700198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6ff7fe640 1 -- 172.21.15.69:0/1396478558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb700107c70 msgr2=0x7fb70019f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6ff7fe640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb700107c70 0x7fb70019f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6ff7fe640 1 -- 172.21.15.69:0/1396478558 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70019ff20 con 0x7fb700102a10 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6feffd640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700105340 0x7fb700198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6ff7fe640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb700102a10 0x7fb700198300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000eb90 tx=0x7fb6f000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6fcff9640 1 -- 172.21.15.69:0/1396478558 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0004d20 con 0x7fb700102a10 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb705b4f640 1 -- 172.21.15.69:0/1396478558 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7001a0210 con 0x7fb700102a10 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.869+0000 7fb6fcff9640 1 -- 172.21.15.69:0/1396478558 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb6f000ee90 con 0x7fb700102a10 2024-04-23T10:24:41.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.870+0000 7fb6fcff9640 1 -- 172.21.15.69:0/1396478558 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0010720 con 0x7fb700102a10 2024-04-23T10:24:41.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.870+0000 7fb705b4f640 1 -- 172.21.15.69:0/1396478558 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7001a06e0 con 0x7fb700102a10 2024-04-23T10:24:41.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.871+0000 7fb705b4f640 1 -- 172.21.15.69:0/1396478558 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7000fdef0 con 0x7fb700102a10 2024-04-23T10:24:41.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.872+0000 7fb6fcff9640 1 -- 172.21.15.69:0/1396478558 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb6f0005580 con 0x7fb700102a10 2024-04-23T10:24:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.873+0000 7fb6fcff9640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb6ec0a3bb0 0x7fb6ec0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.873+0000 7fb6feffd640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb6ec0a3bb0 0x7fb6ec0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.873+0000 7fb6fcff9640 1 -- 172.21.15.69:0/1396478558 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fb6f00d0910 con 0x7fb700102a10 2024-04-23T10:24:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.874+0000 7fb6feffd640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb6ec0a3bb0 0x7fb6ec0a6070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8000c00 tx=0x7fb6e8031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:41.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:41.877+0000 7fb6fcff9640 1 -- 172.21.15.69:0/1396478558 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb6f0053ff0 con 0x7fb700102a10 2024-04-23T10:24:42.070 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:24:41 smithi069 systemd[1]: Starting Ceph mds.g for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:24:42.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.114+0000 7fb705b4f640 1 -- 172.21.15.69:0/1396478558 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb70002d5c0 con 0x7fb700102a10 2024-04-23T10:24:42.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.114+0000 7fb6fcff9640 1 -- 172.21.15.69:0/1396478558 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8007 (secure 0 0 0) 0x7fb6f009d790 con 0x7fb700102a10 2024-04-23T10:24:42.113 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:42.114 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24416,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-23T10:24:42.114 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 10 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.117+0000 7fb705b4f640 1 -- 172.21.15.69:0/1396478558 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb6ec0a3bb0 msgr2=0x7fb6ec0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.117+0000 7fb705b4f640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb6ec0a3bb0 0x7fb6ec0a6070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8000c00 tx=0x7fb6e8031510 comp rx=0 tx=0).stop 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.117+0000 7fb705b4f640 1 -- 172.21.15.69:0/1396478558 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb700102a10 msgr2=0x7fb700198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.117+0000 7fb705b4f640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb700102a10 0x7fb700198300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000eb90 tx=0x7fb6f000c6a0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.118+0000 7fb705b4f640 1 -- 172.21.15.69:0/1396478558 shutdown_connections 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.118+0000 7fb705b4f640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb6ec0a3bb0 0x7fb6ec0a6070 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.118+0000 7fb705b4f640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb700107c70 0x7fb70019f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.118+0000 7fb705b4f640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700105340 0x7fb700198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.118+0000 7fb705b4f640 1 --2- 172.21.15.69:0/1396478558 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb700102a10 0x7fb700198300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.118+0000 7fb705b4f640 1 -- 172.21.15.69:0/1396478558 >> 172.21.15.69:0/1396478558 conn(0x7fb7000fc400 msgr2=0x7fb7001034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.118+0000 7fb705b4f640 1 -- 172.21.15.69:0/1396478558 shutdown_connections 2024-04-23T10:24:42.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:42.118+0000 7fb705b4f640 1 -- 172.21.15.69:0/1396478558 wait complete. 2024-04-23T10:24:42.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:42 smithi167 ceph-mon[32940]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:42.366 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:42 smithi069 ceph-mon[29593]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:42.366 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:24:42 smithi069 podman[68649]: 2024-04-23 10:24:42.127388296 +0000 UTC m=+0.021948529 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:24:42.366 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:24:42 smithi069 podman[68649]: 2024-04-23 10:24:42.262150958 +0000 UTC m=+0.156711175 container create 2558f26a2e85daa45a091bfbb6a1c9483419b03658bac6846e6a9bcb327e82b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:24:42.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:42 smithi146 ceph-mon[32800]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:42.742 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:24:42 smithi069 podman[68649]: 2024-04-23 10:24:42.506712423 +0000 UTC m=+0.401272640 container init 2558f26a2e85daa45a091bfbb6a1c9483419b03658bac6846e6a9bcb327e82b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:24:42.742 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:24:42 smithi069 podman[68649]: 2024-04-23 10:24:42.509550849 +0000 UTC m=+0.404111068 container start 2558f26a2e85daa45a091bfbb6a1c9483419b03658bac6846e6a9bcb327e82b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:24:42.742 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:24:42 smithi069 ceph-mds[68671]: -- 172.21.15.69:0/1281748977 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56068479ba40 con 0x56068476e800 2024-04-23T10:24:42.742 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:24:42 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g[68667]: starting mds.g at 2024-04-23T10:24:42.742 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:24:42 smithi069 bash[68649]: 2558f26a2e85daa45a091bfbb6a1c9483419b03658bac6846e6a9bcb327e82b2 2024-04-23T10:24:42.742 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:24:42 smithi069 systemd[1]: Started Ceph mds.g for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:43.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:43 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1396478558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:43.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:43.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:43.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:43.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:43.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:43.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:43 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:43.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:43 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1396478558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:43.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:43.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:43.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:43.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:43.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:43.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:43 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:43.441 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:43 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1396478558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:43.441 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:43.441 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:43.441 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:43.441 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:43.441 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:43.441 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:43 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:44.132 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:44.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.237+0000 7fa3a4849640 1 -- 172.21.15.69:0/3307859153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a01029a0 msgr2=0x7fa3a01092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.237+0000 7fa3a4849640 1 --2- 172.21.15.69:0/3307859153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a01029a0 0x7fa3a01092c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa398009ca0 tx=0x7fa39802a8c0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.237+0000 7fa3a4849640 1 -- 172.21.15.69:0/3307859153 shutdown_connections 2024-04-23T10:24:44.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.237+0000 7fa3a4849640 1 --2- 172.21.15.69:0/3307859153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a01029a0 0x7fa3a01092c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.237+0000 7fa3a4849640 1 --2- 172.21.15.69:0/3307859153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a0101fe0 0x7fa3a0102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.237+0000 7fa3a4849640 1 --2- 172.21.15.69:0/3307859153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a0100e90 0x7fa3a01012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.237+0000 7fa3a4849640 1 -- 172.21.15.69:0/3307859153 >> 172.21.15.69:0/3307859153 conn(0x7fa3a00fc400 msgr2=0x7fa3a00fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:44.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.237+0000 7fa3a4849640 1 -- 172.21.15.69:0/3307859153 shutdown_connections 2024-04-23T10:24:44.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.237+0000 7fa3a4849640 1 -- 172.21.15.69:0/3307859153 wait complete. 2024-04-23T10:24:44.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.238+0000 7fa3a4849640 1 Processor -- start 2024-04-23T10:24:44.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.238+0000 7fa3a4849640 1 -- start start 2024-04-23T10:24:44.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.238+0000 7fa3a4849640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a0100e90 0x7fa3a01982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.238+0000 7fa3a4849640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a0101fe0 0x7fa3a01987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.238+0000 7fa3a4849640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a01029a0 0x7fa3a019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.238+0000 7fa3a4849640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a010cba0 con 0x7fa3a0100e90 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.238+0000 7fa3a4849640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a010ca20 con 0x7fa3a01029a0 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.238+0000 7fa3a4849640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a010cd20 con 0x7fa3a0101fe0 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.238+0000 7fa39e59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a0100e90 0x7fa3a01982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.238+0000 7fa39e59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a0100e90 0x7fa3a01982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48442/0 (socket says 172.21.15.69:48442) 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.238+0000 7fa39e59c640 1 -- 172.21.15.69:0/4270635364 learned_addr learned my addr 172.21.15.69:0/4270635364 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa39ed9d640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a01029a0 0x7fa3a019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa39dd9b640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a0101fe0 0x7fa3a01987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa39e59c640 1 -- 172.21.15.69:0/4270635364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a0101fe0 msgr2=0x7fa3a01987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa39e59c640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a0101fe0 0x7fa3a01987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa39e59c640 1 -- 172.21.15.69:0/4270635364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a01029a0 msgr2=0x7fa3a019f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa39e59c640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a01029a0 0x7fa3a019f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa39e59c640 1 -- 172.21.15.69:0/4270635364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a019fed0 con 0x7fa3a0100e90 2024-04-23T10:24:44.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa39e59c640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a0100e90 0x7fa3a01982b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa39000b4a0 tx=0x7fa39000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa38f7fe640 1 -- 172.21.15.69:0/4270635364 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390014070 con 0x7fa3a0100e90 2024-04-23T10:24:44.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa3a4849640 1 -- 172.21.15.69:0/4270635364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a01a01c0 con 0x7fa3a0100e90 2024-04-23T10:24:44.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa38f7fe640 1 -- 172.21.15.69:0/4270635364 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa390010ae0 con 0x7fa3a0100e90 2024-04-23T10:24:44.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa38f7fe640 1 -- 172.21.15.69:0/4270635364 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390017ce0 con 0x7fa3a0100e90 2024-04-23T10:24:44.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.239+0000 7fa3a4849640 1 -- 172.21.15.69:0/4270635364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a01a0790 con 0x7fa3a0100e90 2024-04-23T10:24:44.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.240+0000 7fa3a4849640 1 -- 172.21.15.69:0/4270635364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a01a0a50 con 0x7fa3a0100e90 2024-04-23T10:24:44.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.241+0000 7fa38f7fe640 1 -- 172.21.15.69:0/4270635364 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa390017070 con 0x7fa3a0100e90 2024-04-23T10:24:44.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.242+0000 7fa38f7fe640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa3880a3bb0 0x7fa3880a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.242+0000 7fa39dd9b640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa3880a3bb0 0x7fa3880a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.242+0000 7fa38f7fe640 1 -- 172.21.15.69:0/4270635364 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fa3900cf640 con 0x7fa3a0100e90 2024-04-23T10:24:44.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.243+0000 7fa39dd9b640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa3880a3bb0 0x7fa3880a6070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa394005fd0 tx=0x7fa394005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.247+0000 7fa38f7fe640 1 -- 172.21.15.69:0/4270635364 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa39009c4c0 con 0x7fa3a0100e90 2024-04-23T10:24:44.305 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:44 smithi069 ceph-mon[29593]: Deploying daemon mds.a on smithi069 2024-04-23T10:24:44.305 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:44 smithi069 ceph-mon[29593]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:44.305 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:44 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.69:6838/441538329,v1:172.21.15.69:6839/441538329] up:boot 2024-04-23T10:24:44.306 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:44 smithi069 ceph-mon[29593]: fsmap 10 up:standby 2024-04-23T10:24:44.306 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:44 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T10:24:44.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:44 smithi167 ceph-mon[32940]: Deploying daemon mds.a on smithi069 2024-04-23T10:24:44.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:44 smithi167 ceph-mon[32940]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:44.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:44 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.69:6838/441538329,v1:172.21.15.69:6839/441538329] up:boot 2024-04-23T10:24:44.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:44 smithi167 ceph-mon[32940]: fsmap 10 up:standby 2024-04-23T10:24:44.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:44 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T10:24:44.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:44 smithi146 ceph-mon[32800]: Deploying daemon mds.a on smithi069 2024-04-23T10:24:44.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:44 smithi146 ceph-mon[32800]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:44.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:44 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.69:6838/441538329,v1:172.21.15.69:6839/441538329] up:boot 2024-04-23T10:24:44.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:44 smithi146 ceph-mon[32800]: fsmap 10 up:standby 2024-04-23T10:24:44.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:44 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T10:24:44.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.478+0000 7fa3a4849640 1 -- 172.21.15.69:0/4270635364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3a01a0c20 con 0x7fa3a0100e90 2024-04-23T10:24:44.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.479+0000 7fa38f7fe640 1 -- 172.21.15.69:0/4270635364 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8830 (secure 0 0 0) 0x7fa39009bdc0 con 0x7fa3a0100e90 2024-04-23T10:24:44.479 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:44.479 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24416,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-23T10:24:44.479 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 11 2024-04-23T10:24:44.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 -- 172.21.15.69:0/4270635364 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa3880a3bb0 msgr2=0x7fa3880a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa3880a3bb0 0x7fa3880a6070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa394005fd0 tx=0x7fa394005850 comp rx=0 tx=0).stop 2024-04-23T10:24:44.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 -- 172.21.15.69:0/4270635364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a0100e90 msgr2=0x7fa3a01982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a0100e90 0x7fa3a01982b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa39000b4a0 tx=0x7fa39000b960 comp rx=0 tx=0).stop 2024-04-23T10:24:44.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 -- 172.21.15.69:0/4270635364 shutdown_connections 2024-04-23T10:24:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa3880a3bb0 0x7fa3880a6070 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a01029a0 0x7fa3a019f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3a0101fe0 0x7fa3a01987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 --2- 172.21.15.69:0/4270635364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a0100e90 0x7fa3a01982b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 -- 172.21.15.69:0/4270635364 >> 172.21.15.69:0/4270635364 conn(0x7fa3a00fc400 msgr2=0x7fa3a00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 -- 172.21.15.69:0/4270635364 shutdown_connections 2024-04-23T10:24:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:44.481+0000 7fa3a4849640 1 -- 172.21.15.69:0/4270635364 wait complete. 2024-04-23T10:24:44.992 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:24:44 smithi069 systemd[1]: Starting Ceph mds.a for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:24:45.278 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:45 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/4270635364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:45.278 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:24:45 smithi069 podman[69013]: 2024-04-23 10:24:44.920595503 +0000 UTC m=+0.018457640 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:24:45.279 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:24:45 smithi069 podman[69013]: 2024-04-23 10:24:45.018960844 +0000 UTC m=+0.116822973 container create 04975c6805ae28906e8682a68ace24b647301b8ec90cf81ae1425ed607763f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:24:45.279 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:24:45 smithi069 podman[69013]: 2024-04-23 10:24:45.255063905 +0000 UTC m=+0.352926034 container init 04975c6805ae28906e8682a68ace24b647301b8ec90cf81ae1425ed607763f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-23T10:24:45.279 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:24:45 smithi069 podman[69013]: 2024-04-23 10:24:45.257574947 +0000 UTC m=+0.355437083 container start 04975c6805ae28906e8682a68ace24b647301b8ec90cf81ae1425ed607763f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-23T10:24:45.279 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:24:45 smithi069 ceph-mds[69031]: -- 172.21.15.69:0/1113938672 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5584bf9a7a40 con 0x5584bf97ac00 2024-04-23T10:24:45.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:45 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/4270635364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:45.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:45 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/4270635364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:45.742 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:24:45 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a[69027]: starting mds.a at 2024-04-23T10:24:45.742 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:24:45 smithi069 bash[69013]: 04975c6805ae28906e8682a68ace24b647301b8ec90cf81ae1425ed607763f6b 2024-04-23T10:24:45.742 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:24:45 smithi069 systemd[1]: Started Ceph mds.a for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:46.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:46 smithi146 ceph-mon[32800]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:46.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:46 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:46.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:46 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:46.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:46 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:46.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:46 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:46.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:46 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:46.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:46 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:46.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:46 smithi069 ceph-mon[29593]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:46.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:46.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:46.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:46.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:46.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:46.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:46 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:46.492 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:46.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:46 smithi167 ceph-mon[32940]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:46.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:46.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-23T10:24:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-23T10:24:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:46 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:46.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.607+0000 7f45a4d29640 1 -- 172.21.15.69:0/960021009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45a0102a20 msgr2=0x7f45a0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.607+0000 7f45a4d29640 1 --2- 172.21.15.69:0/960021009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45a0102a20 0x7f45a0104e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4590009900 tx=0x7f459002a410 comp rx=0 tx=0).stop 2024-04-23T10:24:46.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.607+0000 7f45a4d29640 1 -- 172.21.15.69:0/960021009 shutdown_connections 2024-04-23T10:24:46.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.607+0000 7f45a4d29640 1 --2- 172.21.15.69:0/960021009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0107c80 0x7f45a010a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.607+0000 7f45a4d29640 1 --2- 172.21.15.69:0/960021009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a0105350 0x7f45a0107740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.607+0000 7f45a4d29640 1 --2- 172.21.15.69:0/960021009 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45a0102a20 0x7f45a0104e10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.607+0000 7f45a4d29640 1 -- 172.21.15.69:0/960021009 >> 172.21.15.69:0/960021009 conn(0x7f45a00fc430 msgr2=0x7f45a00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.607+0000 7f45a4d29640 1 -- 172.21.15.69:0/960021009 shutdown_connections 2024-04-23T10:24:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.607+0000 7f45a4d29640 1 -- 172.21.15.69:0/960021009 wait complete. 2024-04-23T10:24:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f45a4d29640 1 Processor -- start 2024-04-23T10:24:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f45a4d29640 1 -- start start 2024-04-23T10:24:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f45a4d29640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0102a20 0x7f45a0198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f45a4d29640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a0105350 0x7f45a0198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f45a4d29640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45a0107c80 0x7f45a019f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f45a4d29640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f45a010dc20 con 0x7f45a0107c80 2024-04-23T10:24:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f45a4d29640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f45a010daa0 con 0x7f45a0105350 2024-04-23T10:24:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f45a4d29640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45a010dda0 con 0x7f45a0102a20 2024-04-23T10:24:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f459ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45a0107c80 0x7f45a019f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f459ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45a0107c80 0x7f45a019f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48476/0 (socket says 172.21.15.69:48476) 2024-04-23T10:24:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f459ed9d640 1 -- 172.21.15.69:0/565631465 learned_addr learned my addr 172.21.15.69:0/565631465 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.608+0000 7f459dd9b640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a0105350 0x7f45a0198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f459e59c640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0102a20 0x7f45a0198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f459ed9d640 1 -- 172.21.15.69:0/565631465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0102a20 msgr2=0x7f45a0198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f459ed9d640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0102a20 0x7f45a0198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f459ed9d640 1 -- 172.21.15.69:0/565631465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a0105350 msgr2=0x7f45a0198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f459ed9d640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a0105350 0x7f45a0198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f459ed9d640 1 -- 172.21.15.69:0/565631465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a019ff20 con 0x7f45a0107c80 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f459ed9d640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45a0107c80 0x7f45a019f8b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f459800eb10 tx=0x7f459800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f458f7fe640 1 -- 172.21.15.69:0/565631465 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598004b20 con 0x7f45a0107c80 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f458f7fe640 1 -- 172.21.15.69:0/565631465 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4598004cc0 con 0x7f45a0107c80 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f45a4d29640 1 -- 172.21.15.69:0/565631465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a01a0210 con 0x7f45a0107c80 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f458f7fe640 1 -- 172.21.15.69:0/565631465 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598010720 con 0x7f45a0107c80 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.609+0000 7f45a4d29640 1 -- 172.21.15.69:0/565631465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a01a0760 con 0x7f45a0107c80 2024-04-23T10:24:46.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.610+0000 7f45a4d29640 1 -- 172.21.15.69:0/565631465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a00fdf20 con 0x7f45a0107c80 2024-04-23T10:24:46.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.611+0000 7f458f7fe640 1 -- 172.21.15.69:0/565631465 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f4598005020 con 0x7f45a0107c80 2024-04-23T10:24:46.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.612+0000 7f458f7fe640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45880a3bb0 0x7f45880a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:46.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.612+0000 7f459e59c640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45880a3bb0 0x7f45880a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:46.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.612+0000 7f458f7fe640 1 -- 172.21.15.69:0/565631465 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f45980d0530 con 0x7f45a0107c80 2024-04-23T10:24:46.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.612+0000 7f459e59c640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45880a3bb0 0x7f45880a6070 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4590000c00 tx=0x7f4590031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:46.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.616+0000 7f458f7fe640 1 -- 172.21.15.69:0/565631465 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f459809d3b0 con 0x7f45a0107c80 2024-04-23T10:24:46.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.830+0000 7f45a4d29640 1 -- 172.21.15.69:0/565631465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45a0062b50 con 0x7f45a0107c80 2024-04-23T10:24:46.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.830+0000 7f458f7fe640 1 -- 172.21.15.69:0/565631465 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9656 (secure 0 0 0) 0x7f459809ccb0 con 0x7f45a0107c80 2024-04-23T10:24:46.829 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:46.830 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24416,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-23T10:24:46.830 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 12 2024-04-23T10:24:46.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.832+0000 7f45a4d29640 1 -- 172.21.15.69:0/565631465 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45880a3bb0 msgr2=0x7f45880a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.832+0000 7f45a4d29640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45880a3bb0 0x7f45880a6070 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4590000c00 tx=0x7f4590031510 comp rx=0 tx=0).stop 2024-04-23T10:24:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.832+0000 7f45a4d29640 1 -- 172.21.15.69:0/565631465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45a0107c80 msgr2=0x7f45a019f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.832+0000 7f45a4d29640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45a0107c80 0x7f45a019f8b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f459800eb10 tx=0x7f459800c2d0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.832+0000 7f45a4d29640 1 -- 172.21.15.69:0/565631465 shutdown_connections 2024-04-23T10:24:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.832+0000 7f45a4d29640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f45880a3bb0 0x7f45880a6070 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.832+0000 7f45a4d29640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45a0107c80 0x7f45a019f8b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.832+0000 7f45a4d29640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a0105350 0x7f45a0198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.832+0000 7f45a4d29640 1 --2- 172.21.15.69:0/565631465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0102a20 0x7f45a0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.832+0000 7f45a4d29640 1 -- 172.21.15.69:0/565631465 >> 172.21.15.69:0/565631465 conn(0x7f45a00fc430 msgr2=0x7f45a01033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.833+0000 7f45a4d29640 1 -- 172.21.15.69:0/565631465 shutdown_connections 2024-04-23T10:24:46.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:46.833+0000 7f45a4d29640 1 -- 172.21.15.69:0/565631465 wait complete. 2024-04-23T10:24:47.392 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:47 smithi146 ceph-mon[32800]: Deploying daemon mds.b on smithi146 2024-04-23T10:24:47.392 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:47 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.69:6840/3448889268,v1:172.21.15.69:6841/3448889268] up:boot 2024-04-23T10:24:47.392 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:47 smithi146 ceph-mon[32800]: fsmap 11 up:standby 2024-04-23T10:24:47.392 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:47 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T10:24:47.392 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:47 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/565631465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:47 smithi069 ceph-mon[29593]: Deploying daemon mds.b on smithi146 2024-04-23T10:24:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:47 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.69:6840/3448889268,v1:172.21.15.69:6841/3448889268] up:boot 2024-04-23T10:24:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:47 smithi069 ceph-mon[29593]: fsmap 11 up:standby 2024-04-23T10:24:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:47 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T10:24:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:47 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/565631465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:47.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:47 smithi167 ceph-mon[32940]: Deploying daemon mds.b on smithi146 2024-04-23T10:24:47.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:47 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.69:6840/3448889268,v1:172.21.15.69:6841/3448889268] up:boot 2024-04-23T10:24:47.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:47 smithi167 ceph-mon[32940]: fsmap 11 up:standby 2024-04-23T10:24:47.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:47 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T10:24:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:47 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/565631465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:48.100 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:24:48 smithi146 podman[62357]: 2024-04-23 10:24:48.029029579 +0000 UTC m=+0.146792518 container create 322631e4854245c6184afe59420dfa5f22fbf9ce4f00c7bce914296a83f5e758 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:24:48.371 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:48 smithi146 ceph-mon[32800]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:48.372 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:24:48 smithi146 podman[62357]: 2024-04-23 10:24:48.281910362 +0000 UTC m=+0.399673301 container init 322631e4854245c6184afe59420dfa5f22fbf9ce4f00c7bce914296a83f5e758 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-23T10:24:48.372 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:24:48 smithi146 podman[62357]: 2024-04-23 10:24:48.284573266 +0000 UTC m=+0.402336210 container start 322631e4854245c6184afe59420dfa5f22fbf9ce4f00c7bce914296a83f5e758 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:24:48.372 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:24:48 smithi146 ceph-mds[62376]: -- 172.21.15.146:0/75645724 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5652dd183a40 con 0x5652dd156800 2024-04-23T10:24:48.372 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:24:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b[62372]: starting mds.b at 2024-04-23T10:24:48.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:48 smithi069 ceph-mon[29593]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:48.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:48 smithi167 ceph-mon[32940]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:48.677 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:24:48 smithi146 bash[62357]: 322631e4854245c6184afe59420dfa5f22fbf9ce4f00c7bce914296a83f5e758 2024-04-23T10:24:48.678 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:24:48 smithi146 systemd[1]: Started Ceph mds.b for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:24:48.843 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.944+0000 7f9d7c730640 1 -- 172.21.15.69:0/2191030637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d74102a10 msgr2=0x7f9d74104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.944+0000 7f9d7c730640 1 --2- 172.21.15.69:0/2191030637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d74102a10 0x7f9d74104e00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009900 tx=0x7f9d7002a410 comp rx=0 tx=0).stop 2024-04-23T10:24:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.944+0000 7f9d7c730640 1 -- 172.21.15.69:0/2191030637 shutdown_connections 2024-04-23T10:24:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.944+0000 7f9d7c730640 1 --2- 172.21.15.69:0/2191030637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d74107c70 0x7f9d7410a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:48.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.944+0000 7f9d7c730640 1 --2- 172.21.15.69:0/2191030637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d74105340 0x7f9d74107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.944+0000 7f9d7c730640 1 --2- 172.21.15.69:0/2191030637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d74102a10 0x7f9d74104e00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.944+0000 7f9d7c730640 1 -- 172.21.15.69:0/2191030637 >> 172.21.15.69:0/2191030637 conn(0x7f9d740fc400 msgr2=0x7f9d740fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.944+0000 7f9d7c730640 1 -- 172.21.15.69:0/2191030637 shutdown_connections 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.944+0000 7f9d7c730640 1 -- 172.21.15.69:0/2191030637 wait complete. 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7c730640 1 Processor -- start 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7c730640 1 -- start start 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7c730640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d74102a10 0x7f9d74102380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7c730640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d74105340 0x7f9d741009c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7c730640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d74107c70 0x7f9d74100f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7c730640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7410dc10 con 0x7f9d74107c70 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7c730640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7410da90 con 0x7f9d74105340 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7c730640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7410dd90 con 0x7f9d74102a10 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7accd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d74107c70 0x7f9d74100f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:48.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7accd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d74107c70 0x7f9d74100f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48496/0 (socket says 172.21.15.69:48496) 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7accd640 1 -- 172.21.15.69:0/306570320 learned_addr learned my addr 172.21.15.69:0/306570320 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d79ccb640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d74105340 0x7f9d741009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7a4cc640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d74102a10 0x7f9d74102380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7accd640 1 -- 172.21.15.69:0/306570320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d74102a10 msgr2=0x7f9d74102380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7accd640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d74102a10 0x7f9d74102380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7accd640 1 -- 172.21.15.69:0/306570320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d74105340 msgr2=0x7f9d741009c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7accd640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d74105340 0x7f9d741009c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.945+0000 7f9d7accd640 1 -- 172.21.15.69:0/306570320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d74101790 con 0x7f9d74107c70 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.946+0000 7f9d7accd640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d74107c70 0x7f9d74100f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00eb10 tx=0x7f9d6c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.946+0000 7f9d6b7fe640 1 -- 172.21.15.69:0/306570320 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c004b20 con 0x7f9d74107c70 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.946+0000 7f9d6b7fe640 1 -- 172.21.15.69:0/306570320 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d6c004cc0 con 0x7f9d74107c70 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.946+0000 7f9d7c730640 1 -- 172.21.15.69:0/306570320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d741a2400 con 0x7f9d74107c70 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.946+0000 7f9d6b7fe640 1 -- 172.21.15.69:0/306570320 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c010720 con 0x7f9d74107c70 2024-04-23T10:24:48.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.946+0000 7f9d7c730640 1 -- 172.21.15.69:0/306570320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d741a2900 con 0x7f9d74107c70 2024-04-23T10:24:48.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.947+0000 7f9d7c730640 1 -- 172.21.15.69:0/306570320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d740fdef0 con 0x7f9d74107c70 2024-04-23T10:24:48.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.948+0000 7f9d6b7fe640 1 -- 172.21.15.69:0/306570320 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9d6c005020 con 0x7f9d74107c70 2024-04-23T10:24:48.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.948+0000 7f9d6b7fe640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9d600a3bb0 0x7f9d600a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:48.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.948+0000 7f9d7a4cc640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9d600a3bb0 0x7f9d600a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:48.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.949+0000 7f9d6b7fe640 1 -- 172.21.15.69:0/306570320 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f9d6c0d0530 con 0x7f9d74107c70 2024-04-23T10:24:48.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.949+0000 7f9d7a4cc640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9d600a3bb0 0x7f9d600a6070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d70000c00 tx=0x7f9d70031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:48.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:48.953+0000 7f9d6b7fe640 1 -- 172.21.15.69:0/306570320 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9d6c09d3b0 con 0x7f9d74107c70 2024-04-23T10:24:49.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.190+0000 7f9d7c730640 1 -- 172.21.15.69:0/306570320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d74062b50 con 0x7f9d74107c70 2024-04-23T10:24:49.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.191+0000 7f9d6b7fe640 1 -- 172.21.15.69:0/306570320 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10482 (secure 0 0 0) 0x7f9d6c09ccb0 con 0x7f9d74107c70 2024-04-23T10:24:49.190 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:49.190 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24416,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-23T10:24:49.190 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 13 2024-04-23T10:24:49.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 -- 172.21.15.69:0/306570320 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9d600a3bb0 msgr2=0x7f9d600a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9d600a3bb0 0x7f9d600a6070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d70000c00 tx=0x7f9d70031510 comp rx=0 tx=0).stop 2024-04-23T10:24:49.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 -- 172.21.15.69:0/306570320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d74107c70 msgr2=0x7f9d74100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d74107c70 0x7f9d74100f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00eb10 tx=0x7f9d6c00c2d0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 -- 172.21.15.69:0/306570320 shutdown_connections 2024-04-23T10:24:49.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9d600a3bb0 0x7f9d600a6070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d74107c70 0x7f9d74100f00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d74105340 0x7f9d741009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 --2- 172.21.15.69:0/306570320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d74102a10 0x7f9d74102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 -- 172.21.15.69:0/306570320 >> 172.21.15.69:0/306570320 conn(0x7f9d740fc400 msgr2=0x7f9d74103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:49.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 -- 172.21.15.69:0/306570320 shutdown_connections 2024-04-23T10:24:49.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.193+0000 7f9d7c730640 1 -- 172.21.15.69:0/306570320 wait complete. 2024-04-23T10:24:49.204 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:24:49.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.312+0000 7f8e11642640 1 -- 172.21.15.69:0/3522208301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e0c1010f0 msgr2=0x7f8e0c101570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.312+0000 7f8e11642640 1 --2- 172.21.15.69:0/3522208301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e0c1010f0 0x7f8e0c101570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009900 tx=0x7f8dfc02a410 comp rx=0 tx=0).stop 2024-04-23T10:24:49.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.312+0000 7f8e11642640 1 -- 172.21.15.69:0/3522208301 shutdown_connections 2024-04-23T10:24:49.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.312+0000 7f8e11642640 1 --2- 172.21.15.69:0/3522208301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e0c1010f0 0x7f8e0c101570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.312+0000 7f8e11642640 1 --2- 172.21.15.69:0/3522208301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c101ab0 0x7f8e0c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.312+0000 7f8e11642640 1 --2- 172.21.15.69:0/3522208301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e0c1024a0 0x7f8e0c1028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.312+0000 7f8e11642640 1 -- 172.21.15.69:0/3522208301 >> 172.21.15.69:0/3522208301 conn(0x7f8e0c0fbb80 msgr2=0x7f8e0c0fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:49.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.312+0000 7f8e11642640 1 -- 172.21.15.69:0/3522208301 shutdown_connections 2024-04-23T10:24:49.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.312+0000 7f8e11642640 1 -- 172.21.15.69:0/3522208301 wait complete. 2024-04-23T10:24:49.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.313+0000 7f8e11642640 1 Processor -- start 2024-04-23T10:24:49.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.313+0000 7f8e11642640 1 -- start start 2024-04-23T10:24:49.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e11642640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c1010f0 0x7f8e0c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e11642640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e0c101ab0 0x7f8e0c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e11642640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e0c1024a0 0x7f8e0c19f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e11642640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c10dc50 con 0x7f8e0c101ab0 2024-04-23T10:24:49.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e11642640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c10dad0 con 0x7f8e0c1010f0 2024-04-23T10:24:49.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e11642640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c10ddd0 con 0x7f8e0c1024a0 2024-04-23T10:24:49.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e0c101ab0 0x7f8e0c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e0c101ab0 0x7f8e0c198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48514/0 (socket says 172.21.15.69:48514) 2024-04-23T10:24:49.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0a7fc640 1 -- 172.21.15.69:0/3921065312 learned_addr learned my addr 172.21.15.69:0/3921065312 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0affd640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c1010f0 0x7f8e0c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0b7fe640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e0c1024a0 0x7f8e0c19f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0a7fc640 1 -- 172.21.15.69:0/3921065312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e0c1024a0 msgr2=0x7f8e0c19f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0a7fc640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e0c1024a0 0x7f8e0c19f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0a7fc640 1 -- 172.21.15.69:0/3921065312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c1010f0 msgr2=0x7f8e0c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0a7fc640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c1010f0 0x7f8e0c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0a7fc640 1 -- 172.21.15.69:0/3921065312 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0c19ff10 con 0x7f8e0c101ab0 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0b7fe640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e0c1024a0 0x7f8e0c19f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e0a7fc640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e0c101ab0 0x7f8e0c198830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc006010 tx=0x7f8dfc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8df3fff640 1 -- 172.21.15.69:0/3921065312 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc03f030 con 0x7f8e0c101ab0 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e11642640 1 -- 172.21.15.69:0/3921065312 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0c1a01a0 con 0x7f8e0c101ab0 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8df3fff640 1 -- 172.21.15.69:0/3921065312 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8dfc003cd0 con 0x7f8e0c101ab0 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8df3fff640 1 -- 172.21.15.69:0/3921065312 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc035070 con 0x7f8e0c101ab0 2024-04-23T10:24:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.314+0000 7f8e11642640 1 -- 172.21.15.69:0/3921065312 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0c1a0690 con 0x7f8e0c101ab0 2024-04-23T10:24:49.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.316+0000 7f8e11642640 1 -- 172.21.15.69:0/3921065312 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e0c1082b0 con 0x7f8e0c101ab0 2024-04-23T10:24:49.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.317+0000 7f8df3fff640 1 -- 172.21.15.69:0/3921065312 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f8dfc042030 con 0x7f8e0c101ab0 2024-04-23T10:24:49.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.317+0000 7f8df3fff640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8df40a3bb0 0x7f8df40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.317+0000 7f8df3fff640 1 -- 172.21.15.69:0/3921065312 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f8dfc0f04b0 con 0x7f8e0c101ab0 2024-04-23T10:24:49.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.318+0000 7f8e0affd640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8df40a3bb0 0x7f8df40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.318+0000 7f8e0affd640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8df40a3bb0 0x7f8df40a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c068ec0 tx=0x7f8e00005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:49.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.322+0000 7f8df3fff640 1 -- 172.21.15.69:0/3921065312 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8dfc0bd330 con 0x7f8e0c101ab0 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.146:6838/712940861,v1:172.21.15.146:6839/712940861] up:boot 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: fsmap 12 up:standby 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T10:24:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:49 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/306570320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:49.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.509+0000 7f8e11642640 1 -- 172.21.15.69:0/3921065312 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e0c02d830 con 0x7f8e0c101ab0 2024-04-23T10:24:49.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.510+0000 7f8df3fff640 1 -- 172.21.15.69:0/3921065312 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18457 (secure 0 0 0) 0x7f8dfc0bcc30 con 0x7f8e0c101ab0 2024-04-23T10:24:49.509 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:49.510 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":82,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:24:06.204728+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:24:49.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 -- 172.21.15.69:0/3921065312 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8df40a3bb0 msgr2=0x7f8df40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8df40a3bb0 0x7f8df40a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c068ec0 tx=0x7f8e00005f90 comp rx=0 tx=0).stop 2024-04-23T10:24:49.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 -- 172.21.15.69:0/3921065312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e0c101ab0 msgr2=0x7f8e0c198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e0c101ab0 0x7f8e0c198830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc006010 tx=0x7f8dfc0042f0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 -- 172.21.15.69:0/3921065312 shutdown_connections 2024-04-23T10:24:49.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f8df40a3bb0 0x7f8df40a6070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e0c101ab0 0x7f8e0c198830 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e0c1024a0 0x7f8e0c19f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 --2- 172.21.15.69:0/3921065312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c1010f0 0x7f8e0c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 -- 172.21.15.69:0/3921065312 >> 172.21.15.69:0/3921065312 conn(0x7f8e0c0fbb80 msgr2=0x7f8e0c105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:49.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 -- 172.21.15.69:0/3921065312 shutdown_connections 2024-04-23T10:24:49.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.513+0000 7f8e11642640 1 -- 172.21.15.69:0/3921065312 wait complete. 2024-04-23T10:24:49.523 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:24:49.523 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:24:49.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.630+0000 7fc499aa7640 1 -- 172.21.15.69:0/2294094541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc494105360 msgr2=0x7fc494107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.630+0000 7fc499aa7640 1 --2- 172.21.15.69:0/2294094541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc494105360 0x7fc494107750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc488009900 tx=0x7fc48802a410 comp rx=0 tx=0).stop 2024-04-23T10:24:49.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.630+0000 7fc499aa7640 1 -- 172.21.15.69:0/2294094541 shutdown_connections 2024-04-23T10:24:49.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.630+0000 7fc499aa7640 1 --2- 172.21.15.69:0/2294094541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc494107c90 0x7fc49410a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.630+0000 7fc499aa7640 1 --2- 172.21.15.69:0/2294094541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc494105360 0x7fc494107750 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.630+0000 7fc499aa7640 1 --2- 172.21.15.69:0/2294094541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc494102a30 0x7fc494104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.630+0000 7fc499aa7640 1 -- 172.21.15.69:0/2294094541 >> 172.21.15.69:0/2294094541 conn(0x7fc4940fc440 msgr2=0x7fc4940fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:49.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.630+0000 7fc499aa7640 1 -- 172.21.15.69:0/2294094541 shutdown_connections 2024-04-23T10:24:49.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.630+0000 7fc499aa7640 1 -- 172.21.15.69:0/2294094541 wait complete. 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc499aa7640 1 Processor -- start 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc499aa7640 1 -- start start 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc499aa7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc494102a30 0x7fc494198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc499aa7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc494105360 0x7fc494198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc499aa7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc494107c90 0x7fc49419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc499aa7640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc49410dc10 con 0x7fc494102a30 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc499aa7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc49410da90 con 0x7fc494107c90 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc499aa7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc49410dd90 con 0x7fc494105360 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc4937fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc494102a30 0x7fc494198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc4937fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc494102a30 0x7fc494198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37326/0 (socket says 172.21.15.69:37326) 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc4937fe640 1 -- 172.21.15.69:0/1141078107 learned_addr learned my addr 172.21.15.69:0/1141078107 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc492ffd640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc494105360 0x7fc494198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc493fff640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc494107c90 0x7fc49419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc4937fe640 1 -- 172.21.15.69:0/1141078107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc494105360 msgr2=0x7fc494198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc4937fe640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc494105360 0x7fc494198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc4937fe640 1 -- 172.21.15.69:0/1141078107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc494107c90 msgr2=0x7fc49419f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc4937fe640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc494107c90 0x7fc49419f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.631+0000 7fc4937fe640 1 -- 172.21.15.69:0/1141078107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49419ff30 con 0x7fc494102a30 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.632+0000 7fc4937fe640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc494102a30 0x7fc494198310 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc48400e9f0 tx=0x7fc48400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.632+0000 7fc490ff9640 1 -- 172.21.15.69:0/1141078107 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48400cd80 con 0x7fc494102a30 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.632+0000 7fc490ff9640 1 -- 172.21.15.69:0/1141078107 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc484010900 con 0x7fc494102a30 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.632+0000 7fc499aa7640 1 -- 172.21.15.69:0/1141078107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4941a0220 con 0x7fc494102a30 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.632+0000 7fc490ff9640 1 -- 172.21.15.69:0/1141078107 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484018920 con 0x7fc494102a30 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.632+0000 7fc499aa7640 1 -- 172.21.15.69:0/1141078107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4941a0740 con 0x7fc494102a30 2024-04-23T10:24:49.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.633+0000 7fc499aa7640 1 -- 172.21.15.69:0/1141078107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4940fdf30 con 0x7fc494102a30 2024-04-23T10:24:49.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.634+0000 7fc490ff9640 1 -- 172.21.15.69:0/1141078107 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc484010ab0 con 0x7fc494102a30 2024-04-23T10:24:49.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.634+0000 7fc490ff9640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc47c0a3bb0 0x7fc47c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.634+0000 7fc492ffd640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc47c0a3bb0 0x7fc47c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.634+0000 7fc490ff9640 1 -- 172.21.15.69:0/1141078107 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fc4840d0390 con 0x7fc494102a30 2024-04-23T10:24:49.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.635+0000 7fc492ffd640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc47c0a3bb0 0x7fc47c0a6070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc488009230 tx=0x7fc488031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:49.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.639+0000 7fc490ff9640 1 -- 172.21.15.69:0/1141078107 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc48409d210 con 0x7fc494102a30 2024-04-23T10:24:49.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:49.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:49.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.146:6838/712940861,v1:172.21.15.146:6839/712940861] up:boot 2024-04-23T10:24:49.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: fsmap 12 up:standby 2024-04-23T10:24:49.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T10:24:49.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:49 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/306570320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.146:6838/712940861,v1:172.21.15.146:6839/712940861] up:boot 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: fsmap 12 up:standby 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T10:24:49.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:49 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/306570320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:24:49.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.820+0000 7fc499aa7640 1 -- 172.21.15.69:0/1141078107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc49402d7e0 con 0x7fc494102a30 2024-04-23T10:24:49.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.821+0000 7fc490ff9640 1 -- 172.21.15.69:0/1141078107 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7fc48409cb10 con 0x7fc494102a30 2024-04-23T10:24:49.820 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 -- 172.21.15.69:0/1141078107 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc47c0a3bb0 msgr2=0x7fc47c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc47c0a3bb0 0x7fc47c0a6070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc488009230 tx=0x7fc488031510 comp rx=0 tx=0).stop 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 -- 172.21.15.69:0/1141078107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc494102a30 msgr2=0x7fc494198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc494102a30 0x7fc494198310 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc48400e9f0 tx=0x7fc48400eeb0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 -- 172.21.15.69:0/1141078107 shutdown_connections 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc47c0a3bb0 0x7fc47c0a6070 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc494107c90 0x7fc49419f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc494105360 0x7fc494198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 --2- 172.21.15.69:0/1141078107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc494102a30 0x7fc494198310 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 -- 172.21.15.69:0/1141078107 >> 172.21.15.69:0/1141078107 conn(0x7fc4940fc440 msgr2=0x7fc494103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 -- 172.21.15.69:0/1141078107 shutdown_connections 2024-04-23T10:24:49.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.823+0000 7fc499aa7640 1 -- 172.21.15.69:0/1141078107 wait complete. 2024-04-23T10:24:49.833 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-23T10:24:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.936+0000 7f7722b9b640 1 -- 172.21.15.69:0/3409653178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f771c101fa0 msgr2=0x7f771c1023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.936+0000 7f7722b9b640 1 --2- 172.21.15.69:0/3409653178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f771c101fa0 0x7f771c1023c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7710009900 tx=0x7f771002a410 comp rx=0 tx=0).stop 2024-04-23T10:24:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.936+0000 7f7722b9b640 1 -- 172.21.15.69:0/3409653178 shutdown_connections 2024-04-23T10:24:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.936+0000 7f7722b9b640 1 --2- 172.21.15.69:0/3409653178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f771c103b50 0x7f771c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.936+0000 7f7722b9b640 1 --2- 172.21.15.69:0/3409653178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c103190 0x7f771c103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.936+0000 7f7722b9b640 1 --2- 172.21.15.69:0/3409653178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f771c101fa0 0x7f771c1023c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.936+0000 7f7722b9b640 1 -- 172.21.15.69:0/3409653178 >> 172.21.15.69:0/3409653178 conn(0x7f771c0fd550 msgr2=0x7f771c0ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.936+0000 7f7722b9b640 1 -- 172.21.15.69:0/3409653178 shutdown_connections 2024-04-23T10:24:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.936+0000 7f7722b9b640 1 -- 172.21.15.69:0/3409653178 wait complete. 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7722b9b640 1 Processor -- start 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7722b9b640 1 -- start start 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7722b9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f771c101fa0 0x7f771c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7722b9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c103190 0x7f771c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7722b9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f771c103b50 0x7f771c19f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7722b9b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f771c10dc00 con 0x7f771c101fa0 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7722b9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f771c10da80 con 0x7f771c103190 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7722b9b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f771c10dd80 con 0x7f771c103b50 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7720937640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f771c101fa0 0x7f771c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7720937640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f771c101fa0 0x7f771c1982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37340/0 (socket says 172.21.15.69:37340) 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7720937640 1 -- 172.21.15.69:0/4014061442 learned_addr learned my addr 172.21.15.69:0/4014061442 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7721138640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f771c103b50 0x7f771c19f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f771bfff640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c103190 0x7f771c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7720937640 1 -- 172.21.15.69:0/4014061442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f771c103b50 msgr2=0x7f771c19f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7720937640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f771c103b50 0x7f771c19f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7720937640 1 -- 172.21.15.69:0/4014061442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c103190 msgr2=0x7f771c198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7720937640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c103190 0x7f771c198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.937+0000 7f7720937640 1 -- 172.21.15.69:0/4014061442 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c19fef0 con 0x7f771c101fa0 2024-04-23T10:24:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.938+0000 7f7720937640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f771c101fa0 0x7f771c1982d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7710006010 tx=0x7f77100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.938+0000 7f7719ffb640 1 -- 172.21.15.69:0/4014061442 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771003f030 con 0x7f771c101fa0 2024-04-23T10:24:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.938+0000 7f7719ffb640 1 -- 172.21.15.69:0/4014061442 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7710003cd0 con 0x7f771c101fa0 2024-04-23T10:24:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.938+0000 7f7722b9b640 1 -- 172.21.15.69:0/4014061442 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c1a0180 con 0x7f771c101fa0 2024-04-23T10:24:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.938+0000 7f7719ffb640 1 -- 172.21.15.69:0/4014061442 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710035070 con 0x7f771c101fa0 2024-04-23T10:24:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.938+0000 7f7722b9b640 1 -- 172.21.15.69:0/4014061442 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c1a06c0 con 0x7f771c101fa0 2024-04-23T10:24:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.939+0000 7f7722b9b640 1 -- 172.21.15.69:0/4014061442 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771c1092c0 con 0x7f771c101fa0 2024-04-23T10:24:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.941+0000 7f7719ffb640 1 -- 172.21.15.69:0/4014061442 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f7710042030 con 0x7f771c101fa0 2024-04-23T10:24:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.942+0000 7f7719ffb640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f770c0a3c30 0x7f770c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.942+0000 7f7719ffb640 1 -- 172.21.15.69:0/4014061442 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f77100f07e0 con 0x7f771c101fa0 2024-04-23T10:24:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.942+0000 7f771bfff640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f770c0a3c30 0x7f770c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:49.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.942+0000 7f771bfff640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f770c0a3c30 0x7f770c0a60f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f77080095f0 tx=0x7f7708005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:49.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:49.946+0000 7f7719ffb640 1 -- 172.21.15.69:0/4014061442 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f77100bd010 con 0x7f771c101fa0 2024-04-23T10:24:50.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.152+0000 7f7722b9b640 1 -- 172.21.15.69:0/4014061442 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f771c062b50 con 0x7f771c101fa0 2024-04-23T10:24:50.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.153+0000 7f7719ffb640 1 -- 172.21.15.69:0/4014061442 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7f77100c1310 con 0x7f771c101fa0 2024-04-23T10:24:50.152 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2024-04-23T10:24:50.152 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:24:50.152 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 1, 2024-04-23T10:24:50.152 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": ".mgr" 2024-04-23T10:24:50.152 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:24:50.152 INFO:teuthology.orchestra.run.smithi069.stdout:] 2024-04-23T10:24:50.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 -- 172.21.15.69:0/4014061442 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f770c0a3c30 msgr2=0x7f770c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:50.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f770c0a3c30 0x7f770c0a60f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f77080095f0 tx=0x7f7708005f90 comp rx=0 tx=0).stop 2024-04-23T10:24:50.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 -- 172.21.15.69:0/4014061442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f771c101fa0 msgr2=0x7f771c1982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:50.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f771c101fa0 0x7f771c1982d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7710006010 tx=0x7f77100042f0 comp rx=0 tx=0).stop 2024-04-23T10:24:50.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 -- 172.21.15.69:0/4014061442 shutdown_connections 2024-04-23T10:24:50.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f770c0a3c30 0x7f770c0a60f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:50.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f771c103b50 0x7f771c19f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:50.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c103190 0x7f771c198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:50.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 --2- 172.21.15.69:0/4014061442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f771c101fa0 0x7f771c1982d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:50.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 -- 172.21.15.69:0/4014061442 >> 172.21.15.69:0/4014061442 conn(0x7f771c0fd550 msgr2=0x7f771c106490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:50.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 -- 172.21.15.69:0/4014061442 shutdown_connections 2024-04-23T10:24:50.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.155+0000 7f7722b9b640 1 -- 172.21.15.69:0/4014061442 wait complete. 2024-04-23T10:24:50.165 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-23T10:24:50.166 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-23T10:24:50.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.283+0000 7fda94529640 1 -- 172.21.15.69:0/1759093489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda8c102420 msgr2=0x7fda8c102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.283+0000 7fda94529640 1 --2- 172.21.15.69:0/1759093489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda8c102420 0x7fda8c102840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fda88009900 tx=0x7fda8802a410 comp rx=0 tx=0).stop 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.283+0000 7fda94529640 1 -- 172.21.15.69:0/1759093489 shutdown_connections 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.283+0000 7fda94529640 1 --2- 172.21.15.69:0/1759093489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda8c101b10 0x7fda8c1093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.283+0000 7fda94529640 1 --2- 172.21.15.69:0/1759093489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda8c101150 0x7fda8c1015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.283+0000 7fda94529640 1 --2- 172.21.15.69:0/1759093489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda8c102420 0x7fda8c102840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.283+0000 7fda94529640 1 -- 172.21.15.69:0/1759093489 >> 172.21.15.69:0/1759093489 conn(0x7fda8c0fbb80 msgr2=0x7fda8c0fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.283+0000 7fda94529640 1 -- 172.21.15.69:0/1759093489 shutdown_connections 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.283+0000 7fda94529640 1 -- 172.21.15.69:0/1759093489 wait complete. 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.284+0000 7fda94529640 1 Processor -- start 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.284+0000 7fda94529640 1 -- start start 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.284+0000 7fda94529640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda8c101150 0x7fda8c197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.284+0000 7fda94529640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda8c101b10 0x7fda8c197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.284+0000 7fda94529640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda8c102420 0x7fda8c19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:50.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.284+0000 7fda94529640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fda8c10cb10 con 0x7fda8c102420 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.284+0000 7fda94529640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fda8c10c990 con 0x7fda8c101b10 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.284+0000 7fda94529640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fda8c10cc90 con 0x7fda8c101150 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda92ac6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda8c102420 0x7fda8c19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda922c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda8c101150 0x7fda8c197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda922c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda8c101150 0x7fda8c197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.69:53986/0 (socket says 172.21.15.69:53986) 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda922c5640 1 -- 172.21.15.69:0/1608472832 learned_addr learned my addr 172.21.15.69:0/1608472832 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda92ac6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda8c102420 0x7fda8c19e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37352/0 (socket says 172.21.15.69:37352) 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda91ac4640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda8c101b10 0x7fda8c197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda922c5640 1 -- 172.21.15.69:0/1608472832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda8c101b10 msgr2=0x7fda8c197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda922c5640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda8c101b10 0x7fda8c197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda922c5640 1 -- 172.21.15.69:0/1608472832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda8c102420 msgr2=0x7fda8c19e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda922c5640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda8c102420 0x7fda8c19e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda922c5640 1 -- 172.21.15.69:0/1608472832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8c19ee30 con 0x7fda8c101150 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda922c5640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda8c101150 0x7fda8c197210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda88006010 tx=0x7fda880042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:50.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda837fe640 1 -- 172.21.15.69:0/1608472832 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8803f030 con 0x7fda8c101150 2024-04-23T10:24:50.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda94529640 1 -- 172.21.15.69:0/1608472832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda8c19f0c0 con 0x7fda8c101150 2024-04-23T10:24:50.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda837fe640 1 -- 172.21.15.69:0/1608472832 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fda88003cd0 con 0x7fda8c101150 2024-04-23T10:24:50.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda837fe640 1 -- 172.21.15.69:0/1608472832 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88035070 con 0x7fda8c101150 2024-04-23T10:24:50.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.285+0000 7fda94529640 1 -- 172.21.15.69:0/1608472832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda8c19f5b0 con 0x7fda8c101150 2024-04-23T10:24:50.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.286+0000 7fda94529640 1 -- 172.21.15.69:0/1608472832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda8c108360 con 0x7fda8c101150 2024-04-23T10:24:50.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.287+0000 7fda837fe640 1 -- 172.21.15.69:0/1608472832 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fda88042030 con 0x7fda8c101150 2024-04-23T10:24:50.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.288+0000 7fda837fe640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fda780a3bb0 0x7fda780a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:50.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.288+0000 7fda837fe640 1 -- 172.21.15.69:0/1608472832 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fda880f0640 con 0x7fda8c101150 2024-04-23T10:24:50.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.288+0000 7fda91ac4640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fda780a3bb0 0x7fda780a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:50.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.289+0000 7fda91ac4640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fda780a3bb0 0x7fda780a6070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda8c198720 tx=0x7fda7c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:50.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.292+0000 7fda837fe640 1 -- 172.21.15.69:0/1608472832 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fda880bcdd0 con 0x7fda8c101150 2024-04-23T10:24:50.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:50.479+0000 7fda94529640 1 -- 172.21.15.69:0/1608472832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fda8c02d5c0 con 0x7fda8c101150 2024-04-23T10:24:50.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:50 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3921065312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:50.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:50 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1141078107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:24:50.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:50 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/4014061442' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-23T10:24:50.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:50 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:50.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:50 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:50.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:50 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:50.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:50 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:50.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:50 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3921065312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:50.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:50 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1141078107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:24:50.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:50 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/4014061442' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-23T10:24:50.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:50 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:50.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:50 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:50.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:50 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:50.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:50 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:50.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:50 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3921065312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:50.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:50 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1141078107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:24:50.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:50 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/4014061442' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-23T10:24:50.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:50 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:50.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:50 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:50.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:50 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:50.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:50 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:51.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.471+0000 7fda837fe640 1 -- 172.21.15.69:0/1608472832 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7fda880c10d0 con 0x7fda8c101150 2024-04-23T10:24:51.470 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' created 2024-04-23T10:24:51.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.475+0000 7fda94529640 1 -- 172.21.15.69:0/1608472832 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fda780a3bb0 msgr2=0x7fda780a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:51.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.475+0000 7fda94529640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fda780a3bb0 0x7fda780a6070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda8c198720 tx=0x7fda7c005f90 comp rx=0 tx=0).stop 2024-04-23T10:24:51.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.475+0000 7fda94529640 1 -- 172.21.15.69:0/1608472832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda8c101150 msgr2=0x7fda8c197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:51.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.475+0000 7fda94529640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda8c101150 0x7fda8c197210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda88006010 tx=0x7fda880042f0 comp rx=0 tx=0).stop 2024-04-23T10:24:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.475+0000 7fda94529640 1 -- 172.21.15.69:0/1608472832 shutdown_connections 2024-04-23T10:24:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.475+0000 7fda94529640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fda780a3bb0 0x7fda780a6070 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.475+0000 7fda94529640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda8c102420 0x7fda8c19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.475+0000 7fda94529640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda8c101b10 0x7fda8c197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.475+0000 7fda94529640 1 --2- 172.21.15.69:0/1608472832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda8c101150 0x7fda8c197210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.475+0000 7fda94529640 1 -- 172.21.15.69:0/1608472832 >> 172.21.15.69:0/1608472832 conn(0x7fda8c0fbb80 msgr2=0x7fda8c105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.475+0000 7fda94529640 1 -- 172.21.15.69:0/1608472832 shutdown_connections 2024-04-23T10:24:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.476+0000 7fda94529640 1 -- 172.21.15.69:0/1608472832 wait complete. 2024-04-23T10:24:51.487 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-23T10:24:51.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.604+0000 7fdd88459640 1 -- 172.21.15.69:0/2128683135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80101fa0 msgr2=0x7fdd801023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:51.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.604+0000 7fdd88459640 1 --2- 172.21.15.69:0/2128683135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80101fa0 0x7fdd801023c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdd70009900 tx=0x7fdd7002a410 comp rx=0 tx=0).stop 2024-04-23T10:24:51.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.604+0000 7fdd88459640 1 -- 172.21.15.69:0/2128683135 shutdown_connections 2024-04-23T10:24:51.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.604+0000 7fdd88459640 1 --2- 172.21.15.69:0/2128683135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd80103b50 0x7fdd8010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:51.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.604+0000 7fdd88459640 1 --2- 172.21.15.69:0/2128683135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd80103190 0x7fdd80103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:51.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.604+0000 7fdd88459640 1 --2- 172.21.15.69:0/2128683135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80101fa0 0x7fdd801023c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:51.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.604+0000 7fdd88459640 1 -- 172.21.15.69:0/2128683135 >> 172.21.15.69:0/2128683135 conn(0x7fdd800fd530 msgr2=0x7fdd800ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:51.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.604+0000 7fdd88459640 1 -- 172.21.15.69:0/2128683135 shutdown_connections 2024-04-23T10:24:51.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.604+0000 7fdd88459640 1 -- 172.21.15.69:0/2128683135 wait complete. 2024-04-23T10:24:51.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd88459640 1 Processor -- start 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd88459640 1 -- start start 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd88459640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd80101fa0 0x7fdd80198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd88459640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd80103190 0x7fdd80198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd88459640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80103b50 0x7fdd8019f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd88459640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8010dc00 con 0x7fdd80103b50 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd88459640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8010da80 con 0x7fdd80103190 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd88459640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8010dd80 con 0x7fdd80101fa0 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd869f6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80103b50 0x7fdd8019f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd869f6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80103b50 0x7fdd8019f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37374/0 (socket says 172.21.15.69:37374) 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd869f6640 1 -- 172.21.15.69:0/3830189902 learned_addr learned my addr 172.21.15.69:0/3830189902 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd861f5640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd80101fa0 0x7fdd80198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd859f4640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd80103190 0x7fdd80198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd869f6640 1 -- 172.21.15.69:0/3830189902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd80101fa0 msgr2=0x7fdd80198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd869f6640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd80101fa0 0x7fdd80198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd869f6640 1 -- 172.21.15.69:0/3830189902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd80103190 msgr2=0x7fdd80198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd869f6640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd80103190 0x7fdd80198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.605+0000 7fdd869f6640 1 -- 172.21.15.69:0/3830189902 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8019ff50 con 0x7fdd80103b50 2024-04-23T10:24:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.606+0000 7fdd869f6640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80103b50 0x7fdd8019f8e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800efd0 tx=0x7fdd7800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.606+0000 7fdd777fe640 1 -- 172.21.15.69:0/3830189902 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78003b70 con 0x7fdd80103b50 2024-04-23T10:24:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.606+0000 7fdd777fe640 1 -- 172.21.15.69:0/3830189902 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd78003d10 con 0x7fdd80103b50 2024-04-23T10:24:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.606+0000 7fdd777fe640 1 -- 172.21.15.69:0/3830189902 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78010990 con 0x7fdd80103b50 2024-04-23T10:24:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.606+0000 7fdd88459640 1 -- 172.21.15.69:0/3830189902 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd801a0240 con 0x7fdd80103b50 2024-04-23T10:24:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.606+0000 7fdd88459640 1 -- 172.21.15.69:0/3830189902 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd801a0790 con 0x7fdd80103b50 2024-04-23T10:24:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.607+0000 7fdd88459640 1 -- 172.21.15.69:0/3830189902 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd80109430 con 0x7fdd80103b50 2024-04-23T10:24:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.609+0000 7fdd777fe640 1 -- 172.21.15.69:0/3830189902 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fdd78004b40 con 0x7fdd80103b50 2024-04-23T10:24:51.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.609+0000 7fdd777fe640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdd6c0a3c30 0x7fdd6c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:51.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.610+0000 7fdd861f5640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdd6c0a3c30 0x7fdd6c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:51.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.610+0000 7fdd777fe640 1 -- 172.21.15.69:0/3830189902 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7497+0+0 (secure 0 0 0) 0x7fdd780d0850 con 0x7fdd80103b50 2024-04-23T10:24:51.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.610+0000 7fdd861f5640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdd6c0a3c30 0x7fdd6c0a60f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdd70009230 tx=0x7fdd70031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:51.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.613+0000 7fdd777fe640 1 -- 172.21.15.69:0/3830189902 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdd7809d560 con 0x7fdd80103b50 2024-04-23T10:24:51.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:51 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:51.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:51 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:51.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:51 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1608472832' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T10:24:51.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:51 smithi069 ceph-mon[29593]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T10:24:51.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:51 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:51.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:51 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:51.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:51 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:51.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:51 smithi069 ceph-mon[29593]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:51.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:51 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:51.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:51.811+0000 7fdd88459640 1 -- 172.21.15.69:0/3830189902 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdd8002d5c0 con 0x7fdd80103b50 2024-04-23T10:24:51.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:51 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:51.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:51 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:51.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:51 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1608472832' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T10:24:51.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:51 smithi167 ceph-mon[32940]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T10:24:51.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:51 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:51.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:51 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:51.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:51 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:51.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:51 smithi167 ceph-mon[32940]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:51.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:51 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:51.871 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:51 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:51.871 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:51 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:51.871 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:51 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1608472832' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T10:24:51.871 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:51 smithi146 ceph-mon[32800]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-23T10:24:51.871 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:51 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:51.871 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:51 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:51.871 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:51 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:51.871 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:51 smithi146 ceph-mon[32800]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:51.871 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:51 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:24:52.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.474+0000 7fdd777fe640 1 -- 172.21.15.69:0/3830189902 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) ==== 170+0+0 (secure 0 0 0) 0x7fdd7809ce60 con 0x7fdd80103b50 2024-04-23T10:24:52.473 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' created 2024-04-23T10:24:52.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.476+0000 7fdd88459640 1 -- 172.21.15.69:0/3830189902 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdd6c0a3c30 msgr2=0x7fdd6c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:52.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.476+0000 7fdd88459640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdd6c0a3c30 0x7fdd6c0a60f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdd70009230 tx=0x7fdd70031510 comp rx=0 tx=0).stop 2024-04-23T10:24:52.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.476+0000 7fdd88459640 1 -- 172.21.15.69:0/3830189902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80103b50 msgr2=0x7fdd8019f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:52.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.476+0000 7fdd88459640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80103b50 0x7fdd8019f8e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800efd0 tx=0x7fdd7800c6a0 comp rx=0 tx=0).stop 2024-04-23T10:24:52.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.476+0000 7fdd88459640 1 -- 172.21.15.69:0/3830189902 shutdown_connections 2024-04-23T10:24:52.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.476+0000 7fdd88459640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdd6c0a3c30 0x7fdd6c0a60f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:52.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.476+0000 7fdd88459640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd80103b50 0x7fdd8019f8e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:52.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.476+0000 7fdd88459640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd80103190 0x7fdd80198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:52.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.476+0000 7fdd88459640 1 --2- 172.21.15.69:0/3830189902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd80101fa0 0x7fdd80198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:52.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.476+0000 7fdd88459640 1 -- 172.21.15.69:0/3830189902 >> 172.21.15.69:0/3830189902 conn(0x7fdd800fd530 msgr2=0x7fdd80106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:52.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.477+0000 7fdd88459640 1 -- 172.21.15.69:0/3830189902 shutdown_connections 2024-04-23T10:24:52.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.477+0000 7fdd88459640 1 -- 172.21.15.69:0/3830189902 wait complete. 2024-04-23T10:24:52.500 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-23T10:24:52.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.613+0000 7f7925291640 1 -- 172.21.15.69:0/2659867807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7920101fa0 msgr2=0x7f79201023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:52.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.613+0000 7f7925291640 1 --2- 172.21.15.69:0/2659867807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7920101fa0 0x7f79201023c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7914009900 tx=0x7f791402a410 comp rx=0 tx=0).stop 2024-04-23T10:24:52.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.613+0000 7f7925291640 1 -- 172.21.15.69:0/2659867807 shutdown_connections 2024-04-23T10:24:52.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.613+0000 7f7925291640 1 --2- 172.21.15.69:0/2659867807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7920103b50 0x7f792010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:52.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.613+0000 7f7925291640 1 --2- 172.21.15.69:0/2659867807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920103190 0x7f7920103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:52.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.613+0000 7f7925291640 1 --2- 172.21.15.69:0/2659867807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7920101fa0 0x7f79201023c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:52.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.613+0000 7f7925291640 1 -- 172.21.15.69:0/2659867807 >> 172.21.15.69:0/2659867807 conn(0x7f79200fd530 msgr2=0x7f79200ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:52.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.613+0000 7f7925291640 1 -- 172.21.15.69:0/2659867807 shutdown_connections 2024-04-23T10:24:52.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.613+0000 7f7925291640 1 -- 172.21.15.69:0/2659867807 wait complete. 2024-04-23T10:24:52.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.613+0000 7f7925291640 1 Processor -- start 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f7925291640 1 -- start start 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f7925291640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920101fa0 0x7f79201982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f7925291640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7920103190 0x7f7920198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f7925291640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7920103b50 0x7f792019f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f7925291640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f792010dc50 con 0x7f7920103b50 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f7925291640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f792010dad0 con 0x7f7920101fa0 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f7925291640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f792010ddd0 con 0x7f7920103190 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f791f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7920103b50 0x7f792019f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f791f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7920103b50 0x7f792019f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37404/0 (socket says 172.21.15.69:37404) 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f791f7fe640 1 -- 172.21.15.69:0/3850912376 learned_addr learned my addr 172.21.15.69:0/3850912376 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f791e7fc640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7920103190 0x7f7920198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:52.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f791effd640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920101fa0 0x7f79201982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f791f7fe640 1 -- 172.21.15.69:0/3850912376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7920103190 msgr2=0x7f7920198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f791f7fe640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7920103190 0x7f7920198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f791f7fe640 1 -- 172.21.15.69:0/3850912376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920101fa0 msgr2=0x7f79201982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f791f7fe640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920101fa0 0x7f79201982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f791f7fe640 1 -- 172.21.15.69:0/3850912376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792019fef0 con 0x7f7920103b50 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f791f7fe640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7920103b50 0x7f792019f880 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f791800eb10 tx=0x7f791800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.614+0000 7f7907fff640 1 -- 172.21.15.69:0/3850912376 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918004b20 con 0x7f7920103b50 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.615+0000 7f7925291640 1 -- 172.21.15.69:0/3850912376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79201a01e0 con 0x7f7920103b50 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.615+0000 7f7907fff640 1 -- 172.21.15.69:0/3850912376 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7918004cc0 con 0x7f7920103b50 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.615+0000 7f7907fff640 1 -- 172.21.15.69:0/3850912376 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918010720 con 0x7f7920103b50 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.615+0000 7f7925291640 1 -- 172.21.15.69:0/3850912376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79201a0730 con 0x7f7920103b50 2024-04-23T10:24:52.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.616+0000 7f7925291640 1 -- 172.21.15.69:0/3850912376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7920109340 con 0x7f7920103b50 2024-04-23T10:24:52.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.618+0000 7f7907fff640 1 -- 172.21.15.69:0/3850912376 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f7918005000 con 0x7f7920103b50 2024-04-23T10:24:52.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.618+0000 7f7907fff640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f79080a3c30 0x7f79080a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:52.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.618+0000 7f7907fff640 1 -- 172.21.15.69:0/3850912376 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7879+0+0 (secure 0 0 0) 0x7f79180d0a30 con 0x7f7920103b50 2024-04-23T10:24:52.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.618+0000 7f791effd640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f79080a3c30 0x7f79080a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:52.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.619+0000 7f791effd640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f79080a3c30 0x7f79080a60f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7914005ab0 tx=0x7f7914005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:52.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.622+0000 7f7907fff640 1 -- 172.21.15.69:0/3850912376 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7918053ff0 con 0x7f7920103b50 2024-04-23T10:24:52.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:52 smithi069 ceph-mon[29593]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-23T10:24:52.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:52 smithi069 ceph-mon[29593]: osdmap e83: 12 total, 12 up, 12 in 2024-04-23T10:24:52.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:52 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3830189902' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-23T10:24:52.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:52 smithi167 ceph-mon[32940]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-23T10:24:52.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:52 smithi167 ceph-mon[32940]: osdmap e83: 12 total, 12 up, 12 in 2024-04-23T10:24:52.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:52 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3830189902' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-23T10:24:52.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:52.876+0000 7f7925291640 1 -- 172.21.15.69:0/3850912376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f792002d5c0 con 0x7f7920103b50 2024-04-23T10:24:52.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:52 smithi146 ceph-mon[32800]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-23T10:24:52.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:52 smithi146 ceph-mon[32800]: osdmap e83: 12 total, 12 up, 12 in 2024-04-23T10:24:52.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:52 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3830189902' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-23T10:24:53.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3830189902' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-23T10:24:53.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: osdmap e84: 12 total, 12 up, 12 in 2024-04-23T10:24:53.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:53.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:53.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3850912376' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-23T10:24:53.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-04-23T10:24:53.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:53 smithi069 ceph-mon[29593]: pgmap v281: 97 pgs: 17 creating+peering, 79 unknown, 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:53.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.818+0000 7f7907fff640 1 -- 172.21.15.69:0/3850912376 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f791809d520 con 0x7f7920103b50 2024-04-23T10:24:53.817 INFO:teuthology.orchestra.run.smithi069.stderr:new fs with metadata pool 2 and data pool 3 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.821+0000 7f7925291640 1 -- 172.21.15.69:0/3850912376 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f79080a3c30 msgr2=0x7f79080a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.821+0000 7f7925291640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f79080a3c30 0x7f79080a60f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7914005ab0 tx=0x7f7914005a20 comp rx=0 tx=0).stop 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.821+0000 7f7925291640 1 -- 172.21.15.69:0/3850912376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7920103b50 msgr2=0x7f792019f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.821+0000 7f7925291640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7920103b50 0x7f792019f880 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f791800eb10 tx=0x7f791800c2d0 comp rx=0 tx=0).stop 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.821+0000 7f7925291640 1 -- 172.21.15.69:0/3850912376 shutdown_connections 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.821+0000 7f7925291640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f79080a3c30 0x7f79080a60f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.821+0000 7f7925291640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7920103b50 0x7f792019f880 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.821+0000 7f7925291640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7920103190 0x7f7920198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.821+0000 7f7925291640 1 --2- 172.21.15.69:0/3850912376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7920101fa0 0x7f79201982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.821+0000 7f7925291640 1 -- 172.21.15.69:0/3850912376 >> 172.21.15.69:0/3850912376 conn(0x7f79200fd530 msgr2=0x7f7920106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.822+0000 7f7925291640 1 -- 172.21.15.69:0/3850912376 shutdown_connections 2024-04-23T10:24:53.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.822+0000 7f7925291640 1 -- 172.21.15.69:0/3850912376 wait complete. 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3830189902' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: osdmap e84: 12 total, 12 up, 12 in 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3850912376' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-04-23T10:24:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:53 smithi167 ceph-mon[32940]: pgmap v281: 97 pgs: 17 creating+peering, 79 unknown, 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:53.837 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3830189902' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: osdmap e84: 12 total, 12 up, 12 in 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:24:53.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3850912376' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-23T10:24:53.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-04-23T10:24:53.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:53 smithi146 ceph-mon[32800]: pgmap v281: 97 pgs: 17 creating+peering, 79 unknown, 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.940+0000 7f3ec7d68640 1 -- 172.21.15.69:0/1938815638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ec0103c00 msgr2=0x7f3ec010a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.940+0000 7f3ec7d68640 1 --2- 172.21.15.69:0/1938815638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ec0103c00 0x7f3ec010a490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009930 tx=0x7f3eb802a420 comp rx=0 tx=0).stop 2024-04-23T10:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.940+0000 7f3ec7d68640 1 -- 172.21.15.69:0/1938815638 shutdown_connections 2024-04-23T10:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.940+0000 7f3ec7d68640 1 --2- 172.21.15.69:0/1938815638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ec0103c00 0x7f3ec010a490 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.940+0000 7f3ec7d68640 1 --2- 172.21.15.69:0/1938815638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec0103240 0x7f3ec01036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.940+0000 7f3ec7d68640 1 --2- 172.21.15.69:0/1938815638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0100270 0x7f3ec0100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.940+0000 7f3ec7d68640 1 -- 172.21.15.69:0/1938815638 >> 172.21.15.69:0/1938815638 conn(0x7f3ec00fbbc0 msgr2=0x7f3ec00fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.940+0000 7f3ec7d68640 1 -- 172.21.15.69:0/1938815638 shutdown_connections 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.940+0000 7f3ec7d68640 1 -- 172.21.15.69:0/1938815638 wait complete. 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec7d68640 1 Processor -- start 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec7d68640 1 -- start start 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec7d68640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ec0100270 0x7f3ec01982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec7d68640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec0103240 0x7f3ec0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec7d68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0103c00 0x7f3ec019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec7d68640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec010dc30 con 0x7f3ec0100270 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec7d68640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec010dab0 con 0x7f3ec0103c00 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec7d68640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec010ddb0 con 0x7f3ec0103240 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec5b04640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ec0100270 0x7f3ec01982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec5b04640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ec0100270 0x7f3ec01982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37432/0 (socket says 172.21.15.69:37432) 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec5b04640 1 -- 172.21.15.69:0/986167914 learned_addr learned my addr 172.21.15.69:0/986167914 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec5303640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec0103240 0x7f3ec0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec6305640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0103c00 0x7f3ec019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec5b04640 1 -- 172.21.15.69:0/986167914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec0103240 msgr2=0x7f3ec0198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec5b04640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec0103240 0x7f3ec0198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec5b04640 1 -- 172.21.15.69:0/986167914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0103c00 msgr2=0x7f3ec019f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.941+0000 7f3ec5b04640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0103c00 0x7f3ec019f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.942+0000 7f3ec5b04640 1 -- 172.21.15.69:0/986167914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec019ff00 con 0x7f3ec0100270 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.942+0000 7f3ec6305640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0103c00 0x7f3ec019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.942+0000 7f3ec5b04640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ec0100270 0x7f3ec01982e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009fd0 tx=0x7f3ebc00c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.942+0000 7f3eb6ffd640 1 -- 172.21.15.69:0/986167914 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc011470 con 0x7f3ec0100270 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.942+0000 7f3eb6ffd640 1 -- 172.21.15.69:0/986167914 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ebc011ae0 con 0x7f3ec0100270 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.942+0000 7f3eb6ffd640 1 -- 172.21.15.69:0/986167914 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc01ab60 con 0x7f3ec0100270 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.942+0000 7f3ec7d68640 1 -- 172.21.15.69:0/986167914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec01a01f0 con 0x7f3ec0100270 2024-04-23T10:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.942+0000 7f3ec7d68640 1 -- 172.21.15.69:0/986167914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec01a0740 con 0x7f3ec0100270 2024-04-23T10:24:53.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.943+0000 7f3ec7d68640 1 -- 172.21.15.69:0/986167914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec0109310 con 0x7f3ec0100270 2024-04-23T10:24:53.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.944+0000 7f3eb6ffd640 1 -- 172.21.15.69:0/986167914 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f3ebc01ad00 con 0x7f3ec0100270 2024-04-23T10:24:53.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.945+0000 7f3eb6ffd640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3eac0a3bb0 0x7f3eac0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:53.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.945+0000 7f3ec5303640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3eac0a3bb0 0x7f3eac0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:53.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.945+0000 7f3eb6ffd640 1 -- 172.21.15.69:0/986167914 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f3ebc0d0840 con 0x7f3ec0100270 2024-04-23T10:24:53.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.945+0000 7f3ec5303640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3eac0a3bb0 0x7f3eac0a6070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ec01997f0 tx=0x7f3eb0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:53.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:53.950+0000 7f3eb6ffd640 1 -- 172.21.15.69:0/986167914 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3ebc016030 con 0x7f3ec0100270 2024-04-23T10:24:54.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.130+0000 7f3ec7d68640 1 -- 172.21.15.69:0/986167914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ec0062b50 con 0x7f3ec0100270 2024-04-23T10:24:54.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.132+0000 7f3eb6ffd640 1 -- 172.21.15.69:0/986167914 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22233 (secure 0 0 0) 0x7f3ebc09d370 con 0x7f3ec0100270 2024-04-23T10:24:54.131 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:54.131 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":85,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:24:52.877457+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:24:54.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 -- 172.21.15.69:0/986167914 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3eac0a3bb0 msgr2=0x7f3eac0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3eac0a3bb0 0x7f3eac0a6070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ec01997f0 tx=0x7f3eb0005f90 comp rx=0 tx=0).stop 2024-04-23T10:24:54.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 -- 172.21.15.69:0/986167914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ec0100270 msgr2=0x7f3ec01982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ec0100270 0x7f3ec01982e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009fd0 tx=0x7f3ebc00c270 comp rx=0 tx=0).stop 2024-04-23T10:24:54.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 -- 172.21.15.69:0/986167914 shutdown_connections 2024-04-23T10:24:54.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3eac0a3bb0 0x7f3eac0a6070 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0103c00 0x7f3ec019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec0103240 0x7f3ec0198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 --2- 172.21.15.69:0/986167914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ec0100270 0x7f3ec01982e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 -- 172.21.15.69:0/986167914 >> 172.21.15.69:0/986167914 conn(0x7f3ec00fbbc0 msgr2=0x7f3ec01064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:54.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 -- 172.21.15.69:0/986167914 shutdown_connections 2024-04-23T10:24:54.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.134+0000 7f3ec7d68640 1 -- 172.21.15.69:0/986167914 wait complete. 2024-04-23T10:24:54.146 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:24:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.244+0000 7fe9eb337640 1 -- 172.21.15.69:0/3825149721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9e4101fa0 msgr2=0x7fe9e41023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.244+0000 7fe9eb337640 1 --2- 172.21.15.69:0/3825149721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9e4101fa0 0x7fe9e41023c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009900 tx=0x7fe9d402a410 comp rx=0 tx=0).stop 2024-04-23T10:24:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.244+0000 7fe9eb337640 1 -- 172.21.15.69:0/3825149721 shutdown_connections 2024-04-23T10:24:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.244+0000 7fe9eb337640 1 --2- 172.21.15.69:0/3825149721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9e4103b50 0x7fe9e410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.244+0000 7fe9eb337640 1 --2- 172.21.15.69:0/3825149721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e4103190 0x7fe9e4103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.244+0000 7fe9eb337640 1 --2- 172.21.15.69:0/3825149721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9e4101fa0 0x7fe9e41023c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.244+0000 7fe9eb337640 1 -- 172.21.15.69:0/3825149721 >> 172.21.15.69:0/3825149721 conn(0x7fe9e40fd530 msgr2=0x7fe9e40ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.244+0000 7fe9eb337640 1 -- 172.21.15.69:0/3825149721 shutdown_connections 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.244+0000 7fe9eb337640 1 -- 172.21.15.69:0/3825149721 wait complete. 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.244+0000 7fe9eb337640 1 Processor -- start 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9eb337640 1 -- start start 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9eb337640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e4101fa0 0x7fe9e4075d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9eb337640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9e4103190 0x7fe9e4074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9eb337640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9e4103b50 0x7fe9e4074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9eb337640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e410dc00 con 0x7fe9e4103b50 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9eb337640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e410da80 con 0x7fe9e4101fa0 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9eb337640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e410dd80 con 0x7fe9e4103190 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9e98d4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9e4103b50 0x7fe9e4074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9e98d4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9e4103b50 0x7fe9e4074880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37444/0 (socket says 172.21.15.69:37444) 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9e98d4640 1 -- 172.21.15.69:0/2295204566 learned_addr learned my addr 172.21.15.69:0/2295204566 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9e98d4640 1 -- 172.21.15.69:0/2295204566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9e4103190 msgr2=0x7fe9e4074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9e98d4640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9e4103190 0x7fe9e4074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9e98d4640 1 -- 172.21.15.69:0/2295204566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e4101fa0 msgr2=0x7fe9e4075d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9e98d4640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e4101fa0 0x7fe9e4075d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9e98d4640 1 -- 172.21.15.69:0/2295204566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e4075110 con 0x7fe9e4103b50 2024-04-23T10:24:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9e98d4640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9e4103b50 0x7fe9e4074880 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00eaa0 tx=0x7fe9dc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9da7fc640 1 -- 172.21.15.69:0/2295204566 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc00cdb0 con 0x7fe9e4103b50 2024-04-23T10:24:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9da7fc640 1 -- 172.21.15.69:0/2295204566 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe9dc005020 con 0x7fe9e4103b50 2024-04-23T10:24:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9da7fc640 1 -- 172.21.15.69:0/2295204566 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0116d0 con 0x7fe9e4103b50 2024-04-23T10:24:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9eb337640 1 -- 172.21.15.69:0/2295204566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e41a2340 con 0x7fe9e4103b50 2024-04-23T10:24:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.245+0000 7fe9eb337640 1 -- 172.21.15.69:0/2295204566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e41a2840 con 0x7fe9e4103b50 2024-04-23T10:24:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.246+0000 7fe9eb337640 1 -- 172.21.15.69:0/2295204566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e41092c0 con 0x7fe9e4103b50 2024-04-23T10:24:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.247+0000 7fe9da7fc640 1 -- 172.21.15.69:0/2295204566 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fe9dc0051d0 con 0x7fe9e4103b50 2024-04-23T10:24:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.248+0000 7fe9da7fc640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe9d00a3bb0 0x7fe9d00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.248+0000 7fe9e90d3640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe9d00a3bb0 0x7fe9d00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.248+0000 7fe9da7fc640 1 -- 172.21.15.69:0/2295204566 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fe9dc0d0a00 con 0x7fe9e4103b50 2024-04-23T10:24:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.248+0000 7fe9e90d3640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe9d00a3bb0 0x7fe9d00a6070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40096c0 tx=0x7fe9d4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:54.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.252+0000 7fe9da7fc640 1 -- 172.21.15.69:0/2295204566 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe9dc016030 con 0x7fe9e4103b50 2024-04-23T10:24:54.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.429+0000 7fe9eb337640 1 -- 172.21.15.69:0/2295204566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9e402d870 con 0x7fe9e4103b50 2024-04-23T10:24:54.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.430+0000 7fe9da7fc640 1 -- 172.21.15.69:0/2295204566 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22233 (secure 0 0 0) 0x7fe9dc09d530 con 0x7fe9e4103b50 2024-04-23T10:24:54.430 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:24:54.430 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":85,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:24:52.877457+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 -- 172.21.15.69:0/2295204566 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe9d00a3bb0 msgr2=0x7fe9d00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe9d00a3bb0 0x7fe9d00a6070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40096c0 tx=0x7fe9d4000bc0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 -- 172.21.15.69:0/2295204566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9e4103b50 msgr2=0x7fe9e4074880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9e4103b50 0x7fe9e4074880 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00eaa0 tx=0x7fe9dc00ef60 comp rx=0 tx=0).stop 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 -- 172.21.15.69:0/2295204566 shutdown_connections 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe9d00a3bb0 0x7fe9d00a6070 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9e4103b50 0x7fe9e4074880 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9e4103190 0x7fe9e4074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 --2- 172.21.15.69:0/2295204566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e4101fa0 0x7fe9e4075d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 -- 172.21.15.69:0/2295204566 >> 172.21.15.69:0/2295204566 conn(0x7fe9e40fd530 msgr2=0x7fe9e4106490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 -- 172.21.15.69:0/2295204566 shutdown_connections 2024-04-23T10:24:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.432+0000 7fe9eb337640 1 -- 172.21.15.69:0/2295204566 wait complete. 2024-04-23T10:24:54.443 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-23T10:24:54.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.546+0000 7f3452919640 1 -- 172.21.15.69:0/1077443721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f344c101fb0 msgr2=0x7f344c1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.546+0000 7f3452919640 1 --2- 172.21.15.69:0/1077443721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f344c101fb0 0x7f344c1023d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f343c009900 tx=0x7f343c02a410 comp rx=0 tx=0).stop 2024-04-23T10:24:54.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 -- 172.21.15.69:0/1077443721 shutdown_connections 2024-04-23T10:24:54.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 --2- 172.21.15.69:0/1077443721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344c103b60 0x7f344c10a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 --2- 172.21.15.69:0/1077443721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f344c1031a0 0x7f344c103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 --2- 172.21.15.69:0/1077443721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f344c101fb0 0x7f344c1023d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 -- 172.21.15.69:0/1077443721 >> 172.21.15.69:0/1077443721 conn(0x7f344c0fd520 msgr2=0x7f344c0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:54.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 -- 172.21.15.69:0/1077443721 shutdown_connections 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 -- 172.21.15.69:0/1077443721 wait complete. 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 Processor -- start 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 -- start start 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f344c101fb0 0x7f344c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344c1031a0 0x7f344c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f344c103b60 0x7f344c19f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f344c10dcf0 con 0x7f344c101fb0 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f344c10db70 con 0x7f344c1031a0 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.547+0000 7f3452919640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f344c10de70 con 0x7f344c103b60 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f344bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f344c101fb0 0x7f344c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f344bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f344c101fb0 0x7f344c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37454/0 (socket says 172.21.15.69:37454) 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f344bfff640 1 -- 172.21.15.69:0/2956195162 learned_addr learned my addr 172.21.15.69:0/2956195162 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f344b7fe640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344c1031a0 0x7f344c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:54.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f3450eb6640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f344c103b60 0x7f344c19f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f344bfff640 1 -- 172.21.15.69:0/2956195162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f344c103b60 msgr2=0x7f344c19f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f344bfff640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f344c103b60 0x7f344c19f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f344bfff640 1 -- 172.21.15.69:0/2956195162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344c1031a0 msgr2=0x7f344c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f344bfff640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344c1031a0 0x7f344c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f344bfff640 1 -- 172.21.15.69:0/2956195162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c1a0050 con 0x7f344c101fb0 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f3450eb6640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f344c103b60 0x7f344c19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f344b7fe640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344c1031a0 0x7f344c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f344bfff640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f344c101fb0 0x7f344c198480 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f343c006010 tx=0x7f343c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f34497fa640 1 -- 172.21.15.69:0/2956195162 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c03f030 con 0x7f344c101fb0 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f3452919640 1 -- 172.21.15.69:0/2956195162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f344c1a02e0 con 0x7f344c101fb0 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f34497fa640 1 -- 172.21.15.69:0/2956195162 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f343c003cd0 con 0x7f344c101fb0 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f34497fa640 1 -- 172.21.15.69:0/2956195162 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c035070 con 0x7f344c101fb0 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.548+0000 7f3452919640 1 -- 172.21.15.69:0/2956195162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f344c1a08a0 con 0x7f344c101fb0 2024-04-23T10:24:54.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.549+0000 7f3452919640 1 -- 172.21.15.69:0/2956195162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f344c109440 con 0x7f344c101fb0 2024-04-23T10:24:54.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.550+0000 7f34497fa640 1 -- 172.21.15.69:0/2956195162 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f343c042030 con 0x7f344c101fb0 2024-04-23T10:24:54.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.551+0000 7f34497fa640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34340a3bb0 0x7f34340a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.551+0000 7f344b7fe640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34340a3bb0 0x7f34340a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:54.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.551+0000 7f34497fa640 1 -- 172.21.15.69:0/2956195162 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f343c0f0af0 con 0x7f344c101fb0 2024-04-23T10:24:54.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.551+0000 7f344b7fe640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34340a3bb0 0x7f34340a6070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f344c199940 tx=0x7f3440008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:54.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.555+0000 7f34497fa640 1 -- 172.21.15.69:0/2956195162 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f343c0bd620 con 0x7f344c101fb0 2024-04-23T10:24:54.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:54 smithi069 ceph-mon[29593]: osdmap e85: 12 total, 12 up, 12 in 2024-04-23T10:24:54.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:54 smithi069 ceph-mon[29593]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T10:24:54.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:54 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3850912376' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-23T10:24:54.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:54 smithi069 ceph-mon[29593]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-04-23T10:24:54.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:54 smithi069 ceph-mon[29593]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-04-23T10:24:54.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:54 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/986167914' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:54.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:54 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2295204566' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:54.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.774+0000 7f3452919640 1 -- 172.21.15.69:0/2956195162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f344c02d5c0 con 0x7f344c101fb0 2024-04-23T10:24:54.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.819+0000 7f34497fa640 1 -- 172.21.15.69:0/2956195162 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f343c0bcf20 con 0x7f344c101fb0 2024-04-23T10:24:54.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 -- 172.21.15.69:0/2956195162 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34340a3bb0 msgr2=0x7f34340a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34340a3bb0 0x7f34340a6070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f344c199940 tx=0x7f3440008040 comp rx=0 tx=0).stop 2024-04-23T10:24:54.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 -- 172.21.15.69:0/2956195162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f344c101fb0 msgr2=0x7f344c198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f344c101fb0 0x7f344c198480 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f343c006010 tx=0x7f343c0043b0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 -- 172.21.15.69:0/2956195162 shutdown_connections 2024-04-23T10:24:54.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34340a3bb0 0x7f34340a6070 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f344c103b60 0x7f344c19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344c1031a0 0x7f344c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 --2- 172.21.15.69:0/2956195162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f344c101fb0 0x7f344c198480 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 -- 172.21.15.69:0/2956195162 >> 172.21.15.69:0/2956195162 conn(0x7f344c0fd520 msgr2=0x7f344c106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:54.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 -- 172.21.15.69:0/2956195162 shutdown_connections 2024-04-23T10:24:54.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.821+0000 7f3452919640 1 -- 172.21.15.69:0/2956195162 wait complete. 2024-04-23T10:24:54.832 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-23T10:24:54.832 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-23T10:24:54.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:54 smithi167 ceph-mon[32940]: osdmap e85: 12 total, 12 up, 12 in 2024-04-23T10:24:54.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:54 smithi167 ceph-mon[32940]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T10:24:54.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:54 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3850912376' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-23T10:24:54.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:54 smithi167 ceph-mon[32940]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-04-23T10:24:54.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:54 smithi167 ceph-mon[32940]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-04-23T10:24:54.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:54 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/986167914' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:54.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:54 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2295204566' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:54.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:54 smithi146 ceph-mon[32800]: osdmap e85: 12 total, 12 up, 12 in 2024-04-23T10:24:54.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:54 smithi146 ceph-mon[32800]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T10:24:54.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:54 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3850912376' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-23T10:24:54.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:54 smithi146 ceph-mon[32800]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-04-23T10:24:54.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:54 smithi146 ceph-mon[32800]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-04-23T10:24:54.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:54 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/986167914' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:54.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:54 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2295204566' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:24:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.935+0000 7f2ac9007640 1 -- 172.21.15.69:0/1715418447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ac41008a0 msgr2=0x7f2ac4100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.935+0000 7f2ac9007640 1 --2- 172.21.15.69:0/1715418447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ac41008a0 0x7f2ac4100cc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009900 tx=0x7f2ab402a480 comp rx=0 tx=0).stop 2024-04-23T10:24:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.936+0000 7f2ac9007640 1 -- 172.21.15.69:0/1715418447 shutdown_connections 2024-04-23T10:24:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.936+0000 7f2ac9007640 1 --2- 172.21.15.69:0/1715418447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4101ba0 0x7f2ac4102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.936+0000 7f2ac9007640 1 --2- 172.21.15.69:0/1715418447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ac4101200 0x7f2ac4101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.936+0000 7f2ac9007640 1 --2- 172.21.15.69:0/1715418447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ac41008a0 0x7f2ac4100cc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.936+0000 7f2ac9007640 1 -- 172.21.15.69:0/1715418447 >> 172.21.15.69:0/1715418447 conn(0x7f2ac40fc420 msgr2=0x7f2ac40fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.936+0000 7f2ac9007640 1 -- 172.21.15.69:0/1715418447 shutdown_connections 2024-04-23T10:24:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.936+0000 7f2ac9007640 1 -- 172.21.15.69:0/1715418447 wait complete. 2024-04-23T10:24:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.936+0000 7f2ac9007640 1 Processor -- start 2024-04-23T10:24:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.936+0000 7f2ac9007640 1 -- start start 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac9007640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac41008a0 0x7f2ac419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac9007640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ac4101200 0x7f2ac419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac9007640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ac4101ba0 0x7f2ac41a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac9007640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac410fef0 con 0x7f2ac4101ba0 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac9007640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac410fd70 con 0x7f2ac41008a0 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac9007640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac4110070 con 0x7f2ac4101200 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac359e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ac4101ba0 0x7f2ac41a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac359e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ac4101ba0 0x7f2ac41a1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37468/0 (socket says 172.21.15.69:37468) 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac359e640 1 -- 172.21.15.69:0/119188080 learned_addr learned my addr 172.21.15.69:0/119188080 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac259c640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ac4101200 0x7f2ac419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac2d9d640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac41008a0 0x7f2ac419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac359e640 1 -- 172.21.15.69:0/119188080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ac4101200 msgr2=0x7f2ac419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac359e640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ac4101200 0x7f2ac419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac359e640 1 -- 172.21.15.69:0/119188080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac41008a0 msgr2=0x7f2ac419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac359e640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac41008a0 0x7f2ac419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac359e640 1 -- 172.21.15.69:0/119188080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac41a2260 con 0x7f2ac4101ba0 2024-04-23T10:24:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac259c640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ac4101200 0x7f2ac419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac2d9d640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac41008a0 0x7f2ac419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac359e640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ac4101ba0 0x7f2ac41a1bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00b970 tx=0x7f2abc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2aabfff640 1 -- 172.21.15.69:0/119188080 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc019070 con 0x7f2ac4101ba0 2024-04-23T10:24:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac9007640 1 -- 172.21.15.69:0/119188080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac41a2550 con 0x7f2ac4101ba0 2024-04-23T10:24:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2aabfff640 1 -- 172.21.15.69:0/119188080 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2abc00cb40 con 0x7f2ac4101ba0 2024-04-23T10:24:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2aabfff640 1 -- 172.21.15.69:0/119188080 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc007650 con 0x7f2ac4101ba0 2024-04-23T10:24:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.937+0000 7f2ac9007640 1 -- 172.21.15.69:0/119188080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac41a2b20 con 0x7f2ac4101ba0 2024-04-23T10:24:54.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.938+0000 7f2ac9007640 1 -- 172.21.15.69:0/119188080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac410b8d0 con 0x7f2ac4101ba0 2024-04-23T10:24:54.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.939+0000 7f2aabfff640 1 -- 172.21.15.69:0/119188080 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f2abc01c070 con 0x7f2ac4101ba0 2024-04-23T10:24:54.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.940+0000 7f2aabfff640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2aac0a3bb0 0x7f2aac0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:54.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.940+0000 7f2ac2d9d640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2aac0a3bb0 0x7f2aac0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:54.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.940+0000 7f2aabfff640 1 -- 172.21.15.69:0/119188080 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f2abc0cfe20 con 0x7f2ac4101ba0 2024-04-23T10:24:54.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.941+0000 7f2ac2d9d640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2aac0a3bb0 0x7f2aac0a6070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40096c0 tx=0x7f2ab4009650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:54.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:54.943+0000 7f2aabfff640 1 -- 172.21.15.69:0/119188080 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2abc09c950 con 0x7f2ac4101ba0 2024-04-23T10:24:55.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.164+0000 7f2ac9007640 1 -- 172.21.15.69:0/119188080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f2ac402d5c0 con 0x7f2ac4101ba0 2024-04-23T10:24:55.332 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:24:55 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i[63901]: 2024-04-23T10:24:55.069+0000 7fb81da1a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-23T10:24:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:55 smithi069 ceph-mon[29593]: osdmap e86: 12 total, 12 up, 12 in 2024-04-23T10:24:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:55 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2956195162' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-23T10:24:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:55 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2956195162' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-23T10:24:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:55 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] up:active 2024-04-23T10:24:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:55 smithi069 ceph-mon[29593]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-23T10:24:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:55 smithi069 ceph-mon[29593]: pgmap v284: 97 pgs: 29 creating+peering, 45 unknown, 23 active+clean; 578 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 2 op/s 2024-04-23T10:24:55.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:55 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/119188080' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-23T10:24:55.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.828+0000 7f2aabfff640 1 -- 172.21.15.69:0/119188080 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v16) ==== 105+0+0 (secure 0 0 0) 0x7f2abc09c250 con 0x7f2ac4101ba0 2024-04-23T10:24:55.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 -- 172.21.15.69:0/119188080 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2aac0a3bb0 msgr2=0x7f2aac0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:55.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2aac0a3bb0 0x7f2aac0a6070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40096c0 tx=0x7f2ab4009650 comp rx=0 tx=0).stop 2024-04-23T10:24:55.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 -- 172.21.15.69:0/119188080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ac4101ba0 msgr2=0x7f2ac41a1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:55.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ac4101ba0 0x7f2ac41a1bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00b970 tx=0x7f2abc00be30 comp rx=0 tx=0).stop 2024-04-23T10:24:55.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 -- 172.21.15.69:0/119188080 shutdown_connections 2024-04-23T10:24:55.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2aac0a3bb0 0x7f2aac0a6070 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:55.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ac4101ba0 0x7f2ac41a1bf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:55.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ac4101200 0x7f2ac419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:55.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 --2- 172.21.15.69:0/119188080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac41008a0 0x7f2ac419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:55.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 -- 172.21.15.69:0/119188080 >> 172.21.15.69:0/119188080 conn(0x7f2ac40fc420 msgr2=0x7f2ac40fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:55.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 -- 172.21.15.69:0/119188080 shutdown_connections 2024-04-23T10:24:55.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.831+0000 7f2ac9007640 1 -- 172.21.15.69:0/119188080 wait complete. 2024-04-23T10:24:55.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:55 smithi167 ceph-mon[32940]: osdmap e86: 12 total, 12 up, 12 in 2024-04-23T10:24:55.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:55 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2956195162' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-23T10:24:55.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:55 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2956195162' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-23T10:24:55.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:55 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] up:active 2024-04-23T10:24:55.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:55 smithi167 ceph-mon[32940]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-23T10:24:55.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:55 smithi167 ceph-mon[32940]: pgmap v284: 97 pgs: 29 creating+peering, 45 unknown, 23 active+clean; 578 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 2 op/s 2024-04-23T10:24:55.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:55 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/119188080' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-23T10:24:55.845 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-23T10:24:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:55 smithi146 ceph-mon[32800]: osdmap e86: 12 total, 12 up, 12 in 2024-04-23T10:24:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:55 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2956195162' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-23T10:24:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:55 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2956195162' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-23T10:24:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:55 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] up:active 2024-04-23T10:24:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:55 smithi146 ceph-mon[32800]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-23T10:24:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:55 smithi146 ceph-mon[32800]: pgmap v284: 97 pgs: 29 creating+peering, 45 unknown, 23 active+clean; 578 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 2 op/s 2024-04-23T10:24:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:55 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/119188080' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-23T10:24:55.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.952+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3334018561 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0cb4101fb0 msgr2=0x7f0cb41023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:55.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.952+0000 7f0cbc7cd640 1 --2- 172.21.15.69:0/3334018561 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0cb4101fb0 0x7f0cb41023d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009900 tx=0x7f0cb002a410 comp rx=0 tx=0).stop 2024-04-23T10:24:55.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.952+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3334018561 shutdown_connections 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.952+0000 7f0cbc7cd640 1 --2- 172.21.15.69:0/3334018561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb4103b60 0x7f0cb410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.952+0000 7f0cbc7cd640 1 --2- 172.21.15.69:0/3334018561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb41031a0 0x7f0cb4103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.952+0000 7f0cbc7cd640 1 --2- 172.21.15.69:0/3334018561 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0cb4101fb0 0x7f0cb41023d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.952+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3334018561 >> 172.21.15.69:0/3334018561 conn(0x7f0cb40fd520 msgr2=0x7f0cb40ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.952+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3334018561 shutdown_connections 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.952+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3334018561 wait complete. 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.952+0000 7f0cbc7cd640 1 Processor -- start 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cbc7cd640 1 -- start start 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cbc7cd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0cb4101fb0 0x7f0cb4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cbc7cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb41031a0 0x7f0cb4198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cbc7cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb4103b60 0x7f0cb419f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cbc7cd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb410dc70 con 0x7f0cb4101fb0 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cbc7cd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb410daf0 con 0x7f0cb41031a0 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cbc7cd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb410ddf0 con 0x7f0cb4103b60 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cba569640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0cb4101fb0 0x7f0cb4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cba569640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0cb4101fb0 0x7f0cb4198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37484/0 (socket says 172.21.15.69:37484) 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cba569640 1 -- 172.21.15.69:0/3553110929 learned_addr learned my addr 172.21.15.69:0/3553110929 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cb9d68640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb41031a0 0x7f0cb4198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cba569640 1 -- 172.21.15.69:0/3553110929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb4103b60 msgr2=0x7f0cb419f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cba569640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb4103b60 0x7f0cb419f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cba569640 1 -- 172.21.15.69:0/3553110929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb41031a0 msgr2=0x7f0cb4198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cba569640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb41031a0 0x7f0cb4198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cba569640 1 -- 172.21.15.69:0/3553110929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb419ff60 con 0x7f0cb4101fb0 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cb9d68640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb41031a0 0x7f0cb4198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cba569640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0cb4101fb0 0x7f0cb4198340 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0006010 tx=0x7f0cb00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cab7fe640 1 -- 172.21.15.69:0/3553110929 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb003f030 con 0x7f0cb4101fb0 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cab7fe640 1 -- 172.21.15.69:0/3553110929 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0cb0003cd0 con 0x7f0cb4101fb0 2024-04-23T10:24:55.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3553110929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb41a01f0 con 0x7f0cb4101fb0 2024-04-23T10:24:55.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cab7fe640 1 -- 172.21.15.69:0/3553110929 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0035070 con 0x7f0cb4101fb0 2024-04-23T10:24:55.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.953+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3553110929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb41a0760 con 0x7f0cb4101fb0 2024-04-23T10:24:55.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.954+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3553110929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb4109370 con 0x7f0cb4101fb0 2024-04-23T10:24:55.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.956+0000 7f0cab7fe640 1 -- 172.21.15.69:0/3553110929 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0cb0042030 con 0x7f0cb4101fb0 2024-04-23T10:24:55.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.956+0000 7f0cab7fe640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0ca00a3bb0 0x7f0ca00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.956+0000 7f0cb9d68640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0ca00a3bb0 0x7f0ca00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.956+0000 7f0cab7fe640 1 -- 172.21.15.69:0/3553110929 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f0cb00f0f00 con 0x7f0cb4101fb0 2024-04-23T10:24:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.957+0000 7f0cb9d68640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0ca00a3bb0 0x7f0ca00a6070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4199850 tx=0x7f0ca4005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:55.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:55.960+0000 7f0cab7fe640 1 -- 172.21.15.69:0/3553110929 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0cb00bda30 con 0x7f0cb4101fb0 2024-04-23T10:24:56.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.175+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3553110929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f0cb402d5c0 con 0x7f0cb4101fb0 2024-04-23T10:24:56.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.306+0000 7f0cab7fe640 1 -- 172.21.15.69:0/3553110929 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f0cb00bd330 con 0x7f0cb4101fb0 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.308+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3553110929 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0ca00a3bb0 msgr2=0x7f0ca00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.309+0000 7f0cbc7cd640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0ca00a3bb0 0x7f0ca00a6070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4199850 tx=0x7f0ca4005d30 comp rx=0 tx=0).stop 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.309+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3553110929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0cb4101fb0 msgr2=0x7f0cb4198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.309+0000 7f0cbc7cd640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0cb4101fb0 0x7f0cb4198340 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0006010 tx=0x7f0cb00043b0 comp rx=0 tx=0).stop 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.309+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3553110929 shutdown_connections 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.309+0000 7f0cbc7cd640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0ca00a3bb0 0x7f0ca00a6070 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.309+0000 7f0cbc7cd640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cb4103b60 0x7f0cb419f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.309+0000 7f0cbc7cd640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb41031a0 0x7f0cb4198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.309+0000 7f0cbc7cd640 1 --2- 172.21.15.69:0/3553110929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0cb4101fb0 0x7f0cb4198340 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.309+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3553110929 >> 172.21.15.69:0/3553110929 conn(0x7f0cb40fd520 msgr2=0x7f0cb4106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.309+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3553110929 shutdown_connections 2024-04-23T10:24:56.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.309+0000 7f0cbc7cd640 1 -- 172.21.15.69:0/3553110929 wait complete. 2024-04-23T10:24:56.323 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-23T10:24:56.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.425+0000 7f7a442cf640 1 -- 172.21.15.69:0/3998399103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a3c105360 msgr2=0x7f7a3c107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.425+0000 7f7a442cf640 1 --2- 172.21.15.69:0/3998399103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a3c105360 0x7f7a3c107750 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009900 tx=0x7f7a2c02a410 comp rx=0 tx=0).stop 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.425+0000 7f7a442cf640 1 -- 172.21.15.69:0/3998399103 shutdown_connections 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.425+0000 7f7a442cf640 1 --2- 172.21.15.69:0/3998399103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a3c105360 0x7f7a3c107750 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.425+0000 7f7a442cf640 1 --2- 172.21.15.69:0/3998399103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a3c107c90 0x7f7a3c10a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.425+0000 7f7a442cf640 1 --2- 172.21.15.69:0/3998399103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3c102a30 0x7f7a3c104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.425+0000 7f7a442cf640 1 -- 172.21.15.69:0/3998399103 >> 172.21.15.69:0/3998399103 conn(0x7f7a3c0fc440 msgr2=0x7f7a3c0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.425+0000 7f7a442cf640 1 -- 172.21.15.69:0/3998399103 shutdown_connections 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.425+0000 7f7a442cf640 1 -- 172.21.15.69:0/3998399103 wait complete. 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a442cf640 1 Processor -- start 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a442cf640 1 -- start start 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a442cf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a3c102a30 0x7f7a3c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a442cf640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a3c105360 0x7f7a3c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a442cf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3c107c90 0x7f7a3c19f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a442cf640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c10dc10 con 0x7f7a3c105360 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a442cf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c10da90 con 0x7f7a3c102a30 2024-04-23T10:24:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a442cf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c10dd90 con 0x7f7a3c107c90 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a4186a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a3c105360 0x7f7a3c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a4186a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a3c105360 0x7f7a3c198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37500/0 (socket says 172.21.15.69:37500) 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a4186a640 1 -- 172.21.15.69:0/3048101745 learned_addr learned my addr 172.21.15.69:0/3048101745 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a4286c640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3c107c90 0x7f7a3c19f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.426+0000 7f7a4206b640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a3c102a30 0x7f7a3c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a4186a640 1 -- 172.21.15.69:0/3048101745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3c107c90 msgr2=0x7f7a3c19f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a4186a640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3c107c90 0x7f7a3c19f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a4186a640 1 -- 172.21.15.69:0/3048101745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a3c102a30 msgr2=0x7f7a3c198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a4186a640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a3c102a30 0x7f7a3c198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a4186a640 1 -- 172.21.15.69:0/3048101745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3c19ff40 con 0x7f7a3c105360 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a4206b640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a3c102a30 0x7f7a3c198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a4186a640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a3c105360 0x7f7a3c198860 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c006010 tx=0x7f7a2c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a337fe640 1 -- 172.21.15.69:0/3048101745 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c03f030 con 0x7f7a3c105360 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a337fe640 1 -- 172.21.15.69:0/3048101745 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a2c003cd0 con 0x7f7a3c105360 2024-04-23T10:24:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a442cf640 1 -- 172.21.15.69:0/3048101745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3c1a01d0 con 0x7f7a3c105360 2024-04-23T10:24:56.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a337fe640 1 -- 172.21.15.69:0/3048101745 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c035070 con 0x7f7a3c105360 2024-04-23T10:24:56.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.427+0000 7f7a442cf640 1 -- 172.21.15.69:0/3048101745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3c1a0710 con 0x7f7a3c105360 2024-04-23T10:24:56.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.428+0000 7f7a442cf640 1 -- 172.21.15.69:0/3048101745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a3c0fdf30 con 0x7f7a3c105360 2024-04-23T10:24:56.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.429+0000 7f7a337fe640 1 -- 172.21.15.69:0/3048101745 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f7a2c042030 con 0x7f7a3c105360 2024-04-23T10:24:56.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.430+0000 7f7a337fe640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7a280a3c30 0x7f7a280a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:56.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.430+0000 7f7a4206b640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7a280a3c30 0x7f7a280a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:56.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.430+0000 7f7a337fe640 1 -- 172.21.15.69:0/3048101745 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f7a2c0f0be0 con 0x7f7a3c105360 2024-04-23T10:24:56.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.431+0000 7f7a4206b640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7a280a3c30 0x7f7a280a60f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009b50 tx=0x7f7a38005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:56.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.434+0000 7f7a337fe640 1 -- 172.21.15.69:0/3048101745 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7a2c0bd710 con 0x7f7a3c105360 2024-04-23T10:24:56.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:56.650+0000 7f7a442cf640 1 -- 172.21.15.69:0/3048101745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f7a3c02d5c0 con 0x7f7a3c105360 2024-04-23T10:24:56.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-23T10:24:56.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: Cluster is now healthy 2024-04-23T10:24:56.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-23T10:24:56.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/119188080' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-23T10:24:56.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-23T10:24:56.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-23T10:24:56.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-04-23T10:24:56.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-23T10:24:56.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3553110929' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-23T10:24:56.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3553110929' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-23T10:24:56.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] up:active 2024-04-23T10:24:56.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: daemon mds.l assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-23T10:24:56.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 2 up:standby-replay 8 up:standby 2024-04-23T10:24:56.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=l=up:creating} 2 up:standby-replay 7 up:standby 2024-04-23T10:24:56.743 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:56 smithi069 ceph-mon[29593]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-23T10:24:56.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: Cluster is now healthy 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/119188080' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3553110929' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3553110929' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] up:active 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: daemon mds.l assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 2 up:standby-replay 8 up:standby 2024-04-23T10:24:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=l=up:creating} 2 up:standby-replay 7 up:standby 2024-04-23T10:24:56.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:56 smithi167 ceph-mon[32940]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: Cluster is now healthy 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/119188080' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3553110929' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3553110929' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] up:active 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: daemon mds.l assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-23T10:24:56.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 2 up:standby-replay 8 up:standby 2024-04-23T10:24:56.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=l=up:creating} 2 up:standby-replay 7 up:standby 2024-04-23T10:24:56.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:56 smithi146 ceph-mon[32800]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-23T10:24:57.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.313+0000 7f7a337fe640 1 -- 172.21.15.69:0/3048101745 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f7a2c0bd010 con 0x7f7a3c105360 2024-04-23T10:24:57.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 -- 172.21.15.69:0/3048101745 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7a280a3c30 msgr2=0x7f7a280a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7a280a3c30 0x7f7a280a60f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009b50 tx=0x7f7a38005f90 comp rx=0 tx=0).stop 2024-04-23T10:24:57.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 -- 172.21.15.69:0/3048101745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a3c105360 msgr2=0x7f7a3c198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a3c105360 0x7f7a3c198860 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c006010 tx=0x7f7a2c0042f0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 -- 172.21.15.69:0/3048101745 shutdown_connections 2024-04-23T10:24:57.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7a280a3c30 0x7f7a280a60f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a3c105360 0x7f7a3c198860 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3c107c90 0x7f7a3c19f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 --2- 172.21.15.69:0/3048101745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a3c102a30 0x7f7a3c198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 -- 172.21.15.69:0/3048101745 >> 172.21.15.69:0/3048101745 conn(0x7f7a3c0fc440 msgr2=0x7f7a3c103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:57.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 -- 172.21.15.69:0/3048101745 shutdown_connections 2024-04-23T10:24:57.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.316+0000 7f7a442cf640 1 -- 172.21.15.69:0/3048101745 wait complete. 2024-04-23T10:24:57.331 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-04-23T10:24:57.331 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-23T10:24:57.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.438+0000 7f439d507640 1 -- 172.21.15.69:0/2745494311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43981053c0 msgr2=0x7f43981077b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.438+0000 7f439d507640 1 --2- 172.21.15.69:0/2745494311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43981053c0 0x7f43981077b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f438c009900 tx=0x7f438c02a410 comp rx=0 tx=0).stop 2024-04-23T10:24:57.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.438+0000 7f439d507640 1 -- 172.21.15.69:0/2745494311 shutdown_connections 2024-04-23T10:24:57.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.438+0000 7f439d507640 1 --2- 172.21.15.69:0/2745494311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43981053c0 0x7f43981077b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.438+0000 7f439d507640 1 --2- 172.21.15.69:0/2745494311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4398107cf0 0x7f439810a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.438+0000 7f439d507640 1 --2- 172.21.15.69:0/2745494311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4398102a90 0x7f4398104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.438+0000 7f439d507640 1 -- 172.21.15.69:0/2745494311 >> 172.21.15.69:0/2745494311 conn(0x7f43980fc400 msgr2=0x7f43980fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:57.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.438+0000 7f439d507640 1 -- 172.21.15.69:0/2745494311 shutdown_connections 2024-04-23T10:24:57.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.438+0000 7f439d507640 1 -- 172.21.15.69:0/2745494311 wait complete. 2024-04-23T10:24:57.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f439d507640 1 Processor -- start 2024-04-23T10:24:57.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f439d507640 1 -- start start 2024-04-23T10:24:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f439d507640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4398102a90 0x7f4398198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f439d507640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43981053c0 0x7f4398198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f439d507640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4398107cf0 0x7f439819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f439d507640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f439810dc00 con 0x7f43981053c0 2024-04-23T10:24:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f439d507640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f439810da80 con 0x7f4398102a90 2024-04-23T10:24:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f439d507640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f439810dd80 con 0x7f4398107cf0 2024-04-23T10:24:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f43967fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43981053c0 0x7f4398198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f43967fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43981053c0 0x7f4398198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37512/0 (socket says 172.21.15.69:37512) 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f43967fc640 1 -- 172.21.15.69:0/2487963978 learned_addr learned my addr 172.21.15.69:0/2487963978 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.439+0000 7f43977fe640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4398107cf0 0x7f439819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f4396ffd640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4398102a90 0x7f4398198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f43967fc640 1 -- 172.21.15.69:0/2487963978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4398107cf0 msgr2=0x7f439819f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f43967fc640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4398107cf0 0x7f439819f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f43967fc640 1 -- 172.21.15.69:0/2487963978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4398102a90 msgr2=0x7f4398198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f43967fc640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4398102a90 0x7f4398198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f43967fc640 1 -- 172.21.15.69:0/2487963978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439819ff20 con 0x7f43981053c0 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f43967fc640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43981053c0 0x7f4398198840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f438c006010 tx=0x7f438c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f437ffff640 1 -- 172.21.15.69:0/2487963978 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c03f030 con 0x7f43981053c0 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f437ffff640 1 -- 172.21.15.69:0/2487963978 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f438c003cd0 con 0x7f43981053c0 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f439d507640 1 -- 172.21.15.69:0/2487963978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43981a01b0 con 0x7f43981053c0 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f437ffff640 1 -- 172.21.15.69:0/2487963978 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c035070 con 0x7f43981053c0 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.440+0000 7f439d507640 1 -- 172.21.15.69:0/2487963978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43981a06a0 con 0x7f43981053c0 2024-04-23T10:24:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.441+0000 7f439d507640 1 -- 172.21.15.69:0/2487963978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43980fdef0 con 0x7f43981053c0 2024-04-23T10:24:57.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.442+0000 7f437ffff640 1 -- 172.21.15.69:0/2487963978 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f438c042030 con 0x7f43981053c0 2024-04-23T10:24:57.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.443+0000 7f437ffff640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43800a3bb0 0x7f43800a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:57.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.443+0000 7f4396ffd640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43800a3bb0 0x7f43800a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:57.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.443+0000 7f437ffff640 1 -- 172.21.15.69:0/2487963978 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f438c0f0770 con 0x7f43981053c0 2024-04-23T10:24:57.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.443+0000 7f4396ffd640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43800a3bb0 0x7f43800a6070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4388005fd0 tx=0x7f4388009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:57.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.448+0000 7f437ffff640 1 -- 172.21.15.69:0/2487963978 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f438c0bcc50 con 0x7f43981053c0 2024-04-23T10:24:57.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:57.654+0000 7f439d507640 1 -- 172.21.15.69:0/2487963978 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4398062390 con 0x7f43800a3bb0 2024-04-23T10:24:57.658 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3048101745' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-23T10:24:57.659 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-mon[29593]: pgmap v285: 97 pgs: 20 creating+peering, 13 unknown, 64 active+clean; 578 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 739 B/s rd, 3.8 KiB/s wr, 10 op/s 2024-04-23T10:24:57.659 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3048101745' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-23T10:24:57.659 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] up:active 2024-04-23T10:24:57.659 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-mon[29593]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-23T10:24:57.659 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-mon[29593]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=l=up:active} 2 up:standby-replay 7 up:standby 2024-04-23T10:24:57.659 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-mon[29593]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=l=up:active,3=h=up:creating} 2 up:standby-replay 6 up:standby 2024-04-23T10:24:57.659 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-mon[29593]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-04-23T10:24:57.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:57 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3048101745' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-23T10:24:57.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:57 smithi167 ceph-mon[32940]: pgmap v285: 97 pgs: 20 creating+peering, 13 unknown, 64 active+clean; 578 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 739 B/s rd, 3.8 KiB/s wr, 10 op/s 2024-04-23T10:24:57.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:57 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3048101745' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-23T10:24:57.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:57 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] up:active 2024-04-23T10:24:57.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:57 smithi167 ceph-mon[32940]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-23T10:24:57.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:57 smithi167 ceph-mon[32940]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=l=up:active} 2 up:standby-replay 7 up:standby 2024-04-23T10:24:57.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:57 smithi167 ceph-mon[32940]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=l=up:active,3=h=up:creating} 2 up:standby-replay 6 up:standby 2024-04-23T10:24:57.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:57 smithi167 ceph-mon[32940]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-04-23T10:24:57.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:57 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3048101745' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-23T10:24:57.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:57 smithi146 ceph-mon[32800]: pgmap v285: 97 pgs: 20 creating+peering, 13 unknown, 64 active+clean; 578 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 739 B/s rd, 3.8 KiB/s wr, 10 op/s 2024-04-23T10:24:57.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:57 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3048101745' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-23T10:24:57.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:57 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] up:active 2024-04-23T10:24:57.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:57 smithi146 ceph-mon[32800]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-23T10:24:57.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:57 smithi146 ceph-mon[32800]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=l=up:active} 2 up:standby-replay 7 up:standby 2024-04-23T10:24:57.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:57 smithi146 ceph-mon[32800]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=l=up:active,3=h=up:creating} 2 up:standby-replay 6 up:standby 2024-04-23T10:24:57.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:57 smithi146 ceph-mon[32800]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-04-23T10:24:57.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:24:57.658+0000 7fa9df0de700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:24:57.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:24:57.658+0000 7fa9df0de700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:24:57.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:24:57.658+0000 7fa9df0de700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:24:57.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:24:57.658+0000 7fa9df0de700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:24:57.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:24:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:24:57.658+0000 7fa9df0de700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:24:58.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.342+0000 7f437ffff640 1 -- 172.21.15.69:0/2487963978 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4398062390 con 0x7f43800a3bb0 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.344+0000 7f439d507640 1 -- 172.21.15.69:0/2487963978 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43800a3bb0 msgr2=0x7f43800a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.344+0000 7f439d507640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43800a3bb0 0x7f43800a6070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4388005fd0 tx=0x7f4388009500 comp rx=0 tx=0).stop 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.344+0000 7f439d507640 1 -- 172.21.15.69:0/2487963978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43981053c0 msgr2=0x7f4398198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.344+0000 7f439d507640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43981053c0 0x7f4398198840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f438c006010 tx=0x7f438c0042f0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.344+0000 7f439d507640 1 -- 172.21.15.69:0/2487963978 shutdown_connections 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.344+0000 7f439d507640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f43800a3bb0 0x7f43800a6070 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.344+0000 7f439d507640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43981053c0 0x7f4398198840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.344+0000 7f439d507640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4398107cf0 0x7f439819f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.344+0000 7f439d507640 1 --2- 172.21.15.69:0/2487963978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4398102a90 0x7f4398198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.344+0000 7f439d507640 1 -- 172.21.15.69:0/2487963978 >> 172.21.15.69:0/2487963978 conn(0x7f43980fc400 msgr2=0x7f4398103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.345+0000 7f439d507640 1 -- 172.21.15.69:0/2487963978 shutdown_connections 2024-04-23T10:24:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.345+0000 7f439d507640 1 -- 172.21.15.69:0/2487963978 wait complete. 2024-04-23T10:24:58.356 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.463+0000 7f19f73bf640 1 -- 172.21.15.69:0/723131001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f0103170 msgr2=0x7f19f01055e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.463+0000 7f19f73bf640 1 --2- 172.21.15.69:0/723131001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f0103170 0x7f19f01055e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009900 tx=0x7f19e002a410 comp rx=0 tx=0).stop 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.463+0000 7f19f73bf640 1 -- 172.21.15.69:0/723131001 shutdown_connections 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.463+0000 7f19f73bf640 1 --2- 172.21.15.69:0/723131001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f0103170 0x7f19f01055e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.463+0000 7f19f73bf640 1 --2- 172.21.15.69:0/723131001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0105b20 0x7f19f0105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.463+0000 7f19f73bf640 1 --2- 172.21.15.69:0/723131001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19f0100800 0x7f19f0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.463+0000 7f19f73bf640 1 -- 172.21.15.69:0/723131001 >> 172.21.15.69:0/723131001 conn(0x7f19f00fc400 msgr2=0x7f19f00fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.463+0000 7f19f73bf640 1 -- 172.21.15.69:0/723131001 shutdown_connections 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.463+0000 7f19f73bf640 1 -- 172.21.15.69:0/723131001 wait complete. 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f73bf640 1 Processor -- start 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f73bf640 1 -- start start 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f73bf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19f0100800 0x7f19f019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f73bf640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f0103170 0x7f19f019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:58.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f73bf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0105b20 0x7f19f01a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f73bf640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f19f0114200 con 0x7f19f0103170 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f73bf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f19f0114080 con 0x7f19f0100800 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f73bf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19f0114380 con 0x7f19f0105b20 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f495a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f0103170 0x7f19f019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f495a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f0103170 0x7f19f019ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37544/0 (socket says 172.21.15.69:37544) 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f495a640 1 -- 172.21.15.69:0/55899844 learned_addr learned my addr 172.21.15.69:0/55899844 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f595c640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0105b20 0x7f19f01a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f515b640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19f0100800 0x7f19f019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f495a640 1 -- 172.21.15.69:0/55899844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0105b20 msgr2=0x7f19f01a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f495a640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0105b20 0x7f19f01a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f495a640 1 -- 172.21.15.69:0/55899844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19f0100800 msgr2=0x7f19f019e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f495a640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19f0100800 0x7f19f019e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f495a640 1 -- 172.21.15.69:0/55899844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f01a6470 con 0x7f19f0103170 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.464+0000 7f19f515b640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19f0100800 0x7f19f019e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:58.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.465+0000 7f19f495a640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f0103170 0x7f19f019ed90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f19e0005940 tx=0x7f19e00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:58.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.465+0000 7f19e67fc640 1 -- 172.21.15.69:0/55899844 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e003f030 con 0x7f19f0103170 2024-04-23T10:24:58.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.465+0000 7f19e67fc640 1 -- 172.21.15.69:0/55899844 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f19e0003cd0 con 0x7f19f0103170 2024-04-23T10:24:58.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.465+0000 7f19f73bf640 1 -- 172.21.15.69:0/55899844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f01a6700 con 0x7f19f0103170 2024-04-23T10:24:58.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.465+0000 7f19e67fc640 1 -- 172.21.15.69:0/55899844 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0035070 con 0x7f19f0103170 2024-04-23T10:24:58.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.465+0000 7f19f73bf640 1 -- 172.21.15.69:0/55899844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f01a6bf0 con 0x7f19f0103170 2024-04-23T10:24:58.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.466+0000 7f19f73bf640 1 -- 172.21.15.69:0/55899844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f00fdef0 con 0x7f19f0103170 2024-04-23T10:24:58.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.467+0000 7f19e67fc640 1 -- 172.21.15.69:0/55899844 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f19e0042030 con 0x7f19f0103170 2024-04-23T10:24:58.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.467+0000 7f19e67fc640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f19dc0a3bb0 0x7f19dc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:58.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.467+0000 7f19f515b640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f19dc0a3bb0 0x7f19dc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:58.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.467+0000 7f19e67fc640 1 -- 172.21.15.69:0/55899844 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f19e00f08e0 con 0x7f19f0103170 2024-04-23T10:24:58.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.468+0000 7f19f515b640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f19dc0a3bb0 0x7f19dc0a6070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009b40 tx=0x7f19ec005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:58.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.472+0000 7f19e67fc640 1 -- 172.21.15.69:0/55899844 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f19e00bd410 con 0x7f19f0103170 2024-04-23T10:24:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.675+0000 7f19f73bf640 1 -- 172.21.15.69:0/55899844 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f19f0062420 con 0x7f19dc0a3bb0 2024-04-23T10:24:58.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.699+0000 7f19e67fc640 1 -- 172.21.15.69:0/55899844 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f19f0062420 con 0x7f19dc0a3bb0 2024-04-23T10:24:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.700+0000 7f19f73bf640 1 -- 172.21.15.69:0/55899844 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f19dc0a3bb0 msgr2=0x7f19dc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.700+0000 7f19f73bf640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f19dc0a3bb0 0x7f19dc0a6070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009b40 tx=0x7f19ec005e50 comp rx=0 tx=0).stop 2024-04-23T10:24:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.700+0000 7f19f73bf640 1 -- 172.21.15.69:0/55899844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f0103170 msgr2=0x7f19f019ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.700+0000 7f19f73bf640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f0103170 0x7f19f019ed90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f19e0005940 tx=0x7f19e00042f0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.700+0000 7f19f73bf640 1 -- 172.21.15.69:0/55899844 shutdown_connections 2024-04-23T10:24:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.700+0000 7f19f73bf640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f19dc0a3bb0 0x7f19dc0a6070 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.700+0000 7f19f73bf640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f0103170 0x7f19f019ed90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.701+0000 7f19f73bf640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0105b20 0x7f19f01a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.701+0000 7f19f73bf640 1 --2- 172.21.15.69:0/55899844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19f0100800 0x7f19f019e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.701+0000 7f19f73bf640 1 -- 172.21.15.69:0/55899844 >> 172.21.15.69:0/55899844 conn(0x7f19f00fc400 msgr2=0x7f19f0101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.701+0000 7f19f73bf640 1 -- 172.21.15.69:0/55899844 shutdown_connections 2024-04-23T10:24:58.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.701+0000 7f19f73bf640 1 -- 172.21.15.69:0/55899844 wait complete. 2024-04-23T10:24:58.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:58 smithi069 ceph-mon[29593]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:58.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:58 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] up:active 2024-04-23T10:24:58.709 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:58 smithi069 ceph-mon[29593]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-23T10:24:58.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:58 smithi069 ceph-mon[29593]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-23T10:24:58.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:58 smithi069 ceph-mon[29593]: Cluster is now healthy 2024-04-23T10:24:58.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:58 smithi069 ceph-mon[29593]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=l=up:active,3=h=up:active} 2 up:standby-replay 6 up:standby 2024-04-23T10:24:58.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:58 smithi069 ceph-mon[29593]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2024-04-23T10:24:58.710 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:58 smithi069 ceph-mon[29593]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-04-23T10:24:58.711 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-23T10:24:58.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.814+0000 7feb368cb640 1 -- 172.21.15.69:0/399481151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb30100290 msgr2=0x7feb301006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.814+0000 7feb368cb640 1 --2- 172.21.15.69:0/399481151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb30100290 0x7feb301006b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feb20009930 tx=0x7feb2002a420 comp rx=0 tx=0).stop 2024-04-23T10:24:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.814+0000 7feb368cb640 1 -- 172.21.15.69:0/399481151 shutdown_connections 2024-04-23T10:24:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.814+0000 7feb368cb640 1 --2- 172.21.15.69:0/399481151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb30103cc0 0x7feb3010a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.814+0000 7feb368cb640 1 --2- 172.21.15.69:0/399481151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb30103300 0x7feb30103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.814+0000 7feb368cb640 1 --2- 172.21.15.69:0/399481151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb30100290 0x7feb301006b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.814+0000 7feb368cb640 1 -- 172.21.15.69:0/399481151 >> 172.21.15.69:0/399481151 conn(0x7feb300fbb80 msgr2=0x7feb300fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.814+0000 7feb368cb640 1 -- 172.21.15.69:0/399481151 shutdown_connections 2024-04-23T10:24:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.814+0000 7feb368cb640 1 -- 172.21.15.69:0/399481151 wait complete. 2024-04-23T10:24:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb368cb640 1 Processor -- start 2024-04-23T10:24:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb368cb640 1 -- start start 2024-04-23T10:24:58.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb368cb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb30100290 0x7feb3019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:58.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb368cb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb30103300 0x7feb3019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:58.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb368cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb30103cc0 0x7feb301a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:58.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb368cb640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7feb3010dc20 con 0x7feb30103300 2024-04-23T10:24:58.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb368cb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feb3010daa0 con 0x7feb30100290 2024-04-23T10:24:58.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb368cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feb3010dda0 con 0x7feb30103cc0 2024-04-23T10:24:58.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb2f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb30103300 0x7feb3019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:58.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb2f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb30103300 0x7feb3019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37574/0 (socket says 172.21.15.69:37574) 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb2f7fe640 1 -- 172.21.15.69:0/2371689246 learned_addr learned my addr 172.21.15.69:0/2371689246 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb34e68640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb30103cc0 0x7feb301a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb2ffff640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb30100290 0x7feb3019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb2f7fe640 1 -- 172.21.15.69:0/2371689246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb30103cc0 msgr2=0x7feb301a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb2f7fe640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb30103cc0 0x7feb301a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb2f7fe640 1 -- 172.21.15.69:0/2371689246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb30100290 msgr2=0x7feb3019a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb2f7fe640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb30100290 0x7feb3019a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb2f7fe640 1 -- 172.21.15.69:0/2371689246 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb301a2120 con 0x7feb30103300 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.815+0000 7feb2ffff640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb30100290 0x7feb3019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.816+0000 7feb2f7fe640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb30103300 0x7feb3019aa40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feb2400d950 tx=0x7feb2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.816+0000 7feb2d7fa640 1 -- 172.21.15.69:0/2371689246 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24017070 con 0x7feb30103300 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.816+0000 7feb368cb640 1 -- 172.21.15.69:0/2371689246 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb301a2410 con 0x7feb30103300 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.816+0000 7feb2d7fa640 1 -- 172.21.15.69:0/2371689246 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feb24009c30 con 0x7feb30103300 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.816+0000 7feb2d7fa640 1 -- 172.21.15.69:0/2371689246 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2400f6b0 con 0x7feb30103300 2024-04-23T10:24:58.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.816+0000 7feb368cb640 1 -- 172.21.15.69:0/2371689246 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb301a2960 con 0x7feb30103300 2024-04-23T10:24:58.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.817+0000 7feb368cb640 1 -- 172.21.15.69:0/2371689246 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb301a2bc0 con 0x7feb30103300 2024-04-23T10:24:58.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.818+0000 7feb2d7fa640 1 -- 172.21.15.69:0/2371689246 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7feb240109c0 con 0x7feb30103300 2024-04-23T10:24:58.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.818+0000 7feb2d7fa640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb180a3bb0 0x7feb180a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:58.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.818+0000 7feb2ffff640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb180a3bb0 0x7feb180a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:58.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.818+0000 7feb2d7fa640 1 -- 172.21.15.69:0/2371689246 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7feb240cfee0 con 0x7feb30103300 2024-04-23T10:24:58.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.819+0000 7feb2ffff640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb180a3bb0 0x7feb180a6070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feb200096c0 tx=0x7feb20009650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:58.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:58.823+0000 7feb2d7fa640 1 -- 172.21.15.69:0/2371689246 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feb24009de0 con 0x7feb30103300 2024-04-23T10:24:58.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:58 smithi167 ceph-mon[32940]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:58.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:58 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] up:active 2024-04-23T10:24:58.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:58 smithi167 ceph-mon[32940]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-23T10:24:58.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:58 smithi167 ceph-mon[32940]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-23T10:24:58.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:58 smithi167 ceph-mon[32940]: Cluster is now healthy 2024-04-23T10:24:58.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:58 smithi167 ceph-mon[32940]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=l=up:active,3=h=up:active} 2 up:standby-replay 6 up:standby 2024-04-23T10:24:58.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:58 smithi167 ceph-mon[32940]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2024-04-23T10:24:58.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:58 smithi167 ceph-mon[32940]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-04-23T10:24:58.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:58 smithi146 ceph-mon[32800]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:58.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:58 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] up:active 2024-04-23T10:24:58.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:58 smithi146 ceph-mon[32800]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-23T10:24:58.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:58 smithi146 ceph-mon[32800]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-23T10:24:58.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:58 smithi146 ceph-mon[32800]: Cluster is now healthy 2024-04-23T10:24:58.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:58 smithi146 ceph-mon[32800]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=l=up:active,3=h=up:active} 2 up:standby-replay 6 up:standby 2024-04-23T10:24:58.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:58 smithi146 ceph-mon[32800]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2024-04-23T10:24:58.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:58 smithi146 ceph-mon[32800]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-04-23T10:24:59.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.031+0000 7feb368cb640 1 -- 172.21.15.69:0/2371689246 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7feb30102810 con 0x7feb180a3bb0 2024-04-23T10:24:59.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.036+0000 7feb2d7fa640 1 -- 172.21.15.69:0/2371689246 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7feb30102810 con 0x7feb180a3bb0 2024-04-23T10:24:59.035 INFO:teuthology.orchestra.run.smithi069.stdout:/volumes/qa/sv_0/58e29271-3133-4fd8-a7c1-1746caf1dbea 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 -- 172.21.15.69:0/2371689246 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb180a3bb0 msgr2=0x7feb180a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb180a3bb0 0x7feb180a6070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feb200096c0 tx=0x7feb20009650 comp rx=0 tx=0).stop 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 -- 172.21.15.69:0/2371689246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb30103300 msgr2=0x7feb3019aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb30103300 0x7feb3019aa40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feb2400d950 tx=0x7feb2400de10 comp rx=0 tx=0).stop 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 -- 172.21.15.69:0/2371689246 shutdown_connections 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7feb180a3bb0 0x7feb180a6070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb30103300 0x7feb3019aa40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb30103cc0 0x7feb301a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 --2- 172.21.15.69:0/2371689246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb30100290 0x7feb3019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 -- 172.21.15.69:0/2371689246 >> 172.21.15.69:0/2371689246 conn(0x7feb300fbb80 msgr2=0x7feb301010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 -- 172.21.15.69:0/2371689246 shutdown_connections 2024-04-23T10:24:59.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.038+0000 7feb368cb640 1 -- 172.21.15.69:0/2371689246 wait complete. 2024-04-23T10:24:59.047 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-23T10:24:59.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.152+0000 7faf59420640 1 -- 172.21.15.69:0/3188299066 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf54103b40 msgr2=0x7faf5410a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.152+0000 7faf59420640 1 --2- 172.21.15.69:0/3188299066 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf54103b40 0x7faf5410a3d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009ca0 tx=0x7faf4c02a8c0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.152+0000 7faf59420640 1 -- 172.21.15.69:0/3188299066 shutdown_connections 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.152+0000 7faf59420640 1 --2- 172.21.15.69:0/3188299066 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf54103b40 0x7faf5410a3d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.152+0000 7faf59420640 1 --2- 172.21.15.69:0/3188299066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf54103180 0x7faf54103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.152+0000 7faf59420640 1 --2- 172.21.15.69:0/3188299066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf54101f90 0x7faf541023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.152+0000 7faf59420640 1 -- 172.21.15.69:0/3188299066 >> 172.21.15.69:0/3188299066 conn(0x7faf540fd500 msgr2=0x7faf540ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.152+0000 7faf59420640 1 -- 172.21.15.69:0/3188299066 shutdown_connections 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.152+0000 7faf59420640 1 -- 172.21.15.69:0/3188299066 wait complete. 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.152+0000 7faf59420640 1 Processor -- start 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf59420640 1 -- start start 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf59420640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf54101f90 0x7faf54198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf59420640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf54103180 0x7faf54198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf59420640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf54103b40 0x7faf5419f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf59420640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7faf5410dc70 con 0x7faf54103180 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf59420640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf5410daf0 con 0x7faf54103b40 2024-04-23T10:24:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf59420640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faf5410ddf0 con 0x7faf54101f90 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf4bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf54103180 0x7faf54198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf4bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf54103180 0x7faf54198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37590/0 (socket says 172.21.15.69:37590) 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf4bfff640 1 -- 172.21.15.69:0/1042434896 learned_addr learned my addr 172.21.15.69:0/1042434896 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf52ffd640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf54101f90 0x7faf54198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf4bfff640 1 -- 172.21.15.69:0/1042434896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf54101f90 msgr2=0x7faf54198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf4bfff640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf54101f90 0x7faf54198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf4bfff640 1 -- 172.21.15.69:0/1042434896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf54103b40 msgr2=0x7faf5419f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf4bfff640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf54103b40 0x7faf5419f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf4bfff640 1 -- 172.21.15.69:0/1042434896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5419ff20 con 0x7faf54103180 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf4bfff640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf54103180 0x7faf54198840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00b4a0 tx=0x7faf3c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf50ff9640 1 -- 172.21.15.69:0/1042434896 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c014070 con 0x7faf54103180 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf50ff9640 1 -- 172.21.15.69:0/1042434896 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf3c010ae0 con 0x7faf54103180 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf50ff9640 1 -- 172.21.15.69:0/1042434896 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c017ce0 con 0x7faf54103180 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf59420640 1 -- 172.21.15.69:0/1042434896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf541a0210 con 0x7faf54103180 2024-04-23T10:24:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.153+0000 7faf59420640 1 -- 172.21.15.69:0/1042434896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf541a0830 con 0x7faf54103180 2024-04-23T10:24:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.154+0000 7faf59420640 1 -- 172.21.15.69:0/1042434896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf54109350 con 0x7faf54103180 2024-04-23T10:24:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.155+0000 7faf50ff9640 1 -- 172.21.15.69:0/1042434896 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7faf3c017070 con 0x7faf54103180 2024-04-23T10:24:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.156+0000 7faf50ff9640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7faf400a3c30 0x7faf400a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.156+0000 7faf52ffd640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7faf400a3c30 0x7faf400a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:59.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.156+0000 7faf50ff9640 1 -- 172.21.15.69:0/1042434896 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7faf3c0cf900 con 0x7faf54103180 2024-04-23T10:24:59.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.157+0000 7faf52ffd640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7faf400a3c30 0x7faf400a60f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faf54102fe0 tx=0x7faf44005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:59.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.161+0000 7faf50ff9640 1 -- 172.21.15.69:0/1042434896 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faf3c09c430 con 0x7faf54103180 2024-04-23T10:24:59.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.369+0000 7faf59420640 1 -- 172.21.15.69:0/1042434896 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7faf54062390 con 0x7faf400a3c30 2024-04-23T10:24:59.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.393+0000 7faf50ff9640 1 -- 172.21.15.69:0/1042434896 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faf54062390 con 0x7faf400a3c30 2024-04-23T10:24:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 -- 172.21.15.69:0/1042434896 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7faf400a3c30 msgr2=0x7faf400a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7faf400a3c30 0x7faf400a60f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faf54102fe0 tx=0x7faf44005f90 comp rx=0 tx=0).stop 2024-04-23T10:24:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 -- 172.21.15.69:0/1042434896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf54103180 msgr2=0x7faf54198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf54103180 0x7faf54198840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00b4a0 tx=0x7faf3c00b960 comp rx=0 tx=0).stop 2024-04-23T10:24:59.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 -- 172.21.15.69:0/1042434896 shutdown_connections 2024-04-23T10:24:59.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7faf400a3c30 0x7faf400a60f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf54103180 0x7faf54198840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf54103b40 0x7faf5419f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 --2- 172.21.15.69:0/1042434896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf54101f90 0x7faf54198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 -- 172.21.15.69:0/1042434896 >> 172.21.15.69:0/1042434896 conn(0x7faf540fd500 msgr2=0x7faf54106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:59.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 -- 172.21.15.69:0/1042434896 shutdown_connections 2024-04-23T10:24:59.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.395+0000 7faf59420640 1 -- 172.21.15.69:0/1042434896 wait complete. 2024-04-23T10:24:59.405 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-23T10:24:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.514+0000 7f3723460640 1 -- 172.21.15.69:0/1219003200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f371c103b50 msgr2=0x7f371c10a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.514+0000 7f3723460640 1 --2- 172.21.15.69:0/1219003200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f371c103b50 0x7f371c10a3e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3718009900 tx=0x7f371802a410 comp rx=0 tx=0).stop 2024-04-23T10:24:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.514+0000 7f3723460640 1 -- 172.21.15.69:0/1219003200 shutdown_connections 2024-04-23T10:24:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.514+0000 7f3723460640 1 --2- 172.21.15.69:0/1219003200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f371c103b50 0x7f371c10a3e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.514+0000 7f3723460640 1 --2- 172.21.15.69:0/1219003200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f371c103190 0x7f371c103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.514+0000 7f3723460640 1 --2- 172.21.15.69:0/1219003200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f371c101fa0 0x7f371c1023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.514+0000 7f3723460640 1 -- 172.21.15.69:0/1219003200 >> 172.21.15.69:0/1219003200 conn(0x7f371c0fd530 msgr2=0x7f371c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.514+0000 7f3723460640 1 -- 172.21.15.69:0/1219003200 shutdown_connections 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.514+0000 7f3723460640 1 -- 172.21.15.69:0/1219003200 wait complete. 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f3723460640 1 Processor -- start 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f3723460640 1 -- start start 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f3723460640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f371c101fa0 0x7f371c075d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f3723460640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f371c103190 0x7f371c074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f3723460640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f371c103b50 0x7f371c074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f3723460640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f371c10dc00 con 0x7f371c103190 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f3723460640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f371c10da80 con 0x7f371c103b50 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f3723460640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f371c10dd80 con 0x7f371c101fa0 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37209fb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f371c103190 0x7f371c074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37209fb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f371c103190 0x7f371c074340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42250/0 (socket says 172.21.15.69:42250) 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37209fb640 1 -- 172.21.15.69:0/341760424 learned_addr learned my addr 172.21.15.69:0/341760424 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37211fc640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f371c101fa0 0x7f371c075d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37219fd640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f371c103b50 0x7f371c074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37209fb640 1 -- 172.21.15.69:0/341760424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f371c101fa0 msgr2=0x7f371c075d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37209fb640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f371c101fa0 0x7f371c075d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37209fb640 1 -- 172.21.15.69:0/341760424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f371c103b50 msgr2=0x7f371c074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37209fb640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f371c103b50 0x7f371c074880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37209fb640 1 -- 172.21.15.69:0/341760424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c075110 con 0x7f371c103190 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37219fd640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f371c103b50 0x7f371c074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f37209fb640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f371c103190 0x7f371c074340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f371000ebc0 tx=0x7f371000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f370e7fc640 1 -- 172.21.15.69:0/341760424 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710010630 con 0x7f371c103190 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f370e7fc640 1 -- 172.21.15.69:0/341760424 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3710010ca0 con 0x7f371c103190 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f3723460640 1 -- 172.21.15.69:0/341760424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371c1a2390 con 0x7f371c103190 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f370e7fc640 1 -- 172.21.15.69:0/341760424 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710018ba0 con 0x7f371c103190 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.515+0000 7f3723460640 1 -- 172.21.15.69:0/341760424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371c1a28e0 con 0x7f371c103190 2024-04-23T10:24:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.516+0000 7f3723460640 1 -- 172.21.15.69:0/341760424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371c109340 con 0x7f371c103190 2024-04-23T10:24:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.517+0000 7f370e7fc640 1 -- 172.21.15.69:0/341760424 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f37100107d0 con 0x7f371c103190 2024-04-23T10:24:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.518+0000 7f370e7fc640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f37080a3c40 0x7f37080a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.518+0000 7f37211fc640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f37080a3c40 0x7f37080a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.518+0000 7f370e7fc640 1 -- 172.21.15.69:0/341760424 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f37100d0a40 con 0x7f371c103190 2024-04-23T10:24:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.518+0000 7f37211fc640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f37080a3c40 0x7f37080a6100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f371c102ff0 tx=0x7f3714005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:59.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.522+0000 7f370e7fc640 1 -- 172.21.15.69:0/341760424 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3710010ac0 con 0x7f371c103190 2024-04-23T10:24:59.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.731+0000 7f3723460640 1 -- 172.21.15.69:0/341760424 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f371c062420 con 0x7f37080a3c40 2024-04-23T10:24:59.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.736+0000 7f370e7fc640 1 -- 172.21.15.69:0/341760424 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f371c062420 con 0x7f37080a3c40 2024-04-23T10:24:59.735 INFO:teuthology.orchestra.run.smithi069.stdout:/volumes/qa/sv_1/cec0e692-b351-4dd8-958e-abe3bc589ac9 2024-04-23T10:24:59.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 -- 172.21.15.69:0/341760424 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f37080a3c40 msgr2=0x7f37080a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f37080a3c40 0x7f37080a6100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f371c102ff0 tx=0x7f3714005f90 comp rx=0 tx=0).stop 2024-04-23T10:24:59.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 -- 172.21.15.69:0/341760424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f371c103190 msgr2=0x7f371c074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f371c103190 0x7f371c074340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f371000ebc0 tx=0x7f371000c6a0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 -- 172.21.15.69:0/341760424 shutdown_connections 2024-04-23T10:24:59.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f37080a3c40 0x7f37080a6100 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f371c103190 0x7f371c074340 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f371c103b50 0x7f371c074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 --2- 172.21.15.69:0/341760424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f371c101fa0 0x7f371c075d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 -- 172.21.15.69:0/341760424 >> 172.21.15.69:0/341760424 conn(0x7f371c0fd530 msgr2=0x7f371c106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:59.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 -- 172.21.15.69:0/341760424 shutdown_connections 2024-04-23T10:24:59.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.738+0000 7f3723460640 1 -- 172.21.15.69:0/341760424 wait complete. 2024-04-23T10:24:59.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:59 smithi069 ceph-mon[29593]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:59.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:59 smithi069 ceph-mon[29593]: pgmap v286: 97 pgs: 97 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 5.8 KiB/s wr, 20 op/s 2024-04-23T10:24:59.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:59 smithi069 ceph-mon[29593]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:59.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:59 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] up:active 2024-04-23T10:24:59.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:59 smithi069 ceph-mon[29593]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2024-04-23T10:24:59.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:24:59 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:24:59.748 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:59.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:59 smithi167 ceph-mon[32940]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:59.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:59 smithi167 ceph-mon[32940]: pgmap v286: 97 pgs: 97 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 5.8 KiB/s wr, 20 op/s 2024-04-23T10:24:59.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:59 smithi167 ceph-mon[32940]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:59.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:59 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] up:active 2024-04-23T10:24:59.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:59 smithi167 ceph-mon[32940]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2024-04-23T10:24:59.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:24:59 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:24:59.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.846+0000 7f51b32fd640 1 -- 172.21.15.69:0/272500414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac1029a0 msgr2=0x7f51ac1092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.846+0000 7f51b32fd640 1 --2- 172.21.15.69:0/272500414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac1029a0 0x7f51ac1092c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009ca0 tx=0x7f51a402a8c0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.846+0000 7f51b32fd640 1 -- 172.21.15.69:0/272500414 shutdown_connections 2024-04-23T10:24:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.846+0000 7f51b32fd640 1 --2- 172.21.15.69:0/272500414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac1029a0 0x7f51ac1092c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.846+0000 7f51b32fd640 1 --2- 172.21.15.69:0/272500414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51ac101fe0 0x7f51ac102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.846+0000 7f51b32fd640 1 --2- 172.21.15.69:0/272500414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ac100e90 0x7f51ac1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.846+0000 7f51b32fd640 1 -- 172.21.15.69:0/272500414 >> 172.21.15.69:0/272500414 conn(0x7f51ac0fc400 msgr2=0x7f51ac0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b32fd640 1 -- 172.21.15.69:0/272500414 shutdown_connections 2024-04-23T10:24:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b32fd640 1 -- 172.21.15.69:0/272500414 wait complete. 2024-04-23T10:24:59.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b32fd640 1 Processor -- start 2024-04-23T10:24:59.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b32fd640 1 -- start start 2024-04-23T10:24:59.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b32fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51ac100e90 0x7f51ac069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b32fd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac101fe0 0x7f51ac19f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b32fd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ac1029a0 0x7f51ac1a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b32fd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac10cb10 con 0x7f51ac101fe0 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b32fd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac10c990 con 0x7f51ac1029a0 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b32fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac10cc90 con 0x7f51ac100e90 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b0898640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac101fe0 0x7f51ac19f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b0898640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac101fe0 0x7f51ac19f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42272/0 (socket says 172.21.15.69:42272) 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b1099640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51ac100e90 0x7f51ac069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.847+0000 7f51b0898640 1 -- 172.21.15.69:0/3452164359 learned_addr learned my addr 172.21.15.69:0/3452164359 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51b189a640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ac1029a0 0x7f51ac1a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51b0898640 1 -- 172.21.15.69:0/3452164359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51ac100e90 msgr2=0x7f51ac069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51b0898640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51ac100e90 0x7f51ac069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51b0898640 1 -- 172.21.15.69:0/3452164359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ac1029a0 msgr2=0x7f51ac1a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51b0898640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ac1029a0 0x7f51ac1a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51b0898640 1 -- 172.21.15.69:0/3452164359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac1a20c0 con 0x7f51ac101fe0 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51b189a640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ac1029a0 0x7f51ac1a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51b1099640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51ac100e90 0x7f51ac069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:24:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51b0898640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac101fe0 0x7f51ac19f380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f519c00e9c0 tx=0x7f519c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51a27fc640 1 -- 172.21.15.69:0/3452164359 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c00cd80 con 0x7f51ac101fe0 2024-04-23T10:24:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51a27fc640 1 -- 172.21.15.69:0/3452164359 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f519c0035f0 con 0x7f51ac101fe0 2024-04-23T10:24:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51a27fc640 1 -- 172.21.15.69:0/3452164359 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c010690 con 0x7f51ac101fe0 2024-04-23T10:24:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51b32fd640 1 -- 172.21.15.69:0/3452164359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ac1a2350 con 0x7f51ac101fe0 2024-04-23T10:24:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.848+0000 7f51b32fd640 1 -- 172.21.15.69:0/3452164359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ac1a28f0 con 0x7f51ac101fe0 2024-04-23T10:24:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.849+0000 7f51b32fd640 1 -- 172.21.15.69:0/3452164359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ac1081a0 con 0x7f51ac101fe0 2024-04-23T10:24:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.850+0000 7f51a27fc640 1 -- 172.21.15.69:0/3452164359 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f519c0037a0 con 0x7f51ac101fe0 2024-04-23T10:24:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.851+0000 7f51a27fc640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f51980a3cf0 0x7f51980a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.851+0000 7f51b1099640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f51980a3cf0 0x7f51980a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.851+0000 7f51a27fc640 1 -- 172.21.15.69:0/3452164359 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f519c0d08d0 con 0x7f51ac101fe0 2024-04-23T10:24:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.851+0000 7f51b1099640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f51980a3cf0 0x7f51980a61b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009fc0 tx=0x7f51a8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:59.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:24:59.854+0000 7f51a27fc640 1 -- 172.21.15.69:0/3452164359 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f519c09d390 con 0x7f51ac101fe0 2024-04-23T10:24:59.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:59 smithi146 ceph-mon[32800]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:59.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:59 smithi146 ceph-mon[32800]: pgmap v286: 97 pgs: 97 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 5.8 KiB/s wr, 20 op/s 2024-04-23T10:24:59.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:59 smithi146 ceph-mon[32800]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:24:59.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:59 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] up:active 2024-04-23T10:24:59.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:59 smithi146 ceph-mon[32800]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2024-04-23T10:24:59.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:24:59 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:25:00.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.069+0000 7f51b32fd640 1 -- 172.21.15.69:0/3452164359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51ac02d830 con 0x7f51ac101fe0 2024-04-23T10:25:00.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.069+0000 7f51a27fc640 1 -- 172.21.15.69:0/3452164359 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7f519c09cc90 con 0x7f51ac101fe0 2024-04-23T10:25:00.069 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:25:00.069 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:24:59.329454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24463,24421,24487,24416,24392]},"id":1}]} 2024-04-23T10:25:00.069 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 25 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 -- 172.21.15.69:0/3452164359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f51980a3cf0 msgr2=0x7f51980a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f51980a3cf0 0x7f51980a61b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009fc0 tx=0x7f51a8005f90 comp rx=0 tx=0).stop 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 -- 172.21.15.69:0/3452164359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac101fe0 msgr2=0x7f51ac19f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac101fe0 0x7f51ac19f380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f519c00e9c0 tx=0x7f519c00ee80 comp rx=0 tx=0).stop 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 -- 172.21.15.69:0/3452164359 shutdown_connections 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f51980a3cf0 0x7f51980a61b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac101fe0 0x7f51ac19f380 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ac1029a0 0x7f51ac1a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 --2- 172.21.15.69:0/3452164359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51ac100e90 0x7f51ac069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 -- 172.21.15.69:0/3452164359 >> 172.21.15.69:0/3452164359 conn(0x7f51ac0fc400 msgr2=0x7f51ac105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 -- 172.21.15.69:0/3452164359 shutdown_connections 2024-04-23T10:25:00.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.071+0000 7f51b32fd640 1 -- 172.21.15.69:0/3452164359 wait complete. 2024-04-23T10:25:00.081 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:25:00.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.183+0000 7f2b4a42a640 1 -- 172.21.15.69:0/4069950414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b441029a0 msgr2=0x7f2b441092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.183+0000 7f2b4a42a640 1 --2- 172.21.15.69:0/4069950414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b441029a0 0x7f2b441092c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009ca0 tx=0x7f2b3c02a8c0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.183+0000 7f2b4a42a640 1 -- 172.21.15.69:0/4069950414 shutdown_connections 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.183+0000 7f2b4a42a640 1 --2- 172.21.15.69:0/4069950414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b441029a0 0x7f2b441092c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.183+0000 7f2b4a42a640 1 --2- 172.21.15.69:0/4069950414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b44101fe0 0x7f2b44102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.183+0000 7f2b4a42a640 1 --2- 172.21.15.69:0/4069950414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b44100e90 0x7f2b441012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.183+0000 7f2b4a42a640 1 -- 172.21.15.69:0/4069950414 >> 172.21.15.69:0/4069950414 conn(0x7f2b440fc400 msgr2=0x7f2b440fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.183+0000 7f2b4a42a640 1 -- 172.21.15.69:0/4069950414 shutdown_connections 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.183+0000 7f2b4a42a640 1 -- 172.21.15.69:0/4069950414 wait complete. 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.183+0000 7f2b4a42a640 1 Processor -- start 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.183+0000 7f2b4a42a640 1 -- start start 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b4a42a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b44100e90 0x7f2b44198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b4a42a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b44101fe0 0x7f2b44198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b4a42a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b441029a0 0x7f2b4419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b4a42a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4410dc10 con 0x7f2b44101fe0 2024-04-23T10:25:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b4a42a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4410da90 con 0x7f2b44100e90 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b4a42a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4410dd90 con 0x7f2b441029a0 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b437fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b44101fe0 0x7f2b44198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b437fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b44101fe0 0x7f2b44198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42288/0 (socket says 172.21.15.69:42288) 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b437fe640 1 -- 172.21.15.69:0/1593269122 learned_addr learned my addr 172.21.15.69:0/1593269122 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b489c7640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b441029a0 0x7f2b4419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b43fff640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b44100e90 0x7f2b44198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b437fe640 1 -- 172.21.15.69:0/1593269122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b441029a0 msgr2=0x7f2b4419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b437fe640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b441029a0 0x7f2b4419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b437fe640 1 -- 172.21.15.69:0/1593269122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b44100e90 msgr2=0x7f2b44198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b437fe640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b44100e90 0x7f2b44198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b437fe640 1 -- 172.21.15.69:0/1593269122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4419fe40 con 0x7f2b44101fe0 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b437fe640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b44101fe0 0x7f2b44198760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800d770 tx=0x7f2b3800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b417fa640 1 -- 172.21.15.69:0/1593269122 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38017070 con 0x7f2b44101fe0 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b417fa640 1 -- 172.21.15.69:0/1593269122 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2b38009c30 con 0x7f2b44101fe0 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b4a42a640 1 -- 172.21.15.69:0/1593269122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b441a0130 con 0x7f2b44101fe0 2024-04-23T10:25:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.184+0000 7f2b417fa640 1 -- 172.21.15.69:0/1593269122 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38003d70 con 0x7f2b44101fe0 2024-04-23T10:25:00.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.185+0000 7f2b4a42a640 1 -- 172.21.15.69:0/1593269122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b441a0680 con 0x7f2b44101fe0 2024-04-23T10:25:00.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.185+0000 7f2b4a42a640 1 -- 172.21.15.69:0/1593269122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b441081a0 con 0x7f2b44101fe0 2024-04-23T10:25:00.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.187+0000 7f2b417fa640 1 -- 172.21.15.69:0/1593269122 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2b38003f10 con 0x7f2b44101fe0 2024-04-23T10:25:00.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.187+0000 7f2b417fa640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b2c0a3c40 0x7f2b2c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.187+0000 7f2b43fff640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b2c0a3c40 0x7f2b2c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.187+0000 7f2b417fa640 1 -- 172.21.15.69:0/1593269122 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f2b380d01b0 con 0x7f2b44101fe0 2024-04-23T10:25:00.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.188+0000 7f2b43fff640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b2c0a3c40 0x7f2b2c0a6100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b340095f0 tx=0x7f2b34005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:00.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.195+0000 7f2b417fa640 1 -- 172.21.15.69:0/1593269122 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2b3809cbe0 con 0x7f2b44101fe0 2024-04-23T10:25:00.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.379+0000 7f2b4a42a640 1 -- 172.21.15.69:0/1593269122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b4402d790 con 0x7f2b44101fe0 2024-04-23T10:25:00.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.381+0000 7f2b417fa640 1 -- 172.21.15.69:0/1593269122 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22220 (secure 0 0 0) 0x7f2b38009de0 con 0x7f2b44101fe0 2024-04-23T10:25:00.380 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:25:00.380 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":86,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:24:54.477485+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:25:00.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 -- 172.21.15.69:0/1593269122 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b2c0a3c40 msgr2=0x7f2b2c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b2c0a3c40 0x7f2b2c0a6100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b340095f0 tx=0x7f2b34005f90 comp rx=0 tx=0).stop 2024-04-23T10:25:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 -- 172.21.15.69:0/1593269122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b44101fe0 msgr2=0x7f2b44198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b44101fe0 0x7f2b44198760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800d770 tx=0x7f2b3800dc30 comp rx=0 tx=0).stop 2024-04-23T10:25:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 -- 172.21.15.69:0/1593269122 shutdown_connections 2024-04-23T10:25:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b2c0a3c40 0x7f2b2c0a6100 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b44101fe0 0x7f2b44198760 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b441029a0 0x7f2b4419f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 --2- 172.21.15.69:0/1593269122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b44100e90 0x7f2b44198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 -- 172.21.15.69:0/1593269122 >> 172.21.15.69:0/1593269122 conn(0x7f2b440fc400 msgr2=0x7f2b44105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 -- 172.21.15.69:0/1593269122 shutdown_connections 2024-04-23T10:25:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.383+0000 7f2b4a42a640 1 -- 172.21.15.69:0/1593269122 wait complete. 2024-04-23T10:25:00.394 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-23T10:25:00.394 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:25:00.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.497+0000 7f066135d640 1 -- 172.21.15.69:0/2269056493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f065c105340 msgr2=0x7f065c107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.497+0000 7f066135d640 1 --2- 172.21.15.69:0/2269056493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f065c105340 0x7f065c107730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0644009900 tx=0x7f064402a410 comp rx=0 tx=0).stop 2024-04-23T10:25:00.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.497+0000 7f066135d640 1 -- 172.21.15.69:0/2269056493 shutdown_connections 2024-04-23T10:25:00.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.497+0000 7f066135d640 1 --2- 172.21.15.69:0/2269056493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f065c107c70 0x7f065c10a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.497+0000 7f066135d640 1 --2- 172.21.15.69:0/2269056493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f065c105340 0x7f065c107730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.497+0000 7f066135d640 1 --2- 172.21.15.69:0/2269056493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c102a10 0x7f065c104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.497+0000 7f066135d640 1 -- 172.21.15.69:0/2269056493 >> 172.21.15.69:0/2269056493 conn(0x7f065c0fc400 msgr2=0x7f065c0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:00.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.497+0000 7f066135d640 1 -- 172.21.15.69:0/2269056493 shutdown_connections 2024-04-23T10:25:00.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.497+0000 7f066135d640 1 -- 172.21.15.69:0/2269056493 wait complete. 2024-04-23T10:25:00.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f066135d640 1 Processor -- start 2024-04-23T10:25:00.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f066135d640 1 -- start start 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f066135d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f065c102a10 0x7f065c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f066135d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f065c105340 0x7f065c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f066135d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c107c70 0x7f065c1a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f066135d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f065c10dbe0 con 0x7f065c107c70 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f066135d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f065c10da60 con 0x7f065c105340 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f066135d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f065c10dd60 con 0x7f065c102a10 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f065b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c107c70 0x7f065c1a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f065affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f065c102a10 0x7f065c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f065affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f065c102a10 0x7f065c19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.69:50290/0 (socket says 172.21.15.69:50290) 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f065b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c107c70 0x7f065c1a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42302/0 (socket says 172.21.15.69:42302) 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f065affd640 1 -- 172.21.15.69:0/2539957553 learned_addr learned my addr 172.21.15.69:0/2539957553 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f0653fff640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f065c105340 0x7f065c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f065affd640 1 -- 172.21.15.69:0/2539957553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f065c105340 msgr2=0x7f065c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f065affd640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f065c105340 0x7f065c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f065affd640 1 -- 172.21.15.69:0/2539957553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c107c70 msgr2=0x7f065c1a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f065affd640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c107c70 0x7f065c1a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f065affd640 1 -- 172.21.15.69:0/2539957553 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c1a20b0 con 0x7f065c102a10 2024-04-23T10:25:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.498+0000 7f065b7fe640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c107c70 0x7f065c1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:25:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.499+0000 7f065affd640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f065c102a10 0x7f065c19a490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f064c00e9f0 tx=0x7f064c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.499+0000 7f0658ff9640 1 -- 172.21.15.69:0/2539957553 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c00cd80 con 0x7f065c102a10 2024-04-23T10:25:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.499+0000 7f0658ff9640 1 -- 172.21.15.69:0/2539957553 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f064c010900 con 0x7f065c102a10 2024-04-23T10:25:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.499+0000 7f066135d640 1 -- 172.21.15.69:0/2539957553 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065c1a23a0 con 0x7f065c102a10 2024-04-23T10:25:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.499+0000 7f0658ff9640 1 -- 172.21.15.69:0/2539957553 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c018920 con 0x7f065c102a10 2024-04-23T10:25:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.499+0000 7f066135d640 1 -- 172.21.15.69:0/2539957553 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065c1a2910 con 0x7f065c102a10 2024-04-23T10:25:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.500+0000 7f066135d640 1 -- 172.21.15.69:0/2539957553 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065c1097c0 con 0x7f065c102a10 2024-04-23T10:25:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.501+0000 7f0658ff9640 1 -- 172.21.15.69:0/2539957553 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f064c010ab0 con 0x7f065c102a10 2024-04-23T10:25:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.502+0000 7f0658ff9640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f06480a3cc0 0x7f06480a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.502+0000 7f0653fff640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f06480a3cc0 0x7f06480a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.502+0000 7f0658ff9640 1 -- 172.21.15.69:0/2539957553 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f064c0d06e0 con 0x7f065c102a10 2024-04-23T10:25:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.502+0000 7f0653fff640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f06480a3cc0 0x7f06480a6180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0644009230 tx=0x7f0644031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:00.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.508+0000 7f0658ff9640 1 -- 172.21.15.69:0/2539957553 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f064c09cac0 con 0x7f065c102a10 2024-04-23T10:25:00.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.688+0000 7f066135d640 1 -- 172.21.15.69:0/2539957553 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f065c062390 con 0x7f06480a3cc0 2024-04-23T10:25:00.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.696+0000 7f0658ff9640 1 -- 172.21.15.69:0/2539957553 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258907 (secure 0 0 0) 0x7f065c062390 con 0x7f06480a3cc0 2024-04-23T10:25:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:25:00.700 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 -- 172.21.15.69:0/2539957553 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f06480a3cc0 msgr2=0x7f06480a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f06480a3cc0 0x7f06480a6180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0644009230 tx=0x7f0644031510 comp rx=0 tx=0).stop 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 -- 172.21.15.69:0/2539957553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f065c102a10 msgr2=0x7f065c19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f065c102a10 0x7f065c19a490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f064c00e9f0 tx=0x7f064c00eeb0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 -- 172.21.15.69:0/2539957553 shutdown_connections 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f06480a3cc0 0x7f06480a6180 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c107c70 0x7f065c1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f065c105340 0x7f065c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 --2- 172.21.15.69:0/2539957553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f065c102a10 0x7f065c19a490 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 -- 172.21.15.69:0/2539957553 >> 172.21.15.69:0/2539957553 conn(0x7f065c0fc400 msgr2=0x7f065c1021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 -- 172.21.15.69:0/2539957553 shutdown_connections 2024-04-23T10:25:00.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.699+0000 7f066135d640 1 -- 172.21.15.69:0/2539957553 wait complete. 2024-04-23T10:25:00.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:00 smithi069 ceph-mon[29593]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:25:00.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:00 smithi069 ceph-mon[29593]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-23T10:25:00.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:00 smithi069 ceph-mon[29593]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:25:00.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:00 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3452164359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:25:00.708 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:00 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1593269122' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:25:00.709 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-04-23T10:24:59.004121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595030,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":148,"num_read_kb":130,"num_write":304,"num_write_kb":2976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":246,"ondisk_log_size":246,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":223,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356128,"kb_used_data":11092,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585696,"statfs":{"total":1151940427776,"available":1151575752704,"internally_reserved":0,"allocated":11358208,"data_stored":7055032,"data_compressed":107040,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19139,"internal_metadata":353154365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4662,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":123,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.525925"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846782+0000","last_change":"2024-04-23T10:24:53.504514+0000","last_active":"2024-04-23T10:24:55.846782+0000","last_peered":"2024-04-23T10:24:55.846782+0000","last_clean":"2024-04-23T10:24:55.846782+0000","last_became_active":"2024-04-23T10:24:53.504105+0000","last_became_peered":"2024-04-23T10:24:53.504105+0000","last_unstale":"2024-04-23T10:24:55.846782+0000","last_undegraded":"2024-04-23T10:24:55.846782+0000","last_fullsized":"2024-04-23T10:24:55.846782+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:49.730698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986713+0000","last_change":"2024-04-23T10:24:53.504534+0000","last_active":"2024-04-23T10:24:54.986713+0000","last_peered":"2024-04-23T10:24:54.986713+0000","last_clean":"2024-04-23T10:24:54.986713+0000","last_became_active":"2024-04-23T10:24:53.504244+0000","last_became_peered":"2024-04-23T10:24:53.504244+0000","last_unstale":"2024-04-23T10:24:54.986713+0000","last_undegraded":"2024-04-23T10:24:54.986713+0000","last_fullsized":"2024-04-23T10:24:54.986713+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:12:57.447009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986589+0000","last_change":"2024-04-23T10:24:53.502922+0000","last_active":"2024-04-23T10:24:54.986589+0000","last_peered":"2024-04-23T10:24:54.986589+0000","last_clean":"2024-04-23T10:24:54.986589+0000","last_became_active":"2024-04-23T10:24:53.502519+0000","last_became_peered":"2024-04-23T10:24:53.502519+0000","last_unstale":"2024-04-23T10:24:54.986589+0000","last_undegraded":"2024-04-23T10:24:54.986589+0000","last_fullsized":"2024-04-23T10:24:54.986589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:58:35.871081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.488154+0000","last_change":"2024-04-23T10:24:53.500049+0000","last_active":"2024-04-23T10:24:54.488154+0000","last_peered":"2024-04-23T10:24:54.488154+0000","last_clean":"2024-04-23T10:24:54.488154+0000","last_became_active":"2024-04-23T10:24:53.499607+0000","last_became_peered":"2024-04-23T10:24:53.499607+0000","last_unstale":"2024-04-23T10:24:54.488154+0000","last_undegraded":"2024-04-23T10:24:54.488154+0000","last_fullsized":"2024-04-23T10:24:54.488154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:10:27.104622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.826995+0000","last_change":"2024-04-23T10:24:53.493739+0000","last_active":"2024-04-23T10:24:54.826995+0000","last_peered":"2024-04-23T10:24:54.826995+0000","last_clean":"2024-04-23T10:24:54.826995+0000","last_became_active":"2024-04-23T10:24:53.492471+0000","last_became_peered":"2024-04-23T10:24:53.492471+0000","last_unstale":"2024-04-23T10:24:54.826995+0000","last_undegraded":"2024-04-23T10:24:54.826995+0000","last_fullsized":"2024-04-23T10:24:54.826995+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:43.267366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.505200+0000","last_change":"2024-04-23T10:24:53.500426+0000","last_active":"2024-04-23T10:24:53.505200+0000","last_peered":"2024-04-23T10:24:53.505200+0000","last_clean":"2024-04-23T10:24:53.505200+0000","last_became_active":"2024-04-23T10:24:53.500052+0000","last_became_peered":"2024-04-23T10:24:53.500052+0000","last_unstale":"2024-04-23T10:24:53.505200+0000","last_undegraded":"2024-04-23T10:24:53.505200+0000","last_fullsized":"2024-04-23T10:24:53.505200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:10:35.746684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.844316+0000","last_change":"2024-04-23T10:24:53.501672+0000","last_active":"2024-04-23T10:24:55.844316+0000","last_peered":"2024-04-23T10:24:55.844316+0000","last_clean":"2024-04-23T10:24:55.844316+0000","last_became_active":"2024-04-23T10:24:53.501345+0000","last_became_peered":"2024-04-23T10:24:53.501345+0000","last_unstale":"2024-04-23T10:24:55.844316+0000","last_undegraded":"2024-04-23T10:24:55.844316+0000","last_fullsized":"2024-04-23T10:24:55.844316+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:31:41.488482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.484930+0000","last_change":"2024-04-23T10:24:53.499442+0000","last_active":"2024-04-23T10:24:54.484930+0000","last_peered":"2024-04-23T10:24:54.484930+0000","last_clean":"2024-04-23T10:24:54.484930+0000","last_became_active":"2024-04-23T10:24:53.499131+0000","last_became_peered":"2024-04-23T10:24:53.499131+0000","last_unstale":"2024-04-23T10:24:54.484930+0000","last_undegraded":"2024-04-23T10:24:54.484930+0000","last_fullsized":"2024-04-23T10:24:54.484930+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:17:21.815851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394862+0000","last_change":"2024-04-23T10:24:53.501235+0000","last_active":"2024-04-23T10:24:55.394862+0000","last_peered":"2024-04-23T10:24:55.394862+0000","last_clean":"2024-04-23T10:24:55.394862+0000","last_became_active":"2024-04-23T10:24:53.500392+0000","last_became_peered":"2024-04-23T10:24:53.500392+0000","last_unstale":"2024-04-23T10:24:55.394862+0000","last_undegraded":"2024-04-23T10:24:55.394862+0000","last_fullsized":"2024-04-23T10:24:55.394862+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:58:20.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.505872+0000","last_change":"2024-04-23T10:24:53.504235+0000","last_active":"2024-04-23T10:24:53.505872+0000","last_peered":"2024-04-23T10:24:53.505872+0000","last_clean":"2024-04-23T10:24:53.505872+0000","last_became_active":"2024-04-23T10:24:53.503743+0000","last_became_peered":"2024-04-23T10:24:53.503743+0000","last_unstale":"2024-04-23T10:24:53.505872+0000","last_undegraded":"2024-04-23T10:24:53.505872+0000","last_fullsized":"2024-04-23T10:24:53.505872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:22:13.196177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845916+0000","last_change":"2024-04-23T10:24:53.497355+0000","last_active":"2024-04-23T10:24:55.845916+0000","last_peered":"2024-04-23T10:24:55.845916+0000","last_clean":"2024-04-23T10:24:55.845916+0000","last_became_active":"2024-04-23T10:24:53.494195+0000","last_became_peered":"2024-04-23T10:24:53.494195+0000","last_unstale":"2024-04-23T10:24:55.845916+0000","last_undegraded":"2024-04-23T10:24:55.845916+0000","last_fullsized":"2024-04-23T10:24:55.845916+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:19:48.638789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.488010+0000","last_change":"2024-04-23T10:24:53.504513+0000","last_active":"2024-04-23T10:24:54.488010+0000","last_peered":"2024-04-23T10:24:54.488010+0000","last_clean":"2024-04-23T10:24:54.488010+0000","last_became_active":"2024-04-23T10:24:53.504058+0000","last_became_peered":"2024-04-23T10:24:53.504058+0000","last_unstale":"2024-04-23T10:24:54.488010+0000","last_undegraded":"2024-04-23T10:24:54.488010+0000","last_fullsized":"2024-04-23T10:24:54.488010+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:16:34.302848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910137+0000","last_change":"2024-04-23T10:24:53.495277+0000","last_active":"2024-04-23T10:24:54.910137+0000","last_peered":"2024-04-23T10:24:54.910137+0000","last_clean":"2024-04-23T10:24:54.910137+0000","last_became_active":"2024-04-23T10:24:53.494925+0000","last_became_peered":"2024-04-23T10:24:53.494925+0000","last_unstale":"2024-04-23T10:24:54.910137+0000","last_undegraded":"2024-04-23T10:24:54.910137+0000","last_fullsized":"2024-04-23T10:24:54.910137+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:33.647408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986592+0000","last_change":"2024-04-23T10:24:53.504082+0000","last_active":"2024-04-23T10:24:54.986592+0000","last_peered":"2024-04-23T10:24:54.986592+0000","last_clean":"2024-04-23T10:24:54.986592+0000","last_became_active":"2024-04-23T10:24:53.503753+0000","last_became_peered":"2024-04-23T10:24:53.503753+0000","last_unstale":"2024-04-23T10:24:54.986592+0000","last_undegraded":"2024-04-23T10:24:54.986592+0000","last_fullsized":"2024-04-23T10:24:54.986592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:59.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986481+0000","last_change":"2024-04-23T10:24:53.499995+0000","last_active":"2024-04-23T10:24:54.986481+0000","last_peered":"2024-04-23T10:24:54.986481+0000","last_clean":"2024-04-23T10:24:54.986481+0000","last_became_active":"2024-04-23T10:24:53.498918+0000","last_became_peered":"2024-04-23T10:24:53.498918+0000","last_unstale":"2024-04-23T10:24:54.986481+0000","last_undegraded":"2024-04-23T10:24:54.986481+0000","last_fullsized":"2024-04-23T10:24:54.986481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:13.432680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394281+0000","last_change":"2024-04-23T10:24:53.498916+0000","last_active":"2024-04-23T10:24:55.394281+0000","last_peered":"2024-04-23T10:24:55.394281+0000","last_clean":"2024-04-23T10:24:55.394281+0000","last_became_active":"2024-04-23T10:24:53.498560+0000","last_became_peered":"2024-04-23T10:24:53.498560+0000","last_unstale":"2024-04-23T10:24:55.394281+0000","last_undegraded":"2024-04-23T10:24:55.394281+0000","last_fullsized":"2024-04-23T10:24:55.394281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:24:07.965091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846949+0000","last_change":"2024-04-23T10:24:53.505167+0000","last_active":"2024-04-23T10:24:55.846949+0000","last_peered":"2024-04-23T10:24:55.846949+0000","last_clean":"2024-04-23T10:24:55.846949+0000","last_became_active":"2024-04-23T10:24:53.504832+0000","last_became_peered":"2024-04-23T10:24:53.504832+0000","last_unstale":"2024-04-23T10:24:55.846949+0000","last_undegraded":"2024-04-23T10:24:55.846949+0000","last_fullsized":"2024-04-23T10:24:55.846949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:58:20.867496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.824980+0000","last_change":"2024-04-23T10:24:53.505363+0000","last_active":"2024-04-23T10:24:54.824980+0000","last_peered":"2024-04-23T10:24:54.824980+0000","last_clean":"2024-04-23T10:24:54.824980+0000","last_became_active":"2024-04-23T10:24:53.505029+0000","last_became_peered":"2024-04-23T10:24:53.505029+0000","last_unstale":"2024-04-23T10:24:54.824980+0000","last_undegraded":"2024-04-23T10:24:54.824980+0000","last_fullsized":"2024-04-23T10:24:54.824980+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:22.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.499591+0000","last_change":"2024-04-23T10:24:53.497666+0000","last_active":"2024-04-23T10:24:53.499591+0000","last_peered":"2024-04-23T10:24:53.499591+0000","last_clean":"2024-04-23T10:24:53.499591+0000","last_became_active":"2024-04-23T10:24:53.495144+0000","last_became_peered":"2024-04-23T10:24:53.495144+0000","last_unstale":"2024-04-23T10:24:53.499591+0000","last_undegraded":"2024-04-23T10:24:53.499591+0000","last_fullsized":"2024-04-23T10:24:53.499591+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:32.948058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.335960+0000","last_change":"2024-04-23T10:24:52.496907+0000","last_active":"2024-04-23T10:24:58.335960+0000","last_peered":"2024-04-23T10:24:58.335960+0000","last_clean":"2024-04-23T10:24:58.335960+0000","last_became_active":"2024-04-23T10:24:52.496567+0000","last_became_peered":"2024-04-23T10:24:52.496567+0000","last_unstale":"2024-04-23T10:24:58.335960+0000","last_undegraded":"2024-04-23T10:24:58.335960+0000","last_fullsized":"2024-04-23T10:24:58.335960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:33.195504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485326+0000","last_change":"2024-04-23T10:24:53.501140+0000","last_active":"2024-04-23T10:24:54.485326+0000","last_peered":"2024-04-23T10:24:54.485326+0000","last_clean":"2024-04-23T10:24:54.485326+0000","last_became_active":"2024-04-23T10:24:53.500826+0000","last_became_peered":"2024-04-23T10:24:53.500826+0000","last_unstale":"2024-04-23T10:24:54.485326+0000","last_undegraded":"2024-04-23T10:24:54.485326+0000","last_fullsized":"2024-04-23T10:24:54.485326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:39.178784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485432+0000","last_change":"2024-04-23T10:24:52.494413+0000","last_active":"2024-04-23T10:24:54.485432+0000","last_peered":"2024-04-23T10:24:54.485432+0000","last_clean":"2024-04-23T10:24:54.485432+0000","last_became_active":"2024-04-23T10:24:52.494092+0000","last_became_peered":"2024-04-23T10:24:52.494092+0000","last_unstale":"2024-04-23T10:24:54.485432+0000","last_undegraded":"2024-04-23T10:24:54.485432+0000","last_fullsized":"2024-04-23T10:24:54.485432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:42:09.407787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986832+0000","last_change":"2024-04-23T10:24:53.495285+0000","last_active":"2024-04-23T10:24:54.986832+0000","last_peered":"2024-04-23T10:24:54.986832+0000","last_clean":"2024-04-23T10:24:54.986832+0000","last_became_active":"2024-04-23T10:24:53.494959+0000","last_became_peered":"2024-04-23T10:24:53.494959+0000","last_unstale":"2024-04-23T10:24:54.986832+0000","last_undegraded":"2024-04-23T10:24:54.986832+0000","last_fullsized":"2024-04-23T10:24:54.986832+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:59.209505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.329168+0000","last_change":"2024-04-23T10:24:52.496310+0000","last_active":"2024-04-23T10:24:56.329168+0000","last_peered":"2024-04-23T10:24:56.329168+0000","last_clean":"2024-04-23T10:24:56.329168+0000","last_became_active":"2024-04-23T10:24:52.496009+0000","last_became_peered":"2024-04-23T10:24:52.496009+0000","last_unstale":"2024-04-23T10:24:56.329168+0000","last_undegraded":"2024-04-23T10:24:56.329168+0000","last_fullsized":"2024-04-23T10:24:56.329168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:05:46.911691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394428+0000","last_change":"2024-04-23T10:24:53.498204+0000","last_active":"2024-04-23T10:24:55.394428+0000","last_peered":"2024-04-23T10:24:55.394428+0000","last_clean":"2024-04-23T10:24:55.394428+0000","last_became_active":"2024-04-23T10:24:53.496535+0000","last_became_peered":"2024-04-23T10:24:53.496535+0000","last_unstale":"2024-04-23T10:24:55.394428+0000","last_undegraded":"2024-04-23T10:24:55.394428+0000","last_fullsized":"2024-04-23T10:24:55.394428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:32.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.827248+0000","last_change":"2024-04-23T10:24:52.493485+0000","last_active":"2024-04-23T10:24:54.827248+0000","last_peered":"2024-04-23T10:24:54.827248+0000","last_clean":"2024-04-23T10:24:54.827248+0000","last_became_active":"2024-04-23T10:24:52.493164+0000","last_became_peered":"2024-04-23T10:24:52.493164+0000","last_unstale":"2024-04-23T10:24:54.827248+0000","last_undegraded":"2024-04-23T10:24:54.827248+0000","last_fullsized":"2024-04-23T10:24:54.827248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:42:33.701248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490839+0000","last_change":"2024-04-23T10:24:53.507145+0000","last_active":"2024-04-23T10:24:54.490839+0000","last_peered":"2024-04-23T10:24:54.490839+0000","last_clean":"2024-04-23T10:24:54.490839+0000","last_became_active":"2024-04-23T10:24:53.506824+0000","last_became_peered":"2024-04-23T10:24:53.506824+0000","last_unstale":"2024-04-23T10:24:54.490839+0000","last_undegraded":"2024-04-23T10:24:54.490839+0000","last_fullsized":"2024-04-23T10:24:54.490839+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:37:54.870303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.316153+0000","last_change":"2024-04-23T10:24:52.498646+0000","last_active":"2024-04-23T10:24:56.316153+0000","last_peered":"2024-04-23T10:24:56.316153+0000","last_clean":"2024-04-23T10:24:56.316153+0000","last_became_active":"2024-04-23T10:24:52.498328+0000","last_became_peered":"2024-04-23T10:24:52.498328+0000","last_unstale":"2024-04-23T10:24:56.316153+0000","last_undegraded":"2024-04-23T10:24:56.316153+0000","last_fullsized":"2024-04-23T10:24:56.316153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:26:33.646144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.827020+0000","last_change":"2024-04-23T10:24:53.493475+0000","last_active":"2024-04-23T10:24:54.827020+0000","last_peered":"2024-04-23T10:24:54.827020+0000","last_clean":"2024-04-23T10:24:54.827020+0000","last_became_active":"2024-04-23T10:24:53.492981+0000","last_became_peered":"2024-04-23T10:24:53.492981+0000","last_unstale":"2024-04-23T10:24:54.827020+0000","last_undegraded":"2024-04-23T10:24:54.827020+0000","last_fullsized":"2024-04-23T10:24:54.827020+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:50:43.227176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.830129+0000","last_change":"2024-04-23T10:24:52.495242+0000","last_active":"2024-04-23T10:24:53.830129+0000","last_peered":"2024-04-23T10:24:53.830129+0000","last_clean":"2024-04-23T10:24:53.830129+0000","last_became_active":"2024-04-23T10:24:52.493255+0000","last_became_peered":"2024-04-23T10:24:52.493255+0000","last_unstale":"2024-04-23T10:24:53.830129+0000","last_undegraded":"2024-04-23T10:24:53.830129+0000","last_fullsized":"2024-04-23T10:24:53.830129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:33.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490783+0000","last_change":"2024-04-23T10:24:53.499843+0000","last_active":"2024-04-23T10:24:54.490783+0000","last_peered":"2024-04-23T10:24:54.490783+0000","last_clean":"2024-04-23T10:24:54.490783+0000","last_became_active":"2024-04-23T10:24:53.499512+0000","last_became_peered":"2024-04-23T10:24:53.499512+0000","last_unstale":"2024-04-23T10:24:54.490783+0000","last_undegraded":"2024-04-23T10:24:54.490783+0000","last_fullsized":"2024-04-23T10:24:54.490783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:20.333479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.327309+0000","last_change":"2024-04-23T10:24:52.495915+0000","last_active":"2024-04-23T10:24:56.327309+0000","last_peered":"2024-04-23T10:24:56.327309+0000","last_clean":"2024-04-23T10:24:56.327309+0000","last_became_active":"2024-04-23T10:24:52.495558+0000","last_became_peered":"2024-04-23T10:24:52.495558+0000","last_unstale":"2024-04-23T10:24:56.327309+0000","last_undegraded":"2024-04-23T10:24:56.327309+0000","last_fullsized":"2024-04-23T10:24:56.327309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:41:09.080880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485005+0000","last_change":"2024-04-23T10:24:53.496376+0000","last_active":"2024-04-23T10:24:54.485005+0000","last_peered":"2024-04-23T10:24:54.485005+0000","last_clean":"2024-04-23T10:24:54.485005+0000","last_became_active":"2024-04-23T10:24:53.496067+0000","last_became_peered":"2024-04-23T10:24:53.496067+0000","last_unstale":"2024-04-23T10:24:54.485005+0000","last_undegraded":"2024-04-23T10:24:54.485005+0000","last_fullsized":"2024-04-23T10:24:54.485005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:02:51.252365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490420+0000","last_change":"2024-04-23T10:24:52.499566+0000","last_active":"2024-04-23T10:24:54.490420+0000","last_peered":"2024-04-23T10:24:54.490420+0000","last_clean":"2024-04-23T10:24:54.490420+0000","last_became_active":"2024-04-23T10:24:52.499277+0000","last_became_peered":"2024-04-23T10:24:52.499277+0000","last_unstale":"2024-04-23T10:24:54.490420+0000","last_undegraded":"2024-04-23T10:24:54.490420+0000","last_fullsized":"2024-04-23T10:24:54.490420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:38.716187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.824825+0000","last_change":"2024-04-23T10:24:53.499617+0000","last_active":"2024-04-23T10:24:54.824825+0000","last_peered":"2024-04-23T10:24:54.824825+0000","last_clean":"2024-04-23T10:24:54.824825+0000","last_became_active":"2024-04-23T10:24:53.499283+0000","last_became_peered":"2024-04-23T10:24:53.499283+0000","last_unstale":"2024-04-23T10:24:54.824825+0000","last_undegraded":"2024-04-23T10:24:54.824825+0000","last_fullsized":"2024-04-23T10:24:54.824825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:36.931697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.493687+0000","last_change":"2024-04-23T10:24:52.492276+0000","last_active":"2024-04-23T10:24:53.493687+0000","last_peered":"2024-04-23T10:24:53.493687+0000","last_clean":"2024-04-23T10:24:53.493687+0000","last_became_active":"2024-04-23T10:24:52.491979+0000","last_became_peered":"2024-04-23T10:24:52.491979+0000","last_unstale":"2024-04-23T10:24:53.493687+0000","last_undegraded":"2024-04-23T10:24:53.493687+0000","last_fullsized":"2024-04-23T10:24:53.493687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:15:40.847446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394751+0000","last_change":"2024-04-23T10:24:53.500964+0000","last_active":"2024-04-23T10:24:55.394751+0000","last_peered":"2024-04-23T10:24:55.394751+0000","last_clean":"2024-04-23T10:24:55.394751+0000","last_became_active":"2024-04-23T10:24:53.499209+0000","last_became_peered":"2024-04-23T10:24:53.499209+0000","last_unstale":"2024-04-23T10:24:55.394751+0000","last_undegraded":"2024-04-23T10:24:55.394751+0000","last_fullsized":"2024-04-23T10:24:55.394751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:27:29.539994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.851816+0000","last_change":"2024-04-23T10:24:52.496016+0000","last_active":"2024-04-23T10:24:55.851816+0000","last_peered":"2024-04-23T10:24:55.851816+0000","last_clean":"2024-04-23T10:24:55.851816+0000","last_became_active":"2024-04-23T10:24:52.495711+0000","last_became_peered":"2024-04-23T10:24:52.495711+0000","last_unstale":"2024-04-23T10:24:55.851816+0000","last_undegraded":"2024-04-23T10:24:55.851816+0000","last_fullsized":"2024-04-23T10:24:55.851816+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:31:30.970731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986806+0000","last_change":"2024-04-23T10:24:53.495076+0000","last_active":"2024-04-23T10:24:54.986806+0000","last_peered":"2024-04-23T10:24:54.986806+0000","last_clean":"2024-04-23T10:24:54.986806+0000","last_became_active":"2024-04-23T10:24:53.494490+0000","last_became_peered":"2024-04-23T10:24:53.494490+0000","last_unstale":"2024-04-23T10:24:54.986806+0000","last_undegraded":"2024-04-23T10:24:54.986806+0000","last_fullsized":"2024-04-23T10:24:54.986806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:59:04.621528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.851921+0000","last_change":"2024-04-23T10:24:52.497200+0000","last_active":"2024-04-23T10:24:55.851921+0000","last_peered":"2024-04-23T10:24:55.851921+0000","last_clean":"2024-04-23T10:24:55.851921+0000","last_became_active":"2024-04-23T10:24:52.496864+0000","last_became_peered":"2024-04-23T10:24:52.496864+0000","last_unstale":"2024-04-23T10:24:55.851921+0000","last_undegraded":"2024-04-23T10:24:55.851921+0000","last_fullsized":"2024-04-23T10:24:55.851921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:16.514060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394504+0000","last_change":"2024-04-23T10:24:53.498438+0000","last_active":"2024-04-23T10:24:55.394504+0000","last_peered":"2024-04-23T10:24:55.394504+0000","last_clean":"2024-04-23T10:24:55.394504+0000","last_became_active":"2024-04-23T10:24:53.496569+0000","last_became_peered":"2024-04-23T10:24:53.496569+0000","last_unstale":"2024-04-23T10:24:55.394504+0000","last_undegraded":"2024-04-23T10:24:55.394504+0000","last_fullsized":"2024-04-23T10:24:55.394504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:06:45.964699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.834522+0000","last_change":"2024-04-23T10:24:52.490058+0000","last_active":"2024-04-23T10:24:53.834522+0000","last_peered":"2024-04-23T10:24:53.834522+0000","last_clean":"2024-04-23T10:24:53.834522+0000","last_became_active":"2024-04-23T10:24:52.489720+0000","last_became_peered":"2024-04-23T10:24:52.489720+0000","last_unstale":"2024-04-23T10:24:53.834522+0000","last_undegraded":"2024-04-23T10:24:53.834522+0000","last_fullsized":"2024-04-23T10:24:53.834522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:41.049778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.827360+0000","last_change":"2024-04-23T10:24:53.507122+0000","last_active":"2024-04-23T10:24:54.827360+0000","last_peered":"2024-04-23T10:24:54.827360+0000","last_clean":"2024-04-23T10:24:54.827360+0000","last_became_active":"2024-04-23T10:24:53.506838+0000","last_became_peered":"2024-04-23T10:24:53.506838+0000","last_unstale":"2024-04-23T10:24:54.827360+0000","last_undegraded":"2024-04-23T10:24:54.827360+0000","last_fullsized":"2024-04-23T10:24:54.827360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:59:51.289630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.830577+0000","last_change":"2024-04-23T10:24:52.499787+0000","last_active":"2024-04-23T10:24:53.830577+0000","last_peered":"2024-04-23T10:24:53.830577+0000","last_clean":"2024-04-23T10:24:53.830577+0000","last_became_active":"2024-04-23T10:24:52.499400+0000","last_became_peered":"2024-04-23T10:24:52.499400+0000","last_unstale":"2024-04-23T10:24:53.830577+0000","last_undegraded":"2024-04-23T10:24:53.830577+0000","last_fullsized":"2024-04-23T10:24:53.830577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:15:17.638984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910042+0000","last_change":"2024-04-23T10:24:53.495773+0000","last_active":"2024-04-23T10:24:54.910042+0000","last_peered":"2024-04-23T10:24:54.910042+0000","last_clean":"2024-04-23T10:24:54.910042+0000","last_became_active":"2024-04-23T10:24:53.495456+0000","last_became_peered":"2024-04-23T10:24:53.495456+0000","last_unstale":"2024-04-23T10:24:54.910042+0000","last_undegraded":"2024-04-23T10:24:54.910042+0000","last_fullsized":"2024-04-23T10:24:54.910042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:12:06.638141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.848348+0000","last_change":"2024-04-23T10:24:52.498660+0000","last_active":"2024-04-23T10:24:55.848348+0000","last_peered":"2024-04-23T10:24:55.848348+0000","last_clean":"2024-04-23T10:24:55.848348+0000","last_became_active":"2024-04-23T10:24:52.498302+0000","last_became_peered":"2024-04-23T10:24:52.498302+0000","last_unstale":"2024-04-23T10:24:55.848348+0000","last_undegraded":"2024-04-23T10:24:55.848348+0000","last_fullsized":"2024-04-23T10:24:55.848348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:49:23.826748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845326+0000","last_change":"2024-04-23T10:24:53.501718+0000","last_active":"2024-04-23T10:24:55.845326+0000","last_peered":"2024-04-23T10:24:55.845326+0000","last_clean":"2024-04-23T10:24:55.845326+0000","last_became_active":"2024-04-23T10:24:53.501359+0000","last_became_peered":"2024-04-23T10:24:53.501359+0000","last_unstale":"2024-04-23T10:24:55.845326+0000","last_undegraded":"2024-04-23T10:24:55.845326+0000","last_fullsized":"2024-04-23T10:24:55.845326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:51:42.474899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.329340+0000","last_change":"2024-04-23T10:24:52.493910+0000","last_active":"2024-04-23T10:24:57.329340+0000","last_peered":"2024-04-23T10:24:57.329340+0000","last_clean":"2024-04-23T10:24:57.329340+0000","last_became_active":"2024-04-23T10:24:52.493536+0000","last_became_peered":"2024-04-23T10:24:52.493536+0000","last_unstale":"2024-04-23T10:24:57.329340+0000","last_undegraded":"2024-04-23T10:24:57.329340+0000","last_fullsized":"2024-04-23T10:24:57.329340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:23.806993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.844623+0000","last_change":"2024-04-23T10:24:53.498221+0000","last_active":"2024-04-23T10:24:55.844623+0000","last_peered":"2024-04-23T10:24:55.844623+0000","last_clean":"2024-04-23T10:24:55.844623+0000","last_became_active":"2024-04-23T10:24:53.497887+0000","last_became_peered":"2024-04-23T10:24:53.497887+0000","last_unstale":"2024-04-23T10:24:55.844623+0000","last_undegraded":"2024-04-23T10:24:55.844623+0000","last_fullsized":"2024-04-23T10:24:55.844623+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:49:02.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.329553+0000","last_change":"2024-04-23T10:24:52.498883+0000","last_active":"2024-04-23T10:24:56.329553+0000","last_peered":"2024-04-23T10:24:56.329553+0000","last_clean":"2024-04-23T10:24:56.329553+0000","last_became_active":"2024-04-23T10:24:52.498562+0000","last_became_peered":"2024-04-23T10:24:52.498562+0000","last_unstale":"2024-04-23T10:24:56.329553+0000","last_undegraded":"2024-04-23T10:24:56.329553+0000","last_fullsized":"2024-04-23T10:24:56.329553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:33.914481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490702+0000","last_change":"2024-04-23T10:24:53.506303+0000","last_active":"2024-04-23T10:24:54.490702+0000","last_peered":"2024-04-23T10:24:54.490702+0000","last_clean":"2024-04-23T10:24:54.490702+0000","last_became_active":"2024-04-23T10:24:53.505850+0000","last_became_peered":"2024-04-23T10:24:53.505850+0000","last_unstale":"2024-04-23T10:24:54.490702+0000","last_undegraded":"2024-04-23T10:24:54.490702+0000","last_fullsized":"2024-04-23T10:24:54.490702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:18.498188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.827298+0000","last_change":"2024-04-23T10:24:52.493853+0000","last_active":"2024-04-23T10:24:54.827298+0000","last_peered":"2024-04-23T10:24:54.827298+0000","last_clean":"2024-04-23T10:24:54.827298+0000","last_became_active":"2024-04-23T10:24:52.492932+0000","last_became_peered":"2024-04-23T10:24:52.492932+0000","last_unstale":"2024-04-23T10:24:54.827298+0000","last_undegraded":"2024-04-23T10:24:54.827298+0000","last_fullsized":"2024-04-23T10:24:54.827298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:12:33.327611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845949+0000","last_change":"2024-04-23T10:24:53.501437+0000","last_active":"2024-04-23T10:24:55.845949+0000","last_peered":"2024-04-23T10:24:55.845949+0000","last_clean":"2024-04-23T10:24:55.845949+0000","last_became_active":"2024-04-23T10:24:53.501101+0000","last_became_peered":"2024-04-23T10:24:53.501101+0000","last_unstale":"2024-04-23T10:24:55.845949+0000","last_undegraded":"2024-04-23T10:24:55.845949+0000","last_fullsized":"2024-04-23T10:24:55.845949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:27:05.710567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.825013+0000","last_change":"2024-04-23T10:24:52.494032+0000","last_active":"2024-04-23T10:24:54.825013+0000","last_peered":"2024-04-23T10:24:54.825013+0000","last_clean":"2024-04-23T10:24:54.825013+0000","last_became_active":"2024-04-23T10:24:52.493699+0000","last_became_peered":"2024-04-23T10:24:52.493699+0000","last_unstale":"2024-04-23T10:24:54.825013+0000","last_undegraded":"2024-04-23T10:24:54.825013+0000","last_fullsized":"2024-04-23T10:24:54.825013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:54.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.495996+0000","last_change":"2024-04-23T10:24:53.494846+0000","last_active":"2024-04-23T10:24:53.495996+0000","last_peered":"2024-04-23T10:24:53.495996+0000","last_clean":"2024-04-23T10:24:53.495996+0000","last_became_active":"2024-04-23T10:24:53.494541+0000","last_became_peered":"2024-04-23T10:24:53.494541+0000","last_unstale":"2024-04-23T10:24:53.495996+0000","last_undegraded":"2024-04-23T10:24:53.495996+0000","last_fullsized":"2024-04-23T10:24:53.495996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:42:25.770518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.844453+0000","last_change":"2024-04-23T10:24:52.499078+0000","last_active":"2024-04-23T10:24:55.844453+0000","last_peered":"2024-04-23T10:24:55.844453+0000","last_clean":"2024-04-23T10:24:55.844453+0000","last_became_active":"2024-04-23T10:24:52.498764+0000","last_became_peered":"2024-04-23T10:24:52.498764+0000","last_unstale":"2024-04-23T10:24:55.844453+0000","last_undegraded":"2024-04-23T10:24:55.844453+0000","last_fullsized":"2024-04-23T10:24:55.844453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:10:51.634437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.495413+0000","last_change":"2024-04-23T10:24:53.492923+0000","last_active":"2024-04-23T10:24:53.495413+0000","last_peered":"2024-04-23T10:24:53.495413+0000","last_clean":"2024-04-23T10:24:53.495413+0000","last_became_active":"2024-04-23T10:24:53.492601+0000","last_became_peered":"2024-04-23T10:24:53.492601+0000","last_unstale":"2024-04-23T10:24:53.495413+0000","last_undegraded":"2024-04-23T10:24:53.495413+0000","last_fullsized":"2024-04-23T10:24:53.495413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:37:35.916572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490699+0000","last_change":"2024-04-23T10:24:53.504787+0000","last_active":"2024-04-23T10:24:54.490699+0000","last_peered":"2024-04-23T10:24:54.490699+0000","last_clean":"2024-04-23T10:24:54.490699+0000","last_became_active":"2024-04-23T10:24:53.504423+0000","last_became_peered":"2024-04-23T10:24:53.504423+0000","last_unstale":"2024-04-23T10:24:54.490699+0000","last_undegraded":"2024-04-23T10:24:54.490699+0000","last_fullsized":"2024-04-23T10:24:54.490699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:00.171449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.327931+0000","last_change":"2024-04-23T10:24:52.493600+0000","last_active":"2024-04-23T10:24:56.327931+0000","last_peered":"2024-04-23T10:24:56.327931+0000","last_clean":"2024-04-23T10:24:56.327931+0000","last_became_active":"2024-04-23T10:24:52.493310+0000","last_became_peered":"2024-04-23T10:24:52.493310+0000","last_unstale":"2024-04-23T10:24:56.327931+0000","last_undegraded":"2024-04-23T10:24:56.327931+0000","last_fullsized":"2024-04-23T10:24:56.327931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:07.144860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485437+0000","last_change":"2024-04-23T10:24:53.506311+0000","last_active":"2024-04-23T10:24:54.485437+0000","last_peered":"2024-04-23T10:24:54.485437+0000","last_clean":"2024-04-23T10:24:54.485437+0000","last_became_active":"2024-04-23T10:24:53.503910+0000","last_became_peered":"2024-04-23T10:24:53.503910+0000","last_unstale":"2024-04-23T10:24:54.485437+0000","last_undegraded":"2024-04-23T10:24:54.485437+0000","last_fullsized":"2024-04-23T10:24:54.485437+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:01:32.620891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'5","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.329108+0000","last_change":"2024-04-23T10:24:52.485060+0000","last_active":"2024-04-23T10:24:57.329108+0000","last_peered":"2024-04-23T10:24:57.329108+0000","last_clean":"2024-04-23T10:24:57.329108+0000","last_became_active":"2024-04-23T10:24:52.484636+0000","last_became_peered":"2024-04-23T10:24:52.484636+0000","last_unstale":"2024-04-23T10:24:57.329108+0000","last_undegraded":"2024-04-23T10:24:57.329108+0000","last_fullsized":"2024-04-23T10:24:57.329108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:26:01.737147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.843810+0000","last_change":"2024-04-23T10:23:43.804102+0000","last_active":"2024-04-23T10:24:55.843810+0000","last_peered":"2024-04-23T10:24:55.843810+0000","last_clean":"2024-04-23T10:24:55.843810+0000","last_became_active":"2024-04-23T10:23:43.803657+0000","last_became_peered":"2024-04-23T10:23:43.803657+0000","last_unstale":"2024-04-23T10:24:55.843810+0000","last_undegraded":"2024-04-23T10:24:55.843810+0000","last_fullsized":"2024-04-23T10:24:55.843810+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_clean_scrub_stamp":"2024-04-23T10:20:19.875078+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:50.160735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.909843+0000","last_change":"2024-04-23T10:24:53.499334+0000","last_active":"2024-04-23T10:24:54.909843+0000","last_peered":"2024-04-23T10:24:54.909843+0000","last_clean":"2024-04-23T10:24:54.909843+0000","last_became_active":"2024-04-23T10:24:53.499008+0000","last_became_peered":"2024-04-23T10:24:53.499008+0000","last_unstale":"2024-04-23T10:24:54.909843+0000","last_undegraded":"2024-04-23T10:24:54.909843+0000","last_fullsized":"2024-04-23T10:24:54.909843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:13.504789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.326835+0000","last_change":"2024-04-23T10:24:52.493601+0000","last_active":"2024-04-23T10:24:56.326835+0000","last_peered":"2024-04-23T10:24:56.326835+0000","last_clean":"2024-04-23T10:24:56.326835+0000","last_became_active":"2024-04-23T10:24:52.493278+0000","last_became_peered":"2024-04-23T10:24:52.493278+0000","last_unstale":"2024-04-23T10:24:56.326835+0000","last_undegraded":"2024-04-23T10:24:56.326835+0000","last_fullsized":"2024-04-23T10:24:56.326835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:36:21.375233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845033+0000","last_change":"2024-04-23T10:24:52.495637+0000","last_active":"2024-04-23T10:24:55.845033+0000","last_peered":"2024-04-23T10:24:55.845033+0000","last_clean":"2024-04-23T10:24:55.845033+0000","last_became_active":"2024-04-23T10:24:52.495329+0000","last_became_peered":"2024-04-23T10:24:52.495329+0000","last_unstale":"2024-04-23T10:24:55.845033+0000","last_undegraded":"2024-04-23T10:24:55.845033+0000","last_fullsized":"2024-04-23T10:24:55.845033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:14.187803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910131+0000","last_change":"2024-04-23T10:24:53.500353+0000","last_active":"2024-04-23T10:24:54.910131+0000","last_peered":"2024-04-23T10:24:54.910131+0000","last_clean":"2024-04-23T10:24:54.910131+0000","last_became_active":"2024-04-23T10:24:53.499995+0000","last_became_peered":"2024-04-23T10:24:53.499995+0000","last_unstale":"2024-04-23T10:24:54.910131+0000","last_undegraded":"2024-04-23T10:24:54.910131+0000","last_fullsized":"2024-04-23T10:24:54.910131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:55:52.695375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.331187+0000","last_change":"2024-04-23T10:24:52.495960+0000","last_active":"2024-04-23T10:24:57.331187+0000","last_peered":"2024-04-23T10:24:57.331187+0000","last_clean":"2024-04-23T10:24:57.331187+0000","last_became_active":"2024-04-23T10:24:52.495655+0000","last_became_peered":"2024-04-23T10:24:52.495655+0000","last_unstale":"2024-04-23T10:24:57.331187+0000","last_undegraded":"2024-04-23T10:24:57.331187+0000","last_fullsized":"2024-04-23T10:24:57.331187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:41.507393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485230+0000","last_change":"2024-04-23T10:24:53.498140+0000","last_active":"2024-04-23T10:24:54.485230+0000","last_peered":"2024-04-23T10:24:54.485230+0000","last_clean":"2024-04-23T10:24:54.485230+0000","last_became_active":"2024-04-23T10:24:53.496683+0000","last_became_peered":"2024-04-23T10:24:53.496683+0000","last_unstale":"2024-04-23T10:24:54.485230+0000","last_undegraded":"2024-04-23T10:24:54.485230+0000","last_fullsized":"2024-04-23T10:24:54.485230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:49:18.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845747+0000","last_change":"2024-04-23T10:24:52.486505+0000","last_active":"2024-04-23T10:24:55.845747+0000","last_peered":"2024-04-23T10:24:55.845747+0000","last_clean":"2024-04-23T10:24:55.845747+0000","last_became_active":"2024-04-23T10:24:52.486185+0000","last_became_peered":"2024-04-23T10:24:52.486185+0000","last_unstale":"2024-04-23T10:24:55.845747+0000","last_undegraded":"2024-04-23T10:24:55.845747+0000","last_fullsized":"2024-04-23T10:24:55.845747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:46:27.052935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986849+0000","last_change":"2024-04-23T10:24:53.496234+0000","last_active":"2024-04-23T10:24:54.986849+0000","last_peered":"2024-04-23T10:24:54.986849+0000","last_clean":"2024-04-23T10:24:54.986849+0000","last_became_active":"2024-04-23T10:24:53.495892+0000","last_became_peered":"2024-04-23T10:24:53.495892+0000","last_unstale":"2024-04-23T10:24:54.986849+0000","last_undegraded":"2024-04-23T10:24:54.986849+0000","last_fullsized":"2024-04-23T10:24:54.986849+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:11.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.847689+0000","last_change":"2024-04-23T10:24:52.497346+0000","last_active":"2024-04-23T10:24:55.847689+0000","last_peered":"2024-04-23T10:24:55.847689+0000","last_clean":"2024-04-23T10:24:55.847689+0000","last_became_active":"2024-04-23T10:24:52.497033+0000","last_became_peered":"2024-04-23T10:24:52.497033+0000","last_unstale":"2024-04-23T10:24:55.847689+0000","last_undegraded":"2024-04-23T10:24:55.847689+0000","last_fullsized":"2024-04-23T10:24:55.847689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:23.034241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.826927+0000","last_change":"2024-04-23T10:24:53.497985+0000","last_active":"2024-04-23T10:24:54.826927+0000","last_peered":"2024-04-23T10:24:54.826927+0000","last_clean":"2024-04-23T10:24:54.826927+0000","last_became_active":"2024-04-23T10:24:53.497661+0000","last_became_peered":"2024-04-23T10:24:53.497661+0000","last_unstale":"2024-04-23T10:24:54.826927+0000","last_undegraded":"2024-04-23T10:24:54.826927+0000","last_fullsized":"2024-04-23T10:24:54.826927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:48.923714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.329626+0000","last_change":"2024-04-23T10:24:52.490572+0000","last_active":"2024-04-23T10:24:57.329626+0000","last_peered":"2024-04-23T10:24:57.329626+0000","last_clean":"2024-04-23T10:24:57.329626+0000","last_became_active":"2024-04-23T10:24:52.490274+0000","last_became_peered":"2024-04-23T10:24:52.490274+0000","last_unstale":"2024-04-23T10:24:57.329626+0000","last_undegraded":"2024-04-23T10:24:57.329626+0000","last_fullsized":"2024-04-23T10:24:57.329626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:22.447399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845765+0000","last_change":"2024-04-23T10:24:53.509189+0000","last_active":"2024-04-23T10:24:55.845765+0000","last_peered":"2024-04-23T10:24:55.845765+0000","last_clean":"2024-04-23T10:24:55.845765+0000","last_became_active":"2024-04-23T10:24:53.508850+0000","last_became_peered":"2024-04-23T10:24:53.508850+0000","last_unstale":"2024-04-23T10:24:55.845765+0000","last_undegraded":"2024-04-23T10:24:55.845765+0000","last_fullsized":"2024-04-23T10:24:55.845765+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:23.242999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.485195+0000","last_change":"2024-04-23T10:24:52.497616+0000","last_active":"2024-04-23T10:24:53.485195+0000","last_peered":"2024-04-23T10:24:53.485195+0000","last_clean":"2024-04-23T10:24:53.485195+0000","last_became_active":"2024-04-23T10:24:52.497028+0000","last_became_peered":"2024-04-23T10:24:52.497028+0000","last_unstale":"2024-04-23T10:24:53.485195+0000","last_undegraded":"2024-04-23T10:24:53.485195+0000","last_fullsized":"2024-04-23T10:24:53.485195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:51:26.836718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485489+0000","last_change":"2024-04-23T10:24:53.498086+0000","last_active":"2024-04-23T10:24:54.485489+0000","last_peered":"2024-04-23T10:24:54.485489+0000","last_clean":"2024-04-23T10:24:54.485489+0000","last_became_active":"2024-04-23T10:24:53.497734+0000","last_became_peered":"2024-04-23T10:24:53.497734+0000","last_unstale":"2024-04-23T10:24:54.485489+0000","last_undegraded":"2024-04-23T10:24:54.485489+0000","last_fullsized":"2024-04-23T10:24:54.485489+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:57.602301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.847770+0000","last_change":"2024-04-23T10:24:52.496609+0000","last_active":"2024-04-23T10:24:55.847770+0000","last_peered":"2024-04-23T10:24:55.847770+0000","last_clean":"2024-04-23T10:24:55.847770+0000","last_became_active":"2024-04-23T10:24:52.495981+0000","last_became_peered":"2024-04-23T10:24:52.495981+0000","last_unstale":"2024-04-23T10:24:55.847770+0000","last_undegraded":"2024-04-23T10:24:55.847770+0000","last_fullsized":"2024-04-23T10:24:55.847770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:28.111644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.844636+0000","last_change":"2024-04-23T10:24:53.503840+0000","last_active":"2024-04-23T10:24:55.844636+0000","last_peered":"2024-04-23T10:24:55.844636+0000","last_clean":"2024-04-23T10:24:55.844636+0000","last_became_active":"2024-04-23T10:24:53.503448+0000","last_became_peered":"2024-04-23T10:24:53.503448+0000","last_unstale":"2024-04-23T10:24:55.844636+0000","last_undegraded":"2024-04-23T10:24:55.844636+0000","last_fullsized":"2024-04-23T10:24:55.844636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:03.295985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.485429+0000","last_change":"2024-04-23T10:24:52.501792+0000","last_active":"2024-04-23T10:24:53.485429+0000","last_peered":"2024-04-23T10:24:53.485429+0000","last_clean":"2024-04-23T10:24:53.485429+0000","last_became_active":"2024-04-23T10:24:52.501404+0000","last_became_peered":"2024-04-23T10:24:52.501404+0000","last_unstale":"2024-04-23T10:24:53.485429+0000","last_undegraded":"2024-04-23T10:24:53.485429+0000","last_fullsized":"2024-04-23T10:24:53.485429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:03.529410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846194+0000","last_change":"2024-04-23T10:24:53.501649+0000","last_active":"2024-04-23T10:24:55.846194+0000","last_peered":"2024-04-23T10:24:55.846194+0000","last_clean":"2024-04-23T10:24:55.846194+0000","last_became_active":"2024-04-23T10:24:53.501307+0000","last_became_peered":"2024-04-23T10:24:53.501307+0000","last_unstale":"2024-04-23T10:24:55.846194+0000","last_undegraded":"2024-04-23T10:24:55.846194+0000","last_fullsized":"2024-04-23T10:24:55.846194+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:37.863832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490655+0000","last_change":"2024-04-23T10:24:52.495737+0000","last_active":"2024-04-23T10:24:54.490655+0000","last_peered":"2024-04-23T10:24:54.490655+0000","last_clean":"2024-04-23T10:24:54.490655+0000","last_became_active":"2024-04-23T10:24:52.495395+0000","last_became_peered":"2024-04-23T10:24:52.495395+0000","last_unstale":"2024-04-23T10:24:54.490655+0000","last_undegraded":"2024-04-23T10:24:54.490655+0000","last_fullsized":"2024-04-23T10:24:54.490655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:14:45.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845026+0000","last_change":"2024-04-23T10:24:53.496178+0000","last_active":"2024-04-23T10:24:55.845026+0000","last_peered":"2024-04-23T10:24:55.845026+0000","last_clean":"2024-04-23T10:24:55.845026+0000","last_became_active":"2024-04-23T10:24:53.495711+0000","last_became_peered":"2024-04-23T10:24:53.495711+0000","last_unstale":"2024-04-23T10:24:55.845026+0000","last_undegraded":"2024-04-23T10:24:55.845026+0000","last_fullsized":"2024-04-23T10:24:55.845026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:31:56.991821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910077+0000","last_change":"2024-04-23T10:24:52.494322+0000","last_active":"2024-04-23T10:24:54.910077+0000","last_peered":"2024-04-23T10:24:54.910077+0000","last_clean":"2024-04-23T10:24:54.910077+0000","last_became_active":"2024-04-23T10:24:52.494019+0000","last_became_peered":"2024-04-23T10:24:52.494019+0000","last_unstale":"2024-04-23T10:24:54.910077+0000","last_undegraded":"2024-04-23T10:24:54.910077+0000","last_fullsized":"2024-04-23T10:24:54.910077+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:16.099197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845959+0000","last_change":"2024-04-23T10:24:53.507160+0000","last_active":"2024-04-23T10:24:55.845959+0000","last_peered":"2024-04-23T10:24:55.845959+0000","last_clean":"2024-04-23T10:24:55.845959+0000","last_became_active":"2024-04-23T10:24:53.506815+0000","last_became_peered":"2024-04-23T10:24:53.506815+0000","last_unstale":"2024-04-23T10:24:55.845959+0000","last_undegraded":"2024-04-23T10:24:55.845959+0000","last_fullsized":"2024-04-23T10:24:55.845959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:24.657153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846002+0000","last_change":"2024-04-23T10:24:53.510511+0000","last_active":"2024-04-23T10:24:55.846002+0000","last_peered":"2024-04-23T10:24:55.846002+0000","last_clean":"2024-04-23T10:24:55.846002+0000","last_became_active":"2024-04-23T10:24:53.510174+0000","last_became_peered":"2024-04-23T10:24:53.510174+0000","last_unstale":"2024-04-23T10:24:55.846002+0000","last_undegraded":"2024-04-23T10:24:55.846002+0000","last_fullsized":"2024-04-23T10:24:55.846002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:35.048697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.498260+0000","last_change":"2024-04-23T10:24:53.497365+0000","last_active":"2024-04-23T10:24:53.498260+0000","last_peered":"2024-04-23T10:24:53.498260+0000","last_clean":"2024-04-23T10:24:53.498260+0000","last_became_active":"2024-04-23T10:24:53.496427+0000","last_became_peered":"2024-04-23T10:24:53.496427+0000","last_unstale":"2024-04-23T10:24:53.498260+0000","last_undegraded":"2024-04-23T10:24:53.498260+0000","last_fullsized":"2024-04-23T10:24:53.498260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:20:20.735322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.498101+0000","last_change":"2024-04-23T10:24:53.495913+0000","last_active":"2024-04-23T10:24:53.498101+0000","last_peered":"2024-04-23T10:24:53.498101+0000","last_clean":"2024-04-23T10:24:53.498101+0000","last_became_active":"2024-04-23T10:24:53.495543+0000","last_became_peered":"2024-04-23T10:24:53.495543+0000","last_unstale":"2024-04-23T10:24:53.498101+0000","last_undegraded":"2024-04-23T10:24:53.498101+0000","last_fullsized":"2024-04-23T10:24:53.498101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:06.879439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986801+0000","last_change":"2024-04-23T10:24:53.492305+0000","last_active":"2024-04-23T10:24:54.986801+0000","last_peered":"2024-04-23T10:24:54.986801+0000","last_clean":"2024-04-23T10:24:54.986801+0000","last_became_active":"2024-04-23T10:24:53.491980+0000","last_became_peered":"2024-04-23T10:24:53.491980+0000","last_unstale":"2024-04-23T10:24:54.986801+0000","last_undegraded":"2024-04-23T10:24:54.986801+0000","last_fullsized":"2024-04-23T10:24:54.986801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:34.987447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910148+0000","last_change":"2024-04-23T10:24:53.492464+0000","last_active":"2024-04-23T10:24:54.910148+0000","last_peered":"2024-04-23T10:24:54.910148+0000","last_clean":"2024-04-23T10:24:54.910148+0000","last_became_active":"2024-04-23T10:24:53.492156+0000","last_became_peered":"2024-04-23T10:24:53.492156+0000","last_unstale":"2024-04-23T10:24:54.910148+0000","last_undegraded":"2024-04-23T10:24:54.910148+0000","last_fullsized":"2024-04-23T10:24:54.910148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:07:15.414598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846391+0000","last_change":"2024-04-23T10:24:53.502208+0000","last_active":"2024-04-23T10:24:55.846391+0000","last_peered":"2024-04-23T10:24:55.846391+0000","last_clean":"2024-04-23T10:24:55.846391+0000","last_became_active":"2024-04-23T10:24:53.501921+0000","last_became_peered":"2024-04-23T10:24:53.501921+0000","last_unstale":"2024-04-23T10:24:55.846391+0000","last_undegraded":"2024-04-23T10:24:55.846391+0000","last_fullsized":"2024-04-23T10:24:55.846391+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:29:21.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.498059+0000","last_change":"2024-04-23T10:24:53.495446+0000","last_active":"2024-04-23T10:24:53.498059+0000","last_peered":"2024-04-23T10:24:53.498059+0000","last_clean":"2024-04-23T10:24:53.498059+0000","last_became_active":"2024-04-23T10:24:53.495090+0000","last_became_peered":"2024-04-23T10:24:53.495090+0000","last_unstale":"2024-04-23T10:24:53.498059+0000","last_undegraded":"2024-04-23T10:24:53.498059+0000","last_fullsized":"2024-04-23T10:24:53.498059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:14:18.912526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485361+0000","last_change":"2024-04-23T10:24:53.503390+0000","last_active":"2024-04-23T10:24:54.485361+0000","last_peered":"2024-04-23T10:24:54.485361+0000","last_clean":"2024-04-23T10:24:54.485361+0000","last_became_active":"2024-04-23T10:24:53.503057+0000","last_became_peered":"2024-04-23T10:24:53.503057+0000","last_unstale":"2024-04-23T10:24:54.485361+0000","last_undegraded":"2024-04-23T10:24:54.485361+0000","last_fullsized":"2024-04-23T10:24:54.485361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:19:39.950651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490869+0000","last_change":"2024-04-23T10:24:53.498188+0000","last_active":"2024-04-23T10:24:54.490869+0000","last_peered":"2024-04-23T10:24:54.490869+0000","last_clean":"2024-04-23T10:24:54.490869+0000","last_became_active":"2024-04-23T10:24:53.497873+0000","last_became_peered":"2024-04-23T10:24:53.497873+0000","last_unstale":"2024-04-23T10:24:54.490869+0000","last_undegraded":"2024-04-23T10:24:54.490869+0000","last_fullsized":"2024-04-23T10:24:54.490869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:48:05.001361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.484961+0000","last_change":"2024-04-23T10:24:53.502260+0000","last_active":"2024-04-23T10:24:54.484961+0000","last_peered":"2024-04-23T10:24:54.484961+0000","last_clean":"2024-04-23T10:24:54.484961+0000","last_became_active":"2024-04-23T10:24:53.501525+0000","last_became_peered":"2024-04-23T10:24:53.501525+0000","last_unstale":"2024-04-23T10:24:54.484961+0000","last_undegraded":"2024-04-23T10:24:54.484961+0000","last_fullsized":"2024-04-23T10:24:54.484961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:04.379055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394507+0000","last_change":"2024-04-23T10:24:53.499306+0000","last_active":"2024-04-23T10:24:55.394507+0000","last_peered":"2024-04-23T10:24:55.394507+0000","last_clean":"2024-04-23T10:24:55.394507+0000","last_became_active":"2024-04-23T10:24:53.496717+0000","last_became_peered":"2024-04-23T10:24:53.496717+0000","last_unstale":"2024-04-23T10:24:55.394507+0000","last_undegraded":"2024-04-23T10:24:55.394507+0000","last_fullsized":"2024-04-23T10:24:55.394507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:03:17.907117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910191+0000","last_change":"2024-04-23T10:24:53.496330+0000","last_active":"2024-04-23T10:24:54.910191+0000","last_peered":"2024-04-23T10:24:54.910191+0000","last_clean":"2024-04-23T10:24:54.910191+0000","last_became_active":"2024-04-23T10:24:53.496021+0000","last_became_peered":"2024-04-23T10:24:53.496021+0000","last_unstale":"2024-04-23T10:24:54.910191+0000","last_undegraded":"2024-04-23T10:24:54.910191+0000","last_fullsized":"2024-04-23T10:24:54.910191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:10:59.340265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846343+0000","last_change":"2024-04-23T10:24:53.501025+0000","last_active":"2024-04-23T10:24:55.846343+0000","last_peered":"2024-04-23T10:24:55.846343+0000","last_clean":"2024-04-23T10:24:55.846343+0000","last_became_active":"2024-04-23T10:24:53.500673+0000","last_became_peered":"2024-04-23T10:24:53.500673+0000","last_unstale":"2024-04-23T10:24:55.846343+0000","last_undegraded":"2024-04-23T10:24:55.846343+0000","last_fullsized":"2024-04-23T10:24:55.846343+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:07.728645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246478,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4662,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":123,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":12834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350989,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":433581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612625,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1025755,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776152,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":443059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037789,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":933888,"data_stored":442777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299426,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":1034311,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462951,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":442151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":435193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":443629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":435227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149749,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":442559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":442795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724588,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":999424,"data_stored":1033995,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34039,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34039,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:25:00.713 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:25:00.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:00 smithi167 ceph-mon[32940]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:25:00.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:00 smithi167 ceph-mon[32940]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-23T10:25:00.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:00 smithi167 ceph-mon[32940]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:25:00.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:00 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3452164359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:25:00.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:00 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1593269122' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:25:00.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.850+0000 7f210718e640 1 -- 172.21.15.69:0/2732630185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2100102a70 msgr2=0x7f2100104e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.850+0000 7f210718e640 1 --2- 172.21.15.69:0/2732630185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2100102a70 0x7f2100104e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009900 tx=0x7f20f402a410 comp rx=0 tx=0).stop 2024-04-23T10:25:00.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.850+0000 7f210718e640 1 -- 172.21.15.69:0/2732630185 shutdown_connections 2024-04-23T10:25:00.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.850+0000 7f210718e640 1 --2- 172.21.15.69:0/2732630185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2100107cd0 0x7f210010a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.850+0000 7f210718e640 1 --2- 172.21.15.69:0/2732630185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21001053a0 0x7f2100107790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.850+0000 7f210718e640 1 --2- 172.21.15.69:0/2732630185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2100102a70 0x7f2100104e60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.850+0000 7f210718e640 1 -- 172.21.15.69:0/2732630185 >> 172.21.15.69:0/2732630185 conn(0x7f21000fc400 msgr2=0x7f21000fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:00.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.850+0000 7f210718e640 1 -- 172.21.15.69:0/2732630185 shutdown_connections 2024-04-23T10:25:00.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.850+0000 7f210718e640 1 -- 172.21.15.69:0/2732630185 wait complete. 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f210718e640 1 Processor -- start 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f210718e640 1 -- start start 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f210718e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2100102a70 0x7f21001982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f210718e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21001053a0 0x7f2100198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f210718e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2100107cd0 0x7f210019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f210718e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f210010dc10 con 0x7f21001053a0 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f210718e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f210010da90 con 0x7f2100102a70 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f210718e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f210010dd90 con 0x7f2100107cd0 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f20fffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21001053a0 0x7f2100198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f20fffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21001053a0 0x7f2100198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42328/0 (socket says 172.21.15.69:42328) 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f20fffff640 1 -- 172.21.15.69:0/616570698 learned_addr learned my addr 172.21.15.69:0/616570698 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f2104f2a640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2100102a70 0x7f21001982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f210572b640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2100107cd0 0x7f210019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f20fffff640 1 -- 172.21.15.69:0/616570698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2100107cd0 msgr2=0x7f210019f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f20fffff640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2100107cd0 0x7f210019f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f20fffff640 1 -- 172.21.15.69:0/616570698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2100102a70 msgr2=0x7f21001982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f20fffff640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2100102a70 0x7f21001982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.851+0000 7f20fffff640 1 -- 172.21.15.69:0/616570698 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210019ff00 con 0x7f21001053a0 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.852+0000 7f20fffff640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21001053a0 0x7f2100198820 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00d740 tx=0x7f20ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.852+0000 7f20fdffb640 1 -- 172.21.15.69:0/616570698 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec017070 con 0x7f21001053a0 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.852+0000 7f20fdffb640 1 -- 172.21.15.69:0/616570698 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f20ec00de50 con 0x7f21001053a0 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.852+0000 7f20fdffb640 1 -- 172.21.15.69:0/616570698 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec004d90 con 0x7f21001053a0 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.852+0000 7f210718e640 1 -- 172.21.15.69:0/616570698 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21001a01f0 con 0x7f21001053a0 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.852+0000 7f210718e640 1 -- 172.21.15.69:0/616570698 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21001a0740 con 0x7f21001053a0 2024-04-23T10:25:00.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.853+0000 7f210718e640 1 -- 172.21.15.69:0/616570698 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21000fdef0 con 0x7f21001053a0 2024-04-23T10:25:00.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.854+0000 7f20fdffb640 1 -- 172.21.15.69:0/616570698 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f20ec004f30 con 0x7f21001053a0 2024-04-23T10:25:00.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.854+0000 7f20fdffb640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f20f00a3cc0 0x7f20f00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:00.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.855+0000 7f2104f2a640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f20f00a3cc0 0x7f20f00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:00.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.855+0000 7f20fdffb640 1 -- 172.21.15.69:0/616570698 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f20ec0cfde0 con 0x7f21001053a0 2024-04-23T10:25:00.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.855+0000 7f2104f2a640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f20f00a3cc0 0x7f20f00a6180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20f4000c00 tx=0x7f20f4031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:00.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:00.859+0000 7f20fdffb640 1 -- 172.21.15.69:0/616570698 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f20ec09c810 con 0x7f21001053a0 2024-04-23T10:25:00.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:00 smithi146 ceph-mon[32800]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:25:00.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:00 smithi146 ceph-mon[32800]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-23T10:25:00.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:00 smithi146 ceph-mon[32800]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:25:00.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:00 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3452164359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:25:00.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:00 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1593269122' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:25:01.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.038+0000 7f210718e640 1 -- 172.21.15.69:0/616570698 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2100062390 con 0x7f20f00a3cc0 2024-04-23T10:25:01.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.045+0000 7f20fdffb640 1 -- 172.21.15.69:0/616570698 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258964 (secure 0 0 0) 0x7f2100062390 con 0x7f20f00a3cc0 2024-04-23T10:25:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:25:01.048 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-23T10:25:01.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 -- 172.21.15.69:0/616570698 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f20f00a3cc0 msgr2=0x7f20f00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:01.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f20f00a3cc0 0x7f20f00a6180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20f4000c00 tx=0x7f20f4031510 comp rx=0 tx=0).stop 2024-04-23T10:25:01.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 -- 172.21.15.69:0/616570698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21001053a0 msgr2=0x7f2100198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:01.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21001053a0 0x7f2100198820 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00d740 tx=0x7f20ec00dc00 comp rx=0 tx=0).stop 2024-04-23T10:25:01.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 -- 172.21.15.69:0/616570698 shutdown_connections 2024-04-23T10:25:01.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f20f00a3cc0 0x7f20f00a6180 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:01.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21001053a0 0x7f2100198820 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:01.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2100107cd0 0x7f210019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:01.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 --2- 172.21.15.69:0/616570698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2100102a70 0x7f21001982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:01.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 -- 172.21.15.69:0/616570698 >> 172.21.15.69:0/616570698 conn(0x7f21000fc400 msgr2=0x7f2100103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:01.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 -- 172.21.15.69:0/616570698 shutdown_connections 2024-04-23T10:25:01.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:01.048+0000 7f210718e640 1 -- 172.21.15.69:0/616570698 wait complete. 2024-04-23T10:25:01.058 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-04-23T10:25:01.004583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638687,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":170,"num_read_kb":165,"num_write":355,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":289,"ondisk_log_size":289,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":273,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356236,"kb_used_data":11212,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585588,"statfs":{"total":1151940427776,"available":1151575642112,"internally_reserved":0,"allocated":11481088,"data_stored":7115117,"data_compressed":107040,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19139,"internal_metadata":353154365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48319,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":34,"num_read_kb":46,"num_write":174,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001640"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846782+0000","last_change":"2024-04-23T10:24:53.504514+0000","last_active":"2024-04-23T10:24:55.846782+0000","last_peered":"2024-04-23T10:24:55.846782+0000","last_clean":"2024-04-23T10:24:55.846782+0000","last_became_active":"2024-04-23T10:24:53.504105+0000","last_became_peered":"2024-04-23T10:24:53.504105+0000","last_unstale":"2024-04-23T10:24:55.846782+0000","last_undegraded":"2024-04-23T10:24:55.846782+0000","last_fullsized":"2024-04-23T10:24:55.846782+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:49.730698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986713+0000","last_change":"2024-04-23T10:24:53.504534+0000","last_active":"2024-04-23T10:24:54.986713+0000","last_peered":"2024-04-23T10:24:54.986713+0000","last_clean":"2024-04-23T10:24:54.986713+0000","last_became_active":"2024-04-23T10:24:53.504244+0000","last_became_peered":"2024-04-23T10:24:53.504244+0000","last_unstale":"2024-04-23T10:24:54.986713+0000","last_undegraded":"2024-04-23T10:24:54.986713+0000","last_fullsized":"2024-04-23T10:24:54.986713+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:12:57.447009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986589+0000","last_change":"2024-04-23T10:24:53.502922+0000","last_active":"2024-04-23T10:24:54.986589+0000","last_peered":"2024-04-23T10:24:54.986589+0000","last_clean":"2024-04-23T10:24:54.986589+0000","last_became_active":"2024-04-23T10:24:53.502519+0000","last_became_peered":"2024-04-23T10:24:53.502519+0000","last_unstale":"2024-04-23T10:24:54.986589+0000","last_undegraded":"2024-04-23T10:24:54.986589+0000","last_fullsized":"2024-04-23T10:24:54.986589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:58:35.871081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.488154+0000","last_change":"2024-04-23T10:24:53.500049+0000","last_active":"2024-04-23T10:24:54.488154+0000","last_peered":"2024-04-23T10:24:54.488154+0000","last_clean":"2024-04-23T10:24:54.488154+0000","last_became_active":"2024-04-23T10:24:53.499607+0000","last_became_peered":"2024-04-23T10:24:53.499607+0000","last_unstale":"2024-04-23T10:24:54.488154+0000","last_undegraded":"2024-04-23T10:24:54.488154+0000","last_fullsized":"2024-04-23T10:24:54.488154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:10:27.104622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.826995+0000","last_change":"2024-04-23T10:24:53.493739+0000","last_active":"2024-04-23T10:24:54.826995+0000","last_peered":"2024-04-23T10:24:54.826995+0000","last_clean":"2024-04-23T10:24:54.826995+0000","last_became_active":"2024-04-23T10:24:53.492471+0000","last_became_peered":"2024-04-23T10:24:53.492471+0000","last_unstale":"2024-04-23T10:24:54.826995+0000","last_undegraded":"2024-04-23T10:24:54.826995+0000","last_fullsized":"2024-04-23T10:24:54.826995+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:43.267366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.844068+0000","last_change":"2024-04-23T10:24:53.500426+0000","last_active":"2024-04-23T10:24:55.844068+0000","last_peered":"2024-04-23T10:24:55.844068+0000","last_clean":"2024-04-23T10:24:55.844068+0000","last_became_active":"2024-04-23T10:24:53.500052+0000","last_became_peered":"2024-04-23T10:24:53.500052+0000","last_unstale":"2024-04-23T10:24:55.844068+0000","last_undegraded":"2024-04-23T10:24:55.844068+0000","last_fullsized":"2024-04-23T10:24:55.844068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:21:36.361816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.844316+0000","last_change":"2024-04-23T10:24:53.501672+0000","last_active":"2024-04-23T10:24:55.844316+0000","last_peered":"2024-04-23T10:24:55.844316+0000","last_clean":"2024-04-23T10:24:55.844316+0000","last_became_active":"2024-04-23T10:24:53.501345+0000","last_became_peered":"2024-04-23T10:24:53.501345+0000","last_unstale":"2024-04-23T10:24:55.844316+0000","last_undegraded":"2024-04-23T10:24:55.844316+0000","last_fullsized":"2024-04-23T10:24:55.844316+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:31:41.488482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.484930+0000","last_change":"2024-04-23T10:24:53.499442+0000","last_active":"2024-04-23T10:24:54.484930+0000","last_peered":"2024-04-23T10:24:54.484930+0000","last_clean":"2024-04-23T10:24:54.484930+0000","last_became_active":"2024-04-23T10:24:53.499131+0000","last_became_peered":"2024-04-23T10:24:53.499131+0000","last_unstale":"2024-04-23T10:24:54.484930+0000","last_undegraded":"2024-04-23T10:24:54.484930+0000","last_fullsized":"2024-04-23T10:24:54.484930+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:17:21.815851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394862+0000","last_change":"2024-04-23T10:24:53.501235+0000","last_active":"2024-04-23T10:24:55.394862+0000","last_peered":"2024-04-23T10:24:55.394862+0000","last_clean":"2024-04-23T10:24:55.394862+0000","last_became_active":"2024-04-23T10:24:53.500392+0000","last_became_peered":"2024-04-23T10:24:53.500392+0000","last_unstale":"2024-04-23T10:24:55.394862+0000","last_undegraded":"2024-04-23T10:24:55.394862+0000","last_fullsized":"2024-04-23T10:24:55.394862+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:58:20.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846898+0000","last_change":"2024-04-23T10:24:53.504235+0000","last_active":"2024-04-23T10:24:55.846898+0000","last_peered":"2024-04-23T10:24:55.846898+0000","last_clean":"2024-04-23T10:24:55.846898+0000","last_became_active":"2024-04-23T10:24:53.503743+0000","last_became_peered":"2024-04-23T10:24:53.503743+0000","last_unstale":"2024-04-23T10:24:55.846898+0000","last_undegraded":"2024-04-23T10:24:55.846898+0000","last_fullsized":"2024-04-23T10:24:55.846898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:25:53.881433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845916+0000","last_change":"2024-04-23T10:24:53.497355+0000","last_active":"2024-04-23T10:24:55.845916+0000","last_peered":"2024-04-23T10:24:55.845916+0000","last_clean":"2024-04-23T10:24:55.845916+0000","last_became_active":"2024-04-23T10:24:53.494195+0000","last_became_peered":"2024-04-23T10:24:53.494195+0000","last_unstale":"2024-04-23T10:24:55.845916+0000","last_undegraded":"2024-04-23T10:24:55.845916+0000","last_fullsized":"2024-04-23T10:24:55.845916+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:19:48.638789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.488010+0000","last_change":"2024-04-23T10:24:53.504513+0000","last_active":"2024-04-23T10:24:54.488010+0000","last_peered":"2024-04-23T10:24:54.488010+0000","last_clean":"2024-04-23T10:24:54.488010+0000","last_became_active":"2024-04-23T10:24:53.504058+0000","last_became_peered":"2024-04-23T10:24:53.504058+0000","last_unstale":"2024-04-23T10:24:54.488010+0000","last_undegraded":"2024-04-23T10:24:54.488010+0000","last_fullsized":"2024-04-23T10:24:54.488010+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:16:34.302848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910137+0000","last_change":"2024-04-23T10:24:53.495277+0000","last_active":"2024-04-23T10:24:54.910137+0000","last_peered":"2024-04-23T10:24:54.910137+0000","last_clean":"2024-04-23T10:24:54.910137+0000","last_became_active":"2024-04-23T10:24:53.494925+0000","last_became_peered":"2024-04-23T10:24:53.494925+0000","last_unstale":"2024-04-23T10:24:54.910137+0000","last_undegraded":"2024-04-23T10:24:54.910137+0000","last_fullsized":"2024-04-23T10:24:54.910137+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:33.647408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986592+0000","last_change":"2024-04-23T10:24:53.504082+0000","last_active":"2024-04-23T10:24:54.986592+0000","last_peered":"2024-04-23T10:24:54.986592+0000","last_clean":"2024-04-23T10:24:54.986592+0000","last_became_active":"2024-04-23T10:24:53.503753+0000","last_became_peered":"2024-04-23T10:24:53.503753+0000","last_unstale":"2024-04-23T10:24:54.986592+0000","last_undegraded":"2024-04-23T10:24:54.986592+0000","last_fullsized":"2024-04-23T10:24:54.986592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:59.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986481+0000","last_change":"2024-04-23T10:24:53.499995+0000","last_active":"2024-04-23T10:24:54.986481+0000","last_peered":"2024-04-23T10:24:54.986481+0000","last_clean":"2024-04-23T10:24:54.986481+0000","last_became_active":"2024-04-23T10:24:53.498918+0000","last_became_peered":"2024-04-23T10:24:53.498918+0000","last_unstale":"2024-04-23T10:24:54.986481+0000","last_undegraded":"2024-04-23T10:24:54.986481+0000","last_fullsized":"2024-04-23T10:24:54.986481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:13.432680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394281+0000","last_change":"2024-04-23T10:24:53.498916+0000","last_active":"2024-04-23T10:24:55.394281+0000","last_peered":"2024-04-23T10:24:55.394281+0000","last_clean":"2024-04-23T10:24:55.394281+0000","last_became_active":"2024-04-23T10:24:53.498560+0000","last_became_peered":"2024-04-23T10:24:53.498560+0000","last_unstale":"2024-04-23T10:24:55.394281+0000","last_undegraded":"2024-04-23T10:24:55.394281+0000","last_fullsized":"2024-04-23T10:24:55.394281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:24:07.965091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846949+0000","last_change":"2024-04-23T10:24:53.505167+0000","last_active":"2024-04-23T10:24:55.846949+0000","last_peered":"2024-04-23T10:24:55.846949+0000","last_clean":"2024-04-23T10:24:55.846949+0000","last_became_active":"2024-04-23T10:24:53.504832+0000","last_became_peered":"2024-04-23T10:24:53.504832+0000","last_unstale":"2024-04-23T10:24:55.846949+0000","last_undegraded":"2024-04-23T10:24:55.846949+0000","last_fullsized":"2024-04-23T10:24:55.846949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:58:20.867496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.824980+0000","last_change":"2024-04-23T10:24:53.505363+0000","last_active":"2024-04-23T10:24:54.824980+0000","last_peered":"2024-04-23T10:24:54.824980+0000","last_clean":"2024-04-23T10:24:54.824980+0000","last_became_active":"2024-04-23T10:24:53.505029+0000","last_became_peered":"2024-04-23T10:24:53.505029+0000","last_unstale":"2024-04-23T10:24:54.824980+0000","last_undegraded":"2024-04-23T10:24:54.824980+0000","last_fullsized":"2024-04-23T10:24:54.824980+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:22.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846641+0000","last_change":"2024-04-23T10:24:53.497666+0000","last_active":"2024-04-23T10:24:55.846641+0000","last_peered":"2024-04-23T10:24:55.846641+0000","last_clean":"2024-04-23T10:24:55.846641+0000","last_became_active":"2024-04-23T10:24:53.495144+0000","last_became_peered":"2024-04-23T10:24:53.495144+0000","last_unstale":"2024-04-23T10:24:55.846641+0000","last_undegraded":"2024-04-23T10:24:55.846641+0000","last_fullsized":"2024-04-23T10:24:55.846641+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:23:27.148289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.335960+0000","last_change":"2024-04-23T10:24:52.496907+0000","last_active":"2024-04-23T10:24:58.335960+0000","last_peered":"2024-04-23T10:24:58.335960+0000","last_clean":"2024-04-23T10:24:58.335960+0000","last_became_active":"2024-04-23T10:24:52.496567+0000","last_became_peered":"2024-04-23T10:24:52.496567+0000","last_unstale":"2024-04-23T10:24:58.335960+0000","last_undegraded":"2024-04-23T10:24:58.335960+0000","last_fullsized":"2024-04-23T10:24:58.335960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:33.195504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485326+0000","last_change":"2024-04-23T10:24:53.501140+0000","last_active":"2024-04-23T10:24:54.485326+0000","last_peered":"2024-04-23T10:24:54.485326+0000","last_clean":"2024-04-23T10:24:54.485326+0000","last_became_active":"2024-04-23T10:24:53.500826+0000","last_became_peered":"2024-04-23T10:24:53.500826+0000","last_unstale":"2024-04-23T10:24:54.485326+0000","last_undegraded":"2024-04-23T10:24:54.485326+0000","last_fullsized":"2024-04-23T10:24:54.485326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:39.178784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485432+0000","last_change":"2024-04-23T10:24:52.494413+0000","last_active":"2024-04-23T10:24:54.485432+0000","last_peered":"2024-04-23T10:24:54.485432+0000","last_clean":"2024-04-23T10:24:54.485432+0000","last_became_active":"2024-04-23T10:24:52.494092+0000","last_became_peered":"2024-04-23T10:24:52.494092+0000","last_unstale":"2024-04-23T10:24:54.485432+0000","last_undegraded":"2024-04-23T10:24:54.485432+0000","last_fullsized":"2024-04-23T10:24:54.485432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:42:09.407787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986832+0000","last_change":"2024-04-23T10:24:53.495285+0000","last_active":"2024-04-23T10:24:54.986832+0000","last_peered":"2024-04-23T10:24:54.986832+0000","last_clean":"2024-04-23T10:24:54.986832+0000","last_became_active":"2024-04-23T10:24:53.494959+0000","last_became_peered":"2024-04-23T10:24:53.494959+0000","last_unstale":"2024-04-23T10:24:54.986832+0000","last_undegraded":"2024-04-23T10:24:54.986832+0000","last_fullsized":"2024-04-23T10:24:54.986832+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:59.209505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.329168+0000","last_change":"2024-04-23T10:24:52.496310+0000","last_active":"2024-04-23T10:24:56.329168+0000","last_peered":"2024-04-23T10:24:56.329168+0000","last_clean":"2024-04-23T10:24:56.329168+0000","last_became_active":"2024-04-23T10:24:52.496009+0000","last_became_peered":"2024-04-23T10:24:52.496009+0000","last_unstale":"2024-04-23T10:24:56.329168+0000","last_undegraded":"2024-04-23T10:24:56.329168+0000","last_fullsized":"2024-04-23T10:24:56.329168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:05:46.911691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394428+0000","last_change":"2024-04-23T10:24:53.498204+0000","last_active":"2024-04-23T10:24:55.394428+0000","last_peered":"2024-04-23T10:24:55.394428+0000","last_clean":"2024-04-23T10:24:55.394428+0000","last_became_active":"2024-04-23T10:24:53.496535+0000","last_became_peered":"2024-04-23T10:24:53.496535+0000","last_unstale":"2024-04-23T10:24:55.394428+0000","last_undegraded":"2024-04-23T10:24:55.394428+0000","last_fullsized":"2024-04-23T10:24:55.394428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:32.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.827248+0000","last_change":"2024-04-23T10:24:52.493485+0000","last_active":"2024-04-23T10:24:54.827248+0000","last_peered":"2024-04-23T10:24:54.827248+0000","last_clean":"2024-04-23T10:24:54.827248+0000","last_became_active":"2024-04-23T10:24:52.493164+0000","last_became_peered":"2024-04-23T10:24:52.493164+0000","last_unstale":"2024-04-23T10:24:54.827248+0000","last_undegraded":"2024-04-23T10:24:54.827248+0000","last_fullsized":"2024-04-23T10:24:54.827248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:42:33.701248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490839+0000","last_change":"2024-04-23T10:24:53.507145+0000","last_active":"2024-04-23T10:24:54.490839+0000","last_peered":"2024-04-23T10:24:54.490839+0000","last_clean":"2024-04-23T10:24:54.490839+0000","last_became_active":"2024-04-23T10:24:53.506824+0000","last_became_peered":"2024-04-23T10:24:53.506824+0000","last_unstale":"2024-04-23T10:24:54.490839+0000","last_undegraded":"2024-04-23T10:24:54.490839+0000","last_fullsized":"2024-04-23T10:24:54.490839+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:37:54.870303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.316153+0000","last_change":"2024-04-23T10:24:52.498646+0000","last_active":"2024-04-23T10:24:56.316153+0000","last_peered":"2024-04-23T10:24:56.316153+0000","last_clean":"2024-04-23T10:24:56.316153+0000","last_became_active":"2024-04-23T10:24:52.498328+0000","last_became_peered":"2024-04-23T10:24:52.498328+0000","last_unstale":"2024-04-23T10:24:56.316153+0000","last_undegraded":"2024-04-23T10:24:56.316153+0000","last_fullsized":"2024-04-23T10:24:56.316153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:26:33.646144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.827020+0000","last_change":"2024-04-23T10:24:53.493475+0000","last_active":"2024-04-23T10:24:54.827020+0000","last_peered":"2024-04-23T10:24:54.827020+0000","last_clean":"2024-04-23T10:24:54.827020+0000","last_became_active":"2024-04-23T10:24:53.492981+0000","last_became_peered":"2024-04-23T10:24:53.492981+0000","last_unstale":"2024-04-23T10:24:54.827020+0000","last_undegraded":"2024-04-23T10:24:54.827020+0000","last_fullsized":"2024-04-23T10:24:54.827020+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:50:43.227176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.331201+0000","last_change":"2024-04-23T10:24:52.495242+0000","last_active":"2024-04-23T10:24:57.331201+0000","last_peered":"2024-04-23T10:24:57.331201+0000","last_clean":"2024-04-23T10:24:57.331201+0000","last_became_active":"2024-04-23T10:24:52.493255+0000","last_became_peered":"2024-04-23T10:24:52.493255+0000","last_unstale":"2024-04-23T10:24:57.331201+0000","last_undegraded":"2024-04-23T10:24:57.331201+0000","last_fullsized":"2024-04-23T10:24:57.331201+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:33.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490783+0000","last_change":"2024-04-23T10:24:53.499843+0000","last_active":"2024-04-23T10:24:54.490783+0000","last_peered":"2024-04-23T10:24:54.490783+0000","last_clean":"2024-04-23T10:24:54.490783+0000","last_became_active":"2024-04-23T10:24:53.499512+0000","last_became_peered":"2024-04-23T10:24:53.499512+0000","last_unstale":"2024-04-23T10:24:54.490783+0000","last_undegraded":"2024-04-23T10:24:54.490783+0000","last_fullsized":"2024-04-23T10:24:54.490783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:20.333479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.327309+0000","last_change":"2024-04-23T10:24:52.495915+0000","last_active":"2024-04-23T10:24:56.327309+0000","last_peered":"2024-04-23T10:24:56.327309+0000","last_clean":"2024-04-23T10:24:56.327309+0000","last_became_active":"2024-04-23T10:24:52.495558+0000","last_became_peered":"2024-04-23T10:24:52.495558+0000","last_unstale":"2024-04-23T10:24:56.327309+0000","last_undegraded":"2024-04-23T10:24:56.327309+0000","last_fullsized":"2024-04-23T10:24:56.327309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:41:09.080880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485005+0000","last_change":"2024-04-23T10:24:53.496376+0000","last_active":"2024-04-23T10:24:54.485005+0000","last_peered":"2024-04-23T10:24:54.485005+0000","last_clean":"2024-04-23T10:24:54.485005+0000","last_became_active":"2024-04-23T10:24:53.496067+0000","last_became_peered":"2024-04-23T10:24:53.496067+0000","last_unstale":"2024-04-23T10:24:54.485005+0000","last_undegraded":"2024-04-23T10:24:54.485005+0000","last_fullsized":"2024-04-23T10:24:54.485005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:02:51.252365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490420+0000","last_change":"2024-04-23T10:24:52.499566+0000","last_active":"2024-04-23T10:24:54.490420+0000","last_peered":"2024-04-23T10:24:54.490420+0000","last_clean":"2024-04-23T10:24:54.490420+0000","last_became_active":"2024-04-23T10:24:52.499277+0000","last_became_peered":"2024-04-23T10:24:52.499277+0000","last_unstale":"2024-04-23T10:24:54.490420+0000","last_undegraded":"2024-04-23T10:24:54.490420+0000","last_fullsized":"2024-04-23T10:24:54.490420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:38.716187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.824825+0000","last_change":"2024-04-23T10:24:53.499617+0000","last_active":"2024-04-23T10:24:54.824825+0000","last_peered":"2024-04-23T10:24:54.824825+0000","last_clean":"2024-04-23T10:24:54.824825+0000","last_became_active":"2024-04-23T10:24:53.499283+0000","last_became_peered":"2024-04-23T10:24:53.499283+0000","last_unstale":"2024-04-23T10:24:54.824825+0000","last_undegraded":"2024-04-23T10:24:54.824825+0000","last_fullsized":"2024-04-23T10:24:54.824825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:36.931697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.321312+0000","last_change":"2024-04-23T10:24:52.492276+0000","last_active":"2024-04-23T10:24:59.321312+0000","last_peered":"2024-04-23T10:24:59.321312+0000","last_clean":"2024-04-23T10:24:59.321312+0000","last_became_active":"2024-04-23T10:24:52.491979+0000","last_became_peered":"2024-04-23T10:24:52.491979+0000","last_unstale":"2024-04-23T10:24:59.321312+0000","last_undegraded":"2024-04-23T10:24:59.321312+0000","last_fullsized":"2024-04-23T10:24:59.321312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:15:40.847446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394751+0000","last_change":"2024-04-23T10:24:53.500964+0000","last_active":"2024-04-23T10:24:55.394751+0000","last_peered":"2024-04-23T10:24:55.394751+0000","last_clean":"2024-04-23T10:24:55.394751+0000","last_became_active":"2024-04-23T10:24:53.499209+0000","last_became_peered":"2024-04-23T10:24:53.499209+0000","last_unstale":"2024-04-23T10:24:55.394751+0000","last_undegraded":"2024-04-23T10:24:55.394751+0000","last_fullsized":"2024-04-23T10:24:55.394751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:27:29.539994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.851816+0000","last_change":"2024-04-23T10:24:52.496016+0000","last_active":"2024-04-23T10:24:55.851816+0000","last_peered":"2024-04-23T10:24:55.851816+0000","last_clean":"2024-04-23T10:24:55.851816+0000","last_became_active":"2024-04-23T10:24:52.495711+0000","last_became_peered":"2024-04-23T10:24:52.495711+0000","last_unstale":"2024-04-23T10:24:55.851816+0000","last_undegraded":"2024-04-23T10:24:55.851816+0000","last_fullsized":"2024-04-23T10:24:55.851816+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:31:30.970731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986806+0000","last_change":"2024-04-23T10:24:53.495076+0000","last_active":"2024-04-23T10:24:54.986806+0000","last_peered":"2024-04-23T10:24:54.986806+0000","last_clean":"2024-04-23T10:24:54.986806+0000","last_became_active":"2024-04-23T10:24:53.494490+0000","last_became_peered":"2024-04-23T10:24:53.494490+0000","last_unstale":"2024-04-23T10:24:54.986806+0000","last_undegraded":"2024-04-23T10:24:54.986806+0000","last_fullsized":"2024-04-23T10:24:54.986806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:59:04.621528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.851921+0000","last_change":"2024-04-23T10:24:52.497200+0000","last_active":"2024-04-23T10:24:55.851921+0000","last_peered":"2024-04-23T10:24:55.851921+0000","last_clean":"2024-04-23T10:24:55.851921+0000","last_became_active":"2024-04-23T10:24:52.496864+0000","last_became_peered":"2024-04-23T10:24:52.496864+0000","last_unstale":"2024-04-23T10:24:55.851921+0000","last_undegraded":"2024-04-23T10:24:55.851921+0000","last_fullsized":"2024-04-23T10:24:55.851921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:16.514060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394504+0000","last_change":"2024-04-23T10:24:53.498438+0000","last_active":"2024-04-23T10:24:55.394504+0000","last_peered":"2024-04-23T10:24:55.394504+0000","last_clean":"2024-04-23T10:24:55.394504+0000","last_became_active":"2024-04-23T10:24:53.496569+0000","last_became_peered":"2024-04-23T10:24:53.496569+0000","last_unstale":"2024-04-23T10:24:55.394504+0000","last_undegraded":"2024-04-23T10:24:55.394504+0000","last_fullsized":"2024-04-23T10:24:55.394504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:06:45.964699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'22","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.390593+0000","last_change":"2024-04-23T10:24:52.490058+0000","last_active":"2024-04-23T10:24:59.390593+0000","last_peered":"2024-04-23T10:24:59.390593+0000","last_clean":"2024-04-23T10:24:59.390593+0000","last_became_active":"2024-04-23T10:24:52.489720+0000","last_became_peered":"2024-04-23T10:24:52.489720+0000","last_unstale":"2024-04-23T10:24:59.390593+0000","last_undegraded":"2024-04-23T10:24:59.390593+0000","last_fullsized":"2024-04-23T10:24:59.390593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:41.049778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43377,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":26,"num_write":24,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.827360+0000","last_change":"2024-04-23T10:24:53.507122+0000","last_active":"2024-04-23T10:24:54.827360+0000","last_peered":"2024-04-23T10:24:54.827360+0000","last_clean":"2024-04-23T10:24:54.827360+0000","last_became_active":"2024-04-23T10:24:53.506838+0000","last_became_peered":"2024-04-23T10:24:53.506838+0000","last_unstale":"2024-04-23T10:24:54.827360+0000","last_undegraded":"2024-04-23T10:24:54.827360+0000","last_fullsized":"2024-04-23T10:24:54.827360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:59:51.289630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.339226+0000","last_change":"2024-04-23T10:24:52.499787+0000","last_active":"2024-04-23T10:24:58.339226+0000","last_peered":"2024-04-23T10:24:58.339226+0000","last_clean":"2024-04-23T10:24:58.339226+0000","last_became_active":"2024-04-23T10:24:52.499400+0000","last_became_peered":"2024-04-23T10:24:52.499400+0000","last_unstale":"2024-04-23T10:24:58.339226+0000","last_undegraded":"2024-04-23T10:24:58.339226+0000","last_fullsized":"2024-04-23T10:24:58.339226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:15:17.638984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910042+0000","last_change":"2024-04-23T10:24:53.495773+0000","last_active":"2024-04-23T10:24:54.910042+0000","last_peered":"2024-04-23T10:24:54.910042+0000","last_clean":"2024-04-23T10:24:54.910042+0000","last_became_active":"2024-04-23T10:24:53.495456+0000","last_became_peered":"2024-04-23T10:24:53.495456+0000","last_unstale":"2024-04-23T10:24:54.910042+0000","last_undegraded":"2024-04-23T10:24:54.910042+0000","last_fullsized":"2024-04-23T10:24:54.910042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:12:06.638141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.848348+0000","last_change":"2024-04-23T10:24:52.498660+0000","last_active":"2024-04-23T10:24:55.848348+0000","last_peered":"2024-04-23T10:24:55.848348+0000","last_clean":"2024-04-23T10:24:55.848348+0000","last_became_active":"2024-04-23T10:24:52.498302+0000","last_became_peered":"2024-04-23T10:24:52.498302+0000","last_unstale":"2024-04-23T10:24:55.848348+0000","last_undegraded":"2024-04-23T10:24:55.848348+0000","last_fullsized":"2024-04-23T10:24:55.848348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:49:23.826748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845326+0000","last_change":"2024-04-23T10:24:53.501718+0000","last_active":"2024-04-23T10:24:55.845326+0000","last_peered":"2024-04-23T10:24:55.845326+0000","last_clean":"2024-04-23T10:24:55.845326+0000","last_became_active":"2024-04-23T10:24:53.501359+0000","last_became_peered":"2024-04-23T10:24:53.501359+0000","last_unstale":"2024-04-23T10:24:55.845326+0000","last_undegraded":"2024-04-23T10:24:55.845326+0000","last_fullsized":"2024-04-23T10:24:55.845326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:51:42.474899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.329340+0000","last_change":"2024-04-23T10:24:52.493910+0000","last_active":"2024-04-23T10:24:57.329340+0000","last_peered":"2024-04-23T10:24:57.329340+0000","last_clean":"2024-04-23T10:24:57.329340+0000","last_became_active":"2024-04-23T10:24:52.493536+0000","last_became_peered":"2024-04-23T10:24:52.493536+0000","last_unstale":"2024-04-23T10:24:57.329340+0000","last_undegraded":"2024-04-23T10:24:57.329340+0000","last_fullsized":"2024-04-23T10:24:57.329340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:23.806993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.844623+0000","last_change":"2024-04-23T10:24:53.498221+0000","last_active":"2024-04-23T10:24:55.844623+0000","last_peered":"2024-04-23T10:24:55.844623+0000","last_clean":"2024-04-23T10:24:55.844623+0000","last_became_active":"2024-04-23T10:24:53.497887+0000","last_became_peered":"2024-04-23T10:24:53.497887+0000","last_unstale":"2024-04-23T10:24:55.844623+0000","last_undegraded":"2024-04-23T10:24:55.844623+0000","last_fullsized":"2024-04-23T10:24:55.844623+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:49:02.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.329553+0000","last_change":"2024-04-23T10:24:52.498883+0000","last_active":"2024-04-23T10:24:56.329553+0000","last_peered":"2024-04-23T10:24:56.329553+0000","last_clean":"2024-04-23T10:24:56.329553+0000","last_became_active":"2024-04-23T10:24:52.498562+0000","last_became_peered":"2024-04-23T10:24:52.498562+0000","last_unstale":"2024-04-23T10:24:56.329553+0000","last_undegraded":"2024-04-23T10:24:56.329553+0000","last_fullsized":"2024-04-23T10:24:56.329553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:33.914481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490702+0000","last_change":"2024-04-23T10:24:53.506303+0000","last_active":"2024-04-23T10:24:54.490702+0000","last_peered":"2024-04-23T10:24:54.490702+0000","last_clean":"2024-04-23T10:24:54.490702+0000","last_became_active":"2024-04-23T10:24:53.505850+0000","last_became_peered":"2024-04-23T10:24:53.505850+0000","last_unstale":"2024-04-23T10:24:54.490702+0000","last_undegraded":"2024-04-23T10:24:54.490702+0000","last_fullsized":"2024-04-23T10:24:54.490702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:18.498188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.827298+0000","last_change":"2024-04-23T10:24:52.493853+0000","last_active":"2024-04-23T10:24:54.827298+0000","last_peered":"2024-04-23T10:24:54.827298+0000","last_clean":"2024-04-23T10:24:54.827298+0000","last_became_active":"2024-04-23T10:24:52.492932+0000","last_became_peered":"2024-04-23T10:24:52.492932+0000","last_unstale":"2024-04-23T10:24:54.827298+0000","last_undegraded":"2024-04-23T10:24:54.827298+0000","last_fullsized":"2024-04-23T10:24:54.827298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:12:33.327611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845949+0000","last_change":"2024-04-23T10:24:53.501437+0000","last_active":"2024-04-23T10:24:55.845949+0000","last_peered":"2024-04-23T10:24:55.845949+0000","last_clean":"2024-04-23T10:24:55.845949+0000","last_became_active":"2024-04-23T10:24:53.501101+0000","last_became_peered":"2024-04-23T10:24:53.501101+0000","last_unstale":"2024-04-23T10:24:55.845949+0000","last_undegraded":"2024-04-23T10:24:55.845949+0000","last_fullsized":"2024-04-23T10:24:55.845949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:27:05.710567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.825013+0000","last_change":"2024-04-23T10:24:52.494032+0000","last_active":"2024-04-23T10:24:54.825013+0000","last_peered":"2024-04-23T10:24:54.825013+0000","last_clean":"2024-04-23T10:24:54.825013+0000","last_became_active":"2024-04-23T10:24:52.493699+0000","last_became_peered":"2024-04-23T10:24:52.493699+0000","last_unstale":"2024-04-23T10:24:54.825013+0000","last_undegraded":"2024-04-23T10:24:54.825013+0000","last_fullsized":"2024-04-23T10:24:54.825013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:54.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845003+0000","last_change":"2024-04-23T10:24:53.494846+0000","last_active":"2024-04-23T10:24:55.845003+0000","last_peered":"2024-04-23T10:24:55.845003+0000","last_clean":"2024-04-23T10:24:55.845003+0000","last_became_active":"2024-04-23T10:24:53.494541+0000","last_became_peered":"2024-04-23T10:24:53.494541+0000","last_unstale":"2024-04-23T10:24:55.845003+0000","last_undegraded":"2024-04-23T10:24:55.845003+0000","last_fullsized":"2024-04-23T10:24:55.845003+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:33:24.263803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.844453+0000","last_change":"2024-04-23T10:24:52.499078+0000","last_active":"2024-04-23T10:24:55.844453+0000","last_peered":"2024-04-23T10:24:55.844453+0000","last_clean":"2024-04-23T10:24:55.844453+0000","last_became_active":"2024-04-23T10:24:52.498764+0000","last_became_peered":"2024-04-23T10:24:52.498764+0000","last_unstale":"2024-04-23T10:24:55.844453+0000","last_undegraded":"2024-04-23T10:24:55.844453+0000","last_fullsized":"2024-04-23T10:24:55.844453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:10:51.634437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.844562+0000","last_change":"2024-04-23T10:24:53.492923+0000","last_active":"2024-04-23T10:24:55.844562+0000","last_peered":"2024-04-23T10:24:55.844562+0000","last_clean":"2024-04-23T10:24:55.844562+0000","last_became_active":"2024-04-23T10:24:53.492601+0000","last_became_peered":"2024-04-23T10:24:53.492601+0000","last_unstale":"2024-04-23T10:24:55.844562+0000","last_undegraded":"2024-04-23T10:24:55.844562+0000","last_fullsized":"2024-04-23T10:24:55.844562+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:35.017462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490699+0000","last_change":"2024-04-23T10:24:53.504787+0000","last_active":"2024-04-23T10:24:54.490699+0000","last_peered":"2024-04-23T10:24:54.490699+0000","last_clean":"2024-04-23T10:24:54.490699+0000","last_became_active":"2024-04-23T10:24:53.504423+0000","last_became_peered":"2024-04-23T10:24:53.504423+0000","last_unstale":"2024-04-23T10:24:54.490699+0000","last_undegraded":"2024-04-23T10:24:54.490699+0000","last_fullsized":"2024-04-23T10:24:54.490699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:00.171449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.327931+0000","last_change":"2024-04-23T10:24:52.493600+0000","last_active":"2024-04-23T10:24:56.327931+0000","last_peered":"2024-04-23T10:24:56.327931+0000","last_clean":"2024-04-23T10:24:56.327931+0000","last_became_active":"2024-04-23T10:24:52.493310+0000","last_became_peered":"2024-04-23T10:24:52.493310+0000","last_unstale":"2024-04-23T10:24:56.327931+0000","last_undegraded":"2024-04-23T10:24:56.327931+0000","last_fullsized":"2024-04-23T10:24:56.327931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:07.144860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485437+0000","last_change":"2024-04-23T10:24:53.506311+0000","last_active":"2024-04-23T10:24:54.485437+0000","last_peered":"2024-04-23T10:24:54.485437+0000","last_clean":"2024-04-23T10:24:54.485437+0000","last_became_active":"2024-04-23T10:24:53.503910+0000","last_became_peered":"2024-04-23T10:24:53.503910+0000","last_unstale":"2024-04-23T10:24:54.485437+0000","last_undegraded":"2024-04-23T10:24:54.485437+0000","last_fullsized":"2024-04-23T10:24:54.485437+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:01:32.620891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'5","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.329108+0000","last_change":"2024-04-23T10:24:52.485060+0000","last_active":"2024-04-23T10:24:57.329108+0000","last_peered":"2024-04-23T10:24:57.329108+0000","last_clean":"2024-04-23T10:24:57.329108+0000","last_became_active":"2024-04-23T10:24:52.484636+0000","last_became_peered":"2024-04-23T10:24:52.484636+0000","last_unstale":"2024-04-23T10:24:57.329108+0000","last_undegraded":"2024-04-23T10:24:57.329108+0000","last_fullsized":"2024-04-23T10:24:57.329108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:26:01.737147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.843810+0000","last_change":"2024-04-23T10:23:43.804102+0000","last_active":"2024-04-23T10:24:55.843810+0000","last_peered":"2024-04-23T10:24:55.843810+0000","last_clean":"2024-04-23T10:24:55.843810+0000","last_became_active":"2024-04-23T10:23:43.803657+0000","last_became_peered":"2024-04-23T10:23:43.803657+0000","last_unstale":"2024-04-23T10:24:55.843810+0000","last_undegraded":"2024-04-23T10:24:55.843810+0000","last_fullsized":"2024-04-23T10:24:55.843810+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_clean_scrub_stamp":"2024-04-23T10:20:19.875078+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:50.160735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.909843+0000","last_change":"2024-04-23T10:24:53.499334+0000","last_active":"2024-04-23T10:24:54.909843+0000","last_peered":"2024-04-23T10:24:54.909843+0000","last_clean":"2024-04-23T10:24:54.909843+0000","last_became_active":"2024-04-23T10:24:53.499008+0000","last_became_peered":"2024-04-23T10:24:53.499008+0000","last_unstale":"2024-04-23T10:24:54.909843+0000","last_undegraded":"2024-04-23T10:24:54.909843+0000","last_fullsized":"2024-04-23T10:24:54.909843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:13.504789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.326835+0000","last_change":"2024-04-23T10:24:52.493601+0000","last_active":"2024-04-23T10:24:56.326835+0000","last_peered":"2024-04-23T10:24:56.326835+0000","last_clean":"2024-04-23T10:24:56.326835+0000","last_became_active":"2024-04-23T10:24:52.493278+0000","last_became_peered":"2024-04-23T10:24:52.493278+0000","last_unstale":"2024-04-23T10:24:56.326835+0000","last_undegraded":"2024-04-23T10:24:56.326835+0000","last_fullsized":"2024-04-23T10:24:56.326835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:36:21.375233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845033+0000","last_change":"2024-04-23T10:24:52.495637+0000","last_active":"2024-04-23T10:24:55.845033+0000","last_peered":"2024-04-23T10:24:55.845033+0000","last_clean":"2024-04-23T10:24:55.845033+0000","last_became_active":"2024-04-23T10:24:52.495329+0000","last_became_peered":"2024-04-23T10:24:52.495329+0000","last_unstale":"2024-04-23T10:24:55.845033+0000","last_undegraded":"2024-04-23T10:24:55.845033+0000","last_fullsized":"2024-04-23T10:24:55.845033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:14.187803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910131+0000","last_change":"2024-04-23T10:24:53.500353+0000","last_active":"2024-04-23T10:24:54.910131+0000","last_peered":"2024-04-23T10:24:54.910131+0000","last_clean":"2024-04-23T10:24:54.910131+0000","last_became_active":"2024-04-23T10:24:53.499995+0000","last_became_peered":"2024-04-23T10:24:53.499995+0000","last_unstale":"2024-04-23T10:24:54.910131+0000","last_undegraded":"2024-04-23T10:24:54.910131+0000","last_fullsized":"2024-04-23T10:24:54.910131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:55:52.695375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.331187+0000","last_change":"2024-04-23T10:24:52.495960+0000","last_active":"2024-04-23T10:24:57.331187+0000","last_peered":"2024-04-23T10:24:57.331187+0000","last_clean":"2024-04-23T10:24:57.331187+0000","last_became_active":"2024-04-23T10:24:52.495655+0000","last_became_peered":"2024-04-23T10:24:52.495655+0000","last_unstale":"2024-04-23T10:24:57.331187+0000","last_undegraded":"2024-04-23T10:24:57.331187+0000","last_fullsized":"2024-04-23T10:24:57.331187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:41.507393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485230+0000","last_change":"2024-04-23T10:24:53.498140+0000","last_active":"2024-04-23T10:24:54.485230+0000","last_peered":"2024-04-23T10:24:54.485230+0000","last_clean":"2024-04-23T10:24:54.485230+0000","last_became_active":"2024-04-23T10:24:53.496683+0000","last_became_peered":"2024-04-23T10:24:53.496683+0000","last_unstale":"2024-04-23T10:24:54.485230+0000","last_undegraded":"2024-04-23T10:24:54.485230+0000","last_fullsized":"2024-04-23T10:24:54.485230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:49:18.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845747+0000","last_change":"2024-04-23T10:24:52.486505+0000","last_active":"2024-04-23T10:24:55.845747+0000","last_peered":"2024-04-23T10:24:55.845747+0000","last_clean":"2024-04-23T10:24:55.845747+0000","last_became_active":"2024-04-23T10:24:52.486185+0000","last_became_peered":"2024-04-23T10:24:52.486185+0000","last_unstale":"2024-04-23T10:24:55.845747+0000","last_undegraded":"2024-04-23T10:24:55.845747+0000","last_fullsized":"2024-04-23T10:24:55.845747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:46:27.052935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986849+0000","last_change":"2024-04-23T10:24:53.496234+0000","last_active":"2024-04-23T10:24:54.986849+0000","last_peered":"2024-04-23T10:24:54.986849+0000","last_clean":"2024-04-23T10:24:54.986849+0000","last_became_active":"2024-04-23T10:24:53.495892+0000","last_became_peered":"2024-04-23T10:24:53.495892+0000","last_unstale":"2024-04-23T10:24:54.986849+0000","last_undegraded":"2024-04-23T10:24:54.986849+0000","last_fullsized":"2024-04-23T10:24:54.986849+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:11.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.847689+0000","last_change":"2024-04-23T10:24:52.497346+0000","last_active":"2024-04-23T10:24:55.847689+0000","last_peered":"2024-04-23T10:24:55.847689+0000","last_clean":"2024-04-23T10:24:55.847689+0000","last_became_active":"2024-04-23T10:24:52.497033+0000","last_became_peered":"2024-04-23T10:24:52.497033+0000","last_unstale":"2024-04-23T10:24:55.847689+0000","last_undegraded":"2024-04-23T10:24:55.847689+0000","last_fullsized":"2024-04-23T10:24:55.847689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:23.034241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.826927+0000","last_change":"2024-04-23T10:24:53.497985+0000","last_active":"2024-04-23T10:24:54.826927+0000","last_peered":"2024-04-23T10:24:54.826927+0000","last_clean":"2024-04-23T10:24:54.826927+0000","last_became_active":"2024-04-23T10:24:53.497661+0000","last_became_peered":"2024-04-23T10:24:53.497661+0000","last_unstale":"2024-04-23T10:24:54.826927+0000","last_undegraded":"2024-04-23T10:24:54.826927+0000","last_fullsized":"2024-04-23T10:24:54.826927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:48.923714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.329626+0000","last_change":"2024-04-23T10:24:52.490572+0000","last_active":"2024-04-23T10:24:57.329626+0000","last_peered":"2024-04-23T10:24:57.329626+0000","last_clean":"2024-04-23T10:24:57.329626+0000","last_became_active":"2024-04-23T10:24:52.490274+0000","last_became_peered":"2024-04-23T10:24:52.490274+0000","last_unstale":"2024-04-23T10:24:57.329626+0000","last_undegraded":"2024-04-23T10:24:57.329626+0000","last_fullsized":"2024-04-23T10:24:57.329626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:22.447399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845765+0000","last_change":"2024-04-23T10:24:53.509189+0000","last_active":"2024-04-23T10:24:55.845765+0000","last_peered":"2024-04-23T10:24:55.845765+0000","last_clean":"2024-04-23T10:24:55.845765+0000","last_became_active":"2024-04-23T10:24:53.508850+0000","last_became_peered":"2024-04-23T10:24:53.508850+0000","last_unstale":"2024-04-23T10:24:55.845765+0000","last_undegraded":"2024-04-23T10:24:55.845765+0000","last_fullsized":"2024-04-23T10:24:55.845765+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:23.242999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.330735+0000","last_change":"2024-04-23T10:24:52.497616+0000","last_active":"2024-04-23T10:24:57.330735+0000","last_peered":"2024-04-23T10:24:57.330735+0000","last_clean":"2024-04-23T10:24:57.330735+0000","last_became_active":"2024-04-23T10:24:52.497028+0000","last_became_peered":"2024-04-23T10:24:52.497028+0000","last_unstale":"2024-04-23T10:24:57.330735+0000","last_undegraded":"2024-04-23T10:24:57.330735+0000","last_fullsized":"2024-04-23T10:24:57.330735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:51:26.836718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485489+0000","last_change":"2024-04-23T10:24:53.498086+0000","last_active":"2024-04-23T10:24:54.485489+0000","last_peered":"2024-04-23T10:24:54.485489+0000","last_clean":"2024-04-23T10:24:54.485489+0000","last_became_active":"2024-04-23T10:24:53.497734+0000","last_became_peered":"2024-04-23T10:24:53.497734+0000","last_unstale":"2024-04-23T10:24:54.485489+0000","last_undegraded":"2024-04-23T10:24:54.485489+0000","last_fullsized":"2024-04-23T10:24:54.485489+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:57.602301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.847770+0000","last_change":"2024-04-23T10:24:52.496609+0000","last_active":"2024-04-23T10:24:55.847770+0000","last_peered":"2024-04-23T10:24:55.847770+0000","last_clean":"2024-04-23T10:24:55.847770+0000","last_became_active":"2024-04-23T10:24:52.495981+0000","last_became_peered":"2024-04-23T10:24:52.495981+0000","last_unstale":"2024-04-23T10:24:55.847770+0000","last_undegraded":"2024-04-23T10:24:55.847770+0000","last_fullsized":"2024-04-23T10:24:55.847770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:28.111644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.844636+0000","last_change":"2024-04-23T10:24:53.503840+0000","last_active":"2024-04-23T10:24:55.844636+0000","last_peered":"2024-04-23T10:24:55.844636+0000","last_clean":"2024-04-23T10:24:55.844636+0000","last_became_active":"2024-04-23T10:24:53.503448+0000","last_became_peered":"2024-04-23T10:24:53.503448+0000","last_unstale":"2024-04-23T10:24:55.844636+0000","last_undegraded":"2024-04-23T10:24:55.844636+0000","last_fullsized":"2024-04-23T10:24:55.844636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:03.295985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.339306+0000","last_change":"2024-04-23T10:24:52.501792+0000","last_active":"2024-04-23T10:24:59.339306+0000","last_peered":"2024-04-23T10:24:59.339306+0000","last_clean":"2024-04-23T10:24:59.339306+0000","last_became_active":"2024-04-23T10:24:52.501404+0000","last_became_peered":"2024-04-23T10:24:52.501404+0000","last_unstale":"2024-04-23T10:24:59.339306+0000","last_undegraded":"2024-04-23T10:24:59.339306+0000","last_fullsized":"2024-04-23T10:24:59.339306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:03.529410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846194+0000","last_change":"2024-04-23T10:24:53.501649+0000","last_active":"2024-04-23T10:24:55.846194+0000","last_peered":"2024-04-23T10:24:55.846194+0000","last_clean":"2024-04-23T10:24:55.846194+0000","last_became_active":"2024-04-23T10:24:53.501307+0000","last_became_peered":"2024-04-23T10:24:53.501307+0000","last_unstale":"2024-04-23T10:24:55.846194+0000","last_undegraded":"2024-04-23T10:24:55.846194+0000","last_fullsized":"2024-04-23T10:24:55.846194+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:37.863832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490655+0000","last_change":"2024-04-23T10:24:52.495737+0000","last_active":"2024-04-23T10:24:54.490655+0000","last_peered":"2024-04-23T10:24:54.490655+0000","last_clean":"2024-04-23T10:24:54.490655+0000","last_became_active":"2024-04-23T10:24:52.495395+0000","last_became_peered":"2024-04-23T10:24:52.495395+0000","last_unstale":"2024-04-23T10:24:54.490655+0000","last_undegraded":"2024-04-23T10:24:54.490655+0000","last_fullsized":"2024-04-23T10:24:54.490655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:14:45.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845026+0000","last_change":"2024-04-23T10:24:53.496178+0000","last_active":"2024-04-23T10:24:55.845026+0000","last_peered":"2024-04-23T10:24:55.845026+0000","last_clean":"2024-04-23T10:24:55.845026+0000","last_became_active":"2024-04-23T10:24:53.495711+0000","last_became_peered":"2024-04-23T10:24:53.495711+0000","last_unstale":"2024-04-23T10:24:55.845026+0000","last_undegraded":"2024-04-23T10:24:55.845026+0000","last_fullsized":"2024-04-23T10:24:55.845026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:31:56.991821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910077+0000","last_change":"2024-04-23T10:24:52.494322+0000","last_active":"2024-04-23T10:24:54.910077+0000","last_peered":"2024-04-23T10:24:54.910077+0000","last_clean":"2024-04-23T10:24:54.910077+0000","last_became_active":"2024-04-23T10:24:52.494019+0000","last_became_peered":"2024-04-23T10:24:52.494019+0000","last_unstale":"2024-04-23T10:24:54.910077+0000","last_undegraded":"2024-04-23T10:24:54.910077+0000","last_fullsized":"2024-04-23T10:24:54.910077+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:16.099197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.845959+0000","last_change":"2024-04-23T10:24:53.507160+0000","last_active":"2024-04-23T10:24:55.845959+0000","last_peered":"2024-04-23T10:24:55.845959+0000","last_clean":"2024-04-23T10:24:55.845959+0000","last_became_active":"2024-04-23T10:24:53.506815+0000","last_became_peered":"2024-04-23T10:24:53.506815+0000","last_unstale":"2024-04-23T10:24:55.845959+0000","last_undegraded":"2024-04-23T10:24:55.845959+0000","last_fullsized":"2024-04-23T10:24:55.845959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:24.657153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846002+0000","last_change":"2024-04-23T10:24:53.510511+0000","last_active":"2024-04-23T10:24:55.846002+0000","last_peered":"2024-04-23T10:24:55.846002+0000","last_clean":"2024-04-23T10:24:55.846002+0000","last_became_active":"2024-04-23T10:24:53.510174+0000","last_became_peered":"2024-04-23T10:24:53.510174+0000","last_unstale":"2024-04-23T10:24:55.846002+0000","last_undegraded":"2024-04-23T10:24:55.846002+0000","last_fullsized":"2024-04-23T10:24:55.846002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:35.048697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846306+0000","last_change":"2024-04-23T10:24:53.497365+0000","last_active":"2024-04-23T10:24:55.846306+0000","last_peered":"2024-04-23T10:24:55.846306+0000","last_clean":"2024-04-23T10:24:55.846306+0000","last_became_active":"2024-04-23T10:24:53.496427+0000","last_became_peered":"2024-04-23T10:24:53.496427+0000","last_unstale":"2024-04-23T10:24:55.846306+0000","last_undegraded":"2024-04-23T10:24:55.846306+0000","last_fullsized":"2024-04-23T10:24:55.846306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:22:35.867252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846371+0000","last_change":"2024-04-23T10:24:53.495913+0000","last_active":"2024-04-23T10:24:55.846371+0000","last_peered":"2024-04-23T10:24:55.846371+0000","last_clean":"2024-04-23T10:24:55.846371+0000","last_became_active":"2024-04-23T10:24:53.495543+0000","last_became_peered":"2024-04-23T10:24:53.495543+0000","last_unstale":"2024-04-23T10:24:55.846371+0000","last_undegraded":"2024-04-23T10:24:55.846371+0000","last_fullsized":"2024-04-23T10:24:55.846371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:03:29.327759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.986801+0000","last_change":"2024-04-23T10:24:53.492305+0000","last_active":"2024-04-23T10:24:54.986801+0000","last_peered":"2024-04-23T10:24:54.986801+0000","last_clean":"2024-04-23T10:24:54.986801+0000","last_became_active":"2024-04-23T10:24:53.491980+0000","last_became_peered":"2024-04-23T10:24:53.491980+0000","last_unstale":"2024-04-23T10:24:54.986801+0000","last_undegraded":"2024-04-23T10:24:54.986801+0000","last_fullsized":"2024-04-23T10:24:54.986801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:34.987447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910148+0000","last_change":"2024-04-23T10:24:53.492464+0000","last_active":"2024-04-23T10:24:54.910148+0000","last_peered":"2024-04-23T10:24:54.910148+0000","last_clean":"2024-04-23T10:24:54.910148+0000","last_became_active":"2024-04-23T10:24:53.492156+0000","last_became_peered":"2024-04-23T10:24:53.492156+0000","last_unstale":"2024-04-23T10:24:54.910148+0000","last_undegraded":"2024-04-23T10:24:54.910148+0000","last_fullsized":"2024-04-23T10:24:54.910148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:07:15.414598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846391+0000","last_change":"2024-04-23T10:24:53.502208+0000","last_active":"2024-04-23T10:24:55.846391+0000","last_peered":"2024-04-23T10:24:55.846391+0000","last_clean":"2024-04-23T10:24:55.846391+0000","last_became_active":"2024-04-23T10:24:53.501921+0000","last_became_peered":"2024-04-23T10:24:53.501921+0000","last_unstale":"2024-04-23T10:24:55.846391+0000","last_undegraded":"2024-04-23T10:24:55.846391+0000","last_fullsized":"2024-04-23T10:24:55.846391+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:29:21.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846683+0000","last_change":"2024-04-23T10:24:53.495446+0000","last_active":"2024-04-23T10:24:55.846683+0000","last_peered":"2024-04-23T10:24:55.846683+0000","last_clean":"2024-04-23T10:24:55.846683+0000","last_became_active":"2024-04-23T10:24:53.495090+0000","last_became_peered":"2024-04-23T10:24:53.495090+0000","last_unstale":"2024-04-23T10:24:55.846683+0000","last_undegraded":"2024-04-23T10:24:55.846683+0000","last_fullsized":"2024-04-23T10:24:55.846683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:44:00.007468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.485361+0000","last_change":"2024-04-23T10:24:53.503390+0000","last_active":"2024-04-23T10:24:54.485361+0000","last_peered":"2024-04-23T10:24:54.485361+0000","last_clean":"2024-04-23T10:24:54.485361+0000","last_became_active":"2024-04-23T10:24:53.503057+0000","last_became_peered":"2024-04-23T10:24:53.503057+0000","last_unstale":"2024-04-23T10:24:54.485361+0000","last_undegraded":"2024-04-23T10:24:54.485361+0000","last_fullsized":"2024-04-23T10:24:54.485361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:19:39.950651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.490869+0000","last_change":"2024-04-23T10:24:53.498188+0000","last_active":"2024-04-23T10:24:54.490869+0000","last_peered":"2024-04-23T10:24:54.490869+0000","last_clean":"2024-04-23T10:24:54.490869+0000","last_became_active":"2024-04-23T10:24:53.497873+0000","last_became_peered":"2024-04-23T10:24:53.497873+0000","last_unstale":"2024-04-23T10:24:54.490869+0000","last_undegraded":"2024-04-23T10:24:54.490869+0000","last_fullsized":"2024-04-23T10:24:54.490869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:48:05.001361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.484961+0000","last_change":"2024-04-23T10:24:53.502260+0000","last_active":"2024-04-23T10:24:54.484961+0000","last_peered":"2024-04-23T10:24:54.484961+0000","last_clean":"2024-04-23T10:24:54.484961+0000","last_became_active":"2024-04-23T10:24:53.501525+0000","last_became_peered":"2024-04-23T10:24:53.501525+0000","last_unstale":"2024-04-23T10:24:54.484961+0000","last_undegraded":"2024-04-23T10:24:54.484961+0000","last_fullsized":"2024-04-23T10:24:54.484961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:04.379055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.394507+0000","last_change":"2024-04-23T10:24:53.499306+0000","last_active":"2024-04-23T10:24:55.394507+0000","last_peered":"2024-04-23T10:24:55.394507+0000","last_clean":"2024-04-23T10:24:55.394507+0000","last_became_active":"2024-04-23T10:24:53.496717+0000","last_became_peered":"2024-04-23T10:24:53.496717+0000","last_unstale":"2024-04-23T10:24:55.394507+0000","last_undegraded":"2024-04-23T10:24:55.394507+0000","last_fullsized":"2024-04-23T10:24:55.394507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:03:17.907117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.910191+0000","last_change":"2024-04-23T10:24:53.496330+0000","last_active":"2024-04-23T10:24:54.910191+0000","last_peered":"2024-04-23T10:24:54.910191+0000","last_clean":"2024-04-23T10:24:54.910191+0000","last_became_active":"2024-04-23T10:24:53.496021+0000","last_became_peered":"2024-04-23T10:24:53.496021+0000","last_unstale":"2024-04-23T10:24:54.910191+0000","last_undegraded":"2024-04-23T10:24:54.910191+0000","last_fullsized":"2024-04-23T10:24:54.910191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:10:59.340265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.846343+0000","last_change":"2024-04-23T10:24:53.501025+0000","last_active":"2024-04-23T10:24:55.846343+0000","last_peered":"2024-04-23T10:24:55.846343+0000","last_clean":"2024-04-23T10:24:55.846343+0000","last_became_active":"2024-04-23T10:24:53.500673+0000","last_became_peered":"2024-04-23T10:24:53.500673+0000","last_unstale":"2024-04-23T10:24:55.846343+0000","last_undegraded":"2024-04-23T10:24:55.846343+0000","last_fullsized":"2024-04-23T10:24:55.846343+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:07.728645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246478,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":48202,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":34,"num_read_kb":46,"num_write":173,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":95442,"data_compressed":3718,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350989,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":433581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612626,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1048576,"data_stored":1055658,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776152,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":443059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037789,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":933888,"data_stored":442777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299426,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":1034311,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462951,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":442151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":435193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":443629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411387,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":983040,"data_stored":465409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149749,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":442559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":442795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724588,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":999424,"data_stored":1033995,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34039,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34039,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":40556,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45504,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:25:01.061 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-23T10:25:01.062 INFO:tasks.cephadm:Setting up client nodes... 2024-04-23T10:25:01.062 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-23T10:25:01.349 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:01.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:01 smithi069 ceph-mon[29593]: from='client.24628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:25:01.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:01 smithi069 ceph-mon[29593]: pgmap v287: 97 pgs: 97 active+clean; 624 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 KiB/s wr, 25 op/s 2024-04-23T10:25:01.585 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:01 smithi069 ceph-mon[29593]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:25:01.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:01 smithi167 ceph-mon[32940]: from='client.24628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:25:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:01 smithi167 ceph-mon[32940]: pgmap v287: 97 pgs: 97 active+clean; 624 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 KiB/s wr, 25 op/s 2024-04-23T10:25:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:01 smithi167 ceph-mon[32940]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:25:01.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:01 smithi146 ceph-mon[32800]: from='client.24628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:25:01.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:01 smithi146 ceph-mon[32800]: pgmap v287: 97 pgs: 97 active+clean; 624 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 KiB/s wr, 25 op/s 2024-04-23T10:25:01.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:01 smithi146 ceph-mon[32800]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:25:03.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.071+0000 7f86bb8b7700 1 -- 172.21.15.69:0/1256221510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86b4103cb0 msgr2=0x7f86b4106140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:03.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.071+0000 7f86bb8b7700 1 --2- 172.21.15.69:0/1256221510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86b4103cb0 0x7f86b4106140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009990 tx=0x7f86a4009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:03.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.071+0000 7f86bb8b7700 1 -- 172.21.15.69:0/1256221510 shutdown_connections 2024-04-23T10:25:03.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.071+0000 7f86bb8b7700 1 --2- 172.21.15.69:0/1256221510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b4106680 0x7f86b4106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:03.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.071+0000 7f86bb8b7700 1 --2- 172.21.15.69:0/1256221510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86b4101340 0x7f86b4103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:03.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.071+0000 7f86bb8b7700 1 --2- 172.21.15.69:0/1256221510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86b4103cb0 0x7f86b4106140 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.071+0000 7f86bb8b7700 1 -- 172.21.15.69:0/1256221510 >> 172.21.15.69:0/1256221510 conn(0x7f86b40fcf60 msgr2=0x7f86b40ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.071+0000 7f86bb8b7700 1 -- 172.21.15.69:0/1256221510 shutdown_connections 2024-04-23T10:25:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.071+0000 7f86bb8b7700 1 -- 172.21.15.69:0/1256221510 wait complete. 2024-04-23T10:25:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86bb8b7700 1 Processor -- start 2024-04-23T10:25:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86bb8b7700 1 -- start start 2024-04-23T10:25:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86bb8b7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86b4101340 0x7f86b419f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86bb8b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b4103cb0 0x7f86b419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86bb8b7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86b4106680 0x7f86b41a6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86bb8b7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4114c90 con 0x7f86b4101340 2024-04-23T10:25:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86bb8b7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4114b10 con 0x7f86b4103cb0 2024-04-23T10:25:03.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86bb8b7700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4114e10 con 0x7f86b4106680 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86b9653700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86b4101340 0x7f86b419f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86b9653700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86b4101340 0x7f86b419f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42352/0 (socket says 172.21.15.69:42352) 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86b9653700 1 -- 172.21.15.69:0/120851434 learned_addr learned my addr 172.21.15.69:0/120851434 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86b8e52700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b4103cb0 0x7f86b419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86b9e54700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86b4106680 0x7f86b41a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86b9653700 1 -- 172.21.15.69:0/120851434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86b4106680 msgr2=0x7f86b41a6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86b9653700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86b4106680 0x7f86b41a6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86b9653700 1 -- 172.21.15.69:0/120851434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b4103cb0 msgr2=0x7f86b419f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86b9653700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b4103cb0 0x7f86b419f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86b9653700 1 -- 172.21.15.69:0/120851434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b41a6eb0 con 0x7f86b4101340 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.072+0000 7f86b9653700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86b4101340 0x7f86b419f250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f86b000b560 tx=0x7f86b000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:03.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.073+0000 7f86aa7fc700 1 -- 172.21.15.69:0/120851434 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0015020 con 0x7f86b4101340 2024-04-23T10:25:03.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.073+0000 7f86aa7fc700 1 -- 172.21.15.69:0/120851434 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86b0011d00 con 0x7f86b4101340 2024-04-23T10:25:03.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.073+0000 7f86bb8b7700 1 -- 172.21.15.69:0/120851434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b41a71a0 con 0x7f86b4101340 2024-04-23T10:25:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.073+0000 7f86bb8b7700 1 -- 172.21.15.69:0/120851434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b41a7760 con 0x7f86b4101340 2024-04-23T10:25:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.073+0000 7f86aa7fc700 1 -- 172.21.15.69:0/120851434 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0010e60 con 0x7f86b4101340 2024-04-23T10:25:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.074+0000 7f86bb8b7700 1 -- 172.21.15.69:0/120851434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b4050f80 con 0x7f86b4101340 2024-04-23T10:25:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.075+0000 7f86aa7fc700 1 -- 172.21.15.69:0/120851434 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f86b0018020 con 0x7f86b4101340 2024-04-23T10:25:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.075+0000 7f86aa7fc700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a00a3cd0 0x7f86a00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.076+0000 7f86b8e52700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a00a3cd0 0x7f86a00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.076+0000 7f86aa7fc700 1 -- 172.21.15.69:0/120851434 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f86b00cf9d0 con 0x7f86b4101340 2024-04-23T10:25:03.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.076+0000 7f86b8e52700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a00a3cd0 0x7f86a00a6190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f86a400b5c0 tx=0x7f86a4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:03.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.080+0000 7f86aa7fc700 1 -- 172.21.15.69:0/120851434 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f86b001f020 con 0x7f86b4101340 2024-04-23T10:25:03.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.362+0000 7f86bb8b7700 1 -- 172.21.15.69:0/120851434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f86b402e3c0 con 0x7f86b4101340 2024-04-23T10:25:03.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.367+0000 7f86aa7fc700 1 -- 172.21.15.69:0/120851434 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7f86b402e3c0 con 0x7f86b4101340 2024-04-23T10:25:03.366 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2024-04-23T10:25:03.366 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQB/jCdmL2y3FRAAof1wWqEvVetOmnQYppaTkg== 2024-04-23T10:25:03.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 -- 172.21.15.69:0/120851434 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a00a3cd0 msgr2=0x7f86a00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:03.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a00a3cd0 0x7f86a00a6190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f86a400b5c0 tx=0x7f86a4005fb0 comp rx=0 tx=0).stop 2024-04-23T10:25:03.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 -- 172.21.15.69:0/120851434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86b4101340 msgr2=0x7f86b419f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:03.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86b4101340 0x7f86b419f250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f86b000b560 tx=0x7f86b000b870 comp rx=0 tx=0).stop 2024-04-23T10:25:03.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 -- 172.21.15.69:0/120851434 shutdown_connections 2024-04-23T10:25:03.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f86a00a3cd0 0x7f86a00a6190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:03.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86b4106680 0x7f86b41a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:03.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86b4101340 0x7f86b419f250 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:03.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 --2- 172.21.15.69:0/120851434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86b4103cb0 0x7f86b419f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:03.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 -- 172.21.15.69:0/120851434 >> 172.21.15.69:0/120851434 conn(0x7f86b40fcf60 msgr2=0x7f86b4101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:03.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 -- 172.21.15.69:0/120851434 shutdown_connections 2024-04-23T10:25:03.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:03.370+0000 7f86bb8b7700 1 -- 172.21.15.69:0/120851434 wait complete. 2024-04-23T10:25:04.003 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:25:04.003 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-23T10:25:04.003 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-23T10:25:04.040 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-23T10:25:04.040 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-23T10:25:04.041 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-23T10:25:04.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:04 smithi069 ceph-mon[29593]: pgmap v288: 97 pgs: 97 active+clean; 626 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 KiB/s wr, 28 op/s 2024-04-23T10:25:04.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:04 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/120851434' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T10:25:04.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:04 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/120851434' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-23T10:25:04.327 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:04.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:04 smithi167 ceph-mon[32940]: pgmap v288: 97 pgs: 97 active+clean; 626 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 KiB/s wr, 28 op/s 2024-04-23T10:25:04.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:04 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/120851434' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T10:25:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:04 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/120851434' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-23T10:25:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:04 smithi146 ceph-mon[32800]: pgmap v288: 97 pgs: 97 active+clean; 626 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 KiB/s wr, 28 op/s 2024-04-23T10:25:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:04 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/120851434' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-23T10:25:04.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:04 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/120851434' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-23T10:25:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.012+0000 7f66b6aa3700 1 -- 172.21.15.69:0/1257195844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b0103450 msgr2=0x7f66b010f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.012+0000 7f66b6aa3700 1 --2- 172.21.15.69:0/1257195844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b0103450 0x7f66b010f8b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f66a800b0a0 tx=0x7f66a800b3b0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.012+0000 7f66b6aa3700 1 -- 172.21.15.69:0/1257195844 shutdown_connections 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 --2- 172.21.15.69:0/1257195844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b0103450 0x7f66b010f8b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 --2- 172.21.15.69:0/1257195844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66b0108a50 0x7f66b0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 --2- 172.21.15.69:0/1257195844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66b0102a90 0x7f66b0102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 -- 172.21.15.69:0/1257195844 >> 172.21.15.69:0/1257195844 conn(0x7f66b0079ba0 msgr2=0x7f66b0079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 -- 172.21.15.69:0/1257195844 shutdown_connections 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 -- 172.21.15.69:0/1257195844 wait complete. 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 Processor -- start 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 -- start start 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66b0102a90 0x7f66b0199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b0103450 0x7f66b01996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66b0108a50 0x7f66b019da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:06.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f66b0112da0 con 0x7f66b0103450 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66b0112c20 con 0x7f66b0108a50 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.013+0000 7f66b6aa3700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f66b0112f20 con 0x7f66b0102a90 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66affff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b0103450 0x7f66b01996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66affff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b0103450 0x7f66b01996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42364/0 (socket says 172.21.15.69:42364) 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66affff700 1 -- 172.21.15.69:0/503036885 learned_addr learned my addr 172.21.15.69:0/503036885 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66b483f700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66b0102a90 0x7f66b0199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66b5040700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66b0108a50 0x7f66b019da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66affff700 1 -- 172.21.15.69:0/503036885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66b0102a90 msgr2=0x7f66b0199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66affff700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66b0102a90 0x7f66b0199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66affff700 1 -- 172.21.15.69:0/503036885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66b0108a50 msgr2=0x7f66b019da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66affff700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66b0108a50 0x7f66b019da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66affff700 1 -- 172.21.15.69:0/503036885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b019e180 con 0x7f66b0103450 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66affff700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b0103450 0x7f66b01996b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f669c00d950 tx=0x7f669c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66adffb700 1 -- 172.21.15.69:0/503036885 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c016070 con 0x7f66b0103450 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66b6aa3700 1 -- 172.21.15.69:0/503036885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b019e470 con 0x7f66b0103450 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66adffb700 1 -- 172.21.15.69:0/503036885 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f669c00fd60 con 0x7f66b0103450 2024-04-23T10:25:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66adffb700 1 -- 172.21.15.69:0/503036885 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c00e610 con 0x7f66b0103450 2024-04-23T10:25:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.014+0000 7f66b6aa3700 1 -- 172.21.15.69:0/503036885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b01a5cf0 con 0x7f66b0103450 2024-04-23T10:25:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.015+0000 7f66b6aa3700 1 -- 172.21.15.69:0/503036885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b0069730 con 0x7f66b0103450 2024-04-23T10:25:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.017+0000 7f66adffb700 1 -- 172.21.15.69:0/503036885 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f669c019070 con 0x7f66b0103450 2024-04-23T10:25:06.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.017+0000 7f66adffb700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f66a00a3cd0 0x7f66a00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.017+0000 7f66b483f700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f66a00a3cd0 0x7f66a00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.018+0000 7f66adffb700 1 -- 172.21.15.69:0/503036885 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f669c0cfeb0 con 0x7f66b0103450 2024-04-23T10:25:06.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.018+0000 7f66b483f700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f66a00a3cd0 0x7f66a00a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f66a40045b0 tx=0x7f66a400b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:06.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.022+0000 7f66adffb700 1 -- 172.21.15.69:0/503036885 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f669c09c8e0 con 0x7f66b0103450 2024-04-23T10:25:06.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.280+0000 7f66b6aa3700 1 -- 172.21.15.69:0/503036885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f66b002df80 con 0x7f66b0103450 2024-04-23T10:25:06.279 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:06 smithi069 ceph-mon[29593]: pgmap v289: 97 pgs: 97 active+clean; 631 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 30 op/s 2024-04-23T10:25:06.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.285+0000 7f66adffb700 1 -- 172.21.15.69:0/503036885 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264995 (secure 0 0 0) 0x7f669c09c1e0 con 0x7f66b0103450 2024-04-23T10:25:06.288 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:25:06.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.288+0000 7f66b6aa3700 1 -- 172.21.15.69:0/503036885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f66a00a3cd0 msgr2=0x7f66a00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:06.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.288+0000 7f66b6aa3700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f66a00a3cd0 0x7f66a00a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f66a40045b0 tx=0x7f66a400b3c0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.288+0000 7f66b6aa3700 1 -- 172.21.15.69:0/503036885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b0103450 msgr2=0x7f66b01996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:06.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.288+0000 7f66b6aa3700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b0103450 0x7f66b01996b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f669c00d950 tx=0x7f669c00dc60 comp rx=0 tx=0).stop 2024-04-23T10:25:06.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.288+0000 7f66b6aa3700 1 -- 172.21.15.69:0/503036885 shutdown_connections 2024-04-23T10:25:06.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.288+0000 7f66b6aa3700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f66a00a3cd0 0x7f66a00a6190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.288+0000 7f66b6aa3700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66b0108a50 0x7f66b019da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.288+0000 7f66b6aa3700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66b0102a90 0x7f66b0199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.288+0000 7f66b6aa3700 1 --2- 172.21.15.69:0/503036885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b0103450 0x7f66b01996b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.288+0000 7f66b6aa3700 1 -- 172.21.15.69:0/503036885 >> 172.21.15.69:0/503036885 conn(0x7f66b0079ba0 msgr2=0x7f66b0101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:06.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.289+0000 7f66b6aa3700 1 -- 172.21.15.69:0/503036885 shutdown_connections 2024-04-23T10:25:06.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:06.289+0000 7f66b6aa3700 1 -- 172.21.15.69:0/503036885 wait complete. 2024-04-23T10:25:06.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:06 smithi167 ceph-mon[32940]: pgmap v289: 97 pgs: 97 active+clean; 631 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 30 op/s 2024-04-23T10:25:06.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:06 smithi146 ceph-mon[32800]: pgmap v289: 97 pgs: 97 active+clean; 631 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 30 op/s 2024-04-23T10:25:07.000 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":847729550},{"type":"v1","addr":"172.21.15.69:6801","nonce":847729550}]},"active_addr":"172.21.15.69:6801/847729550","active_change":"2024-04-23T10:17:58.923899+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.69:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":1024244898}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3272003821}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":1462548780}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":2621408239}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3946868691}]}]} 2024-04-23T10:25:07.006 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-23T10:25:07.006 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-23T10:25:07.006 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-23T10:25:07.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:07 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/503036885' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-23T10:25:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:07.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:07 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/503036885' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-23T10:25:07.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:07 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/503036885' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-23T10:25:08.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:08 smithi167 ceph-mon[32940]: pgmap v290: 97 pgs: 97 active+clean; 631 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.0 KiB/s wr, 26 op/s 2024-04-23T10:25:08.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:08 smithi069 ceph-mon[29593]: pgmap v290: 97 pgs: 97 active+clean; 631 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.0 KiB/s wr, 26 op/s 2024-04-23T10:25:08.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:08 smithi146 ceph-mon[32800]: pgmap v290: 97 pgs: 97 active+clean; 631 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.0 KiB/s wr, 26 op/s 2024-04-23T10:25:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.887+0000 7f840523f700 1 -- 172.21.15.69:0/442954940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8400103450 msgr2=0x7f840010f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.887+0000 7f840523f700 1 --2- 172.21.15.69:0/442954940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8400103450 0x7f840010f8b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f83f800b0a0 tx=0x7f83f800b3b0 comp rx=0 tx=0).stop 2024-04-23T10:25:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.887+0000 7f840523f700 1 -- 172.21.15.69:0/442954940 shutdown_connections 2024-04-23T10:25:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.887+0000 7f840523f700 1 --2- 172.21.15.69:0/442954940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8400103450 0x7f840010f8b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.887+0000 7f840523f700 1 --2- 172.21.15.69:0/442954940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8400108a50 0x7f8400108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.887+0000 7f840523f700 1 --2- 172.21.15.69:0/442954940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8400102a90 0x7f8400102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.887+0000 7f840523f700 1 -- 172.21.15.69:0/442954940 >> 172.21.15.69:0/442954940 conn(0x7f8400079ba0 msgr2=0x7f8400079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.887+0000 7f840523f700 1 -- 172.21.15.69:0/442954940 shutdown_connections 2024-04-23T10:25:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.887+0000 7f840523f700 1 -- 172.21.15.69:0/442954940 wait complete. 2024-04-23T10:25:08.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.888+0000 7f840523f700 1 Processor -- start 2024-04-23T10:25:08.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.888+0000 7f840523f700 1 -- start start 2024-04-23T10:25:08.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.888+0000 7f840523f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8400102a90 0x7f840019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:08.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.888+0000 7f840523f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8400103450 0x7f840019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:08.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.888+0000 7f840523f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8400108a50 0x7f840019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f840523f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8400112e20 con 0x7f8400103450 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f840523f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8400112ca0 con 0x7f8400108a50 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f840523f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8400112fa0 con 0x7f8400102a90 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83fe59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8400103450 0x7f840019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83fe59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8400103450 0x7f840019b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42374/0 (socket says 172.21.15.69:42374) 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83fe59c700 1 -- 172.21.15.69:0/2912274983 learned_addr learned my addr 172.21.15.69:0/2912274983 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83fed9d700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8400102a90 0x7f840019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83ff59e700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8400108a50 0x7f840019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83fe59c700 1 -- 172.21.15.69:0/2912274983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8400102a90 msgr2=0x7f840019b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83fe59c700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8400102a90 0x7f840019b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83fe59c700 1 -- 172.21.15.69:0/2912274983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8400108a50 msgr2=0x7f840019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83fe59c700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8400108a50 0x7f840019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83fe59c700 1 -- 172.21.15.69:0/2912274983 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84001a04c0 con 0x7f8400103450 2024-04-23T10:25:08.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83ff59e700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8400108a50 0x7f840019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:08.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83fe59c700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8400103450 0x7f840019b9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f83f400b530 tx=0x7f83f400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:08.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83e7fff700 1 -- 172.21.15.69:0/2912274983 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f4015020 con 0x7f8400103450 2024-04-23T10:25:08.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f840523f700 1 -- 172.21.15.69:0/2912274983 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84001a07b0 con 0x7f8400103450 2024-04-23T10:25:08.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83e7fff700 1 -- 172.21.15.69:0/2912274983 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f83f4011d00 con 0x7f8400103450 2024-04-23T10:25:08.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f83e7fff700 1 -- 172.21.15.69:0/2912274983 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f400f2e0 con 0x7f8400103450 2024-04-23T10:25:08.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.889+0000 7f840523f700 1 -- 172.21.15.69:0/2912274983 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84001a8030 con 0x7f8400103450 2024-04-23T10:25:08.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.890+0000 7f840523f700 1 -- 172.21.15.69:0/2912274983 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8400069730 con 0x7f8400103450 2024-04-23T10:25:08.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.891+0000 7f83e7fff700 1 -- 172.21.15.69:0/2912274983 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f83f4018020 con 0x7f8400103450 2024-04-23T10:25:08.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.892+0000 7f83e7fff700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83e80a3cd0 0x7f83e80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:08.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.892+0000 7f83fed9d700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83e80a3cd0 0x7f83e80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:08.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.892+0000 7f83e7fff700 1 -- 172.21.15.69:0/2912274983 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f83f40d0060 con 0x7f8400103450 2024-04-23T10:25:08.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.893+0000 7f83fed9d700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83e80a3cd0 0x7f83e80a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009a10 tx=0x7f83f0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:08.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:08.896+0000 7f83e7fff700 1 -- 172.21.15.69:0/2912274983 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f83f401f020 con 0x7f8400103450 2024-04-23T10:25:09.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.096+0000 7f840523f700 1 -- 172.21.15.69:0/2912274983 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84001a82c0 con 0x7f8400103450 2024-04-23T10:25:09.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.098+0000 7f83e7fff700 1 -- 172.21.15.69:0/2912274983 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22220 (secure 0 0 0) 0x7f83f409cba0 con 0x7f8400103450 2024-04-23T10:25:09.097 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:25:09.097 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":86,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:24:54.477485+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:25:09.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 -- 172.21.15.69:0/2912274983 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83e80a3cd0 msgr2=0x7f83e80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:09.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83e80a3cd0 0x7f83e80a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009a10 tx=0x7f83f0009190 comp rx=0 tx=0).stop 2024-04-23T10:25:09.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 -- 172.21.15.69:0/2912274983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8400103450 msgr2=0x7f840019b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:09.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8400103450 0x7f840019b9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f83f400b530 tx=0x7f83f400b840 comp rx=0 tx=0).stop 2024-04-23T10:25:09.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 -- 172.21.15.69:0/2912274983 shutdown_connections 2024-04-23T10:25:09.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83e80a3cd0 0x7f83e80a6190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:09.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8400108a50 0x7f840019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:09.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8400102a90 0x7f840019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:09.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 --2- 172.21.15.69:0/2912274983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8400103450 0x7f840019b9f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:09.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 -- 172.21.15.69:0/2912274983 >> 172.21.15.69:0/2912274983 conn(0x7f8400079ba0 msgr2=0x7f8400074f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:09.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 -- 172.21.15.69:0/2912274983 shutdown_connections 2024-04-23T10:25:09.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:09.100+0000 7f840523f700 1 -- 172.21.15.69:0/2912274983 wait complete. 2024-04-23T10:25:09.741 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-23T10:25:09.742 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-23T10:25:09.979 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:10.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:10 smithi167 ceph-mon[32940]: pgmap v291: 97 pgs: 97 active+clean; 631 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 8.1 KiB/s wr, 24 op/s 2024-04-23T10:25:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:10 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2912274983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:25:10.377 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:10 smithi069 ceph-mon[29593]: pgmap v291: 97 pgs: 97 active+clean; 631 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 8.1 KiB/s wr, 24 op/s 2024-04-23T10:25:10.377 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:10 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2912274983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:25:10.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:10 smithi146 ceph-mon[32800]: pgmap v291: 97 pgs: 97 active+clean; 631 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 8.1 KiB/s wr, 24 op/s 2024-04-23T10:25:10.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:10 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2912274983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:25:11.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.578+0000 7fa43219e700 1 -- 172.21.15.69:0/3985572080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa42c108960 msgr2=0x7fa42c108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:11.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.578+0000 7fa43219e700 1 --2- 172.21.15.69:0/3985572080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa42c108960 0x7fa42c108d40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa42400b0a0 tx=0x7fa42400b3b0 comp rx=0 tx=0).stop 2024-04-23T10:25:11.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.578+0000 7fa43219e700 1 -- 172.21.15.69:0/3985572080 shutdown_connections 2024-04-23T10:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.578+0000 7fa43219e700 1 --2- 172.21.15.69:0/3985572080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa42c103320 0x7fa42c10f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.578+0000 7fa43219e700 1 --2- 172.21.15.69:0/3985572080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa42c108960 0x7fa42c108d40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.578+0000 7fa43219e700 1 --2- 172.21.15.69:0/3985572080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42c102960 0x7fa42c102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.578+0000 7fa43219e700 1 -- 172.21.15.69:0/3985572080 >> 172.21.15.69:0/3985572080 conn(0x7fa42c0fe490 msgr2=0x7fa42c1008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.578+0000 7fa43219e700 1 -- 172.21.15.69:0/3985572080 shutdown_connections 2024-04-23T10:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.578+0000 7fa43219e700 1 -- 172.21.15.69:0/3985572080 wait complete. 2024-04-23T10:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43219e700 1 Processor -- start 2024-04-23T10:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43219e700 1 -- start start 2024-04-23T10:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43219e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa42c102960 0x7fa42c199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43219e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42c103320 0x7fa42c199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43219e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa42c108960 0x7fa42c19d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43219e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c112c60 con 0x7fa42c102960 2024-04-23T10:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43219e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c112ae0 con 0x7fa42c108960 2024-04-23T10:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43219e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c112de0 con 0x7fa42c103320 2024-04-23T10:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43119c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa42c102960 0x7fa42c199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43119c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa42c102960 0x7fa42c199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43870/0 (socket says 172.21.15.69:43870) 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43119c700 1 -- 172.21.15.69:0/2852438551 learned_addr learned my addr 172.21.15.69:0/2852438551 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43199d700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa42c108960 0x7fa42c19d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43099b700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42c103320 0x7fa42c199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43119c700 1 -- 172.21.15.69:0/2852438551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42c103320 msgr2=0x7fa42c199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43119c700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42c103320 0x7fa42c199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43119c700 1 -- 172.21.15.69:0/2852438551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa42c108960 msgr2=0x7fa42c19d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43119c700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa42c108960 0x7fa42c19d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43119c700 1 -- 172.21.15.69:0/2852438551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42c19dfd0 con 0x7fa42c102960 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43199d700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa42c108960 0x7fa42c19d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.579+0000 7fa43099b700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42c103320 0x7fa42c199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.580+0000 7fa43119c700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa42c102960 0x7fa42c199010 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa42400b070 tx=0x7fa424007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.580+0000 7fa4227fc700 1 -- 172.21.15.69:0/2852438551 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424021020 con 0x7fa42c102960 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.580+0000 7fa43219e700 1 -- 172.21.15.69:0/2852438551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42c19e260 con 0x7fa42c102960 2024-04-23T10:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.580+0000 7fa4227fc700 1 -- 172.21.15.69:0/2852438551 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa424007e10 con 0x7fa42c102960 2024-04-23T10:25:11.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.580+0000 7fa4227fc700 1 -- 172.21.15.69:0/2852438551 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42401bd80 con 0x7fa42c102960 2024-04-23T10:25:11.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.580+0000 7fa43219e700 1 -- 172.21.15.69:0/2852438551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa42c1a5b40 con 0x7fa42c102960 2024-04-23T10:25:11.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.581+0000 7fa43219e700 1 -- 172.21.15.69:0/2852438551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa42c10aef0 con 0x7fa42c102960 2024-04-23T10:25:11.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.582+0000 7fa4227fc700 1 -- 172.21.15.69:0/2852438551 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa424024020 con 0x7fa42c102960 2024-04-23T10:25:11.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.582+0000 7fa4227fc700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa4180a3cd0 0x7fa4180a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:11.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.583+0000 7fa43099b700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa4180a3cd0 0x7fa4180a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:11.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.583+0000 7fa4227fc700 1 -- 172.21.15.69:0/2852438551 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fa42400f020 con 0x7fa42c102960 2024-04-23T10:25:11.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.583+0000 7fa43099b700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa4180a3cd0 0x7fa4180a6190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa41c005fd0 tx=0x7fa41c005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:11.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.587+0000 7fa4227fc700 1 -- 172.21.15.69:0/2852438551 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa42409e320 con 0x7fa42c102960 2024-04-23T10:25:11.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.789+0000 7fa43219e700 1 -- 172.21.15.69:0/2852438551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa42c19a320 con 0x7fa42c102960 2024-04-23T10:25:11.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.791+0000 7fa4227fc700 1 -- 172.21.15.69:0/2852438551 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22220 (secure 0 0 0) 0x7fa42409dc20 con 0x7fa42c102960 2024-04-23T10:25:11.791 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:25:11.791 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":86,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:24:54.477485+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:25:11.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 -- 172.21.15.69:0/2852438551 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa4180a3cd0 msgr2=0x7fa4180a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:11.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa4180a3cd0 0x7fa4180a6190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa41c005fd0 tx=0x7fa41c005e20 comp rx=0 tx=0).stop 2024-04-23T10:25:11.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 -- 172.21.15.69:0/2852438551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa42c102960 msgr2=0x7fa42c199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:11.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa42c102960 0x7fa42c199010 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa42400b070 tx=0x7fa424007b40 comp rx=0 tx=0).stop 2024-04-23T10:25:11.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 -- 172.21.15.69:0/2852438551 shutdown_connections 2024-04-23T10:25:11.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa4180a3cd0 0x7fa4180a6190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:11.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa42c108960 0x7fa42c19d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:11.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa42c102960 0x7fa42c199010 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:11.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 --2- 172.21.15.69:0/2852438551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa42c103320 0x7fa42c199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:11.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 -- 172.21.15.69:0/2852438551 >> 172.21.15.69:0/2852438551 conn(0x7fa42c0fe490 msgr2=0x7fa42c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:11.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 -- 172.21.15.69:0/2852438551 shutdown_connections 2024-04-23T10:25:11.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:11.793+0000 7fa43219e700 1 -- 172.21.15.69:0/2852438551 wait complete. 2024-04-23T10:25:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:12 smithi167 ceph-mon[32940]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 KiB/s wr, 20 op/s 2024-04-23T10:25:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:12 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2852438551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:25:12.423 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:12 smithi069 ceph-mon[29593]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 KiB/s wr, 20 op/s 2024-04-23T10:25:12.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:12 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2852438551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:25:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:12 smithi146 ceph-mon[32800]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 KiB/s wr, 20 op/s 2024-04-23T10:25:12.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:12 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2852438551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:25:12.452 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-23T10:25:12.452 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-23T10:25:12.453 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-23T10:25:12.453 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-23T10:25:12.454 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-23T10:25:12.455 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-23T10:25:12.455 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-23T10:25:12.456 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-23T10:25:12.456 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-23T10:25:12.457 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-23T10:25:12.457 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-23T10:25:12.458 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-23T10:25:13.109 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:14.023 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:14.027 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:14.028 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:14.028 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:14.029 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:14.031 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:14.039 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:14.040 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:14.040 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:14.040 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:14.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:14 smithi167 ceph-mon[32940]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.2 KiB/s wr, 15 op/s 2024-04-23T10:25:14.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:14 smithi146 ceph-mon[32800]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.2 KiB/s wr, 15 op/s 2024-04-23T10:25:14.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:14 smithi069 ceph-mon[29593]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.2 KiB/s wr, 15 op/s 2024-04-23T10:25:14.446 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:16.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:16 smithi167 ceph-mon[32940]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-23T10:25:16.417 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:16 smithi069 ceph-mon[29593]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-23T10:25:16.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:16 smithi146 ceph-mon[32800]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-23T10:25:18.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:18 smithi069 ceph-mon[29593]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-23T10:25:18.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:18 smithi167 ceph-mon[32940]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-23T10:25:18.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:18 smithi146 ceph-mon[32800]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.771+0000 7f19b765c700 1 -- 172.21.15.69:0/2928714464 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b01034b0 msgr2=0x7f19b010f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.771+0000 7f19b765c700 1 --2- 172.21.15.69:0/2928714464 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b01034b0 0x7f19b010f920 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f19a800b0d0 tx=0x7f19a800b3e0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.771+0000 7f19b765c700 1 -- 172.21.15.69:0/2928714464 shutdown_connections 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.771+0000 7f19b765c700 1 --2- 172.21.15.69:0/2928714464 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b01034b0 0x7f19b010f920 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.771+0000 7f19b765c700 1 --2- 172.21.15.69:0/2928714464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0107940 0x7f19b0107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.771+0000 7f19b765c700 1 --2- 172.21.15.69:0/2928714464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0102af0 0x7f19b0102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.771+0000 7f19b765c700 1 -- 172.21.15.69:0/2928714464 >> 172.21.15.69:0/2928714464 conn(0x7f19b0079ba0 msgr2=0x7f19b0079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.771+0000 7f19b765c700 1 -- 172.21.15.69:0/2928714464 shutdown_connections 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.771+0000 7f19b765c700 1 -- 172.21.15.69:0/2928714464 wait complete. 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b765c700 1 Processor -- start 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b765c700 1 -- start start 2024-04-23T10:25:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b765c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0102af0 0x7f19b01991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b765c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b01034b0 0x7f19b01996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b765c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0107940 0x7f19b019da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b765c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0112da0 con 0x7f19b01034b0 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b765c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0112c20 con 0x7f19b0107940 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b765c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0112f20 con 0x7f19b0102af0 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b4bf7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b01034b0 0x7f19b01996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b4bf7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b01034b0 0x7f19b01996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45138/0 (socket says 172.21.15.69:45138) 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b4bf7700 1 -- 172.21.15.69:0/1978171912 learned_addr learned my addr 172.21.15.69:0/1978171912 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b5bf9700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0107940 0x7f19b019da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.772+0000 7f19b53f8700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0102af0 0x7f19b01991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.773+0000 7f19b4bf7700 1 -- 172.21.15.69:0/1978171912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0102af0 msgr2=0x7f19b01991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.773+0000 7f19b4bf7700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0102af0 0x7f19b01991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.773+0000 7f19b4bf7700 1 -- 172.21.15.69:0/1978171912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0107940 msgr2=0x7f19b019da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.773+0000 7f19b4bf7700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0107940 0x7f19b019da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.773+0000 7f19b4bf7700 1 -- 172.21.15.69:0/1978171912 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b019e170 con 0x7f19b01034b0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.773+0000 7f19b4bf7700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b01034b0 0x7f19b01996f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00d980 tx=0x7f19ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.773+0000 7f19a67fc700 1 -- 172.21.15.69:0/1978171912 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac017070 con 0x7f19b01034b0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.773+0000 7f19a67fc700 1 -- 172.21.15.69:0/1978171912 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f19ac005020 con 0x7f19b01034b0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.773+0000 7f19b765c700 1 -- 172.21.15.69:0/1978171912 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b019e460 con 0x7f19b01034b0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.773+0000 7f19a67fc700 1 -- 172.21.15.69:0/1978171912 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac00fb30 con 0x7f19b01034b0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.773+0000 7f19b765c700 1 -- 172.21.15.69:0/1978171912 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b01a5ce0 con 0x7f19b01034b0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.774+0000 7f19b765c700 1 -- 172.21.15.69:0/1978171912 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19b00631d0 con 0x7f19b01034b0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.775+0000 7f19a67fc700 1 -- 172.21.15.69:0/1978171912 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f19ac0051d0 con 0x7f19b01034b0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.776+0000 7f19a67fc700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f199c0a3cd0 0x7f199c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.776+0000 7f19b53f8700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f199c0a3cd0 0x7f199c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.776+0000 7f19a67fc700 1 -- 172.21.15.69:0/1978171912 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f19ac0d0740 con 0x7f19b01034b0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.776+0000 7f19a67fc700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957] conn(0x7f199c0ad4b0 0x7f199c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.776+0000 7f19a67fc700 1 -- 172.21.15.69:0/1978171912 --> [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f199c0aff80 con 0x7f199c0ad4b0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.776+0000 7f19a67fc700 1 -- 172.21.15.69:0/1978171912 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f19ac0d0c20 con 0x7f19b01034b0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.776+0000 7f19b53f8700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f199c0a3cd0 0x7f199c0a6190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f19a0005950 tx=0x7f19a000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:19.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.776+0000 7f19b5bf9700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957] conn(0x7f199c0ad4b0 0x7f199c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:19.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.777+0000 7f19b5bf9700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957] conn(0x7f199c0ad4b0 0x7f199c0af8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:19.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.778+0000 7f19a67fc700 1 -- 172.21.15.69:0/1978171912 <== osd.1 v2:172.21.15.146:6800/3367484957 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f199c0aff80 con 0x7f199c0ad4b0 2024-04-23T10:25:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.794+0000 7f19b765c700 1 -- 172.21.15.69:0/1978171912 --> [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f19b0063650 con 0x7f199c0ad4b0 2024-04-23T10:25:19.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19a67fc700 1 -- 172.21.15.69:0/1978171912 <== osd.1 v2:172.21.15.146:6800/3367484957 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f19b0063650 con 0x7f199c0ad4b0 2024-04-23T10:25:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19b765c700 1 -- 172.21.15.69:0/1978171912 >> [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957] conn(0x7f199c0ad4b0 msgr2=0x7f199c0af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19b765c700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957] conn(0x7f199c0ad4b0 0x7f199c0af8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:19.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19b765c700 1 -- 172.21.15.69:0/1978171912 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f199c0a3cd0 msgr2=0x7f199c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19b765c700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f199c0a3cd0 0x7f199c0a6190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f19a0005950 tx=0x7f19a000b410 comp rx=0 tx=0).stop 2024-04-23T10:25:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19b765c700 1 -- 172.21.15.69:0/1978171912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b01034b0 msgr2=0x7f19b01996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19b765c700 1 --2- 172.21.15.69:0/1978171912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b01034b0 0x7f19b01996f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00d980 tx=0x7f19ac00dc90 comp rx=0 tx=0).stop 2024-04-23T10:25:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19b5bf9700 1 -- 172.21.15.69:0/1978171912 reap_dead start 2024-04-23T10:25:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19b765c700 1 -- 172.21.15.69:0/1978171912 shutdown_connections 2024-04-23T10:25:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19b765c700 1 -- 172.21.15.69:0/1978171912 >> 172.21.15.69:0/1978171912 conn(0x7f19b0079ba0 msgr2=0x7f19b0100aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19b765c700 1 -- 172.21.15.69:0/1978171912 shutdown_connections 2024-04-23T10:25:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:19.795+0000 7f19b765c700 1 -- 172.21.15.69:0/1978171912 wait complete. 2024-04-23T10:25:20.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:20 smithi167 ceph-mon[32940]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-23T10:25:20.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:20 smithi146 ceph-mon[32800]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-23T10:25:20.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:20 smithi069 ceph-mon[29593]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-23T10:25:22.376 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:22 smithi069 ceph-mon[29593]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-23T10:25:22.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:22 smithi146 ceph-mon[32800]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-23T10:25:22.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:22 smithi167 ceph-mon[32940]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.682+0000 7f36721a8700 1 -- 172.21.15.69:0/3763568675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f366c101940 msgr2=0x7f366c101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.682+0000 7f36721a8700 1 --2- 172.21.15.69:0/3763568675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f366c101940 0x7f366c101dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f365c009990 tx=0x7f365c009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.682+0000 7f36721a8700 1 -- 172.21.15.69:0/3763568675 shutdown_connections 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.682+0000 7f36721a8700 1 --2- 172.21.15.69:0/3763568675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f366c102300 0x7f366c10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.682+0000 7f36721a8700 1 --2- 172.21.15.69:0/3763568675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c107990 0x7f366c107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.682+0000 7f36721a8700 1 --2- 172.21.15.69:0/3763568675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f366c101940 0x7f366c101dc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.682+0000 7f36721a8700 1 -- 172.21.15.69:0/3763568675 >> 172.21.15.69:0/3763568675 conn(0x7f366c0788f0 msgr2=0x7f366c078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.682+0000 7f36721a8700 1 -- 172.21.15.69:0/3763568675 shutdown_connections 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.682+0000 7f36721a8700 1 -- 172.21.15.69:0/3763568675 wait complete. 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.683+0000 7f36721a8700 1 Processor -- start 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.683+0000 7f36721a8700 1 -- start start 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.683+0000 7f36721a8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f366c101940 0x7f366c103860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:22.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.683+0000 7f36721a8700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c102300 0x7f366c103da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.683+0000 7f36721a8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f366c107990 0x7f366c1042e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.683+0000 7f36721a8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f366c111c70 con 0x7f366c107990 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.683+0000 7f36721a8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f366c111af0 con 0x7f366c101940 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.683+0000 7f36721a8700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f366c111df0 con 0x7f366c102300 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f366c107990 0x7f366c1042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f366c107990 0x7f366c1042e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45164/0 (socket says 172.21.15.69:45164) 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366bfff700 1 -- 172.21.15.69:0/3694651285 learned_addr learned my addr 172.21.15.69:0/3694651285 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366affd700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c102300 0x7f366c103da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366b7fe700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f366c101940 0x7f366c103860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366bfff700 1 -- 172.21.15.69:0/3694651285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c102300 msgr2=0x7f366c103da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366bfff700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f366c102300 0x7f366c103da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366bfff700 1 -- 172.21.15.69:0/3694651285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f366c101940 msgr2=0x7f366c103860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366bfff700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f366c101940 0x7f366c103860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:22.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366bfff700 1 -- 172.21.15.69:0/3694651285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c1a7740 con 0x7f366c107990 2024-04-23T10:25:22.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366b7fe700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f366c101940 0x7f366c103860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:22.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f366bfff700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f366c107990 0x7f366c1042e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3664007ee0 tx=0x7f366400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:22.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f3668ff9700 1 -- 172.21.15.69:0/3694651285 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366400ddd0 con 0x7f366c107990 2024-04-23T10:25:22.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f36721a8700 1 -- 172.21.15.69:0/3694651285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366c1a7a30 con 0x7f366c107990 2024-04-23T10:25:22.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f3668ff9700 1 -- 172.21.15.69:0/3694651285 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3664004020 con 0x7f366c107990 2024-04-23T10:25:22.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f3668ff9700 1 -- 172.21.15.69:0/3694651285 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664015660 con 0x7f366c107990 2024-04-23T10:25:22.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.684+0000 7f36721a8700 1 -- 172.21.15.69:0/3694651285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366c1a7ef0 con 0x7f366c107990 2024-04-23T10:25:22.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.685+0000 7f36721a8700 1 -- 172.21.15.69:0/3694651285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f366c06a970 con 0x7f366c107990 2024-04-23T10:25:22.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.686+0000 7f3668ff9700 1 -- 172.21.15.69:0/3694651285 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f36640041d0 con 0x7f366c107990 2024-04-23T10:25:22.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.687+0000 7f3668ff9700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f36540a3cd0 0x7f36540a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:22.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.687+0000 7f3668ff9700 1 -- 172.21.15.69:0/3694651285 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f36640d0990 con 0x7f366c107990 2024-04-23T10:25:22.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.687+0000 7f366b7fe700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f36540a3cd0 0x7f36540a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:22.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.687+0000 7f3668ff9700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413] conn(0x7f36540ad4b0 0x7f36540af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:22.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.687+0000 7f3668ff9700 1 -- 172.21.15.69:0/3694651285 --> [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36540aff80 con 0x7f36540ad4b0 2024-04-23T10:25:22.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.687+0000 7f3668ff9700 1 -- 172.21.15.69:0/3694651285 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f36640d0e70 con 0x7f366c107990 2024-04-23T10:25:22.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.687+0000 7f366affd700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413] conn(0x7f36540ad4b0 0x7f36540af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:22.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.687+0000 7f366b7fe700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f36540a3cd0 0x7f36540a6190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3660005e10 tx=0x7f3660005d80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:22.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.688+0000 7f366affd700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413] conn(0x7f36540ad4b0 0x7f36540af8d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:22.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.688+0000 7f3668ff9700 1 -- 172.21.15.69:0/3694651285 <== osd.6 v2:172.21.15.69:6818/556723413 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f36540aff80 con 0x7f36540ad4b0 2024-04-23T10:25:22.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.705+0000 7f36721a8700 1 -- 172.21.15.69:0/3694651285 --> [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f366c103060 con 0x7f36540ad4b0 2024-04-23T10:25:22.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.705+0000 7f3668ff9700 1 -- 172.21.15.69:0/3694651285 <== osd.6 v2:172.21.15.69:6818/556723413 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f366c103060 con 0x7f36540ad4b0 2024-04-23T10:25:22.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.705+0000 7f36721a8700 1 -- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413] conn(0x7f36540ad4b0 msgr2=0x7f36540af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:22.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.705+0000 7f36721a8700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413] conn(0x7f36540ad4b0 0x7f36540af8d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:22.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.705+0000 7f36721a8700 1 -- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f36540a3cd0 msgr2=0x7f36540a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:22.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.705+0000 7f36721a8700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f36540a3cd0 0x7f36540a6190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3660005e10 tx=0x7f3660005d80 comp rx=0 tx=0).stop 2024-04-23T10:25:22.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.705+0000 7f36721a8700 1 -- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f366c107990 msgr2=0x7f366c1042e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:22.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.705+0000 7f36721a8700 1 --2- 172.21.15.69:0/3694651285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f366c107990 0x7f366c1042e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3664007ee0 tx=0x7f366400d3b0 comp rx=0 tx=0).stop 2024-04-23T10:25:22.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.706+0000 7f366bfff700 1 -- 172.21.15.69:0/3694651285 reap_dead start 2024-04-23T10:25:22.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.706+0000 7f36721a8700 1 -- 172.21.15.69:0/3694651285 shutdown_connections 2024-04-23T10:25:22.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.706+0000 7f36721a8700 1 -- 172.21.15.69:0/3694651285 >> 172.21.15.69:0/3694651285 conn(0x7f366c0788f0 msgr2=0x7f366c105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:22.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.706+0000 7f36721a8700 1 -- 172.21.15.69:0/3694651285 shutdown_connections 2024-04-23T10:25:22.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:22.706+0000 7f36721a8700 1 -- 172.21.15.69:0/3694651285 wait complete. 2024-04-23T10:25:23.397 INFO:teuthology.orchestra.run.smithi069.stdout:201863462957 2024-04-23T10:25:23.398 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-23T10:25:24.237 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:24 smithi069 ceph-mon[29593]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-04-23T10:25:24.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:24 smithi167 ceph-mon[32940]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-04-23T10:25:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:24 smithi146 ceph-mon[32800]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-04-23T10:25:24.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.754+0000 7f5bfea17700 1 -- 172.21.15.69:0/4118113388 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bf81023a0 msgr2=0x7f5bf8102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.754+0000 7f5bfea17700 1 --2- 172.21.15.69:0/4118113388 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bf81023a0 0x7f5bf8102780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5be80099c0 tx=0x7f5be8009cd0 comp rx=0 tx=0).stop 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.754+0000 7f5bfea17700 1 -- 172.21.15.69:0/4118113388 shutdown_connections 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.754+0000 7f5bfea17700 1 --2- 172.21.15.69:0/4118113388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bf8106cc0 0x7f5bf810e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.754+0000 7f5bfea17700 1 --2- 172.21.15.69:0/4118113388 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bf81023a0 0x7f5bf8102780 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.754+0000 7f5bfea17700 1 --2- 172.21.15.69:0/4118113388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf8102d50 0x7f5bf81065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.754+0000 7f5bfea17700 1 -- 172.21.15.69:0/4118113388 >> 172.21.15.69:0/4118113388 conn(0x7f5bf8077fb0 msgr2=0x7f5bf80ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.754+0000 7f5bfea17700 1 -- 172.21.15.69:0/4118113388 shutdown_connections 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.754+0000 7f5bfea17700 1 -- 172.21.15.69:0/4118113388 wait complete. 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.754+0000 7f5bfea17700 1 Processor -- start 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.754+0000 7f5bfea17700 1 -- start start 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bfea17700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bf81023a0 0x7f5bf819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bfea17700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bf8102d50 0x7f5bf819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bfea17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf8106cc0 0x7f5bf81a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bfea17700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8111d10 con 0x7f5bf8102d50 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bfea17700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8111b90 con 0x7f5bf8106cc0 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bfea17700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8111e90 con 0x7f5bf81023a0 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bf8102d50 0x7f5bf819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bf8102d50 0x7f5bf819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45188/0 (socket says 172.21.15.69:45188) 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf77fe700 1 -- 172.21.15.69:0/2236260738 learned_addr learned my addr 172.21.15.69:0/2236260738 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf7fff700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bf81023a0 0x7f5bf819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf77fe700 1 -- 172.21.15.69:0/2236260738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bf81023a0 msgr2=0x7f5bf819a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf77fe700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bf81023a0 0x7f5bf819a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf77fe700 1 -- 172.21.15.69:0/2236260738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf8106cc0 msgr2=0x7f5bf81a5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf77fe700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf8106cc0 0x7f5bf81a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf77fe700 1 -- 172.21.15.69:0/2236260738 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf81a56b0 con 0x7f5bf8102d50 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf77fe700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bf8102d50 0x7f5bf819a630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c9e0 tx=0x7f5bec00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf57fa700 1 -- 172.21.15.69:0/2236260738 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec007aa0 con 0x7f5bf8102d50 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bfea17700 1 -- 172.21.15.69:0/2236260738 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf81a58e0 con 0x7f5bf8102d50 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf57fa700 1 -- 172.21.15.69:0/2236260738 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5bec007c40 con 0x7f5bf8102d50 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bf57fa700 1 -- 172.21.15.69:0/2236260738 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0186f0 con 0x7f5bf8102d50 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.755+0000 7f5bfea17700 1 -- 172.21.15.69:0/2236260738 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf81a5e40 con 0x7f5bf8102d50 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.756+0000 7f5bfea17700 1 -- 172.21.15.69:0/2236260738 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5bf8063150 con 0x7f5bf8102d50 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.757+0000 7f5bf57fa700 1 -- 172.21.15.69:0/2236260738 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5bec00f9b0 con 0x7f5bf8102d50 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.758+0000 7f5bf57fa700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5be00a3cd0 0x7f5be00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.758+0000 7f5bf7fff700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5be00a3cd0 0x7f5be00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.758+0000 7f5bf57fa700 1 -- 172.21.15.69:0/2236260738 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f5bec0d07a0 con 0x7f5bf8102d50 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.758+0000 7f5bf57fa700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509] conn(0x7f5be00ad4b0 0x7f5be00af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.758+0000 7f5bf57fa700 1 -- 172.21.15.69:0/2236260738 --> [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5bec015e70 con 0x7f5be00ad4b0 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.758+0000 7f5bf57fa700 1 -- 172.21.15.69:0/2236260738 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f5bec0d0c80 con 0x7f5bf8102d50 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.758+0000 7f5bf7fff700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5be00a3cd0 0x7f5be00a6190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5be8000c00 tx=0x7f5be8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.758+0000 7f5bfcfb4700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509] conn(0x7f5be00ad4b0 0x7f5be00af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:24.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.759+0000 7f5bfcfb4700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509] conn(0x7f5be00ad4b0 0x7f5be00af8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:24.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.759+0000 7f5bf57fa700 1 -- 172.21.15.69:0/2236260738 <== osd.9 v2:172.21.15.69:6826/2332420509 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5bec015e70 con 0x7f5be00ad4b0 2024-04-23T10:25:24.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.776+0000 7f5bfea17700 1 -- 172.21.15.69:0/2236260738 --> [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5bf8063550 con 0x7f5be00ad4b0 2024-04-23T10:25:24.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.776+0000 7f5bf57fa700 1 -- 172.21.15.69:0/2236260738 <== osd.9 v2:172.21.15.69:6826/2332420509 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5bf8063550 con 0x7f5be00ad4b0 2024-04-23T10:25:24.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.776+0000 7f5bfea17700 1 -- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509] conn(0x7f5be00ad4b0 msgr2=0x7f5be00af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:24.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.777+0000 7f5bfea17700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509] conn(0x7f5be00ad4b0 0x7f5be00af8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:24.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.777+0000 7f5bfea17700 1 -- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5be00a3cd0 msgr2=0x7f5be00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:24.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.777+0000 7f5bfea17700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f5be00a3cd0 0x7f5be00a6190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5be8000c00 tx=0x7f5be8005fd0 comp rx=0 tx=0).stop 2024-04-23T10:25:24.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.777+0000 7f5bfea17700 1 -- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bf8102d50 msgr2=0x7f5bf819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:24.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.777+0000 7f5bfea17700 1 --2- 172.21.15.69:0/2236260738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bf8102d50 0x7f5bf819a630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c9e0 tx=0x7f5bec00cda0 comp rx=0 tx=0).stop 2024-04-23T10:25:24.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.777+0000 7f5bfcfb4700 1 -- 172.21.15.69:0/2236260738 reap_dead start 2024-04-23T10:25:24.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.777+0000 7f5bfea17700 1 -- 172.21.15.69:0/2236260738 shutdown_connections 2024-04-23T10:25:24.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.777+0000 7f5bfea17700 1 -- 172.21.15.69:0/2236260738 >> 172.21.15.69:0/2236260738 conn(0x7f5bf8077fb0 msgr2=0x7f5bf80ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:24.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.777+0000 7f5bfea17700 1 -- 172.21.15.69:0/2236260738 shutdown_connections 2024-04-23T10:25:24.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:24.777+0000 7f5bfea17700 1 -- 172.21.15.69:0/2236260738 wait complete. 2024-04-23T10:25:25.166 INFO:teuthology.orchestra.run.smithi069.stdout:55834574915 2024-04-23T10:25:25.166 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-23T10:25:26.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:26 smithi146 ceph-mon[32800]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 op/s 2024-04-23T10:25:26.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:26 smithi069 ceph-mon[29593]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 op/s 2024-04-23T10:25:26.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:26 smithi167 ceph-mon[32940]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 op/s 2024-04-23T10:25:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.124+0000 7f999b1dd700 1 -- 172.21.15.69:0/1759215033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994101970 msgr2=0x7f9994101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.124+0000 7f999b1dd700 1 --2- 172.21.15.69:0/1759215033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994101970 0x7f9994101df0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9980009990 tx=0x7f9980009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.124+0000 7f999b1dd700 1 -- 172.21.15.69:0/1759215033 shutdown_connections 2024-04-23T10:25:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.124+0000 7f999b1dd700 1 --2- 172.21.15.69:0/1759215033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9994102330 0x7f999410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.124+0000 7f999b1dd700 1 --2- 172.21.15.69:0/1759215033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9994107920 0x7f9994107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.124+0000 7f999b1dd700 1 --2- 172.21.15.69:0/1759215033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994101970 0x7f9994101df0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.124+0000 7f999b1dd700 1 -- 172.21.15.69:0/1759215033 >> 172.21.15.69:0/1759215033 conn(0x7f9994078910 msgr2=0x7f9994078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.124+0000 7f999b1dd700 1 -- 172.21.15.69:0/1759215033 shutdown_connections 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.124+0000 7f999b1dd700 1 -- 172.21.15.69:0/1759215033 wait complete. 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.124+0000 7f999b1dd700 1 Processor -- start 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.124+0000 7f999b1dd700 1 -- start start 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999b1dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9994101970 0x7f99941980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999b1dd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9994102330 0x7f9994198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999b1dd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994107920 0x7f999419c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999b1dd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9994111c50 con 0x7f9994107920 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999b1dd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9994111ad0 con 0x7f9994101970 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999b1dd700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9994111dd0 con 0x7f9994102330 2024-04-23T10:25:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999977a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994107920 0x7f999419c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999977a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994107920 0x7f999419c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45204/0 (socket says 172.21.15.69:45204) 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999977a700 1 -- 172.21.15.69:0/1986649365 learned_addr learned my addr 172.21.15.69:0/1986649365 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f9993fff700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9994102330 0x7f9994198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f9998f79700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9994101970 0x7f99941980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999977a700 1 -- 172.21.15.69:0/1986649365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9994102330 msgr2=0x7f9994198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999977a700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9994102330 0x7f9994198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999977a700 1 -- 172.21.15.69:0/1986649365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9994101970 msgr2=0x7f99941980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999977a700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9994101970 0x7f99941980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999977a700 1 -- 172.21.15.69:0/1986649365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999419d080 con 0x7f9994107920 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999977a700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994107920 0x7f999419c940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f998c007ee0 tx=0x7f998c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f9991ffb700 1 -- 172.21.15.69:0/1986649365 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c004bb0 con 0x7f9994107920 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f9991ffb700 1 -- 172.21.15.69:0/1986649365 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f998c004d50 con 0x7f9994107920 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f999b1dd700 1 -- 172.21.15.69:0/1986649365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999419d370 con 0x7f9994107920 2024-04-23T10:25:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.125+0000 7f9991ffb700 1 -- 172.21.15.69:0/1986649365 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c0059e0 con 0x7f9994107920 2024-04-23T10:25:27.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.126+0000 7f999b1dd700 1 -- 172.21.15.69:0/1986649365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99941a4bf0 con 0x7f9994107920 2024-04-23T10:25:27.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.126+0000 7f999b1dd700 1 -- 172.21.15.69:0/1986649365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9994063150 con 0x7f9994107920 2024-04-23T10:25:27.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.127+0000 7f9991ffb700 1 -- 172.21.15.69:0/1986649365 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f998c01a020 con 0x7f9994107920 2024-04-23T10:25:27.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.128+0000 7f9991ffb700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f99840a3cd0 0x7f99840a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.128+0000 7f9998f79700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f99840a3cd0 0x7f99840a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.128+0000 7f9991ffb700 1 -- 172.21.15.69:0/1986649365 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f998c0d00f0 con 0x7f9994107920 2024-04-23T10:25:27.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.128+0000 7f9991ffb700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667] conn(0x7f99840ad4b0 0x7f99840af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.128+0000 7f9991ffb700 1 -- 172.21.15.69:0/1986649365 --> [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f998c009390 con 0x7f99840ad4b0 2024-04-23T10:25:27.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.128+0000 7f9991ffb700 1 -- 172.21.15.69:0/1986649365 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f998c0d05d0 con 0x7f9994107920 2024-04-23T10:25:27.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.128+0000 7f9998f79700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f99840a3cd0 0x7f99840a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f998800abd0 tx=0x7f998800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.129+0000 7f9993fff700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667] conn(0x7f99840ad4b0 0x7f99840af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.129+0000 7f9993fff700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667] conn(0x7f99840ad4b0 0x7f99840af8d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.130+0000 7f9991ffb700 1 -- 172.21.15.69:0/1986649365 <== osd.8 v2:172.21.15.167:6816/625996667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f998c009390 con 0x7f99840ad4b0 2024-04-23T10:25:27.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.146+0000 7f999b1dd700 1 -- 172.21.15.69:0/1986649365 --> [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9994063600 con 0x7f99840ad4b0 2024-04-23T10:25:27.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.147+0000 7f9991ffb700 1 -- 172.21.15.69:0/1986649365 <== osd.8 v2:172.21.15.167:6816/625996667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9994063600 con 0x7f99840ad4b0 2024-04-23T10:25:27.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.147+0000 7f999b1dd700 1 -- 172.21.15.69:0/1986649365 >> [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667] conn(0x7f99840ad4b0 msgr2=0x7f99840af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.147+0000 7f999b1dd700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667] conn(0x7f99840ad4b0 0x7f99840af8d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.147+0000 7f999b1dd700 1 -- 172.21.15.69:0/1986649365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f99840a3cd0 msgr2=0x7f99840a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.147+0000 7f999b1dd700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f99840a3cd0 0x7f99840a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f998800abd0 tx=0x7f998800a380 comp rx=0 tx=0).stop 2024-04-23T10:25:27.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.147+0000 7f999b1dd700 1 -- 172.21.15.69:0/1986649365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994107920 msgr2=0x7f999419c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.147+0000 7f999b1dd700 1 --2- 172.21.15.69:0/1986649365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9994107920 0x7f999419c940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f998c007ee0 tx=0x7f998c00d3b0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.147+0000 7f999977a700 1 -- 172.21.15.69:0/1986649365 reap_dead start 2024-04-23T10:25:27.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.148+0000 7f999b1dd700 1 -- 172.21.15.69:0/1986649365 shutdown_connections 2024-04-23T10:25:27.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.148+0000 7f999b1dd700 1 -- 172.21.15.69:0/1986649365 >> 172.21.15.69:0/1986649365 conn(0x7f9994078910 msgr2=0x7f99940ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.148+0000 7f999b1dd700 1 -- 172.21.15.69:0/1986649365 shutdown_connections 2024-04-23T10:25:27.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.148+0000 7f999b1dd700 1 -- 172.21.15.69:0/1986649365 wait complete. 2024-04-23T10:25:27.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.361+0000 7f0df66ba700 1 -- 172.21.15.69:0/861484931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0df0103450 msgr2=0x7f0df010f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.361+0000 7f0df66ba700 1 --2- 172.21.15.69:0/861484931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0df0103450 0x7f0df010f8b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0de800b0a0 tx=0x7f0de800b3b0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.361+0000 7f0df66ba700 1 -- 172.21.15.69:0/861484931 shutdown_connections 2024-04-23T10:25:27.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.361+0000 7f0df66ba700 1 --2- 172.21.15.69:0/861484931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0df0103450 0x7f0df010f8b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.361+0000 7f0df66ba700 1 --2- 172.21.15.69:0/861484931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0108a50 0x7f0df0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.361+0000 7f0df66ba700 1 --2- 172.21.15.69:0/861484931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0df0102a90 0x7f0df0102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.361+0000 7f0df66ba700 1 -- 172.21.15.69:0/861484931 >> 172.21.15.69:0/861484931 conn(0x7f0df0079ba0 msgr2=0x7f0df0079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.361+0000 7f0df66ba700 1 -- 172.21.15.69:0/861484931 shutdown_connections 2024-04-23T10:25:27.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.361+0000 7f0df66ba700 1 -- 172.21.15.69:0/861484931 wait complete. 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.361+0000 7f0df66ba700 1 Processor -- start 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.361+0000 7f0df66ba700 1 -- start start 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0df66ba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0df0102a90 0x7f0df0074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0df66ba700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0103450 0x7f0df0075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0df66ba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0df0108a50 0x7f0df00757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0df66ba700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0df0112df0 con 0x7f0df0102a90 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0df66ba700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0df0112c70 con 0x7f0df0108a50 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0df66ba700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0df0112f70 con 0x7f0df0103450 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0deffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0df0102a90 0x7f0df0074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0deffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0df0102a90 0x7f0df0074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45218/0 (socket says 172.21.15.69:45218) 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0deffff700 1 -- 172.21.15.69:0/2359688633 learned_addr learned my addr 172.21.15.69:0/2359688633 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:27.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0df4c57700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0df0108a50 0x7f0df00757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0def7fe700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0103450 0x7f0df0075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0deffff700 1 -- 172.21.15.69:0/2359688633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0103450 msgr2=0x7f0df0075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0deffff700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0103450 0x7f0df0075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0deffff700 1 -- 172.21.15.69:0/2359688633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0df0108a50 msgr2=0x7f0df00757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0deffff700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0df0108a50 0x7f0df00757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0deffff700 1 -- 172.21.15.69:0/2359688633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df01a77a0 con 0x7f0df0102a90 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.362+0000 7f0def7fe700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0103450 0x7f0df0075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.363+0000 7f0deffff700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0df0102a90 0x7f0df0074d40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0de000e9a0 tx=0x7f0de000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.363+0000 7f0ded7fa700 1 -- 172.21.15.69:0/2359688633 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de000cbd0 con 0x7f0df0102a90 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.363+0000 7f0df66ba700 1 -- 172.21.15.69:0/2359688633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df01a7a90 con 0x7f0df0102a90 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.363+0000 7f0ded7fa700 1 -- 172.21.15.69:0/2359688633 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0de000cd70 con 0x7f0df0102a90 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.363+0000 7f0ded7fa700 1 -- 172.21.15.69:0/2359688633 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0018710 con 0x7f0df0102a90 2024-04-23T10:25:27.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.363+0000 7f0df66ba700 1 -- 172.21.15.69:0/2359688633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df01a8020 con 0x7f0df0102a90 2024-04-23T10:25:27.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.364+0000 7f0df66ba700 1 -- 172.21.15.69:0/2359688633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0df0063110 con 0x7f0df0102a90 2024-04-23T10:25:27.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.365+0000 7f0ded7fa700 1 -- 172.21.15.69:0/2359688633 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0de0010430 con 0x7f0df0102a90 2024-04-23T10:25:27.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.365+0000 7f0ded7fa700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0dd80a3cd0 0x7f0dd80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.366+0000 7f0def7fe700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0dd80a3cd0 0x7f0dd80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.366+0000 7f0ded7fa700 1 -- 172.21.15.69:0/2359688633 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f0de00d0da0 con 0x7f0df0102a90 2024-04-23T10:25:27.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.366+0000 7f0ded7fa700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302] conn(0x7f0dd80ad4b0 0x7f0dd80af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.366+0000 7f0ded7fa700 1 -- 172.21.15.69:0/2359688633 --> [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0dd80aff80 con 0x7f0dd80ad4b0 2024-04-23T10:25:27.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.366+0000 7f0ded7fa700 1 -- 172.21.15.69:0/2359688633 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f0de00d1280 con 0x7f0df0102a90 2024-04-23T10:25:27.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.366+0000 7f0df4c57700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302] conn(0x7f0dd80ad4b0 0x7f0dd80af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.366+0000 7f0def7fe700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0dd80a3cd0 0x7f0dd80a6190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0df007a210 tx=0x7f0de4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.367+0000 7f0df4c57700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302] conn(0x7f0dd80ad4b0 0x7f0dd80af8d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.367+0000 7f0ded7fa700 1 -- 172.21.15.69:0/2359688633 <== osd.10 v2:172.21.15.146:6824/1086639302 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0dd80aff80 con 0x7f0dd80ad4b0 2024-04-23T10:25:27.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.384+0000 7f0df66ba700 1 -- 172.21.15.69:0/2359688633 --> [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0df0063510 con 0x7f0dd80ad4b0 2024-04-23T10:25:27.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0ded7fa700 1 -- 172.21.15.69:0/2359688633 <== osd.10 v2:172.21.15.146:6824/1086639302 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0df0063510 con 0x7f0dd80ad4b0 2024-04-23T10:25:27.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0df66ba700 1 -- 172.21.15.69:0/2359688633 >> [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302] conn(0x7f0dd80ad4b0 msgr2=0x7f0dd80af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0df66ba700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302] conn(0x7f0dd80ad4b0 0x7f0dd80af8d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0df66ba700 1 -- 172.21.15.69:0/2359688633 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0dd80a3cd0 msgr2=0x7f0dd80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0df66ba700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0dd80a3cd0 0x7f0dd80a6190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0df007a210 tx=0x7f0de4009260 comp rx=0 tx=0).stop 2024-04-23T10:25:27.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0df66ba700 1 -- 172.21.15.69:0/2359688633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0df0102a90 msgr2=0x7f0df0074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0df66ba700 1 --2- 172.21.15.69:0/2359688633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0df0102a90 0x7f0df0074d40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0de000e9a0 tx=0x7f0de000ecb0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0df4c57700 1 -- 172.21.15.69:0/2359688633 reap_dead start 2024-04-23T10:25:27.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0df66ba700 1 -- 172.21.15.69:0/2359688633 shutdown_connections 2024-04-23T10:25:27.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0df66ba700 1 -- 172.21.15.69:0/2359688633 >> 172.21.15.69:0/2359688633 conn(0x7f0df0079ba0 msgr2=0x7f0df0101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0df66ba700 1 -- 172.21.15.69:0/2359688633 shutdown_connections 2024-04-23T10:25:27.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.385+0000 7f0df66ba700 1 -- 172.21.15.69:0/2359688633 wait complete. 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.974+0000 7f29a8bd2700 1 -- 172.21.15.69:0/827537369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29a4102a90 msgr2=0x7f29a4102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.974+0000 7f29a8bd2700 1 --2- 172.21.15.69:0/827537369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29a4102a90 0x7f29a4102f10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2998009990 tx=0x7f2998009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.974+0000 7f29a8bd2700 1 -- 172.21.15.69:0/827537369 shutdown_connections 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.974+0000 7f29a8bd2700 1 --2- 172.21.15.69:0/827537369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29a4103450 0x7f29a410f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.974+0000 7f29a8bd2700 1 --2- 172.21.15.69:0/827537369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29a4108a50 0x7f29a4108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.974+0000 7f29a8bd2700 1 --2- 172.21.15.69:0/827537369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29a4102a90 0x7f29a4102f10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.974+0000 7f29a8bd2700 1 -- 172.21.15.69:0/827537369 >> 172.21.15.69:0/827537369 conn(0x7f29a4079ba0 msgr2=0x7f29a4079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.974+0000 7f29a8bd2700 1 -- 172.21.15.69:0/827537369 shutdown_connections 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.974+0000 7f29a8bd2700 1 -- 172.21.15.69:0/827537369 wait complete. 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.974+0000 7f29a8bd2700 1 Processor -- start 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a8bd2700 1 -- start start 2024-04-23T10:25:27.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a8bd2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29a4102a90 0x7f29a4074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a8bd2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29a4103450 0x7f29a4075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a8bd2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29a4108a50 0x7f29a40757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a8bd2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f29a4112da0 con 0x7f29a4108a50 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a8bd2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f29a4112c20 con 0x7f29a4102a90 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a8bd2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f29a4112f20 con 0x7f29a4103450 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29a4108a50 0x7f29a40757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29a4108a50 0x7f29a40757c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45234/0 (socket says 172.21.15.69:45234) 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a2d9d700 1 -- 172.21.15.69:0/139283937 learned_addr learned my addr 172.21.15.69:0/139283937 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a1d9b700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29a4103450 0x7f29a4075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a259c700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29a4102a90 0x7f29a4074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a2d9d700 1 -- 172.21.15.69:0/139283937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29a4103450 msgr2=0x7f29a4075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a2d9d700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29a4103450 0x7f29a4075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a2d9d700 1 -- 172.21.15.69:0/139283937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29a4102a90 msgr2=0x7f29a4074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a2d9d700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29a4102a90 0x7f29a4074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a2d9d700 1 -- 172.21.15.69:0/139283937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a41a77e0 con 0x7f29a4108a50 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a259c700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29a4102a90 0x7f29a4074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29a2d9d700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29a4108a50 0x7f29a40757c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f299c00b970 tx=0x7f299c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29937fe700 1 -- 172.21.15.69:0/139283937 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c019070 con 0x7f29a4108a50 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29937fe700 1 -- 172.21.15.69:0/139283937 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f299c00ce00 con 0x7f29a4108a50 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.975+0000 7f29937fe700 1 -- 172.21.15.69:0/139283937 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c007370 con 0x7f29a4108a50 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.976+0000 7f29a8bd2700 1 -- 172.21.15.69:0/139283937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a41a7ad0 con 0x7f29a4108a50 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.976+0000 7f29a8bd2700 1 -- 172.21.15.69:0/139283937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a41a7f90 con 0x7f29a4108a50 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.976+0000 7f29a8bd2700 1 -- 172.21.15.69:0/139283937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29a40630d0 con 0x7f29a4108a50 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.978+0000 7f29937fe700 1 -- 172.21.15.69:0/139283937 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f299c01c070 con 0x7f29a4108a50 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.978+0000 7f29937fe700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f298c0a3cd0 0x7f298c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.978+0000 7f29a259c700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f298c0a3cd0 0x7f298c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.978+0000 7f29937fe700 1 -- 172.21.15.69:0/139283937 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f299c0cfec0 con 0x7f29a4108a50 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.978+0000 7f29937fe700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496] conn(0x7f298c0ad4b0 0x7f298c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.978+0000 7f29937fe700 1 -- 172.21.15.69:0/139283937 --> [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f299c015e80 con 0x7f298c0ad4b0 2024-04-23T10:25:27.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.978+0000 7f29937fe700 1 -- 172.21.15.69:0/139283937 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f299c0d03a0 con 0x7f29a4108a50 2024-04-23T10:25:27.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.978+0000 7f29a259c700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f298c0a3cd0 0x7f298c0a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2994005fd0 tx=0x7f2994005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.979+0000 7f29a1d9b700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496] conn(0x7f298c0ad4b0 0x7f298c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.979+0000 7f29a1d9b700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496] conn(0x7f298c0ad4b0 0x7f298c0af8d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.980+0000 7f29937fe700 1 -- 172.21.15.69:0/139283937 <== osd.5 v2:172.21.15.167:6808/2875657496 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f299c015e80 con 0x7f298c0ad4b0 2024-04-23T10:25:27.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.996+0000 7f29a8bd2700 1 -- 172.21.15.69:0/139283937 --> [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29a4063550 con 0x7f298c0ad4b0 2024-04-23T10:25:27.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.996+0000 7f29937fe700 1 -- 172.21.15.69:0/139283937 <== osd.5 v2:172.21.15.167:6808/2875657496 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f29a4063550 con 0x7f298c0ad4b0 2024-04-23T10:25:27.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.997+0000 7f29a8bd2700 1 -- 172.21.15.69:0/139283937 >> [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496] conn(0x7f298c0ad4b0 msgr2=0x7f298c0af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.997+0000 7f29a8bd2700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496] conn(0x7f298c0ad4b0 0x7f298c0af8d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.997+0000 7f29a8bd2700 1 -- 172.21.15.69:0/139283937 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f298c0a3cd0 msgr2=0x7f298c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.997+0000 7f29a8bd2700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f298c0a3cd0 0x7f298c0a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2994005fd0 tx=0x7f2994005ee0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.997+0000 7f29a8bd2700 1 -- 172.21.15.69:0/139283937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29a4108a50 msgr2=0x7f29a40757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.997+0000 7f29a8bd2700 1 --2- 172.21.15.69:0/139283937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29a4108a50 0x7f29a40757c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f299c00b970 tx=0x7f299c00bc80 comp rx=0 tx=0).stop 2024-04-23T10:25:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.997+0000 7f29a2d9d700 1 -- 172.21.15.69:0/139283937 reap_dead start 2024-04-23T10:25:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.997+0000 7f29a8bd2700 1 -- 172.21.15.69:0/139283937 shutdown_connections 2024-04-23T10:25:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.997+0000 7f29a8bd2700 1 -- 172.21.15.69:0/139283937 >> 172.21.15.69:0/139283937 conn(0x7f29a4079ba0 msgr2=0x7f29a4101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.997+0000 7f29a8bd2700 1 -- 172.21.15.69:0/139283937 shutdown_connections 2024-04-23T10:25:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:27.997+0000 7f29a8bd2700 1 -- 172.21.15.69:0/139283937 wait complete. 2024-04-23T10:25:28.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:28 smithi069 ceph-mon[29593]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-23T10:25:28.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:28 smithi146 ceph-mon[32800]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-23T10:25:28.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:28 smithi167 ceph-mon[32940]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-23T10:25:28.714 INFO:teuthology.orchestra.run.smithi069.stdout:257698037796 2024-04-23T10:25:28.714 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-23T10:25:29.688 INFO:teuthology.orchestra.run.smithi069.stdout:167503724595 2024-04-23T10:25:29.689 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-23T10:25:30.364 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:30 smithi069 ceph-mon[29593]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-23T10:25:30.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:30 smithi146 ceph-mon[32800]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-23T10:25:30.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:30 smithi167 ceph-mon[32940]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-23T10:25:32.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:32 smithi069 ceph-mon[29593]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-23T10:25:32.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:32 smithi146 ceph-mon[32800]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-23T10:25:32.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:32 smithi167 ceph-mon[32940]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-23T10:25:33.041 INFO:teuthology.orchestra.run.smithi069.stdout:313532612632 2024-04-23T10:25:33.042 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-23T10:25:33.644 INFO:teuthology.orchestra.run.smithi069.stdout:292057776158 2024-04-23T10:25:33.644 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-23T10:25:33.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.016+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/366714613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9c4107990 msgr2=0x7fa9c4107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:33.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.016+0000 7fa9cbd5e700 1 --2- 172.21.15.69:0/366714613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9c4107990 0x7fa9c4107d70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009990 tx=0x7fa9c0009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:33.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.016+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/366714613 shutdown_connections 2024-04-23T10:25:33.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.016+0000 7fa9cbd5e700 1 --2- 172.21.15.69:0/366714613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9c4102300 0x7fa9c410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:33.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.016+0000 7fa9cbd5e700 1 --2- 172.21.15.69:0/366714613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9c4107990 0x7fa9c4107d70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:33.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.016+0000 7fa9cbd5e700 1 --2- 172.21.15.69:0/366714613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9c4101940 0x7fa9c4101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.016+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/366714613 >> 172.21.15.69:0/366714613 conn(0x7fa9c40788f0 msgr2=0x7fa9c4078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.016+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/366714613 shutdown_connections 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.016+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/366714613 wait complete. 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9cbd5e700 1 Processor -- start 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9cbd5e700 1 -- start start 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9cbd5e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9c4101940 0x7fa9c4199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9cbd5e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9c4102300 0x7fa9c41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9cbd5e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9c4107990 0x7fa9c419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9cbd5e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4111c90 con 0x7fa9c4102300 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9cbd5e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4111b10 con 0x7fa9c4107990 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9cbd5e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4111e10 con 0x7fa9c4101940 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9c92f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9c4102300 0x7fa9c41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9c92f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9c4102300 0x7fa9c41997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39958/0 (socket says 172.21.15.69:39958) 2024-04-23T10:25:33.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9c92f9700 1 -- 172.21.15.69:0/1189462413 learned_addr learned my addr 172.21.15.69:0/1189462413 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:33.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9c9afa700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9c4101940 0x7fa9c4199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:33.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9c92f9700 1 -- 172.21.15.69:0/1189462413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9c4101940 msgr2=0x7fa9c4199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:33.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9c92f9700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9c4101940 0x7fa9c4199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:33.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9c92f9700 1 -- 172.21.15.69:0/1189462413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9c4107990 msgr2=0x7fa9c419db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:33.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.017+0000 7fa9ca2fb700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9c4107990 0x7fa9c419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:33.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.018+0000 7fa9c92f9700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9c4107990 0x7fa9c419db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:33.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.018+0000 7fa9c92f9700 1 -- 172.21.15.69:0/1189462413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c419e280 con 0x7fa9c4102300 2024-04-23T10:25:33.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.018+0000 7fa9c92f9700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9c4102300 0x7fa9c41997b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400b530 tx=0x7fa9b400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:33.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.018+0000 7fa9baffd700 1 -- 172.21.15.69:0/1189462413 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4015020 con 0x7fa9c4102300 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.018+0000 7fa9baffd700 1 -- 172.21.15.69:0/1189462413 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9b4011d00 con 0x7fa9c4102300 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.018+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/1189462413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c419e570 con 0x7fa9c4102300 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.018+0000 7fa9baffd700 1 -- 172.21.15.69:0/1189462413 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b400f2e0 con 0x7fa9c4102300 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.018+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/1189462413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c41a5df0 con 0x7fa9c4102300 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.019+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/1189462413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa9c406aa70 con 0x7fa9c4102300 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.020+0000 7fa9baffd700 1 -- 172.21.15.69:0/1189462413 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa9b4018020 con 0x7fa9c4102300 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.020+0000 7fa9baffd700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa9b00a3cd0 0x7fa9b00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.020+0000 7fa9c9afa700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa9b00a3cd0 0x7fa9b00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.021+0000 7fa9baffd700 1 -- 172.21.15.69:0/1189462413 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fa9b40d0270 con 0x7fa9c4102300 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.021+0000 7fa9baffd700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719] conn(0x7fa9b00ad4b0 0x7fa9b00af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.021+0000 7fa9baffd700 1 -- 172.21.15.69:0/1189462413 --> [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9b401ce70 con 0x7fa9b00ad4b0 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.021+0000 7fa9baffd700 1 -- 172.21.15.69:0/1189462413 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fa9b40d0750 con 0x7fa9c4102300 2024-04-23T10:25:33.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.021+0000 7fa9c9afa700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa9b00a3cd0 0x7fa9b00a6190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000b5c0 tx=0x7fa9c0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.021+0000 7fa9ca2fb700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719] conn(0x7fa9b00ad4b0 0x7fa9b00af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.021+0000 7fa9ca2fb700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719] conn(0x7fa9b00ad4b0 0x7fa9b00af8d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.022+0000 7fa9baffd700 1 -- 172.21.15.69:0/1189462413 <== osd.3 v2:172.21.15.69:6810/4041470719 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa9b401ce70 con 0x7fa9b00ad4b0 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.038+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/1189462413 --> [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa9c4103060 con 0x7fa9b00ad4b0 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.038+0000 7fa9baffd700 1 -- 172.21.15.69:0/1189462413 <== osd.3 v2:172.21.15.69:6810/4041470719 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa9c4103060 con 0x7fa9b00ad4b0 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.038+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719] conn(0x7fa9b00ad4b0 msgr2=0x7fa9b00af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.038+0000 7fa9cbd5e700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719] conn(0x7fa9b00ad4b0 0x7fa9b00af8d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.039+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa9b00a3cd0 msgr2=0x7fa9b00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.039+0000 7fa9cbd5e700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa9b00a3cd0 0x7fa9b00a6190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000b5c0 tx=0x7fa9c0005960 comp rx=0 tx=0).stop 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.039+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9c4102300 msgr2=0x7fa9c41997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.039+0000 7fa9cbd5e700 1 --2- 172.21.15.69:0/1189462413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9c4102300 0x7fa9c41997b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400b530 tx=0x7fa9b400b840 comp rx=0 tx=0).stop 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.039+0000 7fa9ca2fb700 1 -- 172.21.15.69:0/1189462413 reap_dead start 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.039+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/1189462413 shutdown_connections 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.039+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/1189462413 >> 172.21.15.69:0/1189462413 conn(0x7fa9c40788f0 msgr2=0x7fa9c4105c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:33.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.039+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/1189462413 shutdown_connections 2024-04-23T10:25:33.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:31.039+0000 7fa9cbd5e700 1 -- 172.21.15.69:0/1189462413 wait complete. 2024-04-23T10:25:34.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:34 smithi146 ceph-mon[32800]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:25:34.440 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:34 smithi069 ceph-mon[29593]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:25:34.474 INFO:teuthology.orchestra.run.smithi069.stdout:111669149756 2024-04-23T10:25:34.474 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-23T10:25:34.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:34 smithi167 ceph-mon[32940]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:25:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.745+0000 7fd0c1a80700 1 -- 172.21.15.69:0/531858905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0bc101940 msgr2=0x7fd0bc101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.745+0000 7fd0c1a80700 1 --2- 172.21.15.69:0/531858905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0bc101940 0x7fd0bc101dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009990 tx=0x7fd0b0009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.745+0000 7fd0c1a80700 1 -- 172.21.15.69:0/531858905 shutdown_connections 2024-04-23T10:25:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.745+0000 7fd0c1a80700 1 --2- 172.21.15.69:0/531858905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0bc102300 0x7fd0bc10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.745+0000 7fd0c1a80700 1 --2- 172.21.15.69:0/531858905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0bc107990 0x7fd0bc107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.745+0000 7fd0c1a80700 1 --2- 172.21.15.69:0/531858905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0bc101940 0x7fd0bc101dc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.745+0000 7fd0c1a80700 1 -- 172.21.15.69:0/531858905 >> 172.21.15.69:0/531858905 conn(0x7fd0bc0788f0 msgr2=0x7fd0bc078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.745+0000 7fd0c1a80700 1 -- 172.21.15.69:0/531858905 shutdown_connections 2024-04-23T10:25:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.745+0000 7fd0c1a80700 1 -- 172.21.15.69:0/531858905 wait complete. 2024-04-23T10:25:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0c1a80700 1 Processor -- start 2024-04-23T10:25:34.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0c1a80700 1 -- start start 2024-04-23T10:25:34.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0c1a80700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0bc101940 0x7fd0bc1034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:34.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0c1a80700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0bc102300 0x7fd0bc103a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:34.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0c1a80700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0bc107990 0x7fd0bc103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:34.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0c1a80700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc111cb0 con 0x7fd0bc101940 2024-04-23T10:25:34.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0c1a80700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc111b30 con 0x7fd0bc102300 2024-04-23T10:25:34.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0c1a80700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc111e30 con 0x7fd0bc107990 2024-04-23T10:25:34.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0bb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0bc101940 0x7fd0bc1034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0bb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0bc101940 0x7fd0bc1034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39970/0 (socket says 172.21.15.69:39970) 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0bb7fe700 1 -- 172.21.15.69:0/3214344852 learned_addr learned my addr 172.21.15.69:0/3214344852 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.746+0000 7fd0bbfff700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0bc107990 0x7fd0bc103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0baffd700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0bc102300 0x7fd0bc103a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0bb7fe700 1 -- 172.21.15.69:0/3214344852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0bc107990 msgr2=0x7fd0bc103f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0bb7fe700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0bc107990 0x7fd0bc103f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0bb7fe700 1 -- 172.21.15.69:0/3214344852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0bc102300 msgr2=0x7fd0bc103a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0bb7fe700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0bc102300 0x7fd0bc103a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0bb7fe700 1 -- 172.21.15.69:0/3214344852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc1a7780 con 0x7fd0bc101940 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0baffd700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0bc102300 0x7fd0bc103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0bb7fe700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0bc101940 0x7fd0bc1034f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c970 tx=0x7fd0ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0b8ff9700 1 -- 172.21.15.69:0/3214344852 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac007aa0 con 0x7fd0bc101940 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0b8ff9700 1 -- 172.21.15.69:0/3214344852 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd0ac004d00 con 0x7fd0bc101940 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0b8ff9700 1 -- 172.21.15.69:0/3214344852 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0055c0 con 0x7fd0bc101940 2024-04-23T10:25:34.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0c1a80700 1 -- 172.21.15.69:0/3214344852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0bc1a7a70 con 0x7fd0bc101940 2024-04-23T10:25:34.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.747+0000 7fd0c1a80700 1 -- 172.21.15.69:0/3214344852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0bc1a7f60 con 0x7fd0bc101940 2024-04-23T10:25:34.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.748+0000 7fd0c1a80700 1 -- 172.21.15.69:0/3214344852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0bc0630d0 con 0x7fd0bc101940 2024-04-23T10:25:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.749+0000 7fd0b8ff9700 1 -- 172.21.15.69:0/3214344852 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd0ac007c40 con 0x7fd0bc101940 2024-04-23T10:25:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.750+0000 7fd0b8ff9700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd0a40a3d50 0x7fd0a40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.750+0000 7fd0baffd700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd0a40a3d50 0x7fd0a40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.750+0000 7fd0b8ff9700 1 -- 172.21.15.69:0/3214344852 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fd0ac0d0560 con 0x7fd0bc101940 2024-04-23T10:25:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.750+0000 7fd0b8ff9700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644] conn(0x7fd0a40ad530 0x7fd0a40af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.750+0000 7fd0b8ff9700 1 -- 172.21.15.69:0/3214344852 --> [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0ac01ee50 con 0x7fd0a40ad530 2024-04-23T10:25:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.750+0000 7fd0b8ff9700 1 -- 172.21.15.69:0/3214344852 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fd0ac0d0a40 con 0x7fd0bc101940 2024-04-23T10:25:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.750+0000 7fd0baffd700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd0a40a3d50 0x7fd0a40a6210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0006010 tx=0x7fd0b000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.750+0000 7fd0bbfff700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644] conn(0x7fd0a40ad530 0x7fd0a40af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.751+0000 7fd0bbfff700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644] conn(0x7fd0a40ad530 0x7fd0a40af950 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:34.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.752+0000 7fd0b8ff9700 1 -- 172.21.15.69:0/3214344852 <== osd.2 v2:172.21.15.167:6800/683605644 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0ac01ee50 con 0x7fd0a40ad530 2024-04-23T10:25:34.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.771+0000 7fd0c1a80700 1 -- 172.21.15.69:0/3214344852 --> [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd0bc063550 con 0x7fd0a40ad530 2024-04-23T10:25:34.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.771+0000 7fd0b8ff9700 1 -- 172.21.15.69:0/3214344852 <== osd.2 v2:172.21.15.167:6800/683605644 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd0bc063550 con 0x7fd0a40ad530 2024-04-23T10:25:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.772+0000 7fd0c1a80700 1 -- 172.21.15.69:0/3214344852 >> [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644] conn(0x7fd0a40ad530 msgr2=0x7fd0a40af950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.772+0000 7fd0c1a80700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644] conn(0x7fd0a40ad530 0x7fd0a40af950 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.772+0000 7fd0c1a80700 1 -- 172.21.15.69:0/3214344852 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd0a40a3d50 msgr2=0x7fd0a40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.772+0000 7fd0c1a80700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd0a40a3d50 0x7fd0a40a6210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0006010 tx=0x7fd0b000b540 comp rx=0 tx=0).stop 2024-04-23T10:25:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.772+0000 7fd0c1a80700 1 -- 172.21.15.69:0/3214344852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0bc101940 msgr2=0x7fd0bc1034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:34.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.772+0000 7fd0c1a80700 1 --2- 172.21.15.69:0/3214344852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0bc101940 0x7fd0bc1034f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c970 tx=0x7fd0ac00cc80 comp rx=0 tx=0).stop 2024-04-23T10:25:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.772+0000 7fd0bbfff700 1 -- 172.21.15.69:0/3214344852 reap_dead start 2024-04-23T10:25:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.772+0000 7fd0c1a80700 1 -- 172.21.15.69:0/3214344852 shutdown_connections 2024-04-23T10:25:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.772+0000 7fd0c1a80700 1 -- 172.21.15.69:0/3214344852 >> 172.21.15.69:0/3214344852 conn(0x7fd0bc0788f0 msgr2=0x7fd0bc06aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.772+0000 7fd0c1a80700 1 -- 172.21.15.69:0/3214344852 shutdown_connections 2024-04-23T10:25:34.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:34.772+0000 7fd0c1a80700 1 -- 172.21.15.69:0/3214344852 wait complete. 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.667+0000 7fc0d798f700 1 -- 172.21.15.69:0/3190689505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d0101640 msgr2=0x7fc0d0101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.667+0000 7fc0d798f700 1 --2- 172.21.15.69:0/3190689505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d0101640 0x7fc0d0101a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009990 tx=0x7fc0c0009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.667+0000 7fc0d798f700 1 -- 172.21.15.69:0/3190689505 shutdown_connections 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.667+0000 7fc0d798f700 1 --2- 172.21.15.69:0/3190689505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d01064e0 0x7fc0d010e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.667+0000 7fc0d798f700 1 --2- 172.21.15.69:0/3190689505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d0101640 0x7fc0d0101a20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.667+0000 7fc0d798f700 1 --2- 172.21.15.69:0/3190689505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0d0101ff0 0x7fc0d0105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.667+0000 7fc0d798f700 1 -- 172.21.15.69:0/3190689505 >> 172.21.15.69:0/3190689505 conn(0x7fc0d0076c60 msgr2=0x7fc0d0077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.667+0000 7fc0d798f700 1 -- 172.21.15.69:0/3190689505 shutdown_connections 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d798f700 1 -- 172.21.15.69:0/3190689505 wait complete. 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d798f700 1 Processor -- start 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d798f700 1 -- start start 2024-04-23T10:25:35.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d798f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d0101640 0x7fc0d0199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d798f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0d0101ff0 0x7fc0d019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d798f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d01064e0 0x7fc0d01a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d798f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d0111440 con 0x7fc0d0101640 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d798f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d01112c0 con 0x7fc0d01064e0 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d798f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d01115c0 con 0x7fc0d0101ff0 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d572b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d0101640 0x7fc0d0199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d572b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d0101640 0x7fc0d0199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39984/0 (socket says 172.21.15.69:39984) 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.668+0000 7fc0d572b700 1 -- 172.21.15.69:0/2444217659 learned_addr learned my addr 172.21.15.69:0/2444217659 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0d5f2c700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d01064e0 0x7fc0d01a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0d572b700 1 -- 172.21.15.69:0/2444217659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0d0101ff0 msgr2=0x7fc0d019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0d572b700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0d0101ff0 0x7fc0d019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0d572b700 1 -- 172.21.15.69:0/2444217659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d01064e0 msgr2=0x7fc0d01a4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0d572b700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d01064e0 0x7fc0d01a4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:35.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0d572b700 1 -- 172.21.15.69:0/2444217659 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d01a5500 con 0x7fc0d0101640 2024-04-23T10:25:35.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0d5f2c700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d01064e0 0x7fc0d01a4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:35.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0d572b700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d0101640 0x7fc0d0199f40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009590 tx=0x7fc0c0005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:35.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0c67fc700 1 -- 172.21.15.69:0/2444217659 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0027070 con 0x7fc0d0101640 2024-04-23T10:25:35.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0c67fc700 1 -- 172.21.15.69:0/2444217659 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc0c0003fb0 con 0x7fc0d0101640 2024-04-23T10:25:35.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0d798f700 1 -- 172.21.15.69:0/2444217659 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d01a56d0 con 0x7fc0d0101640 2024-04-23T10:25:35.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0c67fc700 1 -- 172.21.15.69:0/2444217659 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0022c40 con 0x7fc0d0101640 2024-04-23T10:25:35.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.669+0000 7fc0d798f700 1 -- 172.21.15.69:0/2444217659 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d01a5bb0 con 0x7fc0d0101640 2024-04-23T10:25:35.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.670+0000 7fc0d798f700 1 -- 172.21.15.69:0/2444217659 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0d0100e10 con 0x7fc0d0101640 2024-04-23T10:25:35.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.671+0000 7fc0c67fc700 1 -- 172.21.15.69:0/2444217659 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc0c002a070 con 0x7fc0d0101640 2024-04-23T10:25:35.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.672+0000 7fc0c67fc700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc0bc0a3cd0 0x7fc0bc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:35.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.672+0000 7fc0d4f2a700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc0bc0a3cd0 0x7fc0bc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.672+0000 7fc0c67fc700 1 -- 172.21.15.69:0/2444217659 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fc0c0022e00 con 0x7fc0d0101640 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.672+0000 7fc0c67fc700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052] conn(0x7fc0bc0ad4b0 0x7fc0bc0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.672+0000 7fc0c67fc700 1 -- 172.21.15.69:0/2444217659 --> [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0bc0aff80 con 0x7fc0bc0ad4b0 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.672+0000 7fc0c67fc700 1 -- 172.21.15.69:0/2444217659 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fc0c00d20c0 con 0x7fc0d0101640 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.672+0000 7fc0d4f2a700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc0bc0a3cd0 0x7fc0bc0a6190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc005fd0 tx=0x7fc0cc005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.672+0000 7fc0d5f2c700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052] conn(0x7fc0bc0ad4b0 0x7fc0bc0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.673+0000 7fc0d5f2c700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052] conn(0x7fc0bc0ad4b0 0x7fc0bc0af8d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.674+0000 7fc0c67fc700 1 -- 172.21.15.69:0/2444217659 <== osd.11 v2:172.21.15.167:6824/2968784052 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0bc0aff80 con 0x7fc0bc0ad4b0 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.690+0000 7fc0d798f700 1 -- 172.21.15.69:0/2444217659 --> [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0d0102820 con 0x7fc0bc0ad4b0 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0c67fc700 1 -- 172.21.15.69:0/2444217659 <== osd.11 v2:172.21.15.167:6824/2968784052 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc0d0102820 con 0x7fc0bc0ad4b0 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0d798f700 1 -- 172.21.15.69:0/2444217659 >> [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052] conn(0x7fc0bc0ad4b0 msgr2=0x7fc0bc0af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0d798f700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052] conn(0x7fc0bc0ad4b0 0x7fc0bc0af8d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0d798f700 1 -- 172.21.15.69:0/2444217659 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc0bc0a3cd0 msgr2=0x7fc0bc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0d798f700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc0bc0a3cd0 0x7fc0bc0a6190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc005fd0 tx=0x7fc0cc005d00 comp rx=0 tx=0).stop 2024-04-23T10:25:35.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0d798f700 1 -- 172.21.15.69:0/2444217659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d0101640 msgr2=0x7fc0d0199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0d798f700 1 --2- 172.21.15.69:0/2444217659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d0101640 0x7fc0d0199f40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009590 tx=0x7fc0c0005590 comp rx=0 tx=0).stop 2024-04-23T10:25:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0d5f2c700 1 -- 172.21.15.69:0/2444217659 reap_dead start 2024-04-23T10:25:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0d798f700 1 -- 172.21.15.69:0/2444217659 shutdown_connections 2024-04-23T10:25:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0d798f700 1 -- 172.21.15.69:0/2444217659 >> 172.21.15.69:0/2444217659 conn(0x7fc0d0076c60 msgr2=0x7fc0d01003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0d798f700 1 -- 172.21.15.69:0/2444217659 shutdown_connections 2024-04-23T10:25:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:35.691+0000 7fc0d798f700 1 -- 172.21.15.69:0/2444217659 wait complete. 2024-04-23T10:25:36.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.279+0000 7fa15adc7700 1 -- 172.21.15.69:0/2514083298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154107980 msgr2=0x7fa154107d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:36.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.279+0000 7fa15adc7700 1 --2- 172.21.15.69:0/2514083298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154107980 0x7fa154107d60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa148009990 tx=0x7fa148009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:36.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.279+0000 7fa15adc7700 1 -- 172.21.15.69:0/2514083298 shutdown_connections 2024-04-23T10:25:36.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.279+0000 7fa15adc7700 1 --2- 172.21.15.69:0/2514083298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1541022f0 0x7fa15410e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:36.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.279+0000 7fa15adc7700 1 --2- 172.21.15.69:0/2514083298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154107980 0x7fa154107d60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:36.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.279+0000 7fa15adc7700 1 --2- 172.21.15.69:0/2514083298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa154101930 0x7fa154101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:36.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.279+0000 7fa15adc7700 1 -- 172.21.15.69:0/2514083298 >> 172.21.15.69:0/2514083298 conn(0x7fa1540788b0 msgr2=0x7fa154078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:36.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.279+0000 7fa15adc7700 1 -- 172.21.15.69:0/2514083298 shutdown_connections 2024-04-23T10:25:36.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.279+0000 7fa15adc7700 1 -- 172.21.15.69:0/2514083298 wait complete. 2024-04-23T10:25:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa15adc7700 1 Processor -- start 2024-04-23T10:25:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa15adc7700 1 -- start start 2024-04-23T10:25:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa15adc7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa154101930 0x7fa15419a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa15adc7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1541022f0 0x7fa15419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa15adc7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154107980 0x7fa1541a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa15adc7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa154111d00 con 0x7fa154107980 2024-04-23T10:25:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa15adc7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa154111b80 con 0x7fa1541022f0 2024-04-23T10:25:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa15adc7700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa154111e80 con 0x7fa154101930 2024-04-23T10:25:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa159364700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154107980 0x7fa1541a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa159364700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154107980 0x7fa1541a51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39992/0 (socket says 172.21.15.69:39992) 2024-04-23T10:25:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa159364700 1 -- 172.21.15.69:0/487553797 learned_addr learned my addr 172.21.15.69:0/487553797 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa158b63700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa154101930 0x7fa15419a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa159364700 1 -- 172.21.15.69:0/487553797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa154101930 msgr2=0x7fa15419a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa159364700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa154101930 0x7fa15419a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa159364700 1 -- 172.21.15.69:0/487553797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1541022f0 msgr2=0x7fa15419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.280+0000 7fa159364700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1541022f0 0x7fa15419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.281+0000 7fa159364700 1 -- 172.21.15.69:0/487553797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1541a5720 con 0x7fa154107980 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.281+0000 7fa159364700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154107980 0x7fa1541a51e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00b970 tx=0x7fa14c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.281+0000 7fa151ffb700 1 -- 172.21.15.69:0/487553797 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c019070 con 0x7fa154107980 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.281+0000 7fa151ffb700 1 -- 172.21.15.69:0/487553797 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa14c014440 con 0x7fa154107980 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.281+0000 7fa151ffb700 1 -- 172.21.15.69:0/487553797 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0075d0 con 0x7fa154107980 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.281+0000 7fa15adc7700 1 -- 172.21.15.69:0/487553797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1541a5950 con 0x7fa154107980 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.281+0000 7fa15adc7700 1 -- 172.21.15.69:0/487553797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1541a5ee0 con 0x7fa154107980 2024-04-23T10:25:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.282+0000 7fa15adc7700 1 -- 172.21.15.69:0/487553797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa154063110 con 0x7fa154107980 2024-04-23T10:25:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.283+0000 7fa151ffb700 1 -- 172.21.15.69:0/487553797 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa14c01c070 con 0x7fa154107980 2024-04-23T10:25:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.283+0000 7fa151ffb700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa1440a3d50 0x7fa1440a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.283+0000 7fa158b63700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa1440a3d50 0x7fa1440a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.284+0000 7fa151ffb700 1 -- 172.21.15.69:0/487553797 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fa14c0cf630 con 0x7fa154107980 2024-04-23T10:25:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.284+0000 7fa151ffb700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604] conn(0x7fa1440ad530 0x7fa1440af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.284+0000 7fa151ffb700 1 -- 172.21.15.69:0/487553797 --> [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa14c017e70 con 0x7fa1440ad530 2024-04-23T10:25:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.284+0000 7fa151ffb700 1 -- 172.21.15.69:0/487553797 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fa14c0d6050 con 0x7fa154107980 2024-04-23T10:25:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.284+0000 7fa158b63700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa1440a3d50 0x7fa1440a6210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa148009750 tx=0x7fa14800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.284+0000 7fa153fff700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604] conn(0x7fa1440ad530 0x7fa1440af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.284+0000 7fa153fff700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604] conn(0x7fa1440ad530 0x7fa1440af950 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:36.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.285+0000 7fa151ffb700 1 -- 172.21.15.69:0/487553797 <== osd.7 v2:172.21.15.146:6816/2492628604 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa14c017e70 con 0x7fa1440ad530 2024-04-23T10:25:36.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.302+0000 7fa15adc7700 1 -- 172.21.15.69:0/487553797 --> [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa154063540 con 0x7fa1440ad530 2024-04-23T10:25:36.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa151ffb700 1 -- 172.21.15.69:0/487553797 <== osd.7 v2:172.21.15.146:6816/2492628604 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa154063540 con 0x7fa1440ad530 2024-04-23T10:25:36.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa15adc7700 1 -- 172.21.15.69:0/487553797 >> [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604] conn(0x7fa1440ad530 msgr2=0x7fa1440af950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:36.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa15adc7700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604] conn(0x7fa1440ad530 0x7fa1440af950 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:36.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa15adc7700 1 -- 172.21.15.69:0/487553797 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa1440a3d50 msgr2=0x7fa1440a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:36.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa15adc7700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa1440a3d50 0x7fa1440a6210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa148009750 tx=0x7fa14800b540 comp rx=0 tx=0).stop 2024-04-23T10:25:36.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa15adc7700 1 -- 172.21.15.69:0/487553797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154107980 msgr2=0x7fa1541a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:36.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa15adc7700 1 --2- 172.21.15.69:0/487553797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154107980 0x7fa1541a51e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00b970 tx=0x7fa14c00bd30 comp rx=0 tx=0).stop 2024-04-23T10:25:36.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa159364700 1 -- 172.21.15.69:0/487553797 reap_dead start 2024-04-23T10:25:36.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa15adc7700 1 -- 172.21.15.69:0/487553797 shutdown_connections 2024-04-23T10:25:36.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa15adc7700 1 -- 172.21.15.69:0/487553797 >> 172.21.15.69:0/487553797 conn(0x7fa1540788b0 msgr2=0x7fa1541007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:36.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa15adc7700 1 -- 172.21.15.69:0/487553797 shutdown_connections 2024-04-23T10:25:36.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:36.303+0000 7fa15adc7700 1 -- 172.21.15.69:0/487553797 wait complete. 2024-04-23T10:25:36.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:36 smithi146 ceph-mon[32800]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-23T10:25:36.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:36 smithi069 ceph-mon[29593]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-23T10:25:36.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:36 smithi167 ceph-mon[32940]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-23T10:25:37.186 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:37.188 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:37.188 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:37.222 INFO:teuthology.orchestra.run.smithi069.stdout:77309411395 2024-04-23T10:25:37.222 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-23T10:25:37.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.885+0000 7f6929c25700 1 -- 172.21.15.69:0/1101255449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f692406b170 msgr2=0x7f692406b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:37.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.885+0000 7f6929c25700 1 --2- 172.21.15.69:0/1101255449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f692406b170 0x7f692406b5d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6918009990 tx=0x7f6918009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:37.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.885+0000 7f6929c25700 1 -- 172.21.15.69:0/1101255449 shutdown_connections 2024-04-23T10:25:37.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.885+0000 7f6929c25700 1 --2- 172.21.15.69:0/1101255449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f692406bb10 0x7f692410f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:37.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.885+0000 7f6929c25700 1 --2- 172.21.15.69:0/1101255449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6924108a30 0x7f6924108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:37.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.885+0000 7f6929c25700 1 --2- 172.21.15.69:0/1101255449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f692406b170 0x7f692406b5d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.885+0000 7f6929c25700 1 -- 172.21.15.69:0/1101255449 >> 172.21.15.69:0/1101255449 conn(0x7f69240788f0 msgr2=0x7f6924078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.885+0000 7f6929c25700 1 -- 172.21.15.69:0/1101255449 shutdown_connections 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.885+0000 7f6929c25700 1 -- 172.21.15.69:0/1101255449 wait complete. 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.886+0000 7f6929c25700 1 Processor -- start 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.886+0000 7f6929c25700 1 -- start start 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.886+0000 7f6929c25700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f692406b170 0x7f6924101a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.886+0000 7f6929c25700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692406bb10 0x7f6924101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.886+0000 7f6929c25700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6924108a30 0x7f69241024c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.886+0000 7f6929c25700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6924112df0 con 0x7f6924108a30 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.886+0000 7f6929c25700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6924112c70 con 0x7f692406bb10 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.886+0000 7f6929c25700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6924112f70 con 0x7f692406b170 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6923fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6924108a30 0x7f69241024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6923fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6924108a30 0x7f69241024c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40002/0 (socket says 172.21.15.69:40002) 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6923fff700 1 -- 172.21.15.69:0/57125546 learned_addr learned my addr 172.21.15.69:0/57125546 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f69237fe700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f692406b170 0x7f6924101a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:37.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6922ffd700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692406bb10 0x7f6924101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6923fff700 1 -- 172.21.15.69:0/57125546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f692406b170 msgr2=0x7f6924101a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6923fff700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f692406b170 0x7f6924101a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6923fff700 1 -- 172.21.15.69:0/57125546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692406bb10 msgr2=0x7f6924101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6923fff700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692406bb10 0x7f6924101f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6923fff700 1 -- 172.21.15.69:0/57125546 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69241a78b0 con 0x7f6924108a30 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6922ffd700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692406bb10 0x7f6924101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6923fff700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6924108a30 0x7f69241024c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f691c00b970 tx=0x7f691c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6920ff9700 1 -- 172.21.15.69:0/57125546 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c019070 con 0x7f6924108a30 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6929c25700 1 -- 172.21.15.69:0/57125546 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69241a7ba0 con 0x7f6924108a30 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6920ff9700 1 -- 172.21.15.69:0/57125546 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f691c014440 con 0x7f6924108a30 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6920ff9700 1 -- 172.21.15.69:0/57125546 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c0075d0 con 0x7f6924108a30 2024-04-23T10:25:37.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.887+0000 7f6929c25700 1 -- 172.21.15.69:0/57125546 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69241a80e0 con 0x7f6924108a30 2024-04-23T10:25:37.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.888+0000 7f6929c25700 1 -- 172.21.15.69:0/57125546 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f69240630d0 con 0x7f6924108a30 2024-04-23T10:25:37.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.889+0000 7f6920ff9700 1 -- 172.21.15.69:0/57125546 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f691c01c070 con 0x7f6924108a30 2024-04-23T10:25:37.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.890+0000 7f6920ff9700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f690c0a3cd0 0x7f690c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:37.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.890+0000 7f69237fe700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f690c0a3cd0 0x7f690c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:37.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.890+0000 7f6920ff9700 1 -- 172.21.15.69:0/57125546 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f691c0cff10 con 0x7f6924108a30 2024-04-23T10:25:37.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.890+0000 7f6920ff9700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384] conn(0x7f690c0ad4b0 0x7f690c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:37.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.890+0000 7f6920ff9700 1 -- 172.21.15.69:0/57125546 --> [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f691c00fec0 con 0x7f690c0ad4b0 2024-04-23T10:25:37.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.890+0000 7f6920ff9700 1 -- 172.21.15.69:0/57125546 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f691c0d03f0 con 0x7f6924108a30 2024-04-23T10:25:37.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.890+0000 7f6922ffd700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384] conn(0x7f690c0ad4b0 0x7f690c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:37.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.890+0000 7f69237fe700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f690c0a3cd0 0x7f690c0a6190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6914006fd0 tx=0x7f6914008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:37.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.890+0000 7f6922ffd700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384] conn(0x7f690c0ad4b0 0x7f690c0af8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:37.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.891+0000 7f6920ff9700 1 -- 172.21.15.69:0/57125546 <== osd.0 v2:172.21.15.69:6802/3356554384 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f691c00fec0 con 0x7f690c0ad4b0 2024-04-23T10:25:37.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6929c25700 1 -- 172.21.15.69:0/57125546 --> [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6924063550 con 0x7f690c0ad4b0 2024-04-23T10:25:37.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6920ff9700 1 -- 172.21.15.69:0/57125546 <== osd.0 v2:172.21.15.69:6802/3356554384 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6924063550 con 0x7f690c0ad4b0 2024-04-23T10:25:37.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6929c25700 1 -- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384] conn(0x7f690c0ad4b0 msgr2=0x7f690c0af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:37.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6929c25700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384] conn(0x7f690c0ad4b0 0x7f690c0af8d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:37.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6929c25700 1 -- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f690c0a3cd0 msgr2=0x7f690c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:37.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6929c25700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f690c0a3cd0 0x7f690c0a6190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6914006fd0 tx=0x7f6914008040 comp rx=0 tx=0).stop 2024-04-23T10:25:37.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6929c25700 1 -- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6924108a30 msgr2=0x7f69241024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:37.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6929c25700 1 --2- 172.21.15.69:0/57125546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6924108a30 0x7f69241024c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f691c00b970 tx=0x7f691c00bd30 comp rx=0 tx=0).stop 2024-04-23T10:25:37.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6923fff700 1 -- 172.21.15.69:0/57125546 reap_dead start 2024-04-23T10:25:37.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6929c25700 1 -- 172.21.15.69:0/57125546 shutdown_connections 2024-04-23T10:25:37.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6929c25700 1 -- 172.21.15.69:0/57125546 >> 172.21.15.69:0/57125546 conn(0x7f69240788f0 msgr2=0x7f69240ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:37.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6929c25700 1 -- 172.21.15.69:0/57125546 shutdown_connections 2024-04-23T10:25:37.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:37.909+0000 7f6929c25700 1 -- 172.21.15.69:0/57125546 wait complete. 2024-04-23T10:25:38.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:38 smithi146 ceph-mon[32800]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-23T10:25:38.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:38 smithi069 ceph-mon[29593]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-23T10:25:38.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:38 smithi167 ceph-mon[32940]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-23T10:25:39.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.326+0000 7f506c6cc700 1 -- 172.21.15.69:0/2946930885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5064101930 msgr2=0x7f5064101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:39.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.326+0000 7f506c6cc700 1 --2- 172.21.15.69:0/2946930885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5064101930 0x7f5064101db0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5060009990 tx=0x7f5060009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:39.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.326+0000 7f506c6cc700 1 -- 172.21.15.69:0/2946930885 shutdown_connections 2024-04-23T10:25:39.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.326+0000 7f506c6cc700 1 --2- 172.21.15.69:0/2946930885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50641022f0 0x7f506410e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.326+0000 7f506c6cc700 1 --2- 172.21.15.69:0/2946930885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5064107980 0x7f5064107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.326+0000 7f506c6cc700 1 --2- 172.21.15.69:0/2946930885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5064101930 0x7f5064101db0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.326+0000 7f506c6cc700 1 -- 172.21.15.69:0/2946930885 >> 172.21.15.69:0/2946930885 conn(0x7f50640788b0 msgr2=0x7f5064078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.326+0000 7f506c6cc700 1 -- 172.21.15.69:0/2946930885 shutdown_connections 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.326+0000 7f506c6cc700 1 -- 172.21.15.69:0/2946930885 wait complete. 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506c6cc700 1 Processor -- start 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506c6cc700 1 -- start start 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506c6cc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5064101930 0x7f5064199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506c6cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50641022f0 0x7f506419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506c6cc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5064107980 0x7f50641a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506c6cc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5064111c30 con 0x7f5064107980 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506c6cc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5064111ab0 con 0x7f50641022f0 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506c6cc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5064111db0 con 0x7f5064101930 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506ac69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5064107980 0x7f50641a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506ac69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5064107980 0x7f50641a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40020/0 (socket says 172.21.15.69:40020) 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506ac69700 1 -- 172.21.15.69:0/2683163844 learned_addr learned my addr 172.21.15.69:0/2683163844 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:39.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506a468700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5064101930 0x7f5064199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:39.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f5069c67700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50641022f0 0x7f506419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:39.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506ac69700 1 -- 172.21.15.69:0/2683163844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5064101930 msgr2=0x7f5064199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:39.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506ac69700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5064101930 0x7f5064199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:39.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506ac69700 1 -- 172.21.15.69:0/2683163844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50641022f0 msgr2=0x7f506419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:39.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506ac69700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50641022f0 0x7f506419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:39.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506ac69700 1 -- 172.21.15.69:0/2683163844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50641a5530 con 0x7f5064107980 2024-04-23T10:25:39.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506a468700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5064101930 0x7f5064199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:39.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f5069c67700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50641022f0 0x7f506419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506ac69700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5064107980 0x7f50641a4ff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f505c007ee0 tx=0x7f505c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f505b7fe700 1 -- 172.21.15.69:0/2683163844 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c00dbd0 con 0x7f5064107980 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f506c6cc700 1 -- 172.21.15.69:0/2683163844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50641a5760 con 0x7f5064107980 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f505b7fe700 1 -- 172.21.15.69:0/2683163844 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f505c00dd70 con 0x7f5064107980 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.327+0000 7f505b7fe700 1 -- 172.21.15.69:0/2683163844 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c0133f0 con 0x7f5064107980 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.328+0000 7f506c6cc700 1 -- 172.21.15.69:0/2683163844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50641a5c20 con 0x7f5064107980 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.328+0000 7f506c6cc700 1 -- 172.21.15.69:0/2683163844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5064063110 con 0x7f5064107980 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.330+0000 7f505b7fe700 1 -- 172.21.15.69:0/2683163844 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f505c01a020 con 0x7f5064107980 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.330+0000 7f505b7fe700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f50500a3cd0 0x7f50500a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.330+0000 7f506a468700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f50500a3cd0 0x7f50500a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.330+0000 7f505b7fe700 1 -- 172.21.15.69:0/2683163844 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f505c0d03a0 con 0x7f5064107980 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.330+0000 7f505b7fe700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598] conn(0x7f50500ad4b0 0x7f50500af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.330+0000 7f505b7fe700 1 -- 172.21.15.69:0/2683163844 --> [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50500aff80 con 0x7f50500ad4b0 2024-04-23T10:25:39.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.330+0000 7f505b7fe700 1 -- 172.21.15.69:0/2683163844 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f505c0d0880 con 0x7f5064107980 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.331+0000 7f506a468700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f50500a3cd0 0x7f50500a6190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f505400baa0 tx=0x7f5054005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.331+0000 7f5069c67700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598] conn(0x7f50500ad4b0 0x7f50500af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.331+0000 7f5069c67700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598] conn(0x7f50500ad4b0 0x7f50500af8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.332+0000 7f505b7fe700 1 -- 172.21.15.69:0/2683163844 <== osd.4 v2:172.21.15.146:6808/1408511598 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f50500aff80 con 0x7f50500ad4b0 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.348+0000 7f506c6cc700 1 -- 172.21.15.69:0/2683163844 --> [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5064063590 con 0x7f50500ad4b0 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.348+0000 7f505b7fe700 1 -- 172.21.15.69:0/2683163844 <== osd.4 v2:172.21.15.146:6808/1408511598 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5064063590 con 0x7f50500ad4b0 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.349+0000 7f506c6cc700 1 -- 172.21.15.69:0/2683163844 >> [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598] conn(0x7f50500ad4b0 msgr2=0x7f50500af8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.349+0000 7f506c6cc700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598] conn(0x7f50500ad4b0 0x7f50500af8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.349+0000 7f506c6cc700 1 -- 172.21.15.69:0/2683163844 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f50500a3cd0 msgr2=0x7f50500a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.349+0000 7f506c6cc700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f50500a3cd0 0x7f50500a6190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f505400baa0 tx=0x7f5054005db0 comp rx=0 tx=0).stop 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.349+0000 7f506c6cc700 1 -- 172.21.15.69:0/2683163844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5064107980 msgr2=0x7f50641a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.349+0000 7f506c6cc700 1 --2- 172.21.15.69:0/2683163844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5064107980 0x7f50641a4ff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f505c007ee0 tx=0x7f505c00d3b0 comp rx=0 tx=0).stop 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.349+0000 7f506ac69700 1 -- 172.21.15.69:0/2683163844 reap_dead start 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.349+0000 7f506c6cc700 1 -- 172.21.15.69:0/2683163844 shutdown_connections 2024-04-23T10:25:39.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.349+0000 7f506c6cc700 1 -- 172.21.15.69:0/2683163844 >> 172.21.15.69:0/2683163844 conn(0x7f50640788b0 msgr2=0x7f50640ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:39.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.349+0000 7f506c6cc700 1 -- 172.21.15.69:0/2683163844 shutdown_connections 2024-04-23T10:25:39.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:39.349+0000 7f506c6cc700 1 -- 172.21.15.69:0/2683163844 wait complete. 2024-04-23T10:25:40.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:40 smithi069 ceph-mon[29593]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-04-23T10:25:40.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:40 smithi146 ceph-mon[32800]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-04-23T10:25:40.457 INFO:teuthology.orchestra.run.smithi069.stdout:347892350997 2024-04-23T10:25:40.457 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-23T10:25:40.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:40 smithi167 ceph-mon[32940]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-04-23T10:25:40.902 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:40.903 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:40.904 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:41.447 INFO:teuthology.orchestra.run.smithi069.stdout:34359738445 2024-04-23T10:25:41.448 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-23T10:25:42.372 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:42 smithi069 ceph-mon[29593]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-23T10:25:42.384 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:42 smithi167 ceph-mon[32940]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-23T10:25:42.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:42 smithi146 ceph-mon[32800]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-04-23T10:25:42.535 INFO:teuthology.orchestra.run.smithi069.stdout:223338299434 2024-04-23T10:25:42.535 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-23T10:25:43.203 INFO:teuthology.orchestra.run.smithi069.stdout:146028888121 2024-04-23T10:25:43.204 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-23T10:25:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.715+0000 7ff01dac7700 1 -- 172.21.15.69:0/1933309817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff018102af0 msgr2=0x7ff018102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.715+0000 7ff01dac7700 1 --2- 172.21.15.69:0/1933309817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff018102af0 0x7ff018102f70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009990 tx=0x7ff00c009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.715+0000 7ff01dac7700 1 -- 172.21.15.69:0/1933309817 shutdown_connections 2024-04-23T10:25:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.715+0000 7ff01dac7700 1 --2- 172.21.15.69:0/1933309817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0181034b0 0x7ff01810f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.715+0000 7ff01dac7700 1 --2- 172.21.15.69:0/1933309817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018108a80 0x7ff018108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.715+0000 7ff01dac7700 1 --2- 172.21.15.69:0/1933309817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff018102af0 0x7ff018102f70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.715+0000 7ff01dac7700 1 -- 172.21.15.69:0/1933309817 >> 172.21.15.69:0/1933309817 conn(0x7ff018079b20 msgr2=0x7ff018079f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.715+0000 7ff01dac7700 1 -- 172.21.15.69:0/1933309817 shutdown_connections 2024-04-23T10:25:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.715+0000 7ff01dac7700 1 -- 172.21.15.69:0/1933309817 wait complete. 2024-04-23T10:25:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.715+0000 7ff01dac7700 1 Processor -- start 2024-04-23T10:25:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff01dac7700 1 -- start start 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff01dac7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff018102af0 0x7ff0181990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff01dac7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0181034b0 0x7ff018199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff01dac7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018108a80 0x7ff01819d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff01dac7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff018112dd0 con 0x7ff0181034b0 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff01dac7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff018112c50 con 0x7ff018108a80 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff01dac7700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff018112f50 con 0x7ff018102af0 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff016ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0181034b0 0x7ff018199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff016ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0181034b0 0x7ff018199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52644/0 (socket says 172.21.15.69:52644) 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff016ffd700 1 -- 172.21.15.69:0/4006017331 learned_addr learned my addr 172.21.15.69:0/4006017331 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff017fff700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018108a80 0x7ff01819d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff0177fe700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff018102af0 0x7ff0181990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff016ffd700 1 -- 172.21.15.69:0/4006017331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff018102af0 msgr2=0x7ff0181990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff016ffd700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff018102af0 0x7ff0181990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff016ffd700 1 -- 172.21.15.69:0/4006017331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018108a80 msgr2=0x7ff01819d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff016ffd700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018108a80 0x7ff01819d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff016ffd700 1 -- 172.21.15.69:0/4006017331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01819e0f0 con 0x7ff0181034b0 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff0177fe700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff018102af0 0x7ff0181990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.716+0000 7ff016ffd700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0181034b0 0x7ff018199620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff00c000c00 tx=0x7ff00c0037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.717+0000 7ff014ff9700 1 -- 172.21.15.69:0/4006017331 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c027070 con 0x7ff0181034b0 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.717+0000 7ff01dac7700 1 -- 172.21.15.69:0/4006017331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01819e380 con 0x7ff0181034b0 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.717+0000 7ff014ff9700 1 -- 172.21.15.69:0/4006017331 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff00c0041e0 con 0x7ff0181034b0 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.717+0000 7ff014ff9700 1 -- 172.21.15.69:0/4006017331 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00f460 con 0x7ff0181034b0 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.717+0000 7ff01dac7700 1 -- 172.21.15.69:0/4006017331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0181a5c60 con 0x7ff0181034b0 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.718+0000 7ff01dac7700 1 -- 172.21.15.69:0/4006017331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff018069730 con 0x7ff0181034b0 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.719+0000 7ff014ff9700 1 -- 172.21.15.69:0/4006017331 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff00c02a070 con 0x7ff0181034b0 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.719+0000 7ff014ff9700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff0000a3cd0 0x7ff0000a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.719+0000 7ff0177fe700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff0000a3cd0 0x7ff0000a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.719+0000 7ff014ff9700 1 -- 172.21.15.69:0/4006017331 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7ff00c0d1490 con 0x7ff0181034b0 2024-04-23T10:25:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.720+0000 7ff0177fe700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff0000a3cd0 0x7ff0000a6190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff00800baa0 tx=0x7ff008005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:43.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.723+0000 7ff014ff9700 1 -- 172.21.15.69:0/4006017331 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff00c013070 con 0x7ff0181034b0 2024-04-23T10:25:43.930 INFO:teuthology.orchestra.run.smithi069.stdout:55834574920 2024-04-23T10:25:43.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.931+0000 7ff01dac7700 1 -- 172.21.15.69:0/4006017331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff01802df80 con 0x7ff0181034b0 2024-04-23T10:25:43.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.931+0000 7ff014ff9700 1 -- 172.21.15.69:0/4006017331 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff00c09df50 con 0x7ff0181034b0 2024-04-23T10:25:43.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.933+0000 7ff01dac7700 1 -- 172.21.15.69:0/4006017331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff0000a3cd0 msgr2=0x7ff0000a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:43.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.933+0000 7ff01dac7700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff0000a3cd0 0x7ff0000a6190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff00800baa0 tx=0x7ff008005db0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.933+0000 7ff01dac7700 1 -- 172.21.15.69:0/4006017331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0181034b0 msgr2=0x7ff018199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:43.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.933+0000 7ff01dac7700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0181034b0 0x7ff018199620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff00c000c00 tx=0x7ff00c0037a0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.933+0000 7ff01dac7700 1 -- 172.21.15.69:0/4006017331 shutdown_connections 2024-04-23T10:25:43.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.933+0000 7ff01dac7700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff0000a3cd0 0x7ff0000a6190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.933+0000 7ff01dac7700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018108a80 0x7ff01819d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.933+0000 7ff01dac7700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff018102af0 0x7ff0181990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.933+0000 7ff01dac7700 1 --2- 172.21.15.69:0/4006017331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0181034b0 0x7ff018199620 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:43.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.933+0000 7ff01dac7700 1 -- 172.21.15.69:0/4006017331 >> 172.21.15.69:0/4006017331 conn(0x7ff018079b20 msgr2=0x7ff018101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:43.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.933+0000 7ff01dac7700 1 -- 172.21.15.69:0/4006017331 shutdown_connections 2024-04-23T10:25:43.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:43.934+0000 7ff01dac7700 1 -- 172.21.15.69:0/4006017331 wait complete. 2024-04-23T10:25:44.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:44 smithi146 ceph-mon[32800]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-23T10:25:44.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:44 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/4006017331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-23T10:25:44.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:44 smithi069 ceph-mon[29593]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-23T10:25:44.624 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:44 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/4006017331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-23T10:25:44.625 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:44 smithi167 ceph-mon[32940]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-23T10:25:44.625 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:44 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/4006017331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-23T10:25:46.097 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574915 got 55834574920 for osd.1 2024-04-23T10:25:46.097 DEBUG:teuthology.parallel:result is None 2024-04-23T10:25:46.416 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:46 smithi069 ceph-mon[29593]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-23T10:25:46.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:46 smithi146 ceph-mon[32800]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-23T10:25:46.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.521+0000 7fdc842bb700 1 -- 172.21.15.69:0/4162777512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc7c107b20 msgr2=0x7fdc7c107f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:46.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.521+0000 7fdc842bb700 1 --2- 172.21.15.69:0/4162777512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc7c107b20 0x7fdc7c107f00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400b0a0 tx=0x7fdc7400b3b0 comp rx=0 tx=0).stop 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 -- 172.21.15.69:0/4162777512 shutdown_connections 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 --2- 172.21.15.69:0/4162777512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7c101dc0 0x7fdc7c10f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 --2- 172.21.15.69:0/4162777512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc7c107b20 0x7fdc7c107f00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 --2- 172.21.15.69:0/4162777512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc7c101400 0x7fdc7c101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 -- 172.21.15.69:0/4162777512 >> 172.21.15.69:0/4162777512 conn(0x7fdc7c076c60 msgr2=0x7fdc7c077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 -- 172.21.15.69:0/4162777512 shutdown_connections 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 -- 172.21.15.69:0/4162777512 wait complete. 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 Processor -- start 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 -- start start 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7c101400 0x7fdc7c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc7c101dc0 0x7fdc7c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc7c107b20 0x7fdc7c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:46.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c112e50 con 0x7fdc7c101dc0 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c112cd0 con 0x7fdc7c107b20 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc842bb700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c112fd0 con 0x7fdc7c101400 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.522+0000 7fdc81856700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc7c101dc0 0x7fdc7c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc81856700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc7c101dc0 0x7fdc7c199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52658/0 (socket says 172.21.15.69:52658) 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc81856700 1 -- 172.21.15.69:0/244243913 learned_addr learned my addr 172.21.15.69:0/244243913 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc82057700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7c101400 0x7fdc7c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc82858700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc7c107b20 0x7fdc7c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc81856700 1 -- 172.21.15.69:0/244243913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7c101400 msgr2=0x7fdc7c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc81856700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7c101400 0x7fdc7c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc81856700 1 -- 172.21.15.69:0/244243913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc7c107b20 msgr2=0x7fdc7c19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc81856700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc7c107b20 0x7fdc7c19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc81856700 1 -- 172.21.15.69:0/244243913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c19e2f0 con 0x7fdc7c101dc0 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc81856700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc7c101dc0 0x7fdc7c199820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000b530 tx=0x7fdc7000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc7b7fe700 1 -- 172.21.15.69:0/244243913 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70015020 con 0x7fdc7c101dc0 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc7b7fe700 1 -- 172.21.15.69:0/244243913 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdc70011d00 con 0x7fdc7c101dc0 2024-04-23T10:25:46.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc842bb700 1 -- 172.21.15.69:0/244243913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7c19e5e0 con 0x7fdc7c101dc0 2024-04-23T10:25:46.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc7b7fe700 1 -- 172.21.15.69:0/244243913 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7000f2e0 con 0x7fdc7c101dc0 2024-04-23T10:25:46.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.523+0000 7fdc842bb700 1 -- 172.21.15.69:0/244243913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c1a5e60 con 0x7fdc7c101dc0 2024-04-23T10:25:46.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.524+0000 7fdc842bb700 1 -- 172.21.15.69:0/244243913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc7c069730 con 0x7fdc7c101dc0 2024-04-23T10:25:46.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.525+0000 7fdc7b7fe700 1 -- 172.21.15.69:0/244243913 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fdc70018020 con 0x7fdc7c101dc0 2024-04-23T10:25:46.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.526+0000 7fdc7b7fe700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdc640a3cd0 0x7fdc640a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:46.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.526+0000 7fdc82057700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdc640a3cd0 0x7fdc640a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:46.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.526+0000 7fdc7b7fe700 1 -- 172.21.15.69:0/244243913 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fdc700d0100 con 0x7fdc7c101dc0 2024-04-23T10:25:46.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.527+0000 7fdc82057700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdc640a3cd0 0x7fdc640a6190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc74009e60 tx=0x7fdc7400b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:46.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.530+0000 7fdc7b7fe700 1 -- 172.21.15.69:0/244243913 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdc7001f020 con 0x7fdc7c101dc0 2024-04-23T10:25:46.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:46 smithi167 ceph-mon[32940]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-23T10:25:46.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.733+0000 7fdc842bb700 1 -- 172.21.15.69:0/244243913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fdc7c02df80 con 0x7fdc7c101dc0 2024-04-23T10:25:46.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.733+0000 7fdc7b7fe700 1 -- 172.21.15.69:0/244243913 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdc7009cb80 con 0x7fdc7c101dc0 2024-04-23T10:25:46.732 INFO:teuthology.orchestra.run.smithi069.stdout:201863462961 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 -- 172.21.15.69:0/244243913 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdc640a3cd0 msgr2=0x7fdc640a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdc640a3cd0 0x7fdc640a6190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc74009e60 tx=0x7fdc7400b7b0 comp rx=0 tx=0).stop 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 -- 172.21.15.69:0/244243913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc7c101dc0 msgr2=0x7fdc7c199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc7c101dc0 0x7fdc7c199820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000b530 tx=0x7fdc7000b840 comp rx=0 tx=0).stop 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 -- 172.21.15.69:0/244243913 shutdown_connections 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fdc640a3cd0 0x7fdc640a6190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc7c107b20 0x7fdc7c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7c101400 0x7fdc7c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 --2- 172.21.15.69:0/244243913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc7c101dc0 0x7fdc7c199820 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 -- 172.21.15.69:0/244243913 >> 172.21.15.69:0/244243913 conn(0x7fdc7c076c60 msgr2=0x7fdc7c0fffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 -- 172.21.15.69:0/244243913 shutdown_connections 2024-04-23T10:25:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:46.736+0000 7fdc842bb700 1 -- 172.21.15.69:0/244243913 wait complete. 2024-04-23T10:25:47.154 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:47.163 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:47.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:47 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/244243913' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-23T10:25:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:47 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/244243913' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-23T10:25:47.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:47 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/244243913' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-23T10:25:48.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:48 smithi146 ceph-mon[32800]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:25:48.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:48 smithi069 ceph-mon[29593]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:25:48.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:48 smithi167 ceph-mon[32940]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:25:48.649 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462957 got 201863462961 for osd.6 2024-04-23T10:25:48.649 DEBUG:teuthology.parallel:result is None 2024-04-23T10:25:49.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.923+0000 7f42ccac3700 1 -- 172.21.15.69:0/837318122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8103950 msgr2=0x7f42c8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:49.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.923+0000 7f42ccac3700 1 --2- 172.21.15.69:0/837318122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8103950 0x7f42c8103d30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009990 tx=0x7f42b8009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:49.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.923+0000 7f42ccac3700 1 -- 172.21.15.69:0/837318122 shutdown_connections 2024-04-23T10:25:49.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.923+0000 7f42ccac3700 1 --2- 172.21.15.69:0/837318122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8101ad0 0x7f42c81117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:49.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.923+0000 7f42ccac3700 1 --2- 172.21.15.69:0/837318122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8103950 0x7f42c8103d30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:49.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.923+0000 7f42ccac3700 1 --2- 172.21.15.69:0/837318122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c8101030 0x7f42c81014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:49.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.923+0000 7f42ccac3700 1 -- 172.21.15.69:0/837318122 >> 172.21.15.69:0/837318122 conn(0x7f42c8077fb0 msgr2=0x7f42c80ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:49.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.923+0000 7f42ccac3700 1 -- 172.21.15.69:0/837318122 shutdown_connections 2024-04-23T10:25:49.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.923+0000 7f42ccac3700 1 -- 172.21.15.69:0/837318122 wait complete. 2024-04-23T10:25:49.924 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:49.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.924+0000 7f42ccac3700 1 Processor -- start 2024-04-23T10:25:49.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.924+0000 7f42ccac3700 1 -- start start 2024-04-23T10:25:49.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.924+0000 7f42ccac3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c8101030 0x7f42c819b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:49.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.924+0000 7f42ccac3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8101ad0 0x7f42c819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:49.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.924+0000 7f42ccac3700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8103950 0x7f42c819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.924+0000 7f42ccac3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f42c8114f20 con 0x7f42c8101ad0 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.924+0000 7f42ccac3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f42c8114da0 con 0x7f42c8101030 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.924+0000 7f42ccac3700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f42c81150a0 con 0x7f42c8103950 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.924+0000 7f42c5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8101ad0 0x7f42c819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.925+0000 7f42c5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8101ad0 0x7f42c819b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56354/0 (socket says 172.21.15.69:56354) 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.925+0000 7f42c659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c8101030 0x7f42c819b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.925+0000 7f42c5d9b700 1 -- 172.21.15.69:0/2237445170 learned_addr learned my addr 172.21.15.69:0/2237445170 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.925+0000 7f42c6d9d700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8103950 0x7f42c819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.925+0000 7f42c659c700 1 -- 172.21.15.69:0/2237445170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8103950 msgr2=0x7f42c819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.925+0000 7f42c659c700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8103950 0x7f42c819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.925+0000 7f42c659c700 1 -- 172.21.15.69:0/2237445170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8101ad0 msgr2=0x7f42c819b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.925+0000 7f42c659c700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8101ad0 0x7f42c819b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.925+0000 7f42c659c700 1 -- 172.21.15.69:0/2237445170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c81a03e0 con 0x7f42c8101030 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.925+0000 7f42c5d9b700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8101ad0 0x7f42c819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:25:49.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.925+0000 7f42c659c700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c8101030 0x7f42c819b3d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42b8006010 tx=0x7f42b8005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.926+0000 7f42b77fe700 1 -- 172.21.15.69:0/2237445170 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8027070 con 0x7f42c8101030 2024-04-23T10:25:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.926+0000 7f42b77fe700 1 -- 172.21.15.69:0/2237445170 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f42b8003fb0 con 0x7f42c8101030 2024-04-23T10:25:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.926+0000 7f42ccac3700 1 -- 172.21.15.69:0/2237445170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c81a0670 con 0x7f42c8101030 2024-04-23T10:25:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.926+0000 7f42b77fe700 1 -- 172.21.15.69:0/2237445170 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8022c20 con 0x7f42c8101030 2024-04-23T10:25:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.926+0000 7f42ccac3700 1 -- 172.21.15.69:0/2237445170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c81a7f50 con 0x7f42c8101030 2024-04-23T10:25:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.927+0000 7f42ccac3700 1 -- 172.21.15.69:0/2237445170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c8102040 con 0x7f42c8101030 2024-04-23T10:25:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.929+0000 7f42b77fe700 1 -- 172.21.15.69:0/2237445170 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f42b802a070 con 0x7f42c8101030 2024-04-23T10:25:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.930+0000 7f42b77fe700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42b00a3cd0 0x7f42b00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.930+0000 7f42c5d9b700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42b00a3cd0 0x7f42b00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.930+0000 7f42b77fe700 1 -- 172.21.15.69:0/2237445170 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f42b80d1390 con 0x7f42c8101030 2024-04-23T10:25:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.930+0000 7f42c5d9b700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42b00a3cd0 0x7f42b00a6190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f42c8100740 tx=0x7f42bc00b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:49.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:49.933+0000 7f42b77fe700 1 -- 172.21.15.69:0/2237445170 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f42b8013070 con 0x7f42c8101030 2024-04-23T10:25:50.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.144+0000 7f42ccac3700 1 -- 172.21.15.69:0/2237445170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f42c819c730 con 0x7f42c8101030 2024-04-23T10:25:50.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.145+0000 7f42b77fe700 1 -- 172.21.15.69:0/2237445170 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f42b809de50 con 0x7f42c8101030 2024-04-23T10:25:50.144 INFO:teuthology.orchestra.run.smithi069.stdout:292057776163 2024-04-23T10:25:50.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 -- 172.21.15.69:0/2237445170 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42b00a3cd0 msgr2=0x7f42b00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:50.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42b00a3cd0 0x7f42b00a6190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f42c8100740 tx=0x7f42bc00b500 comp rx=0 tx=0).stop 2024-04-23T10:25:50.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 -- 172.21.15.69:0/2237445170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c8101030 msgr2=0x7f42c819b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:50.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c8101030 0x7f42c819b3d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42b8006010 tx=0x7f42b8005ef0 comp rx=0 tx=0).stop 2024-04-23T10:25:50.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 -- 172.21.15.69:0/2237445170 shutdown_connections 2024-04-23T10:25:50.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f42b00a3cd0 0x7f42b00a6190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:50.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8103950 0x7f42c819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:50.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c8101030 0x7f42c819b3d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:50.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 --2- 172.21.15.69:0/2237445170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c8101ad0 0x7f42c819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:50.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 -- 172.21.15.69:0/2237445170 >> 172.21.15.69:0/2237445170 conn(0x7f42c8077fb0 msgr2=0x7f42c80fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:50.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 -- 172.21.15.69:0/2237445170 shutdown_connections 2024-04-23T10:25:50.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:50.148+0000 7f42ccac3700 1 -- 172.21.15.69:0/2237445170 wait complete. 2024-04-23T10:25:50.177 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:50 smithi069 ceph-mon[29593]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:25:50.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:50 smithi146 ceph-mon[32800]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:25:50.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:50 smithi167 ceph-mon[32940]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:25:51.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.277+0000 7fe8283d3700 1 -- 172.21.15.69:0/410298729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe820101030 msgr2=0x7fe8201014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.277+0000 7fe8283d3700 1 --2- 172.21.15.69:0/410298729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe820101030 0x7fe8201014b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe810009990 tx=0x7fe810009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.277+0000 7fe8283d3700 1 -- 172.21.15.69:0/410298729 shutdown_connections 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.277+0000 7fe8283d3700 1 --2- 172.21.15.69:0/410298729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe820101ad0 0x7fe8201117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.277+0000 7fe8283d3700 1 --2- 172.21.15.69:0/410298729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe820103950 0x7fe820103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.277+0000 7fe8283d3700 1 --2- 172.21.15.69:0/410298729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe820101030 0x7fe8201014b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.277+0000 7fe8283d3700 1 -- 172.21.15.69:0/410298729 >> 172.21.15.69:0/410298729 conn(0x7fe820077fb0 msgr2=0x7fe8200ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.277+0000 7fe8283d3700 1 -- 172.21.15.69:0/410298729 shutdown_connections 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.277+0000 7fe8283d3700 1 -- 172.21.15.69:0/410298729 wait complete. 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe8283d3700 1 Processor -- start 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe8283d3700 1 -- start start 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe8283d3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe820101030 0x7fe82019b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe8283d3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe820101ad0 0x7fe82019ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:51.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe8283d3700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe820103950 0x7fe82019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe8283d3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe820115020 con 0x7fe820101ad0 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe8283d3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe820114ea0 con 0x7fe820101030 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe8283d3700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe8201151a0 con 0x7fe820103950 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe82596e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe820101ad0 0x7fe82019ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe82596e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe820101ad0 0x7fe82019ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56358/0 (socket says 172.21.15.69:56358) 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe82596e700 1 -- 172.21.15.69:0/638918931 learned_addr learned my addr 172.21.15.69:0/638918931 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe826970700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe820103950 0x7fe82019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.278+0000 7fe82616f700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe820101030 0x7fe82019b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe82596e700 1 -- 172.21.15.69:0/638918931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe820103950 msgr2=0x7fe82019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe82596e700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe820103950 0x7fe82019fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe82596e700 1 -- 172.21.15.69:0/638918931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe820101030 msgr2=0x7fe82019b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe82596e700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe820101030 0x7fe82019b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe82596e700 1 -- 172.21.15.69:0/638918931 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8201a0560 con 0x7fe820101ad0 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe826970700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe820103950 0x7fe82019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe82616f700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe820101030 0x7fe82019b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:51.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe82596e700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe820101ad0 0x7fe82019ba90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe810000c00 tx=0x7fe8100037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:51.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe8177fe700 1 -- 172.21.15.69:0/638918931 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810027070 con 0x7fe820101ad0 2024-04-23T10:25:51.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe8283d3700 1 -- 172.21.15.69:0/638918931 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8201a07f0 con 0x7fe820101ad0 2024-04-23T10:25:51.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe8283d3700 1 -- 172.21.15.69:0/638918931 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8201a80d0 con 0x7fe820101ad0 2024-04-23T10:25:51.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe8177fe700 1 -- 172.21.15.69:0/638918931 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe8100041e0 con 0x7fe820101ad0 2024-04-23T10:25:51.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.279+0000 7fe8177fe700 1 -- 172.21.15.69:0/638918931 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81000f460 con 0x7fe820101ad0 2024-04-23T10:25:51.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.280+0000 7fe8283d3700 1 -- 172.21.15.69:0/638918931 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe820102040 con 0x7fe820101ad0 2024-04-23T10:25:51.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.282+0000 7fe8177fe700 1 -- 172.21.15.69:0/638918931 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe81002a070 con 0x7fe820101ad0 2024-04-23T10:25:51.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.283+0000 7fe8177fe700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe80c0a3d50 0x7fe80c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:51.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.284+0000 7fe8177fe700 1 -- 172.21.15.69:0/638918931 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fe8100d1410 con 0x7fe820101ad0 2024-04-23T10:25:51.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.284+0000 7fe82616f700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe80c0a3d50 0x7fe80c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:51.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.284+0000 7fe82616f700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe80c0a3d50 0x7fe80c0a6210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0099d0 tx=0x7fe81c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:51.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.287+0000 7fe8177fe700 1 -- 172.21.15.69:0/638918931 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe810013070 con 0x7fe820101ad0 2024-04-23T10:25:51.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:51 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2237445170' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-23T10:25:51.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:51 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2237445170' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-23T10:25:51.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.498+0000 7fe8283d3700 1 -- 172.21.15.69:0/638918931 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe82002df80 con 0x7fe820101ad0 2024-04-23T10:25:51.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.498+0000 7fe8177fe700 1 -- 172.21.15.69:0/638918931 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe81009ded0 con 0x7fe820101ad0 2024-04-23T10:25:51.498 INFO:teuthology.orchestra.run.smithi069.stdout:167503724599 2024-04-23T10:25:51.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 -- 172.21.15.69:0/638918931 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe80c0a3d50 msgr2=0x7fe80c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:51.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe80c0a3d50 0x7fe80c0a6210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0099d0 tx=0x7fe81c008040 comp rx=0 tx=0).stop 2024-04-23T10:25:51.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 -- 172.21.15.69:0/638918931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe820101ad0 msgr2=0x7fe82019ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:51.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe820101ad0 0x7fe82019ba90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe810000c00 tx=0x7fe8100037a0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 -- 172.21.15.69:0/638918931 shutdown_connections 2024-04-23T10:25:51.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe80c0a3d50 0x7fe80c0a6210 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe820103950 0x7fe82019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe820101030 0x7fe82019b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 --2- 172.21.15.69:0/638918931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe820101ad0 0x7fe82019ba90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 -- 172.21.15.69:0/638918931 >> 172.21.15.69:0/638918931 conn(0x7fe820077fb0 msgr2=0x7fe8200fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:51.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 -- 172.21.15.69:0/638918931 shutdown_connections 2024-04-23T10:25:51.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.501+0000 7fe8283d3700 1 -- 172.21.15.69:0/638918931 wait complete. 2024-04-23T10:25:51.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:51 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2237445170' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-23T10:25:51.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.731+0000 7fadd3011700 1 -- 172.21.15.69:0/4173322645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadcc1063f0 msgr2=0x7fadcc10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:51.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.731+0000 7fadd3011700 1 --2- 172.21.15.69:0/4173322645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadcc1063f0 0x7fadcc10dfc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fadc400b0d0 tx=0x7fadc400b3e0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.731+0000 7fadd3011700 1 -- 172.21.15.69:0/4173322645 shutdown_connections 2024-04-23T10:25:51.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.731+0000 7fadd3011700 1 --2- 172.21.15.69:0/4173322645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadcc1063f0 0x7fadcc10dfc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.731+0000 7fadd3011700 1 --2- 172.21.15.69:0/4173322645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc101360 0x7fadcc101740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.731+0000 7fadd3011700 1 --2- 172.21.15.69:0/4173322645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc101d10 0x7fadcc105d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.731+0000 7fadd3011700 1 -- 172.21.15.69:0/4173322645 >> 172.21.15.69:0/4173322645 conn(0x7fadcc077fb0 msgr2=0x7fadcc0ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:51.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.731+0000 7fadd3011700 1 -- 172.21.15.69:0/4173322645 shutdown_connections 2024-04-23T10:25:51.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.731+0000 7fadd3011700 1 -- 172.21.15.69:0/4173322645 wait complete. 2024-04-23T10:25:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd3011700 1 Processor -- start 2024-04-23T10:25:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd3011700 1 -- start start 2024-04-23T10:25:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd3011700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadcc101360 0x7fadcc0fd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd3011700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc101d10 0x7fadcc0fd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd3011700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc1063f0 0x7fadcc0fdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd3011700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc111440 con 0x7fadcc101360 2024-04-23T10:25:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd3011700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1112c0 con 0x7fadcc1063f0 2024-04-23T10:25:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd3011700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1115c0 con 0x7fadcc101d10 2024-04-23T10:25:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd0dad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadcc101360 0x7fadcc0fd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd0dad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadcc101360 0x7fadcc0fd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56374/0 (socket says 172.21.15.69:56374) 2024-04-23T10:25:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd0dad700 1 -- 172.21.15.69:0/28110906 learned_addr learned my addr 172.21.15.69:0/28110906 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadd15ae700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc1063f0 0x7fadcc0fdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.732+0000 7fadcbfff700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc101d10 0x7fadcc0fd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.733+0000 7fadd0dad700 1 -- 172.21.15.69:0/28110906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc101d10 msgr2=0x7fadcc0fd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.733+0000 7fadd0dad700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc101d10 0x7fadcc0fd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.733+0000 7fadd0dad700 1 -- 172.21.15.69:0/28110906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc1063f0 msgr2=0x7fadcc0fdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.733+0000 7fadd0dad700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc1063f0 0x7fadcc0fdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.733+0000 7fadd0dad700 1 -- 172.21.15.69:0/28110906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc1a7720 con 0x7fadcc101360 2024-04-23T10:25:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.733+0000 7fadd0dad700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadcc101360 0x7fadcc0fd420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fadc000b530 tx=0x7fadc000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.733+0000 7fadc9ffb700 1 -- 172.21.15.69:0/28110906 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0015020 con 0x7fadcc101360 2024-04-23T10:25:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.733+0000 7fadd3011700 1 -- 172.21.15.69:0/28110906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc1a7a10 con 0x7fadcc101360 2024-04-23T10:25:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.733+0000 7fadc9ffb700 1 -- 172.21.15.69:0/28110906 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fadc0011d00 con 0x7fadcc101360 2024-04-23T10:25:51.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.733+0000 7fadc9ffb700 1 -- 172.21.15.69:0/28110906 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc001add0 con 0x7fadcc101360 2024-04-23T10:25:51.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.733+0000 7fadd3011700 1 -- 172.21.15.69:0/28110906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1a7f50 con 0x7fadcc101360 2024-04-23T10:25:51.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.734+0000 7fadd3011700 1 -- 172.21.15.69:0/28110906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadcc1027f0 con 0x7fadcc101360 2024-04-23T10:25:51.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.735+0000 7fadc9ffb700 1 -- 172.21.15.69:0/28110906 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fadc0018020 con 0x7fadcc101360 2024-04-23T10:25:51.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.736+0000 7fadc9ffb700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fadbc0a3cd0 0x7fadbc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:51.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.736+0000 7fadcbfff700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fadbc0a3cd0 0x7fadbc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:51.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.736+0000 7fadc9ffb700 1 -- 172.21.15.69:0/28110906 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fadc00cfa00 con 0x7fadcc101360 2024-04-23T10:25:51.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.736+0000 7fadcbfff700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fadbc0a3cd0 0x7fadbc0a6190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fadcc105c60 tx=0x7fadb800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:51.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.741+0000 7fadc9ffb700 1 -- 172.21.15.69:0/28110906 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fadc001f020 con 0x7fadcc101360 2024-04-23T10:25:51.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.951+0000 7fadd3011700 1 -- 172.21.15.69:0/28110906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fadcc0fe930 con 0x7fadcc101360 2024-04-23T10:25:51.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.951+0000 7fadc9ffb700 1 -- 172.21.15.69:0/28110906 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fadcc0fe930 con 0x7fadcc101360 2024-04-23T10:25:51.950 INFO:teuthology.orchestra.run.smithi069.stdout:257698037800 2024-04-23T10:25:51.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.953+0000 7fadd3011700 1 -- 172.21.15.69:0/28110906 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fadbc0a3cd0 msgr2=0x7fadbc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:51.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.953+0000 7fadd3011700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fadbc0a3cd0 0x7fadbc0a6190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fadcc105c60 tx=0x7fadb800b410 comp rx=0 tx=0).stop 2024-04-23T10:25:51.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.953+0000 7fadd3011700 1 -- 172.21.15.69:0/28110906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadcc101360 msgr2=0x7fadcc0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:51.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.953+0000 7fadd3011700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadcc101360 0x7fadcc0fd420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fadc000b530 tx=0x7fadc000b840 comp rx=0 tx=0).stop 2024-04-23T10:25:51.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.954+0000 7fadd3011700 1 -- 172.21.15.69:0/28110906 shutdown_connections 2024-04-23T10:25:51.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.954+0000 7fadd3011700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fadbc0a3cd0 0x7fadbc0a6190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.954+0000 7fadd3011700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc1063f0 0x7fadcc0fdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.954+0000 7fadd3011700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadcc101360 0x7fadcc0fd420 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.954+0000 7fadd3011700 1 --2- 172.21.15.69:0/28110906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc101d10 0x7fadcc0fd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:51.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.954+0000 7fadd3011700 1 -- 172.21.15.69:0/28110906 >> 172.21.15.69:0/28110906 conn(0x7fadcc077fb0 msgr2=0x7fadcc107f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:51.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.954+0000 7fadd3011700 1 -- 172.21.15.69:0/28110906 shutdown_connections 2024-04-23T10:25:51.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:51.954+0000 7fadd3011700 1 -- 172.21.15.69:0/28110906 wait complete. 2024-04-23T10:25:52.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:52 smithi146 ceph-mon[32800]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-23T10:25:52.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:52 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/638918931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-23T10:25:52.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:52 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/28110906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-23T10:25:52.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:52 smithi069 ceph-mon[29593]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-23T10:25:52.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:52 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/638918931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-23T10:25:52.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:52 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/28110906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-23T10:25:52.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:52 smithi167 ceph-mon[32940]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-23T10:25:52.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:52 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/638918931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-23T10:25:52.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:52 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/28110906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-23T10:25:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.775+0000 7f80bba0d700 1 -- 172.21.15.69:0/3276899361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b4101dc0 msgr2=0x7f80b410f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.775+0000 7f80bba0d700 1 --2- 172.21.15.69:0/3276899361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b4101dc0 0x7f80b410f830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00b0a0 tx=0x7f80ac00b3b0 comp rx=0 tx=0).stop 2024-04-23T10:25:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.775+0000 7f80bba0d700 1 -- 172.21.15.69:0/3276899361 shutdown_connections 2024-04-23T10:25:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.775+0000 7f80bba0d700 1 --2- 172.21.15.69:0/3276899361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b4101dc0 0x7f80b410f830 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.775+0000 7f80bba0d700 1 --2- 172.21.15.69:0/3276899361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b4107b20 0x7f80b4107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.775+0000 7f80bba0d700 1 --2- 172.21.15.69:0/3276899361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80b4101400 0x7f80b4101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.775+0000 7f80bba0d700 1 -- 172.21.15.69:0/3276899361 >> 172.21.15.69:0/3276899361 conn(0x7f80b4076c60 msgr2=0x7f80b4077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.775+0000 7f80bba0d700 1 -- 172.21.15.69:0/3276899361 shutdown_connections 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.775+0000 7f80bba0d700 1 -- 172.21.15.69:0/3276899361 wait complete. 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80bba0d700 1 Processor -- start 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80bba0d700 1 -- start start 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80bba0d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b4101400 0x7f80b41991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80bba0d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b4101dc0 0x7f80b4199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80bba0d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80b4107b20 0x7f80b419da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80bba0d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4112dd0 con 0x7f80b4101dc0 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80bba0d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4112c50 con 0x7f80b4101400 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80bba0d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4112f50 con 0x7f80b4107b20 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80b8fa8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b4101dc0 0x7f80b4199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80b8fa8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b4101dc0 0x7f80b4199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56396/0 (socket says 172.21.15.69:56396) 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80b8fa8700 1 -- 172.21.15.69:0/434409179 learned_addr learned my addr 172.21.15.69:0/434409179 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:52.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80b97a9700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b4101400 0x7f80b41991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.776+0000 7f80b9faa700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80b4107b20 0x7f80b419da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.777+0000 7f80b8fa8700 1 -- 172.21.15.69:0/434409179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80b4107b20 msgr2=0x7f80b419da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.777+0000 7f80b8fa8700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80b4107b20 0x7f80b419da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.777+0000 7f80b8fa8700 1 -- 172.21.15.69:0/434409179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b4101400 msgr2=0x7f80b41991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.777+0000 7f80b8fa8700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b4101400 0x7f80b41991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.777+0000 7f80b8fa8700 1 -- 172.21.15.69:0/434409179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b419e1d0 con 0x7f80b4101dc0 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.777+0000 7f80b8fa8700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b4101dc0 0x7f80b4199700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f80a400b530 tx=0x7f80a400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.777+0000 7f80aa7fc700 1 -- 172.21.15.69:0/434409179 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4015020 con 0x7f80b4101dc0 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.777+0000 7f80aa7fc700 1 -- 172.21.15.69:0/434409179 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80a4011d00 con 0x7f80b4101dc0 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.777+0000 7f80bba0d700 1 -- 172.21.15.69:0/434409179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b419e4c0 con 0x7f80b4101dc0 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.777+0000 7f80aa7fc700 1 -- 172.21.15.69:0/434409179 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a400f2e0 con 0x7f80b4101dc0 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.777+0000 7f80bba0d700 1 -- 172.21.15.69:0/434409179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b41a5d40 con 0x7f80b4101dc0 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.778+0000 7f80bba0d700 1 -- 172.21.15.69:0/434409179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b4069730 con 0x7f80b4101dc0 2024-04-23T10:25:52.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.779+0000 7f80aa7fc700 1 -- 172.21.15.69:0/434409179 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f80a4018020 con 0x7f80b4101dc0 2024-04-23T10:25:52.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.779+0000 7f80aa7fc700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f80a00a3d50 0x7f80a00a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:52.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.780+0000 7f80b97a9700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f80a00a3d50 0x7f80a00a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:52.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.780+0000 7f80aa7fc700 1 -- 172.21.15.69:0/434409179 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f80a40d0010 con 0x7f80b4101dc0 2024-04-23T10:25:52.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.780+0000 7f80b97a9700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f80a00a3d50 0x7f80a00a6210 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f80b40781e0 tx=0x7f80b000a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:52.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.783+0000 7f80aa7fc700 1 -- 172.21.15.69:0/434409179 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f80a401f020 con 0x7f80b4101dc0 2024-04-23T10:25:52.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.994+0000 7f80bba0d700 1 -- 172.21.15.69:0/434409179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f80b41a5f70 con 0x7f80b4101dc0 2024-04-23T10:25:52.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.995+0000 7f80aa7fc700 1 -- 172.21.15.69:0/434409179 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f80a409cb50 con 0x7f80b4101dc0 2024-04-23T10:25:52.994 INFO:teuthology.orchestra.run.smithi069.stdout:313532612637 2024-04-23T10:25:52.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 -- 172.21.15.69:0/434409179 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f80a00a3d50 msgr2=0x7f80a00a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:52.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f80a00a3d50 0x7f80a00a6210 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f80b40781e0 tx=0x7f80b000a3b0 comp rx=0 tx=0).stop 2024-04-23T10:25:52.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 -- 172.21.15.69:0/434409179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b4101dc0 msgr2=0x7f80b4199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:52.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b4101dc0 0x7f80b4199700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f80a400b530 tx=0x7f80a400b840 comp rx=0 tx=0).stop 2024-04-23T10:25:52.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 -- 172.21.15.69:0/434409179 shutdown_connections 2024-04-23T10:25:52.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f80a00a3d50 0x7f80a00a6210 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:52.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80b4107b20 0x7f80b419da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:52.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b4101400 0x7f80b41991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:52.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 --2- 172.21.15.69:0/434409179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b4101dc0 0x7f80b4199700 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:52.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 -- 172.21.15.69:0/434409179 >> 172.21.15.69:0/434409179 conn(0x7f80b4076c60 msgr2=0x7f80b40ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:52.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 -- 172.21.15.69:0/434409179 shutdown_connections 2024-04-23T10:25:52.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:52.997+0000 7f80bba0d700 1 -- 172.21.15.69:0/434409179 wait complete. 2024-04-23T10:25:53.168 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724595 got 167503724599 for osd.5 2024-04-23T10:25:53.168 DEBUG:teuthology.parallel:result is None 2024-04-23T10:25:53.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:53 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:25:53.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:53 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/434409179' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-23T10:25:53.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:53 smithi069 ceph-mon[29593]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:25:53.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:53 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:25:53.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:53 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/434409179' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-23T10:25:53.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:53 smithi167 ceph-mon[32940]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:25:53.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:53 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:25:53.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:53 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/434409179' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-23T10:25:53.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:53 smithi146 ceph-mon[32800]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:25:53.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.991+0000 7f653de91700 1 -- 172.21.15.69:0/922620987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6538108ad0 msgr2=0x7f6538108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:53.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.991+0000 7f653de91700 1 --2- 172.21.15.69:0/922620987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6538108ad0 0x7f6538108eb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6530009990 tx=0x7f6530009ca0 comp rx=0 tx=0).stop 2024-04-23T10:25:53.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.991+0000 7f653de91700 1 -- 172.21.15.69:0/922620987 shutdown_connections 2024-04-23T10:25:53.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.991+0000 7f653de91700 1 --2- 172.21.15.69:0/922620987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65381019d0 0x7f653810f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.991+0000 7f653de91700 1 --2- 172.21.15.69:0/922620987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6538108ad0 0x7f6538108eb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.991+0000 7f653de91700 1 --2- 172.21.15.69:0/922620987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6538101030 0x7f6538101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.991+0000 7f653de91700 1 -- 172.21.15.69:0/922620987 >> 172.21.15.69:0/922620987 conn(0x7f6538077fb0 msgr2=0x7f65380ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.991+0000 7f653de91700 1 -- 172.21.15.69:0/922620987 shutdown_connections 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.991+0000 7f653de91700 1 -- 172.21.15.69:0/922620987 wait complete. 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.992+0000 7f653de91700 1 Processor -- start 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.992+0000 7f653de91700 1 -- start start 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.992+0000 7f653de91700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6538101030 0x7f6538102210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.992+0000 7f653de91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65381019d0 0x7f6538102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.992+0000 7f653de91700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6538108ad0 0x7f6538102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.992+0000 7f653de91700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6538112da0 con 0x7f6538108ad0 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.992+0000 7f653de91700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6538112c20 con 0x7f65381019d0 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.992+0000 7f653de91700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6538112f20 con 0x7f6538101030 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f65377fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6538101030 0x7f6538102210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6537fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6538108ad0 0x7f6538102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:53.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6536ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65381019d0 0x7f6538102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:53.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f65377fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6538101030 0x7f6538102210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.69:55172/0 (socket says 172.21.15.69:55172) 2024-04-23T10:25:53.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6537fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6538108ad0 0x7f6538102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56402/0 (socket says 172.21.15.69:56402) 2024-04-23T10:25:53.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f65377fe700 1 -- 172.21.15.69:0/2889625365 learned_addr learned my addr 172.21.15.69:0/2889625365 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6537fff700 1 -- 172.21.15.69:0/2889625365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6538101030 msgr2=0x7f6538102210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6537fff700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6538101030 0x7f6538102210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6537fff700 1 -- 172.21.15.69:0/2889625365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65381019d0 msgr2=0x7f6538102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6537fff700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65381019d0 0x7f6538102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6537fff700 1 -- 172.21.15.69:0/2889625365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65381a7720 con 0x7f6538108ad0 2024-04-23T10:25:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6536ffd700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65381019d0 0x7f6538102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:25:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6537fff700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6538108ad0 0x7f6538102c90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f652800c7a0 tx=0x7f652800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6534ff9700 1 -- 172.21.15.69:0/2889625365 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6528004a30 con 0x7f6538108ad0 2024-04-23T10:25:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f653de91700 1 -- 172.21.15.69:0/2889625365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65381a7a10 con 0x7f6538108ad0 2024-04-23T10:25:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6534ff9700 1 -- 172.21.15.69:0/2889625365 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f65280054f0 con 0x7f6538108ad0 2024-04-23T10:25:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f6534ff9700 1 -- 172.21.15.69:0/2889625365 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652800ec30 con 0x7f6538108ad0 2024-04-23T10:25:53.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.993+0000 7f653de91700 1 -- 172.21.15.69:0/2889625365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65381a7fa0 con 0x7f6538108ad0 2024-04-23T10:25:53.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.995+0000 7f653de91700 1 -- 172.21.15.69:0/2889625365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653810aeb0 con 0x7f6538108ad0 2024-04-23T10:25:53.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.996+0000 7f6534ff9700 1 -- 172.21.15.69:0/2889625365 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6528004bd0 con 0x7f6538108ad0 2024-04-23T10:25:53.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.996+0000 7f6534ff9700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65200a3cd0 0x7f65200a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:53.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.997+0000 7f65377fe700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65200a3cd0 0x7f65200a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:53.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.997+0000 7f6534ff9700 1 -- 172.21.15.69:0/2889625365 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f65280cff10 con 0x7f6538108ad0 2024-04-23T10:25:53.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:53.997+0000 7f65377fe700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65200a3cd0 0x7f65200a6190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f653000b2e0 tx=0x7f653000b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:54.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.001+0000 7f6534ff9700 1 -- 172.21.15.69:0/2889625365 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f652809c9d0 con 0x7f6538108ad0 2024-04-23T10:25:54.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.205+0000 7f653de91700 1 -- 172.21.15.69:0/2889625365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f653810a890 con 0x7f6538108ad0 2024-04-23T10:25:54.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.206+0000 7f6534ff9700 1 -- 172.21.15.69:0/2889625365 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f652809c2d0 con 0x7f6538108ad0 2024-04-23T10:25:54.205 INFO:teuthology.orchestra.run.smithi069.stdout:111669149760 2024-04-23T10:25:54.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 -- 172.21.15.69:0/2889625365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65200a3cd0 msgr2=0x7f65200a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:54.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65200a3cd0 0x7f65200a6190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f653000b2e0 tx=0x7f653000b610 comp rx=0 tx=0).stop 2024-04-23T10:25:54.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 -- 172.21.15.69:0/2889625365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6538108ad0 msgr2=0x7f6538102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:54.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6538108ad0 0x7f6538102c90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f652800c7a0 tx=0x7f652800cab0 comp rx=0 tx=0).stop 2024-04-23T10:25:54.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 -- 172.21.15.69:0/2889625365 shutdown_connections 2024-04-23T10:25:54.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65200a3cd0 0x7f65200a6190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:54.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6538108ad0 0x7f6538102c90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:54.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6538101030 0x7f6538102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:54.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 --2- 172.21.15.69:0/2889625365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65381019d0 0x7f6538102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:54.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 -- 172.21.15.69:0/2889625365 >> 172.21.15.69:0/2889625365 conn(0x7f6538077fb0 msgr2=0x7f65380ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:54.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 -- 172.21.15.69:0/2889625365 shutdown_connections 2024-04-23T10:25:54.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:54.208+0000 7f653de91700 1 -- 172.21.15.69:0/2889625365 wait complete. 2024-04-23T10:25:54.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:54 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2889625365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-23T10:25:54.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:54 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2889625365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-23T10:25:54.648 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037796 got 257698037800 for osd.8 2024-04-23T10:25:54.648 DEBUG:teuthology.parallel:result is None 2024-04-23T10:25:54.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:54 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2889625365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-23T10:25:55.031 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612632 got 313532612637 for osd.10 2024-04-23T10:25:55.031 DEBUG:teuthology.parallel:result is None 2024-04-23T10:25:55.203 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:55.627 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776158 got 292057776163 for osd.9 2024-04-23T10:25:55.627 DEBUG:teuthology.parallel:result is None 2024-04-23T10:25:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:55 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:55 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:55 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:55 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:55.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:55 smithi146 ceph-mon[32800]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T10:25:55.955 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:55.955 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:55.955 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:55.955 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:55 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:55.955 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:55 smithi069 ceph-mon[29593]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T10:25:56.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:56.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:56.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:55 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:25:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:55 smithi167 ceph-mon[32940]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T10:25:56.594 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:25:57.442 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149756 got 111669149760 for osd.3 2024-04-23T10:25:57.442 DEBUG:teuthology.parallel:result is None 2024-04-23T10:25:58.158 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:58 smithi069 ceph-mon[29593]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:25:58.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:58 smithi167 ceph-mon[32940]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:25:58.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:58 smithi146 ceph-mon[32800]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:25:59.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.215+0000 7fb1d34aa700 1 -- 172.21.15.69:0/1539129021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1cc103480 msgr2=0x7fb1cc10f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:59.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.215+0000 7fb1d34aa700 1 --2- 172.21.15.69:0/1539129021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1cc103480 0x7fb1cc10f8d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400b0a0 tx=0x7fb1c400b3b0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.215+0000 7fb1d34aa700 1 -- 172.21.15.69:0/1539129021 shutdown_connections 2024-04-23T10:25:59.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.215+0000 7fb1d34aa700 1 --2- 172.21.15.69:0/1539129021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1cc103480 0x7fb1cc10f8d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.216+0000 7fb1d34aa700 1 --2- 172.21.15.69:0/1539129021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1cc108a70 0x7fb1cc108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.216+0000 7fb1d34aa700 1 --2- 172.21.15.69:0/1539129021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1cc102ac0 0x7fb1cc102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.216+0000 7fb1d34aa700 1 -- 172.21.15.69:0/1539129021 >> 172.21.15.69:0/1539129021 conn(0x7fb1cc079bb0 msgr2=0x7fb1cc079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:59.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.216+0000 7fb1d34aa700 1 -- 172.21.15.69:0/1539129021 shutdown_connections 2024-04-23T10:25:59.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.216+0000 7fb1d34aa700 1 -- 172.21.15.69:0/1539129021 wait complete. 2024-04-23T10:25:59.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.216+0000 7fb1d34aa700 1 Processor -- start 2024-04-23T10:25:59.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.216+0000 7fb1d34aa700 1 -- start start 2024-04-23T10:25:59.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.216+0000 7fb1d34aa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1cc102ac0 0x7fb1cc1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:59.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d34aa700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1cc103480 0x7fb1cc199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:59.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d34aa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1cc108a70 0x7fb1cc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:59.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d34aa700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc112e40 con 0x7fb1cc102ac0 2024-04-23T10:25:59.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d34aa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc112cc0 con 0x7fb1cc108a70 2024-04-23T10:25:59.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d34aa700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc112fc0 con 0x7fb1cc103480 2024-04-23T10:25:59.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d1246700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1cc102ac0 0x7fb1cc1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:59.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d1246700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1cc102ac0 0x7fb1cc1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56422/0 (socket says 172.21.15.69:56422) 2024-04-23T10:25:59.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d1246700 1 -- 172.21.15.69:0/2649901517 learned_addr learned my addr 172.21.15.69:0/2649901517 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:25:59.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d0a45700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1cc103480 0x7fb1cc199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:59.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d1a47700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1cc108a70 0x7fb1cc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:59.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d1246700 1 -- 172.21.15.69:0/2649901517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1cc103480 msgr2=0x7fb1cc199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:59.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d1246700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1cc103480 0x7fb1cc199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d1246700 1 -- 172.21.15.69:0/2649901517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1cc108a70 msgr2=0x7fb1cc19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:59.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d1246700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1cc108a70 0x7fb1cc19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d1246700 1 -- 172.21.15.69:0/2649901517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc19e2b0 con 0x7fb1cc102ac0 2024-04-23T10:25:59.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d1a47700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1cc108a70 0x7fb1cc19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:59.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d1246700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1cc102ac0 0x7fb1cc1992f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800b530 tx=0x7fb1c800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:59.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1c27fc700 1 -- 172.21.15.69:0/2649901517 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8015020 con 0x7fb1cc102ac0 2024-04-23T10:25:59.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1c27fc700 1 -- 172.21.15.69:0/2649901517 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb1c8011d00 con 0x7fb1cc102ac0 2024-04-23T10:25:59.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d34aa700 1 -- 172.21.15.69:0/2649901517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1cc19e5a0 con 0x7fb1cc102ac0 2024-04-23T10:25:59.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1c27fc700 1 -- 172.21.15.69:0/2649901517 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8010e60 con 0x7fb1cc102ac0 2024-04-23T10:25:59.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.217+0000 7fb1d34aa700 1 -- 172.21.15.69:0/2649901517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1cc1a5e20 con 0x7fb1cc102ac0 2024-04-23T10:25:59.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.218+0000 7fb1d34aa700 1 -- 172.21.15.69:0/2649901517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1cc069730 con 0x7fb1cc102ac0 2024-04-23T10:25:59.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.219+0000 7fb1c27fc700 1 -- 172.21.15.69:0/2649901517 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb1c8018020 con 0x7fb1cc102ac0 2024-04-23T10:25:59.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.220+0000 7fb1c27fc700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb1b80a3cd0 0x7fb1b80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:59.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.220+0000 7fb1d0a45700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb1b80a3cd0 0x7fb1b80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:59.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.220+0000 7fb1c27fc700 1 -- 172.21.15.69:0/2649901517 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fb1c80cfcd0 con 0x7fb1cc102ac0 2024-04-23T10:25:59.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.221+0000 7fb1d0a45700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb1b80a3cd0 0x7fb1b80a6190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc006fd0 tx=0x7fb1bc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:59.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.225+0000 7fb1c27fc700 1 -- 172.21.15.69:0/2649901517 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb1c801f020 con 0x7fb1cc102ac0 2024-04-23T10:25:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-04-23T10:25:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-23T10:25:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-23T10:25:59.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-04-23T10:25:59.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-04-23T10:25:59.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-04-23T10:25:59.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-04-23T10:25:59.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:25:59 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2024-04-23T10:25:59.346 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-04-23T10:25:59.346 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-23T10:25:59.346 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-23T10:25:59.346 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-04-23T10:25:59.347 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-04-23T10:25:59.347 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-04-23T10:25:59.347 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-04-23T10:25:59.347 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:25:59 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2024-04-23T10:25:59.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-04-23T10:25:59.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-23T10:25:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-23T10:25:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-04-23T10:25:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-04-23T10:25:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-04-23T10:25:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-04-23T10:25:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:25:59 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2024-04-23T10:25:59.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.438+0000 7fb1d34aa700 1 -- 172.21.15.69:0/2649901517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb1cc19a600 con 0x7fb1cc102ac0 2024-04-23T10:25:59.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.438+0000 7fb1c27fc700 1 -- 172.21.15.69:0/2649901517 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb1c809c670 con 0x7fb1cc102ac0 2024-04-23T10:25:59.437 INFO:teuthology.orchestra.run.smithi069.stdout:34359738449 2024-04-23T10:25:59.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 -- 172.21.15.69:0/2649901517 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb1b80a3cd0 msgr2=0x7fb1b80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:59.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb1b80a3cd0 0x7fb1b80a6190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc006fd0 tx=0x7fb1bc008040 comp rx=0 tx=0).stop 2024-04-23T10:25:59.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 -- 172.21.15.69:0/2649901517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1cc102ac0 msgr2=0x7fb1cc1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:59.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1cc102ac0 0x7fb1cc1992f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800b530 tx=0x7fb1c800b8f0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 -- 172.21.15.69:0/2649901517 shutdown_connections 2024-04-23T10:25:59.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb1b80a3cd0 0x7fb1b80a6190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1cc108a70 0x7fb1cc19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1cc102ac0 0x7fb1cc1992f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 --2- 172.21.15.69:0/2649901517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1cc103480 0x7fb1cc199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:59.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 -- 172.21.15.69:0/2649901517 >> 172.21.15.69:0/2649901517 conn(0x7fb1cc079bb0 msgr2=0x7fb1cc101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:59.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 -- 172.21.15.69:0/2649901517 shutdown_connections 2024-04-23T10:25:59.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:25:59.441+0000 7fb1d34aa700 1 -- 172.21.15.69:0/2649901517 wait complete. 2024-04-23T10:26:00.089 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:00.370 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:00 smithi069 ceph-mon[29593]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:00.370 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-04-23T10:26:00.370 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-23T10:26:00.370 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-23T10:26:00.370 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-04-23T10:26:00.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-04-23T10:26:00.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-04-23T10:26:00.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-04-23T10:26:00.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:00 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2024-04-23T10:26:00.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:00 smithi069 ceph-mon[29593]: osdmap e87: 12 total, 12 up, 12 in 2024-04-23T10:26:00.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:00 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2649901517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-23T10:26:00.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.381+0000 7f0017b17700 1 -- 172.21.15.69:0/1752135812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0010103450 msgr2=0x7f001010f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:00.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.381+0000 7f0017b17700 1 --2- 172.21.15.69:0/1752135812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0010103450 0x7f001010f8b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f000800b0a0 tx=0x7f000800b3b0 comp rx=0 tx=0).stop 2024-04-23T10:26:00.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.381+0000 7f0017b17700 1 -- 172.21.15.69:0/1752135812 shutdown_connections 2024-04-23T10:26:00.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.381+0000 7f0017b17700 1 --2- 172.21.15.69:0/1752135812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0010103450 0x7f001010f8b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:00.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.381+0000 7f0017b17700 1 --2- 172.21.15.69:0/1752135812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0010108a50 0x7f0010108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:00.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.381+0000 7f0017b17700 1 --2- 172.21.15.69:0/1752135812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010102a90 0x7f0010102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:00.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.381+0000 7f0017b17700 1 -- 172.21.15.69:0/1752135812 >> 172.21.15.69:0/1752135812 conn(0x7f0010079ba0 msgr2=0x7f0010079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:00.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.381+0000 7f0017b17700 1 -- 172.21.15.69:0/1752135812 shutdown_connections 2024-04-23T10:26:00.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.381+0000 7f0017b17700 1 -- 172.21.15.69:0/1752135812 wait complete. 2024-04-23T10:26:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f0017b17700 1 Processor -- start 2024-04-23T10:26:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f0017b17700 1 -- start start 2024-04-23T10:26:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f0017b17700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0010102a90 0x7f0010199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f0017b17700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0010103450 0x7f00101997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f0017b17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010108a50 0x7f001019daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f0017b17700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0010112da0 con 0x7f0010103450 2024-04-23T10:26:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f0017b17700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0010112c20 con 0x7f0010108a50 2024-04-23T10:26:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f0017b17700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0010112f20 con 0x7f0010102a90 2024-04-23T10:26:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f00150b2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0010103450 0x7f00101997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f00150b2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0010103450 0x7f00101997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55398/0 (socket says 172.21.15.69:55398) 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f00150b2700 1 -- 172.21.15.69:0/2672555263 learned_addr learned my addr 172.21.15.69:0/2672555263 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f00158b3700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0010102a90 0x7f0010199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f00160b4700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010108a50 0x7f001019daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f00150b2700 1 -- 172.21.15.69:0/2672555263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0010102a90 msgr2=0x7f0010199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f00150b2700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0010102a90 0x7f0010199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f00150b2700 1 -- 172.21.15.69:0/2672555263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010108a50 msgr2=0x7f001019daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f00150b2700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010108a50 0x7f001019daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.382+0000 7f00150b2700 1 -- 172.21.15.69:0/2672555263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001019e230 con 0x7f0010103450 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.383+0000 7f00160b4700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010108a50 0x7f001019daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.383+0000 7f00150b2700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0010103450 0x7f00101997b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c9b0 tx=0x7f000c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.383+0000 7f0006ffd700 1 -- 172.21.15.69:0/2672555263 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c007b00 con 0x7f0010103450 2024-04-23T10:26:00.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.383+0000 7f0006ffd700 1 -- 172.21.15.69:0/2672555263 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f000c007ca0 con 0x7f0010103450 2024-04-23T10:26:00.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.383+0000 7f0006ffd700 1 -- 172.21.15.69:0/2672555263 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c0187c0 con 0x7f0010103450 2024-04-23T10:26:00.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.383+0000 7f0017b17700 1 -- 172.21.15.69:0/2672555263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001019e520 con 0x7f0010103450 2024-04-23T10:26:00.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.383+0000 7f0017b17700 1 -- 172.21.15.69:0/2672555263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00101a5da0 con 0x7f0010103450 2024-04-23T10:26:00.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.384+0000 7f0017b17700 1 -- 172.21.15.69:0/2672555263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0010069730 con 0x7f0010103450 2024-04-23T10:26:00.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.385+0000 7f0006ffd700 1 -- 172.21.15.69:0/2672555263 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f000c00f450 con 0x7f0010103450 2024-04-23T10:26:00.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.385+0000 7f0006ffd700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efffc0a3d50 0x7efffc0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:00.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.386+0000 7f00158b3700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efffc0a3d50 0x7efffc0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:00.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.386+0000 7f0006ffd700 1 -- 172.21.15.69:0/2672555263 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f000c0d08b0 con 0x7f0010103450 2024-04-23T10:26:00.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.386+0000 7f00158b3700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efffc0a3d50 0x7efffc0a6210 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0000006fd0 tx=0x7f0000008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:00.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.389+0000 7f0006ffd700 1 -- 172.21.15.69:0/2672555263 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f000c014030 con 0x7f0010103450 2024-04-23T10:26:00.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:00 smithi146 ceph-mon[32800]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:00.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:00 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-04-23T10:26:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:00 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-23T10:26:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:00 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-23T10:26:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:00 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-04-23T10:26:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:00 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-04-23T10:26:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:00 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-04-23T10:26:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:00 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-04-23T10:26:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:00 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2024-04-23T10:26:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:00 smithi146 ceph-mon[32800]: osdmap e87: 12 total, 12 up, 12 in 2024-04-23T10:26:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:00 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2649901517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-23T10:26:00.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:00 smithi167 ceph-mon[32940]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:00.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:00 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-04-23T10:26:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:00 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-23T10:26:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:00 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-23T10:26:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:00 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-04-23T10:26:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:00 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-04-23T10:26:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:00 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-04-23T10:26:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:00 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-04-23T10:26:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:00 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2024-04-23T10:26:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:00 smithi167 ceph-mon[32940]: osdmap e87: 12 total, 12 up, 12 in 2024-04-23T10:26:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:00 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2649901517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-23T10:26:00.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.592+0000 7f0017b17700 1 -- 172.21.15.69:0/2672555263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f001002df80 con 0x7f0010103450 2024-04-23T10:26:00.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.592+0000 7f0006ffd700 1 -- 172.21.15.69:0/2672555263 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f000c00de20 con 0x7f0010103450 2024-04-23T10:26:00.591 INFO:teuthology.orchestra.run.smithi069.stdout:77309411399 2024-04-23T10:26:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 -- 172.21.15.69:0/2672555263 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efffc0a3d50 msgr2=0x7efffc0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efffc0a3d50 0x7efffc0a6210 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0000006fd0 tx=0x7f0000008040 comp rx=0 tx=0).stop 2024-04-23T10:26:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 -- 172.21.15.69:0/2672555263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0010103450 msgr2=0x7f00101997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0010103450 0x7f00101997b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c9b0 tx=0x7f000c00cd70 comp rx=0 tx=0).stop 2024-04-23T10:26:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 -- 172.21.15.69:0/2672555263 shutdown_connections 2024-04-23T10:26:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7efffc0a3d50 0x7efffc0a6210 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010108a50 0x7f001019daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0010102a90 0x7f0010199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 --2- 172.21.15.69:0/2672555263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0010103450 0x7f00101997b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 -- 172.21.15.69:0/2672555263 >> 172.21.15.69:0/2672555263 conn(0x7f0010079ba0 msgr2=0x7f00101016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 -- 172.21.15.69:0/2672555263 shutdown_connections 2024-04-23T10:26:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:00.594+0000 7f0017b17700 1 -- 172.21.15.69:0/2672555263 wait complete. 2024-04-23T10:26:00.808 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738449 for osd.0 2024-04-23T10:26:00.808 DEBUG:teuthology.parallel:result is None 2024-04-23T10:26:01.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:01 smithi146 ceph-mon[32800]: osdmap e88: 12 total, 12 up, 12 in 2024-04-23T10:26:01.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:01 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2672555263' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-23T10:26:01.436 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:01 smithi069 ceph-mon[29593]: osdmap e88: 12 total, 12 up, 12 in 2024-04-23T10:26:01.436 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:01 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2672555263' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-23T10:26:01.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:01 smithi167 ceph-mon[32940]: osdmap e88: 12 total, 12 up, 12 in 2024-04-23T10:26:01.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:01 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2672555263' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-23T10:26:02.410 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:02 smithi069 ceph-mon[29593]: pgmap v319: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-04-23T10:26:02.410 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:02 smithi069 ceph-mon[29593]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-23T10:26:02.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:02 smithi146 ceph-mon[32800]: pgmap v319: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-04-23T10:26:02.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:02 smithi146 ceph-mon[32800]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-23T10:26:02.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:02 smithi167 ceph-mon[32940]: pgmap v319: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-04-23T10:26:02.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:02 smithi167 ceph-mon[32940]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-23T10:26:02.753 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411399 for osd.2 2024-04-23T10:26:02.753 DEBUG:teuthology.parallel:result is None 2024-04-23T10:26:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.975+0000 7fea47d58700 1 -- 172.21.15.69:0/2297361590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea40108a20 msgr2=0x7fea40108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.975+0000 7fea47d58700 1 --2- 172.21.15.69:0/2297361590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea40108a20 0x7fea40108e00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fea300099c0 tx=0x7fea30009cd0 comp rx=0 tx=0).stop 2024-04-23T10:26:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.975+0000 7fea47d58700 1 -- 172.21.15.69:0/2297361590 shutdown_connections 2024-04-23T10:26:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.975+0000 7fea47d58700 1 --2- 172.21.15.69:0/2297361590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea4006bba0 0x7fea4010f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.975+0000 7fea47d58700 1 --2- 172.21.15.69:0/2297361590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea40108a20 0x7fea40108e00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.975+0000 7fea47d58700 1 --2- 172.21.15.69:0/2297361590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea4006b1e0 0x7fea4006b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.975+0000 7fea47d58700 1 -- 172.21.15.69:0/2297361590 >> 172.21.15.69:0/2297361590 conn(0x7fea400779b0 msgr2=0x7fea40077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.975+0000 7fea47d58700 1 -- 172.21.15.69:0/2297361590 shutdown_connections 2024-04-23T10:26:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.975+0000 7fea47d58700 1 -- 172.21.15.69:0/2297361590 wait complete. 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.975+0000 7fea47d58700 1 Processor -- start 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.975+0000 7fea47d58700 1 -- start start 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea47d58700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea4006b1e0 0x7fea40199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea47d58700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea4006bba0 0x7fea40199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea47d58700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea40108a20 0x7fea4019dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea47d58700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fea40112d20 con 0x7fea40108a20 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea47d58700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea40112ba0 con 0x7fea4006bba0 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea47d58700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fea40112ea0 con 0x7fea4006b1e0 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea462f5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea40108a20 0x7fea4019dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea45af4700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea4006b1e0 0x7fea40199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea462f5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea40108a20 0x7fea4019dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55416/0 (socket says 172.21.15.69:55416) 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea462f5700 1 -- 172.21.15.69:0/2311474081 learned_addr learned my addr 172.21.15.69:0/2311474081 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea452f3700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea4006bba0 0x7fea40199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea462f5700 1 -- 172.21.15.69:0/2311474081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea4006b1e0 msgr2=0x7fea40199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea462f5700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea4006b1e0 0x7fea40199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea462f5700 1 -- 172.21.15.69:0/2311474081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea4006bba0 msgr2=0x7fea40199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea462f5700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea4006bba0 0x7fea40199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea462f5700 1 -- 172.21.15.69:0/2311474081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4019e1f0 con 0x7fea40108a20 2024-04-23T10:26:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.976+0000 7fea462f5700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea40108a20 0x7fea4019dab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fea38007ee0 tx=0x7fea3800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.977+0000 7fea36ffd700 1 -- 172.21.15.69:0/2311474081 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38004bb0 con 0x7fea40108a20 2024-04-23T10:26:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.977+0000 7fea36ffd700 1 -- 172.21.15.69:0/2311474081 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fea38004d50 con 0x7fea40108a20 2024-04-23T10:26:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.977+0000 7fea47d58700 1 -- 172.21.15.69:0/2311474081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea4019e4e0 con 0x7fea40108a20 2024-04-23T10:26:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.977+0000 7fea36ffd700 1 -- 172.21.15.69:0/2311474081 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea380059e0 con 0x7fea40108a20 2024-04-23T10:26:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.977+0000 7fea47d58700 1 -- 172.21.15.69:0/2311474081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea401a5d60 con 0x7fea40108a20 2024-04-23T10:26:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.977+0000 7fea47d58700 1 -- 172.21.15.69:0/2311474081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea401041a0 con 0x7fea40108a20 2024-04-23T10:26:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.979+0000 7fea36ffd700 1 -- 172.21.15.69:0/2311474081 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fea3801a020 con 0x7fea40108a20 2024-04-23T10:26:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.979+0000 7fea36ffd700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea2c0a3cd0 0x7fea2c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.979+0000 7fea45af4700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea2c0a3cd0 0x7fea2c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.979+0000 7fea36ffd700 1 -- 172.21.15.69:0/2311474081 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fea380d01f0 con 0x7fea40108a20 2024-04-23T10:26:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.980+0000 7fea45af4700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea2c0a3cd0 0x7fea2c0a6190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea30009990 tx=0x7fea300095d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:03.983+0000 7fea36ffd700 1 -- 172.21.15.69:0/2311474081 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fea38010070 con 0x7fea40108a20 2024-04-23T10:26:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.193+0000 7fea47d58700 1 -- 172.21.15.69:0/2311474081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fea4002df80 con 0x7fea40108a20 2024-04-23T10:26:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.193+0000 7fea36ffd700 1 -- 172.21.15.69:0/2311474081 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fea3809ca80 con 0x7fea40108a20 2024-04-23T10:26:04.192 INFO:teuthology.orchestra.run.smithi069.stdout:223338299440 2024-04-23T10:26:04.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.195+0000 7fea47d58700 1 -- 172.21.15.69:0/2311474081 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea2c0a3cd0 msgr2=0x7fea2c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:04.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.195+0000 7fea47d58700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea2c0a3cd0 0x7fea2c0a6190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea30009990 tx=0x7fea300095d0 comp rx=0 tx=0).stop 2024-04-23T10:26:04.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.195+0000 7fea47d58700 1 -- 172.21.15.69:0/2311474081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea40108a20 msgr2=0x7fea4019dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:04.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.195+0000 7fea47d58700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea40108a20 0x7fea4019dab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fea38007ee0 tx=0x7fea3800d3b0 comp rx=0 tx=0).stop 2024-04-23T10:26:04.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.195+0000 7fea47d58700 1 -- 172.21.15.69:0/2311474081 shutdown_connections 2024-04-23T10:26:04.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.195+0000 7fea47d58700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fea2c0a3cd0 0x7fea2c0a6190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:04.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.195+0000 7fea47d58700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea40108a20 0x7fea4019dab0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:04.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.195+0000 7fea47d58700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea4006b1e0 0x7fea40199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:04.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.195+0000 7fea47d58700 1 --2- 172.21.15.69:0/2311474081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea4006bba0 0x7fea40199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:04.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.196+0000 7fea47d58700 1 -- 172.21.15.69:0/2311474081 >> 172.21.15.69:0/2311474081 conn(0x7fea400779b0 msgr2=0x7fea40100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:04.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.196+0000 7fea47d58700 1 -- 172.21.15.69:0/2311474081 shutdown_connections 2024-04-23T10:26:04.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:04.196+0000 7fea47d58700 1 -- 172.21.15.69:0/2311474081 wait complete. 2024-04-23T10:26:04.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:04 smithi146 ceph-mon[32800]: pgmap v320: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 14 B/s, 0 objects/s recovering 2024-04-23T10:26:04.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:04 smithi069 ceph-mon[29593]: pgmap v320: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 14 B/s, 0 objects/s recovering 2024-04-23T10:26:04.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:04 smithi167 ceph-mon[32940]: pgmap v320: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 14 B/s, 0 objects/s recovering 2024-04-23T10:26:05.160 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299434 got 223338299440 for osd.7 2024-04-23T10:26:05.160 DEBUG:teuthology.parallel:result is None 2024-04-23T10:26:05.376 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:05 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2311474081' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-23T10:26:05.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:05 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2311474081' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-23T10:26:05.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.482+0000 7fbdf329d700 1 -- 172.21.15.69:0/3330029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdec102300 msgr2=0x7fbdec10e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:05.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.482+0000 7fbdf329d700 1 --2- 172.21.15.69:0/3330029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdec102300 0x7fbdec10e7f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbde400b0a0 tx=0x7fbde400b3b0 comp rx=0 tx=0).stop 2024-04-23T10:26:05.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.482+0000 7fbdf329d700 1 -- 172.21.15.69:0/3330029 shutdown_connections 2024-04-23T10:26:05.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.482+0000 7fbdf329d700 1 --2- 172.21.15.69:0/3330029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdec102300 0x7fbdec10e7f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:05.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.482+0000 7fbdf329d700 1 --2- 172.21.15.69:0/3330029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdec107990 0x7fbdec107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:05.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.482+0000 7fbdf329d700 1 --2- 172.21.15.69:0/3330029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdec101940 0x7fbdec101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:05.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.482+0000 7fbdf329d700 1 -- 172.21.15.69:0/3330029 >> 172.21.15.69:0/3330029 conn(0x7fbdec0788f0 msgr2=0x7fbdec078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:05.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.483+0000 7fbdf329d700 1 -- 172.21.15.69:0/3330029 shutdown_connections 2024-04-23T10:26:05.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.483+0000 7fbdf329d700 1 -- 172.21.15.69:0/3330029 wait complete. 2024-04-23T10:26:05.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.483+0000 7fbdf329d700 1 Processor -- start 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.483+0000 7fbdf329d700 1 -- start start 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.483+0000 7fbdf329d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdec101940 0x7fbdec199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.483+0000 7fbdf329d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdec102300 0x7fbdec19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.483+0000 7fbdf329d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdec107990 0x7fbdec1a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.483+0000 7fbdf329d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec111c10 con 0x7fbdec101940 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.483+0000 7fbdf329d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec111a90 con 0x7fbdec102300 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.483+0000 7fbdf329d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec111d90 con 0x7fbdec107990 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf1039700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdec101940 0x7fbdec199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf1039700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdec101940 0x7fbdec199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55456/0 (socket says 172.21.15.69:55456) 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf1039700 1 -- 172.21.15.69:0/1793183010 learned_addr learned my addr 172.21.15.69:0/1793183010 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf0838700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdec102300 0x7fbdec19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf183a700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdec107990 0x7fbdec1a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf1039700 1 -- 172.21.15.69:0/1793183010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdec107990 msgr2=0x7fbdec1a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:05.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf1039700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdec107990 0x7fbdec1a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:05.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf1039700 1 -- 172.21.15.69:0/1793183010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdec102300 msgr2=0x7fbdec19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:05.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf1039700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdec102300 0x7fbdec19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:05.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf1039700 1 -- 172.21.15.69:0/1793183010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec1a5510 con 0x7fbdec101940 2024-04-23T10:26:05.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf1039700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdec101940 0x7fbdec199f50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c920 tx=0x7fbde800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:05.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbde27fc700 1 -- 172.21.15.69:0/1793183010 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8007b00 con 0x7fbdec101940 2024-04-23T10:26:05.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbde27fc700 1 -- 172.21.15.69:0/1793183010 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbde8004d00 con 0x7fbdec101940 2024-04-23T10:26:05.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf329d700 1 -- 172.21.15.69:0/1793183010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdec1a57a0 con 0x7fbdec101940 2024-04-23T10:26:05.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbde27fc700 1 -- 172.21.15.69:0/1793183010 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8005650 con 0x7fbdec101940 2024-04-23T10:26:05.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.484+0000 7fbdf329d700 1 -- 172.21.15.69:0/1793183010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdec1a5d00 con 0x7fbdec101940 2024-04-23T10:26:05.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.486+0000 7fbdf329d700 1 -- 172.21.15.69:0/1793183010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdec103060 con 0x7fbdec101940 2024-04-23T10:26:05.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.486+0000 7fbde27fc700 1 -- 172.21.15.69:0/1793183010 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fbde8007ca0 con 0x7fbdec101940 2024-04-23T10:26:05.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.487+0000 7fbde27fc700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbdd80a3d50 0x7fbdd80a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:05.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.487+0000 7fbdf0838700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbdd80a3d50 0x7fbdd80a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:05.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.487+0000 7fbde27fc700 1 -- 172.21.15.69:0/1793183010 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fbde80cffe0 con 0x7fbdec101940 2024-04-23T10:26:05.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.488+0000 7fbdf0838700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbdd80a3d50 0x7fbdd80a6210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbdec078e60 tx=0x7fbddc00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:05.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.491+0000 7fbde27fc700 1 -- 172.21.15.69:0/1793183010 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbde8014030 con 0x7fbdec101940 2024-04-23T10:26:05.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:05 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2311474081' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-23T10:26:05.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.710+0000 7fbdf329d700 1 -- 172.21.15.69:0/1793183010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fbdec02df80 con 0x7fbdec101940 2024-04-23T10:26:05.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.710+0000 7fbde27fc700 1 -- 172.21.15.69:0/1793183010 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fbde8004eb0 con 0x7fbdec101940 2024-04-23T10:26:05.709 INFO:teuthology.orchestra.run.smithi069.stdout:347892351003 2024-04-23T10:26:05.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 -- 172.21.15.69:0/1793183010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbdd80a3d50 msgr2=0x7fbdd80a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:05.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbdd80a3d50 0x7fbdd80a6210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbdec078e60 tx=0x7fbddc00a300 comp rx=0 tx=0).stop 2024-04-23T10:26:05.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 -- 172.21.15.69:0/1793183010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdec101940 msgr2=0x7fbdec199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:05.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdec101940 0x7fbdec199f50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c920 tx=0x7fbde800cc30 comp rx=0 tx=0).stop 2024-04-23T10:26:05.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 -- 172.21.15.69:0/1793183010 shutdown_connections 2024-04-23T10:26:05.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbdd80a3d50 0x7fbdd80a6210 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:05.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdec107990 0x7fbdec1a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:05.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdec101940 0x7fbdec199f50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:05.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 --2- 172.21.15.69:0/1793183010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdec102300 0x7fbdec19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:05.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 -- 172.21.15.69:0/1793183010 >> 172.21.15.69:0/1793183010 conn(0x7fbdec0788f0 msgr2=0x7fbdec0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:05.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 -- 172.21.15.69:0/1793183010 shutdown_connections 2024-04-23T10:26:05.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.713+0000 7fbdf329d700 1 -- 172.21.15.69:0/1793183010 wait complete. 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.381+0000 7ff669132700 1 -- 172.21.15.69:0/2500365005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff664101930 msgr2=0x7ff664101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.381+0000 7ff669132700 1 --2- 172.21.15.69:0/2500365005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff664101930 0x7ff664101db0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff658009990 tx=0x7ff658009ca0 comp rx=0 tx=0).stop 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.381+0000 7ff669132700 1 -- 172.21.15.69:0/2500365005 shutdown_connections 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.381+0000 7ff669132700 1 --2- 172.21.15.69:0/2500365005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6641022f0 0x7ff66410e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.381+0000 7ff669132700 1 --2- 172.21.15.69:0/2500365005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff664107980 0x7ff664107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.381+0000 7ff669132700 1 --2- 172.21.15.69:0/2500365005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff664101930 0x7ff664101db0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.381+0000 7ff669132700 1 -- 172.21.15.69:0/2500365005 >> 172.21.15.69:0/2500365005 conn(0x7ff6640788b0 msgr2=0x7ff664078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.381+0000 7ff669132700 1 -- 172.21.15.69:0/2500365005 shutdown_connections 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.381+0000 7ff669132700 1 -- 172.21.15.69:0/2500365005 wait complete. 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff669132700 1 Processor -- start 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff669132700 1 -- start start 2024-04-23T10:26:06.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff669132700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff664101930 0x7ff6641034e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:06.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff669132700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6641022f0 0x7ff664103a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:06.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff669132700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff664107980 0x7ff664103f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:06.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff669132700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff664111c80 con 0x7ff664101930 2024-04-23T10:26:06.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff669132700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff664111b00 con 0x7ff664107980 2024-04-23T10:26:06.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff669132700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff664111e00 con 0x7ff6641022f0 2024-04-23T10:26:06.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff662d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff664101930 0x7ff6641034e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:06.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff662d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff664101930 0x7ff6641034e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55426/0 (socket says 172.21.15.69:55426) 2024-04-23T10:26:06.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff662d9d700 1 -- 172.21.15.69:0/1973480804 learned_addr learned my addr 172.21.15.69:0/1973480804 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:06.100 INFO:teuthology.orchestra.run.smithi069.stdout:146028888126 2024-04-23T10:26:06.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.382+0000 7ff66259c700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6641022f0 0x7ff664103a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:06.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff66359e700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff664107980 0x7ff664103f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:06.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff662d9d700 1 -- 172.21.15.69:0/1973480804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6641022f0 msgr2=0x7ff664103a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:06.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff662d9d700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6641022f0 0x7ff664103a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:06.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff662d9d700 1 -- 172.21.15.69:0/1973480804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff664107980 msgr2=0x7ff664103f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:06.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff662d9d700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff664107980 0x7ff664103f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:06.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff662d9d700 1 -- 172.21.15.69:0/1973480804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6641a76f0 con 0x7ff664101930 2024-04-23T10:26:06.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff662d9d700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff664101930 0x7ff6641034e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff65400b530 tx=0x7ff65400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:06.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff64bfff700 1 -- 172.21.15.69:0/1973480804 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654015020 con 0x7ff664101930 2024-04-23T10:26:06.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff669132700 1 -- 172.21.15.69:0/1973480804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6641a79e0 con 0x7ff664101930 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff64bfff700 1 -- 172.21.15.69:0/1973480804 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff654011d00 con 0x7ff664101930 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff64bfff700 1 -- 172.21.15.69:0/1973480804 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654010e40 con 0x7ff664101930 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.383+0000 7ff669132700 1 -- 172.21.15.69:0/1973480804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6641a7ef0 con 0x7ff664101930 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.384+0000 7ff669132700 1 -- 172.21.15.69:0/1973480804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff664103050 con 0x7ff664101930 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.385+0000 7ff64bfff700 1 -- 172.21.15.69:0/1973480804 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff654018020 con 0x7ff664101930 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.386+0000 7ff64bfff700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff64c0a3cd0 0x7ff64c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.386+0000 7ff66259c700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff64c0a3cd0 0x7ff64c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.386+0000 7ff64bfff700 1 -- 172.21.15.69:0/1973480804 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7ff6540d0170 con 0x7ff664101930 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.387+0000 7ff66259c700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff64c0a3cd0 0x7ff64c0a6190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6580098e0 tx=0x7ff658005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.390+0000 7ff64bfff700 1 -- 172.21.15.69:0/1973480804 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff65401f020 con 0x7ff664101930 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.608+0000 7ff669132700 1 -- 172.21.15.69:0/1973480804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff664069730 con 0x7ff664101930 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.608+0000 7ff64bfff700 1 -- 172.21.15.69:0/1973480804 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff664069730 con 0x7ff664101930 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.610+0000 7ff669132700 1 -- 172.21.15.69:0/1973480804 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff64c0a3cd0 msgr2=0x7ff64c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:06.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.610+0000 7ff669132700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff64c0a3cd0 0x7ff64c0a6190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6580098e0 tx=0x7ff658005960 comp rx=0 tx=0).stop 2024-04-23T10:26:06.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.610+0000 7ff669132700 1 -- 172.21.15.69:0/1973480804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff664101930 msgr2=0x7ff6641034e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:06.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.610+0000 7ff669132700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff664101930 0x7ff6641034e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff65400b530 tx=0x7ff65400b840 comp rx=0 tx=0).stop 2024-04-23T10:26:06.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.610+0000 7ff669132700 1 -- 172.21.15.69:0/1973480804 shutdown_connections 2024-04-23T10:26:06.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.610+0000 7ff669132700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7ff64c0a3cd0 0x7ff64c0a6190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:06.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.610+0000 7ff669132700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff664107980 0x7ff664103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:06.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.610+0000 7ff669132700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff664101930 0x7ff6641034e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:06.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.610+0000 7ff669132700 1 --2- 172.21.15.69:0/1973480804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6641022f0 0x7ff664103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:06.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.610+0000 7ff669132700 1 -- 172.21.15.69:0/1973480804 >> 172.21.15.69:0/1973480804 conn(0x7ff6640788b0 msgr2=0x7ff664100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:06.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.611+0000 7ff669132700 1 -- 172.21.15.69:0/1973480804 shutdown_connections 2024-04-23T10:26:06.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:05.611+0000 7ff669132700 1 -- 172.21.15.69:0/1973480804 wait complete. 2024-04-23T10:26:06.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:06 smithi146 ceph-mon[32800]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:06.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:06 smithi146 ceph-mon[32800]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-23T10:26:06.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:06 smithi146 ceph-mon[32800]: Cluster is now healthy 2024-04-23T10:26:06.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:06 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1973480804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-23T10:26:06.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:06 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1793183010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-23T10:26:06.436 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:06 smithi069 ceph-mon[29593]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:06.436 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:06 smithi069 ceph-mon[29593]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-23T10:26:06.436 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:06 smithi069 ceph-mon[29593]: Cluster is now healthy 2024-04-23T10:26:06.436 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:06 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1973480804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-23T10:26:06.436 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:06 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1793183010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-23T10:26:06.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:06 smithi167 ceph-mon[32940]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:06.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:06 smithi167 ceph-mon[32940]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-23T10:26:06.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:06 smithi167 ceph-mon[32940]: Cluster is now healthy 2024-04-23T10:26:06.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:06 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1973480804' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-23T10:26:06.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:06 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1793183010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-23T10:26:06.734 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350997 got 347892351003 for osd.11 2024-04-23T10:26:06.735 DEBUG:teuthology.parallel:result is None 2024-04-23T10:26:07.239 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888121 got 146028888126 for osd.4 2024-04-23T10:26:07.239 DEBUG:teuthology.parallel:result is None 2024-04-23T10:26:07.239 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-23T10:26:07.239 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-23T10:26:07.504 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:08.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:08 smithi069 ceph-mon[29593]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 9 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:08.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:08 smithi146 ceph-mon[32800]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 9 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:08.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:08 smithi167 ceph-mon[32940]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 9 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:09.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.186+0000 7fd5e07a6700 1 -- 172.21.15.69:0/1116565211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5d81034b0 msgr2=0x7fd5d810f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:09.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.186+0000 7fd5e07a6700 1 --2- 172.21.15.69:0/1116565211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5d81034b0 0x7fd5d810f8e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009990 tx=0x7fd5c8009ca0 comp rx=0 tx=0).stop 2024-04-23T10:26:09.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.186+0000 7fd5e07a6700 1 -- 172.21.15.69:0/1116565211 shutdown_connections 2024-04-23T10:26:09.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.186+0000 7fd5e07a6700 1 --2- 172.21.15.69:0/1116565211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5d81034b0 0x7fd5d810f8e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.186+0000 7fd5e07a6700 1 --2- 172.21.15.69:0/1116565211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d8108a80 0x7fd5d8108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.186+0000 7fd5e07a6700 1 --2- 172.21.15.69:0/1116565211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d8102af0 0x7fd5d8102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.186+0000 7fd5e07a6700 1 -- 172.21.15.69:0/1116565211 >> 172.21.15.69:0/1116565211 conn(0x7fd5d8079ad0 msgr2=0x7fd5d8079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.186+0000 7fd5e07a6700 1 -- 172.21.15.69:0/1116565211 shutdown_connections 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.186+0000 7fd5e07a6700 1 -- 172.21.15.69:0/1116565211 wait complete. 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5e07a6700 1 Processor -- start 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5e07a6700 1 -- start start 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5e07a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d8102af0 0x7fd5d8074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5e07a6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5d81034b0 0x7fd5d8075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5e07a6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d8108a80 0x7fd5d80757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5e07a6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8112d90 con 0x7fd5d81034b0 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5e07a6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8112c10 con 0x7fd5d8102af0 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5e07a6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8112f10 con 0x7fd5d8108a80 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5ddd41700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5d81034b0 0x7fd5d8075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:09.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5ddd41700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5d81034b0 0x7fd5d8075280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55480/0 (socket says 172.21.15.69:55480) 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5ddd41700 1 -- 172.21.15.69:0/3694064885 learned_addr learned my addr 172.21.15.69:0/3694064885 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5ded43700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d8108a80 0x7fd5d80757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.187+0000 7fd5de542700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d8102af0 0x7fd5d8074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5ddd41700 1 -- 172.21.15.69:0/3694064885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d8108a80 msgr2=0x7fd5d80757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5ddd41700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d8108a80 0x7fd5d80757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5ddd41700 1 -- 172.21.15.69:0/3694064885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d8102af0 msgr2=0x7fd5d8074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5ddd41700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d8102af0 0x7fd5d8074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5ddd41700 1 -- 172.21.15.69:0/3694064885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d81a7720 con 0x7fd5d81034b0 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5de542700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d8102af0 0x7fd5d8074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5ddd41700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5d81034b0 0x7fd5d8075280 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00d980 tx=0x7fd5cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5d77fe700 1 -- 172.21.15.69:0/3694064885 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc017070 con 0x7fd5d81034b0 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5e07a6700 1 -- 172.21.15.69:0/3694064885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d81a7a10 con 0x7fd5d81034b0 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5d77fe700 1 -- 172.21.15.69:0/3694064885 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd5cc005020 con 0x7fd5d81034b0 2024-04-23T10:26:09.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5d77fe700 1 -- 172.21.15.69:0/3694064885 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc009bf0 con 0x7fd5d81034b0 2024-04-23T10:26:09.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.188+0000 7fd5e07a6700 1 -- 172.21.15.69:0/3694064885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d81a7f00 con 0x7fd5d81034b0 2024-04-23T10:26:09.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.189+0000 7fd5e07a6700 1 -- 172.21.15.69:0/3694064885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d8069730 con 0x7fd5d81034b0 2024-04-23T10:26:09.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.190+0000 7fd5d77fe700 1 -- 172.21.15.69:0/3694064885 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd5cc0051d0 con 0x7fd5d81034b0 2024-04-23T10:26:09.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.190+0000 7fd5d77fe700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd5c00a3cd0 0x7fd5c00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:09.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.191+0000 7fd5de542700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd5c00a3cd0 0x7fd5c00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:09.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.191+0000 7fd5d77fe700 1 -- 172.21.15.69:0/3694064885 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fd5cc0d0450 con 0x7fd5d81034b0 2024-04-23T10:26:09.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.191+0000 7fd5de542700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd5c00a3cd0 0x7fd5c00a6190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009d50 tx=0x7fd5d0009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:09.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.195+0000 7fd5d77fe700 1 -- 172.21.15.69:0/3694064885 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd5cc020020 con 0x7fd5d81034b0 2024-04-23T10:26:09.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.395+0000 7fd5e07a6700 1 -- 172.21.15.69:0/3694064885 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5d8062e80 con 0x7fd5c00a3cd0 2024-04-23T10:26:09.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.402+0000 7fd5d77fe700 1 -- 172.21.15.69:0/3694064885 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258969 (secure 0 0 0) 0x7fd5d8062e80 con 0x7fd5c00a3cd0 2024-04-23T10:26:09.405 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 -- 172.21.15.69:0/3694064885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd5c00a3cd0 msgr2=0x7fd5c00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:09.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd5c00a3cd0 0x7fd5c00a6190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009d50 tx=0x7fd5d0009040 comp rx=0 tx=0).stop 2024-04-23T10:26:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 -- 172.21.15.69:0/3694064885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5d81034b0 msgr2=0x7fd5d8075280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5d81034b0 0x7fd5d8075280 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00d980 tx=0x7fd5cc00dc90 comp rx=0 tx=0).stop 2024-04-23T10:26:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 -- 172.21.15.69:0/3694064885 shutdown_connections 2024-04-23T10:26:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd5c00a3cd0 0x7fd5c00a6190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d8108a80 0x7fd5d80757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5d8102af0 0x7fd5d8074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 --2- 172.21.15.69:0/3694064885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5d81034b0 0x7fd5d8075280 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 -- 172.21.15.69:0/3694064885 >> 172.21.15.69:0/3694064885 conn(0x7fd5d8079ad0 msgr2=0x7fd5d8101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 -- 172.21.15.69:0/3694064885 shutdown_connections 2024-04-23T10:26:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:09.405+0000 7fd5e07a6700 1 -- 172.21.15.69:0/3694064885 wait complete. 2024-04-23T10:26:09.408 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-23T10:26:09.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:26:09.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:26:09.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:26:09.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:26:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:09 smithi167 ceph-mon[32940]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:26:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:09 smithi167 ceph-mon[32940]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:09.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:26:09.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:26:09.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:26:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:26:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:09 smithi146 ceph-mon[32800]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:26:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:09 smithi146 ceph-mon[32800]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:09.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:26:09.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:26:09.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:26:09.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:26:09.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:09 smithi069 ceph-mon[29593]: from='mgr.14152 172.21.15.69:0/2162206904' entity='mgr.x' 2024-04-23T10:26:09.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:09 smithi069 ceph-mon[29593]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:10.137 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-04-23T10:26:09.021154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654659,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":857,"num_read_kb":548,"num_write":415,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180853,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361012,"kb_used_data":11784,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580812,"statfs":{"total":1151940427776,"available":1151570751488,"internally_reserved":0,"allocated":12066816,"data_stored":7475109,"data_compressed":112617,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19139,"internal_metadata":357414205},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":117,"num_keys_recovered":7,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.941778"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086071+0000","last_change":"2024-04-23T10:24:53.504514+0000","last_active":"2024-04-23T10:26:00.086071+0000","last_peered":"2024-04-23T10:26:00.086071+0000","last_clean":"2024-04-23T10:26:00.086071+0000","last_became_active":"2024-04-23T10:24:53.504105+0000","last_became_peered":"2024-04-23T10:24:53.504105+0000","last_unstale":"2024-04-23T10:26:00.086071+0000","last_undegraded":"2024-04-23T10:26:00.086071+0000","last_fullsized":"2024-04-23T10:26:00.086071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:49.730698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086940+0000","last_change":"2024-04-23T10:24:53.504534+0000","last_active":"2024-04-23T10:26:00.086940+0000","last_peered":"2024-04-23T10:26:00.086940+0000","last_clean":"2024-04-23T10:26:00.086940+0000","last_became_active":"2024-04-23T10:24:53.504244+0000","last_became_peered":"2024-04-23T10:24:53.504244+0000","last_unstale":"2024-04-23T10:26:00.086940+0000","last_undegraded":"2024-04-23T10:26:00.086940+0000","last_fullsized":"2024-04-23T10:26:00.086940+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:12:57.447009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086041+0000","last_change":"2024-04-23T10:24:53.502922+0000","last_active":"2024-04-23T10:26:00.086041+0000","last_peered":"2024-04-23T10:26:00.086041+0000","last_clean":"2024-04-23T10:26:00.086041+0000","last_became_active":"2024-04-23T10:24:53.502519+0000","last_became_peered":"2024-04-23T10:24:53.502519+0000","last_unstale":"2024-04-23T10:26:00.086041+0000","last_undegraded":"2024-04-23T10:26:00.086041+0000","last_fullsized":"2024-04-23T10:26:00.086041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:58:35.871081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.282857+0000","last_change":"2024-04-23T10:24:53.500049+0000","last_active":"2024-04-23T10:26:00.282857+0000","last_peered":"2024-04-23T10:26:00.282857+0000","last_clean":"2024-04-23T10:26:00.282857+0000","last_became_active":"2024-04-23T10:24:53.499607+0000","last_became_peered":"2024-04-23T10:24:53.499607+0000","last_unstale":"2024-04-23T10:26:00.282857+0000","last_undegraded":"2024-04-23T10:26:00.282857+0000","last_fullsized":"2024-04-23T10:26:00.282857+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:10:27.104622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082378+0000","last_change":"2024-04-23T10:24:53.493739+0000","last_active":"2024-04-23T10:26:00.082378+0000","last_peered":"2024-04-23T10:26:00.082378+0000","last_clean":"2024-04-23T10:26:00.082378+0000","last_became_active":"2024-04-23T10:24:53.492471+0000","last_became_peered":"2024-04-23T10:24:53.492471+0000","last_unstale":"2024-04-23T10:26:00.082378+0000","last_undegraded":"2024-04-23T10:26:00.082378+0000","last_fullsized":"2024-04-23T10:26:00.082378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:43.267366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082307+0000","last_change":"2024-04-23T10:24:53.500426+0000","last_active":"2024-04-23T10:26:00.082307+0000","last_peered":"2024-04-23T10:26:00.082307+0000","last_clean":"2024-04-23T10:26:00.082307+0000","last_became_active":"2024-04-23T10:24:53.500052+0000","last_became_peered":"2024-04-23T10:24:53.500052+0000","last_unstale":"2024-04-23T10:26:00.082307+0000","last_undegraded":"2024-04-23T10:26:00.082307+0000","last_fullsized":"2024-04-23T10:26:00.082307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:21:36.361816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086739+0000","last_change":"2024-04-23T10:24:53.501672+0000","last_active":"2024-04-23T10:26:00.086739+0000","last_peered":"2024-04-23T10:26:00.086739+0000","last_clean":"2024-04-23T10:26:00.086739+0000","last_became_active":"2024-04-23T10:24:53.501345+0000","last_became_peered":"2024-04-23T10:24:53.501345+0000","last_unstale":"2024-04-23T10:26:00.086739+0000","last_undegraded":"2024-04-23T10:26:00.086739+0000","last_fullsized":"2024-04-23T10:26:00.086739+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:31:41.488482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083027+0000","last_change":"2024-04-23T10:24:53.499442+0000","last_active":"2024-04-23T10:26:00.083027+0000","last_peered":"2024-04-23T10:26:00.083027+0000","last_clean":"2024-04-23T10:26:00.083027+0000","last_became_active":"2024-04-23T10:24:53.499131+0000","last_became_peered":"2024-04-23T10:24:53.499131+0000","last_unstale":"2024-04-23T10:26:00.083027+0000","last_undegraded":"2024-04-23T10:26:00.083027+0000","last_fullsized":"2024-04-23T10:26:00.083027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:17:21.815851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086822+0000","last_change":"2024-04-23T10:24:53.501235+0000","last_active":"2024-04-23T10:26:00.086822+0000","last_peered":"2024-04-23T10:26:00.086822+0000","last_clean":"2024-04-23T10:26:00.086822+0000","last_became_active":"2024-04-23T10:24:53.500392+0000","last_became_peered":"2024-04-23T10:24:53.500392+0000","last_unstale":"2024-04-23T10:26:00.086822+0000","last_undegraded":"2024-04-23T10:26:00.086822+0000","last_fullsized":"2024-04-23T10:26:00.086822+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:58:20.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082699+0000","last_change":"2024-04-23T10:24:53.504235+0000","last_active":"2024-04-23T10:26:00.082699+0000","last_peered":"2024-04-23T10:26:00.082699+0000","last_clean":"2024-04-23T10:26:00.082699+0000","last_became_active":"2024-04-23T10:24:53.503743+0000","last_became_peered":"2024-04-23T10:24:53.503743+0000","last_unstale":"2024-04-23T10:26:00.082699+0000","last_undegraded":"2024-04-23T10:26:00.082699+0000","last_fullsized":"2024-04-23T10:26:00.082699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:25:53.881433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086074+0000","last_change":"2024-04-23T10:24:53.497355+0000","last_active":"2024-04-23T10:26:00.086074+0000","last_peered":"2024-04-23T10:26:00.086074+0000","last_clean":"2024-04-23T10:26:00.086074+0000","last_became_active":"2024-04-23T10:24:53.494195+0000","last_became_peered":"2024-04-23T10:24:53.494195+0000","last_unstale":"2024-04-23T10:26:00.086074+0000","last_undegraded":"2024-04-23T10:26:00.086074+0000","last_fullsized":"2024-04-23T10:26:00.086074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:19:48.638789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.282944+0000","last_change":"2024-04-23T10:24:53.504513+0000","last_active":"2024-04-23T10:26:00.282944+0000","last_peered":"2024-04-23T10:26:00.282944+0000","last_clean":"2024-04-23T10:26:00.282944+0000","last_became_active":"2024-04-23T10:24:53.504058+0000","last_became_peered":"2024-04-23T10:24:53.504058+0000","last_unstale":"2024-04-23T10:26:00.282944+0000","last_undegraded":"2024-04-23T10:26:00.282944+0000","last_fullsized":"2024-04-23T10:26:00.282944+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:16:34.302848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215459+0000","last_change":"2024-04-23T10:24:53.495277+0000","last_active":"2024-04-23T10:26:00.215459+0000","last_peered":"2024-04-23T10:26:00.215459+0000","last_clean":"2024-04-23T10:26:00.215459+0000","last_became_active":"2024-04-23T10:24:53.494925+0000","last_became_peered":"2024-04-23T10:24:53.494925+0000","last_unstale":"2024-04-23T10:26:00.215459+0000","last_undegraded":"2024-04-23T10:26:00.215459+0000","last_fullsized":"2024-04-23T10:26:00.215459+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:33.647408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085291+0000","last_change":"2024-04-23T10:24:53.504082+0000","last_active":"2024-04-23T10:26:00.085291+0000","last_peered":"2024-04-23T10:26:00.085291+0000","last_clean":"2024-04-23T10:26:00.085291+0000","last_became_active":"2024-04-23T10:24:53.503753+0000","last_became_peered":"2024-04-23T10:24:53.503753+0000","last_unstale":"2024-04-23T10:26:00.085291+0000","last_undegraded":"2024-04-23T10:26:00.085291+0000","last_fullsized":"2024-04-23T10:26:00.085291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:59.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.091416+0000","last_change":"2024-04-23T10:26:00.091416+0000","last_active":"2024-04-23T10:26:00.091416+0000","last_peered":"2024-04-23T10:26:00.091416+0000","last_clean":"2024-04-23T10:26:00.091416+0000","last_became_active":"2024-04-23T10:26:00.091030+0000","last_became_peered":"2024-04-23T10:26:00.091030+0000","last_unstale":"2024-04-23T10:26:00.091416+0000","last_undegraded":"2024-04-23T10:26:00.091416+0000","last_fullsized":"2024-04-23T10:26:00.091416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:28.835870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085470+0000","last_change":"2024-04-23T10:24:53.498916+0000","last_active":"2024-04-23T10:26:00.085470+0000","last_peered":"2024-04-23T10:26:00.085470+0000","last_clean":"2024-04-23T10:26:00.085470+0000","last_became_active":"2024-04-23T10:24:53.498560+0000","last_became_peered":"2024-04-23T10:24:53.498560+0000","last_unstale":"2024-04-23T10:26:00.085470+0000","last_undegraded":"2024-04-23T10:26:00.085470+0000","last_fullsized":"2024-04-23T10:26:00.085470+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:24:07.965091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086098+0000","last_change":"2024-04-23T10:24:53.505167+0000","last_active":"2024-04-23T10:26:00.086098+0000","last_peered":"2024-04-23T10:26:00.086098+0000","last_clean":"2024-04-23T10:26:00.086098+0000","last_became_active":"2024-04-23T10:24:53.504832+0000","last_became_peered":"2024-04-23T10:24:53.504832+0000","last_unstale":"2024-04-23T10:26:00.086098+0000","last_undegraded":"2024-04-23T10:26:00.086098+0000","last_fullsized":"2024-04-23T10:26:00.086098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:58:20.867496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.081482+0000","last_change":"2024-04-23T10:24:53.505363+0000","last_active":"2024-04-23T10:26:00.081482+0000","last_peered":"2024-04-23T10:26:00.081482+0000","last_clean":"2024-04-23T10:26:00.081482+0000","last_became_active":"2024-04-23T10:24:53.505029+0000","last_became_peered":"2024-04-23T10:24:53.505029+0000","last_unstale":"2024-04-23T10:26:00.081482+0000","last_undegraded":"2024-04-23T10:26:00.081482+0000","last_fullsized":"2024-04-23T10:26:00.081482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:22.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089910+0000","last_change":"2024-04-23T10:24:53.497666+0000","last_active":"2024-04-23T10:26:00.089910+0000","last_peered":"2024-04-23T10:26:00.089910+0000","last_clean":"2024-04-23T10:26:00.089910+0000","last_became_active":"2024-04-23T10:24:53.495144+0000","last_became_peered":"2024-04-23T10:24:53.495144+0000","last_unstale":"2024-04-23T10:26:00.089910+0000","last_undegraded":"2024-04-23T10:26:00.089910+0000","last_fullsized":"2024-04-23T10:26:00.089910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:23:27.148289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:06.420826+0000","last_change":"2024-04-23T10:24:52.496907+0000","last_active":"2024-04-23T10:26:06.420826+0000","last_peered":"2024-04-23T10:26:06.420826+0000","last_clean":"2024-04-23T10:26:06.420826+0000","last_became_active":"2024-04-23T10:24:52.496567+0000","last_became_peered":"2024-04-23T10:24:52.496567+0000","last_unstale":"2024-04-23T10:26:06.420826+0000","last_undegraded":"2024-04-23T10:26:06.420826+0000","last_fullsized":"2024-04-23T10:26:06.420826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:33.195504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.084171+0000","last_change":"2024-04-23T10:24:53.501140+0000","last_active":"2024-04-23T10:26:00.084171+0000","last_peered":"2024-04-23T10:26:00.084171+0000","last_clean":"2024-04-23T10:26:00.084171+0000","last_became_active":"2024-04-23T10:24:53.500826+0000","last_became_peered":"2024-04-23T10:24:53.500826+0000","last_unstale":"2024-04-23T10:26:00.084171+0000","last_undegraded":"2024-04-23T10:26:00.084171+0000","last_fullsized":"2024-04-23T10:26:00.084171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:39.178784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.084766+0000","last_change":"2024-04-23T10:24:52.494413+0000","last_active":"2024-04-23T10:26:00.084766+0000","last_peered":"2024-04-23T10:26:00.084766+0000","last_clean":"2024-04-23T10:26:00.084766+0000","last_became_active":"2024-04-23T10:24:52.494092+0000","last_became_peered":"2024-04-23T10:24:52.494092+0000","last_unstale":"2024-04-23T10:26:00.084766+0000","last_undegraded":"2024-04-23T10:26:00.084766+0000","last_fullsized":"2024-04-23T10:26:00.084766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:42:09.407787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086757+0000","last_change":"2024-04-23T10:24:53.495285+0000","last_active":"2024-04-23T10:26:00.086757+0000","last_peered":"2024-04-23T10:26:00.086757+0000","last_clean":"2024-04-23T10:26:00.086757+0000","last_became_active":"2024-04-23T10:24:53.494959+0000","last_became_peered":"2024-04-23T10:24:53.494959+0000","last_unstale":"2024-04-23T10:26:00.086757+0000","last_undegraded":"2024-04-23T10:26:00.086757+0000","last_fullsized":"2024-04-23T10:26:00.086757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:59.209505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082999+0000","last_change":"2024-04-23T10:24:52.496310+0000","last_active":"2024-04-23T10:26:00.082999+0000","last_peered":"2024-04-23T10:26:00.082999+0000","last_clean":"2024-04-23T10:26:00.082999+0000","last_became_active":"2024-04-23T10:24:52.496009+0000","last_became_peered":"2024-04-23T10:24:52.496009+0000","last_unstale":"2024-04-23T10:26:00.082999+0000","last_undegraded":"2024-04-23T10:26:00.082999+0000","last_fullsized":"2024-04-23T10:26:00.082999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:05:46.911691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086163+0000","last_change":"2024-04-23T10:24:53.498204+0000","last_active":"2024-04-23T10:26:00.086163+0000","last_peered":"2024-04-23T10:26:00.086163+0000","last_clean":"2024-04-23T10:26:00.086163+0000","last_became_active":"2024-04-23T10:24:53.496535+0000","last_became_peered":"2024-04-23T10:24:53.496535+0000","last_unstale":"2024-04-23T10:26:00.086163+0000","last_undegraded":"2024-04-23T10:26:00.086163+0000","last_fullsized":"2024-04-23T10:26:00.086163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:32.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082632+0000","last_change":"2024-04-23T10:24:52.493485+0000","last_active":"2024-04-23T10:26:00.082632+0000","last_peered":"2024-04-23T10:26:00.082632+0000","last_clean":"2024-04-23T10:26:00.082632+0000","last_became_active":"2024-04-23T10:24:52.493164+0000","last_became_peered":"2024-04-23T10:24:52.493164+0000","last_unstale":"2024-04-23T10:26:00.082632+0000","last_undegraded":"2024-04-23T10:26:00.082632+0000","last_fullsized":"2024-04-23T10:26:00.082632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:42:33.701248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.090646+0000","last_change":"2024-04-23T10:24:53.507145+0000","last_active":"2024-04-23T10:26:00.090646+0000","last_peered":"2024-04-23T10:26:00.090646+0000","last_clean":"2024-04-23T10:26:00.090646+0000","last_became_active":"2024-04-23T10:24:53.506824+0000","last_became_peered":"2024-04-23T10:24:53.506824+0000","last_unstale":"2024-04-23T10:26:00.090646+0000","last_undegraded":"2024-04-23T10:26:00.090646+0000","last_fullsized":"2024-04-23T10:26:00.090646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:37:54.870303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:05.419268+0000","last_change":"2024-04-23T10:24:52.498646+0000","last_active":"2024-04-23T10:26:05.419268+0000","last_peered":"2024-04-23T10:26:05.419268+0000","last_clean":"2024-04-23T10:26:05.419268+0000","last_became_active":"2024-04-23T10:24:52.498328+0000","last_became_peered":"2024-04-23T10:24:52.498328+0000","last_unstale":"2024-04-23T10:26:05.419268+0000","last_undegraded":"2024-04-23T10:26:05.419268+0000","last_fullsized":"2024-04-23T10:26:05.419268+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:26:33.646144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.216570+0000","last_change":"2024-04-23T10:26:00.216570+0000","last_active":"2024-04-23T10:26:00.216570+0000","last_peered":"2024-04-23T10:26:00.216570+0000","last_clean":"2024-04-23T10:26:00.216570+0000","last_became_active":"2024-04-23T10:26:00.216228+0000","last_became_peered":"2024-04-23T10:26:00.216228+0000","last_unstale":"2024-04-23T10:26:00.216570+0000","last_undegraded":"2024-04-23T10:26:00.216570+0000","last_fullsized":"2024-04-23T10:26:00.216570+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:57:54.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082265+0000","last_change":"2024-04-23T10:24:52.495242+0000","last_active":"2024-04-23T10:26:00.082265+0000","last_peered":"2024-04-23T10:26:00.082265+0000","last_clean":"2024-04-23T10:26:00.082265+0000","last_became_active":"2024-04-23T10:24:52.493255+0000","last_became_peered":"2024-04-23T10:24:52.493255+0000","last_unstale":"2024-04-23T10:26:00.082265+0000","last_undegraded":"2024-04-23T10:26:00.082265+0000","last_fullsized":"2024-04-23T10:26:00.082265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:33.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.090426+0000","last_change":"2024-04-23T10:24:53.499843+0000","last_active":"2024-04-23T10:26:00.090426+0000","last_peered":"2024-04-23T10:26:00.090426+0000","last_clean":"2024-04-23T10:26:00.090426+0000","last_became_active":"2024-04-23T10:24:53.499512+0000","last_became_peered":"2024-04-23T10:24:53.499512+0000","last_unstale":"2024-04-23T10:26:00.090426+0000","last_undegraded":"2024-04-23T10:26:00.090426+0000","last_fullsized":"2024-04-23T10:26:00.090426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:20.333479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215375+0000","last_change":"2024-04-23T10:24:52.495915+0000","last_active":"2024-04-23T10:26:00.215375+0000","last_peered":"2024-04-23T10:26:00.215375+0000","last_clean":"2024-04-23T10:26:00.215375+0000","last_became_active":"2024-04-23T10:24:52.495558+0000","last_became_peered":"2024-04-23T10:24:52.495558+0000","last_unstale":"2024-04-23T10:26:00.215375+0000","last_undegraded":"2024-04-23T10:26:00.215375+0000","last_fullsized":"2024-04-23T10:26:00.215375+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:41:09.080880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082956+0000","last_change":"2024-04-23T10:24:53.496376+0000","last_active":"2024-04-23T10:26:00.082956+0000","last_peered":"2024-04-23T10:26:00.082956+0000","last_clean":"2024-04-23T10:26:00.082956+0000","last_became_active":"2024-04-23T10:24:53.496067+0000","last_became_peered":"2024-04-23T10:24:53.496067+0000","last_unstale":"2024-04-23T10:26:00.082956+0000","last_undegraded":"2024-04-23T10:26:00.082956+0000","last_fullsized":"2024-04-23T10:26:00.082956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:02:51.252365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089619+0000","last_change":"2024-04-23T10:24:52.499566+0000","last_active":"2024-04-23T10:26:00.089619+0000","last_peered":"2024-04-23T10:26:00.089619+0000","last_clean":"2024-04-23T10:26:00.089619+0000","last_became_active":"2024-04-23T10:24:52.499277+0000","last_became_peered":"2024-04-23T10:24:52.499277+0000","last_unstale":"2024-04-23T10:26:00.089619+0000","last_undegraded":"2024-04-23T10:26:00.089619+0000","last_fullsized":"2024-04-23T10:26:00.089619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:38.716187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.081254+0000","last_change":"2024-04-23T10:24:53.499617+0000","last_active":"2024-04-23T10:26:00.081254+0000","last_peered":"2024-04-23T10:26:00.081254+0000","last_clean":"2024-04-23T10:26:00.081254+0000","last_became_active":"2024-04-23T10:24:53.499283+0000","last_became_peered":"2024-04-23T10:24:53.499283+0000","last_unstale":"2024-04-23T10:26:00.081254+0000","last_undegraded":"2024-04-23T10:26:00.081254+0000","last_fullsized":"2024-04-23T10:26:00.081254+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:36.931697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":158,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:04.417204+0000","last_change":"2024-04-23T10:24:52.492276+0000","last_active":"2024-04-23T10:26:04.417204+0000","last_peered":"2024-04-23T10:26:04.417204+0000","last_clean":"2024-04-23T10:26:04.417204+0000","last_became_active":"2024-04-23T10:24:52.491979+0000","last_became_peered":"2024-04-23T10:24:52.491979+0000","last_unstale":"2024-04-23T10:26:04.417204+0000","last_undegraded":"2024-04-23T10:26:04.417204+0000","last_fullsized":"2024-04-23T10:26:04.417204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:15:40.847446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086212+0000","last_change":"2024-04-23T10:24:53.500964+0000","last_active":"2024-04-23T10:26:00.086212+0000","last_peered":"2024-04-23T10:26:00.086212+0000","last_clean":"2024-04-23T10:26:00.086212+0000","last_became_active":"2024-04-23T10:24:53.499209+0000","last_became_peered":"2024-04-23T10:24:53.499209+0000","last_unstale":"2024-04-23T10:26:00.086212+0000","last_undegraded":"2024-04-23T10:26:00.086212+0000","last_fullsized":"2024-04-23T10:26:00.086212+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:27:29.539994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086637+0000","last_change":"2024-04-23T10:24:52.496016+0000","last_active":"2024-04-23T10:26:00.086637+0000","last_peered":"2024-04-23T10:26:00.086637+0000","last_clean":"2024-04-23T10:26:00.086637+0000","last_became_active":"2024-04-23T10:24:52.495711+0000","last_became_peered":"2024-04-23T10:24:52.495711+0000","last_unstale":"2024-04-23T10:26:00.086637+0000","last_undegraded":"2024-04-23T10:26:00.086637+0000","last_fullsized":"2024-04-23T10:26:00.086637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:31:30.970731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.091494+0000","last_change":"2024-04-23T10:26:00.091494+0000","last_active":"2024-04-23T10:26:00.091494+0000","last_peered":"2024-04-23T10:26:00.091494+0000","last_clean":"2024-04-23T10:26:00.091494+0000","last_became_active":"2024-04-23T10:26:00.091122+0000","last_became_peered":"2024-04-23T10:26:00.091122+0000","last_unstale":"2024-04-23T10:26:00.091494+0000","last_undegraded":"2024-04-23T10:26:00.091494+0000","last_fullsized":"2024-04-23T10:26:00.091494+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:32.833741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.090790+0000","last_change":"2024-04-23T10:24:52.497200+0000","last_active":"2024-04-23T10:26:00.090790+0000","last_peered":"2024-04-23T10:26:00.090790+0000","last_clean":"2024-04-23T10:26:00.090790+0000","last_became_active":"2024-04-23T10:24:52.496864+0000","last_became_peered":"2024-04-23T10:24:52.496864+0000","last_unstale":"2024-04-23T10:26:00.090790+0000","last_undegraded":"2024-04-23T10:26:00.090790+0000","last_fullsized":"2024-04-23T10:26:00.090790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:16.514060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086392+0000","last_change":"2024-04-23T10:24:53.498438+0000","last_active":"2024-04-23T10:26:00.086392+0000","last_peered":"2024-04-23T10:26:00.086392+0000","last_clean":"2024-04-23T10:26:00.086392+0000","last_became_active":"2024-04-23T10:24:53.496569+0000","last_became_peered":"2024-04-23T10:24:53.496569+0000","last_unstale":"2024-04-23T10:26:00.086392+0000","last_undegraded":"2024-04-23T10:26:00.086392+0000","last_fullsized":"2024-04-23T10:26:00.086392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:06:45.964699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'27","reported_seq":191,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:04.419222+0000","last_change":"2024-04-23T10:24:52.490058+0000","last_active":"2024-04-23T10:26:04.419222+0000","last_peered":"2024-04-23T10:26:04.419222+0000","last_clean":"2024-04-23T10:26:04.419222+0000","last_became_active":"2024-04-23T10:24:52.489720+0000","last_became_peered":"2024-04-23T10:24:52.489720+0000","last_unstale":"2024-04-23T10:26:04.419222+0000","last_undegraded":"2024-04-23T10:26:04.419222+0000","last_fullsized":"2024-04-23T10:26:04.419222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:41.049778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56853,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":145,"num_read_kb":127,"num_write":29,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082741+0000","last_change":"2024-04-23T10:24:53.507122+0000","last_active":"2024-04-23T10:26:00.082741+0000","last_peered":"2024-04-23T10:26:00.082741+0000","last_clean":"2024-04-23T10:26:00.082741+0000","last_became_active":"2024-04-23T10:24:53.506838+0000","last_became_peered":"2024-04-23T10:24:53.506838+0000","last_unstale":"2024-04-23T10:26:00.082741+0000","last_undegraded":"2024-04-23T10:26:00.082741+0000","last_fullsized":"2024-04-23T10:26:00.082741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:59:51.289630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089687+0000","last_change":"2024-04-23T10:24:52.499787+0000","last_active":"2024-04-23T10:26:00.089687+0000","last_peered":"2024-04-23T10:26:00.089687+0000","last_clean":"2024-04-23T10:26:00.089687+0000","last_became_active":"2024-04-23T10:24:52.499400+0000","last_became_peered":"2024-04-23T10:24:52.499400+0000","last_unstale":"2024-04-23T10:26:00.089687+0000","last_undegraded":"2024-04-23T10:26:00.089687+0000","last_fullsized":"2024-04-23T10:26:00.089687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:15:17.638984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215580+0000","last_change":"2024-04-23T10:24:53.495773+0000","last_active":"2024-04-23T10:26:00.215580+0000","last_peered":"2024-04-23T10:26:00.215580+0000","last_clean":"2024-04-23T10:26:00.215580+0000","last_became_active":"2024-04-23T10:24:53.495456+0000","last_became_peered":"2024-04-23T10:24:53.495456+0000","last_unstale":"2024-04-23T10:26:00.215580+0000","last_undegraded":"2024-04-23T10:26:00.215580+0000","last_fullsized":"2024-04-23T10:26:00.215580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:12:06.638141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.090186+0000","last_change":"2024-04-23T10:24:52.498660+0000","last_active":"2024-04-23T10:26:00.090186+0000","last_peered":"2024-04-23T10:26:00.090186+0000","last_clean":"2024-04-23T10:26:00.090186+0000","last_became_active":"2024-04-23T10:24:52.498302+0000","last_became_peered":"2024-04-23T10:24:52.498302+0000","last_unstale":"2024-04-23T10:26:00.090186+0000","last_undegraded":"2024-04-23T10:26:00.090186+0000","last_fullsized":"2024-04-23T10:26:00.090186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:49:23.826748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085878+0000","last_change":"2024-04-23T10:24:53.501718+0000","last_active":"2024-04-23T10:26:00.085878+0000","last_peered":"2024-04-23T10:26:00.085878+0000","last_clean":"2024-04-23T10:26:00.085878+0000","last_became_active":"2024-04-23T10:24:53.501359+0000","last_became_peered":"2024-04-23T10:24:53.501359+0000","last_unstale":"2024-04-23T10:26:00.085878+0000","last_undegraded":"2024-04-23T10:26:00.085878+0000","last_fullsized":"2024-04-23T10:26:00.085878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:51:42.474899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:06.421289+0000","last_change":"2024-04-23T10:24:52.493910+0000","last_active":"2024-04-23T10:26:06.421289+0000","last_peered":"2024-04-23T10:26:06.421289+0000","last_clean":"2024-04-23T10:26:06.421289+0000","last_became_active":"2024-04-23T10:24:52.493536+0000","last_became_peered":"2024-04-23T10:24:52.493536+0000","last_unstale":"2024-04-23T10:26:06.421289+0000","last_undegraded":"2024-04-23T10:26:06.421289+0000","last_fullsized":"2024-04-23T10:26:06.421289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:23.806993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085439+0000","last_change":"2024-04-23T10:24:53.498221+0000","last_active":"2024-04-23T10:26:00.085439+0000","last_peered":"2024-04-23T10:26:00.085439+0000","last_clean":"2024-04-23T10:26:00.085439+0000","last_became_active":"2024-04-23T10:24:53.497887+0000","last_became_peered":"2024-04-23T10:24:53.497887+0000","last_unstale":"2024-04-23T10:26:00.085439+0000","last_undegraded":"2024-04-23T10:26:00.085439+0000","last_fullsized":"2024-04-23T10:26:00.085439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:49:02.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082338+0000","last_change":"2024-04-23T10:24:52.498883+0000","last_active":"2024-04-23T10:26:00.082338+0000","last_peered":"2024-04-23T10:26:00.082338+0000","last_clean":"2024-04-23T10:26:00.082338+0000","last_became_active":"2024-04-23T10:24:52.498562+0000","last_became_peered":"2024-04-23T10:24:52.498562+0000","last_unstale":"2024-04-23T10:26:00.082338+0000","last_undegraded":"2024-04-23T10:26:00.082338+0000","last_fullsized":"2024-04-23T10:26:00.082338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:33.914481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089216+0000","last_change":"2024-04-23T10:24:53.506303+0000","last_active":"2024-04-23T10:26:00.089216+0000","last_peered":"2024-04-23T10:26:00.089216+0000","last_clean":"2024-04-23T10:26:00.089216+0000","last_became_active":"2024-04-23T10:24:53.505850+0000","last_became_peered":"2024-04-23T10:24:53.505850+0000","last_unstale":"2024-04-23T10:26:00.089216+0000","last_undegraded":"2024-04-23T10:26:00.089216+0000","last_fullsized":"2024-04-23T10:26:00.089216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:18.498188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082721+0000","last_change":"2024-04-23T10:24:52.493853+0000","last_active":"2024-04-23T10:26:00.082721+0000","last_peered":"2024-04-23T10:26:00.082721+0000","last_clean":"2024-04-23T10:26:00.082721+0000","last_became_active":"2024-04-23T10:24:52.492932+0000","last_became_peered":"2024-04-23T10:24:52.492932+0000","last_unstale":"2024-04-23T10:26:00.082721+0000","last_undegraded":"2024-04-23T10:26:00.082721+0000","last_fullsized":"2024-04-23T10:26:00.082721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:12:33.327611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.284417+0000","last_change":"2024-04-23T10:26:00.284417+0000","last_active":"2024-04-23T10:26:00.284417+0000","last_peered":"2024-04-23T10:26:00.284417+0000","last_clean":"2024-04-23T10:26:00.284417+0000","last_became_active":"2024-04-23T10:26:00.284097+0000","last_became_peered":"2024-04-23T10:26:00.284097+0000","last_unstale":"2024-04-23T10:26:00.284417+0000","last_undegraded":"2024-04-23T10:26:00.284417+0000","last_fullsized":"2024-04-23T10:26:00.284417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:53.114887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.081309+0000","last_change":"2024-04-23T10:24:52.494032+0000","last_active":"2024-04-23T10:26:00.081309+0000","last_peered":"2024-04-23T10:26:00.081309+0000","last_clean":"2024-04-23T10:26:00.081309+0000","last_became_active":"2024-04-23T10:24:52.493699+0000","last_became_peered":"2024-04-23T10:24:52.493699+0000","last_unstale":"2024-04-23T10:26:00.081309+0000","last_undegraded":"2024-04-23T10:26:00.081309+0000","last_fullsized":"2024-04-23T10:26:00.081309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:54.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082575+0000","last_change":"2024-04-23T10:24:53.494846+0000","last_active":"2024-04-23T10:26:00.082575+0000","last_peered":"2024-04-23T10:26:00.082575+0000","last_clean":"2024-04-23T10:26:00.082575+0000","last_became_active":"2024-04-23T10:24:53.494541+0000","last_became_peered":"2024-04-23T10:24:53.494541+0000","last_unstale":"2024-04-23T10:26:00.082575+0000","last_undegraded":"2024-04-23T10:26:00.082575+0000","last_fullsized":"2024-04-23T10:26:00.082575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:33:24.263803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:05.420058+0000","last_change":"2024-04-23T10:24:52.499078+0000","last_active":"2024-04-23T10:26:05.420058+0000","last_peered":"2024-04-23T10:26:05.420058+0000","last_clean":"2024-04-23T10:26:05.420058+0000","last_became_active":"2024-04-23T10:24:52.498764+0000","last_became_peered":"2024-04-23T10:24:52.498764+0000","last_unstale":"2024-04-23T10:26:05.420058+0000","last_undegraded":"2024-04-23T10:26:05.420058+0000","last_fullsized":"2024-04-23T10:26:05.420058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:10:51.634437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.087050+0000","last_change":"2024-04-23T10:26:00.087050+0000","last_active":"2024-04-23T10:26:00.087050+0000","last_peered":"2024-04-23T10:26:00.087050+0000","last_clean":"2024-04-23T10:26:00.087050+0000","last_became_active":"2024-04-23T10:26:00.086634+0000","last_became_peered":"2024-04-23T10:26:00.086634+0000","last_unstale":"2024-04-23T10:26:00.087050+0000","last_undegraded":"2024-04-23T10:26:00.087050+0000","last_fullsized":"2024-04-23T10:26:00.087050+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:40:38.242963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089830+0000","last_change":"2024-04-23T10:24:53.504787+0000","last_active":"2024-04-23T10:26:00.089830+0000","last_peered":"2024-04-23T10:26:00.089830+0000","last_clean":"2024-04-23T10:26:00.089830+0000","last_became_active":"2024-04-23T10:24:53.504423+0000","last_became_peered":"2024-04-23T10:24:53.504423+0000","last_unstale":"2024-04-23T10:26:00.089830+0000","last_undegraded":"2024-04-23T10:26:00.089830+0000","last_fullsized":"2024-04-23T10:26:00.089830+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:00.171449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:05.419607+0000","last_change":"2024-04-23T10:24:52.493600+0000","last_active":"2024-04-23T10:26:05.419607+0000","last_peered":"2024-04-23T10:26:05.419607+0000","last_clean":"2024-04-23T10:26:05.419607+0000","last_became_active":"2024-04-23T10:24:52.493310+0000","last_became_peered":"2024-04-23T10:24:52.493310+0000","last_unstale":"2024-04-23T10:26:05.419607+0000","last_undegraded":"2024-04-23T10:26:05.419607+0000","last_fullsized":"2024-04-23T10:26:05.419607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:07.144860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083517+0000","last_change":"2024-04-23T10:24:53.506311+0000","last_active":"2024-04-23T10:26:00.083517+0000","last_peered":"2024-04-23T10:26:00.083517+0000","last_clean":"2024-04-23T10:26:00.083517+0000","last_became_active":"2024-04-23T10:24:53.503910+0000","last_became_peered":"2024-04-23T10:24:53.503910+0000","last_unstale":"2024-04-23T10:26:00.083517+0000","last_undegraded":"2024-04-23T10:26:00.083517+0000","last_fullsized":"2024-04-23T10:26:00.083517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:01:32.620891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.282827+0000","last_change":"2024-04-23T10:24:52.485060+0000","last_active":"2024-04-23T10:26:00.282827+0000","last_peered":"2024-04-23T10:26:00.282827+0000","last_clean":"2024-04-23T10:26:00.282827+0000","last_became_active":"2024-04-23T10:24:52.484636+0000","last_became_peered":"2024-04-23T10:24:52.484636+0000","last_unstale":"2024-04-23T10:26:00.282827+0000","last_undegraded":"2024-04-23T10:26:00.282827+0000","last_fullsized":"2024-04-23T10:26:00.282827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:26:01.737147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":353,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085552+0000","last_change":"2024-04-23T10:23:43.804102+0000","last_active":"2024-04-23T10:26:00.085552+0000","last_peered":"2024-04-23T10:26:00.085552+0000","last_clean":"2024-04-23T10:26:00.085552+0000","last_became_active":"2024-04-23T10:23:43.803657+0000","last_became_peered":"2024-04-23T10:23:43.803657+0000","last_unstale":"2024-04-23T10:26:00.085552+0000","last_undegraded":"2024-04-23T10:26:00.085552+0000","last_fullsized":"2024-04-23T10:26:00.085552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_clean_scrub_stamp":"2024-04-23T10:20:19.875078+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:50.160735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215248+0000","last_change":"2024-04-23T10:24:53.499334+0000","last_active":"2024-04-23T10:26:00.215248+0000","last_peered":"2024-04-23T10:26:00.215248+0000","last_clean":"2024-04-23T10:26:00.215248+0000","last_became_active":"2024-04-23T10:24:53.499008+0000","last_became_peered":"2024-04-23T10:24:53.499008+0000","last_unstale":"2024-04-23T10:26:00.215248+0000","last_undegraded":"2024-04-23T10:26:00.215248+0000","last_fullsized":"2024-04-23T10:26:00.215248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:13.504789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085663+0000","last_change":"2024-04-23T10:24:52.493601+0000","last_active":"2024-04-23T10:26:00.085663+0000","last_peered":"2024-04-23T10:26:00.085663+0000","last_clean":"2024-04-23T10:26:00.085663+0000","last_became_active":"2024-04-23T10:24:52.493278+0000","last_became_peered":"2024-04-23T10:24:52.493278+0000","last_unstale":"2024-04-23T10:26:00.085663+0000","last_undegraded":"2024-04-23T10:26:00.085663+0000","last_fullsized":"2024-04-23T10:26:00.085663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:36:21.375233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082851+0000","last_change":"2024-04-23T10:24:52.495637+0000","last_active":"2024-04-23T10:26:00.082851+0000","last_peered":"2024-04-23T10:26:00.082851+0000","last_clean":"2024-04-23T10:26:00.082851+0000","last_became_active":"2024-04-23T10:24:52.495329+0000","last_became_peered":"2024-04-23T10:24:52.495329+0000","last_unstale":"2024-04-23T10:26:00.082851+0000","last_undegraded":"2024-04-23T10:26:00.082851+0000","last_fullsized":"2024-04-23T10:26:00.082851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:14.187803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215472+0000","last_change":"2024-04-23T10:24:53.500353+0000","last_active":"2024-04-23T10:26:00.215472+0000","last_peered":"2024-04-23T10:26:00.215472+0000","last_clean":"2024-04-23T10:26:00.215472+0000","last_became_active":"2024-04-23T10:24:53.499995+0000","last_became_peered":"2024-04-23T10:24:53.499995+0000","last_unstale":"2024-04-23T10:26:00.215472+0000","last_undegraded":"2024-04-23T10:26:00.215472+0000","last_fullsized":"2024-04-23T10:26:00.215472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:55:52.695375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.099289+0000","last_change":"2024-04-23T10:26:00.099289+0000","last_active":"2024-04-23T10:26:00.099289+0000","last_peered":"2024-04-23T10:26:00.099289+0000","last_clean":"2024-04-23T10:26:00.099289+0000","last_became_active":"2024-04-23T10:26:00.088425+0000","last_became_peered":"2024-04-23T10:26:00.088425+0000","last_unstale":"2024-04-23T10:26:00.099289+0000","last_undegraded":"2024-04-23T10:26:00.099289+0000","last_fullsized":"2024-04-23T10:26:00.099289+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:54:11.848553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083865+0000","last_change":"2024-04-23T10:24:53.498140+0000","last_active":"2024-04-23T10:26:00.083865+0000","last_peered":"2024-04-23T10:26:00.083865+0000","last_clean":"2024-04-23T10:26:00.083865+0000","last_became_active":"2024-04-23T10:24:53.496683+0000","last_became_peered":"2024-04-23T10:24:53.496683+0000","last_unstale":"2024-04-23T10:26:00.083865+0000","last_undegraded":"2024-04-23T10:26:00.083865+0000","last_fullsized":"2024-04-23T10:26:00.083865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:49:18.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.283236+0000","last_change":"2024-04-23T10:24:52.486505+0000","last_active":"2024-04-23T10:26:00.283236+0000","last_peered":"2024-04-23T10:26:00.283236+0000","last_clean":"2024-04-23T10:26:00.283236+0000","last_became_active":"2024-04-23T10:24:52.486185+0000","last_became_peered":"2024-04-23T10:24:52.486185+0000","last_unstale":"2024-04-23T10:26:00.283236+0000","last_undegraded":"2024-04-23T10:26:00.283236+0000","last_fullsized":"2024-04-23T10:26:00.283236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:46:27.052935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.087044+0000","last_change":"2024-04-23T10:24:53.496234+0000","last_active":"2024-04-23T10:26:00.087044+0000","last_peered":"2024-04-23T10:26:00.087044+0000","last_clean":"2024-04-23T10:26:00.087044+0000","last_became_active":"2024-04-23T10:24:53.495892+0000","last_became_peered":"2024-04-23T10:24:53.495892+0000","last_unstale":"2024-04-23T10:26:00.087044+0000","last_undegraded":"2024-04-23T10:26:00.087044+0000","last_fullsized":"2024-04-23T10:26:00.087044+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:11.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.094344+0000","last_change":"2024-04-23T10:26:00.094344+0000","last_active":"2024-04-23T10:26:00.094344+0000","last_peered":"2024-04-23T10:26:00.094344+0000","last_clean":"2024-04-23T10:26:00.094344+0000","last_became_active":"2024-04-23T10:26:00.090692+0000","last_became_peered":"2024-04-23T10:26:00.090692+0000","last_unstale":"2024-04-23T10:26:00.094344+0000","last_undegraded":"2024-04-23T10:26:00.094344+0000","last_fullsized":"2024-04-23T10:26:00.094344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082268+0000","last_change":"2024-04-23T10:24:53.497985+0000","last_active":"2024-04-23T10:26:00.082268+0000","last_peered":"2024-04-23T10:26:00.082268+0000","last_clean":"2024-04-23T10:26:00.082268+0000","last_became_active":"2024-04-23T10:24:53.497661+0000","last_became_peered":"2024-04-23T10:24:53.497661+0000","last_unstale":"2024-04-23T10:26:00.082268+0000","last_undegraded":"2024-04-23T10:26:00.082268+0000","last_fullsized":"2024-04-23T10:26:00.082268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:48.923714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083094+0000","last_change":"2024-04-23T10:24:52.490572+0000","last_active":"2024-04-23T10:26:00.083094+0000","last_peered":"2024-04-23T10:26:00.083094+0000","last_clean":"2024-04-23T10:26:00.083094+0000","last_became_active":"2024-04-23T10:24:52.490274+0000","last_became_peered":"2024-04-23T10:24:52.490274+0000","last_unstale":"2024-04-23T10:26:00.083094+0000","last_undegraded":"2024-04-23T10:26:00.083094+0000","last_fullsized":"2024-04-23T10:26:00.083094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:22.447399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085693+0000","last_change":"2024-04-23T10:24:53.509189+0000","last_active":"2024-04-23T10:26:00.085693+0000","last_peered":"2024-04-23T10:26:00.085693+0000","last_clean":"2024-04-23T10:26:00.085693+0000","last_became_active":"2024-04-23T10:24:53.508850+0000","last_became_peered":"2024-04-23T10:24:53.508850+0000","last_unstale":"2024-04-23T10:26:00.085693+0000","last_undegraded":"2024-04-23T10:26:00.085693+0000","last_fullsized":"2024-04-23T10:26:00.085693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:23.242999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089203+0000","last_change":"2024-04-23T10:24:52.497616+0000","last_active":"2024-04-23T10:26:00.089203+0000","last_peered":"2024-04-23T10:26:00.089203+0000","last_clean":"2024-04-23T10:26:00.089203+0000","last_became_active":"2024-04-23T10:24:52.497028+0000","last_became_peered":"2024-04-23T10:24:52.497028+0000","last_unstale":"2024-04-23T10:26:00.089203+0000","last_undegraded":"2024-04-23T10:26:00.089203+0000","last_fullsized":"2024-04-23T10:26:00.089203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:51:26.836718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083947+0000","last_change":"2024-04-23T10:24:53.498086+0000","last_active":"2024-04-23T10:26:00.083947+0000","last_peered":"2024-04-23T10:26:00.083947+0000","last_clean":"2024-04-23T10:26:00.083947+0000","last_became_active":"2024-04-23T10:24:53.497734+0000","last_became_peered":"2024-04-23T10:24:53.497734+0000","last_unstale":"2024-04-23T10:26:00.083947+0000","last_undegraded":"2024-04-23T10:26:00.083947+0000","last_fullsized":"2024-04-23T10:26:00.083947+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:57.602301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082537+0000","last_change":"2024-04-23T10:24:52.496609+0000","last_active":"2024-04-23T10:26:00.082537+0000","last_peered":"2024-04-23T10:26:00.082537+0000","last_clean":"2024-04-23T10:26:00.082537+0000","last_became_active":"2024-04-23T10:24:52.495981+0000","last_became_peered":"2024-04-23T10:24:52.495981+0000","last_unstale":"2024-04-23T10:26:00.082537+0000","last_undegraded":"2024-04-23T10:26:00.082537+0000","last_fullsized":"2024-04-23T10:26:00.082537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:28.111644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086000+0000","last_change":"2024-04-23T10:24:53.503840+0000","last_active":"2024-04-23T10:26:00.086000+0000","last_peered":"2024-04-23T10:26:00.086000+0000","last_clean":"2024-04-23T10:26:00.086000+0000","last_became_active":"2024-04-23T10:24:53.503448+0000","last_became_peered":"2024-04-23T10:24:53.503448+0000","last_unstale":"2024-04-23T10:26:00.086000+0000","last_undegraded":"2024-04-23T10:26:00.086000+0000","last_fullsized":"2024-04-23T10:26:00.086000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:03.295985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:03.447454+0000","last_change":"2024-04-23T10:24:52.501792+0000","last_active":"2024-04-23T10:26:03.447454+0000","last_peered":"2024-04-23T10:26:03.447454+0000","last_clean":"2024-04-23T10:26:03.447454+0000","last_became_active":"2024-04-23T10:24:52.501404+0000","last_became_peered":"2024-04-23T10:24:52.501404+0000","last_unstale":"2024-04-23T10:26:03.447454+0000","last_undegraded":"2024-04-23T10:26:03.447454+0000","last_fullsized":"2024-04-23T10:26:03.447454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:03.529410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086056+0000","last_change":"2024-04-23T10:24:53.501649+0000","last_active":"2024-04-23T10:26:00.086056+0000","last_peered":"2024-04-23T10:26:00.086056+0000","last_clean":"2024-04-23T10:26:00.086056+0000","last_became_active":"2024-04-23T10:24:53.501307+0000","last_became_peered":"2024-04-23T10:24:53.501307+0000","last_unstale":"2024-04-23T10:26:00.086056+0000","last_undegraded":"2024-04-23T10:26:00.086056+0000","last_fullsized":"2024-04-23T10:26:00.086056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:37.863832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.090913+0000","last_change":"2024-04-23T10:24:52.495737+0000","last_active":"2024-04-23T10:26:00.090913+0000","last_peered":"2024-04-23T10:26:00.090913+0000","last_clean":"2024-04-23T10:26:00.090913+0000","last_became_active":"2024-04-23T10:24:52.495395+0000","last_became_peered":"2024-04-23T10:24:52.495395+0000","last_unstale":"2024-04-23T10:26:00.090913+0000","last_undegraded":"2024-04-23T10:26:00.090913+0000","last_fullsized":"2024-04-23T10:26:00.090913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:14:45.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.095511+0000","last_change":"2024-04-23T10:26:00.095511+0000","last_active":"2024-04-23T10:26:00.095511+0000","last_peered":"2024-04-23T10:26:00.095511+0000","last_clean":"2024-04-23T10:26:00.095511+0000","last_became_active":"2024-04-23T10:26:00.092403+0000","last_became_peered":"2024-04-23T10:26:00.092403+0000","last_unstale":"2024-04-23T10:26:00.095511+0000","last_undegraded":"2024-04-23T10:26:00.095511+0000","last_fullsized":"2024-04-23T10:26:00.095511+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:16:45.782094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215630+0000","last_change":"2024-04-23T10:24:52.494322+0000","last_active":"2024-04-23T10:26:00.215630+0000","last_peered":"2024-04-23T10:26:00.215630+0000","last_clean":"2024-04-23T10:26:00.215630+0000","last_became_active":"2024-04-23T10:24:52.494019+0000","last_became_peered":"2024-04-23T10:24:52.494019+0000","last_unstale":"2024-04-23T10:26:00.215630+0000","last_undegraded":"2024-04-23T10:26:00.215630+0000","last_fullsized":"2024-04-23T10:26:00.215630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:16.099197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085884+0000","last_change":"2024-04-23T10:24:53.507160+0000","last_active":"2024-04-23T10:26:00.085884+0000","last_peered":"2024-04-23T10:26:00.085884+0000","last_clean":"2024-04-23T10:26:00.085884+0000","last_became_active":"2024-04-23T10:24:53.506815+0000","last_became_peered":"2024-04-23T10:24:53.506815+0000","last_unstale":"2024-04-23T10:26:00.085884+0000","last_undegraded":"2024-04-23T10:26:00.085884+0000","last_fullsized":"2024-04-23T10:26:00.085884+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:24.657153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085835+0000","last_change":"2024-04-23T10:24:53.510511+0000","last_active":"2024-04-23T10:26:00.085835+0000","last_peered":"2024-04-23T10:26:00.085835+0000","last_clean":"2024-04-23T10:26:00.085835+0000","last_became_active":"2024-04-23T10:24:53.510174+0000","last_became_peered":"2024-04-23T10:24:53.510174+0000","last_unstale":"2024-04-23T10:26:00.085835+0000","last_undegraded":"2024-04-23T10:26:00.085835+0000","last_fullsized":"2024-04-23T10:26:00.085835+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:35.048697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089559+0000","last_change":"2024-04-23T10:24:53.497365+0000","last_active":"2024-04-23T10:26:00.089559+0000","last_peered":"2024-04-23T10:26:00.089559+0000","last_clean":"2024-04-23T10:26:00.089559+0000","last_became_active":"2024-04-23T10:24:53.496427+0000","last_became_peered":"2024-04-23T10:24:53.496427+0000","last_unstale":"2024-04-23T10:26:00.089559+0000","last_undegraded":"2024-04-23T10:26:00.089559+0000","last_fullsized":"2024-04-23T10:26:00.089559+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:22:35.867252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089089+0000","last_change":"2024-04-23T10:24:53.495913+0000","last_active":"2024-04-23T10:26:00.089089+0000","last_peered":"2024-04-23T10:26:00.089089+0000","last_clean":"2024-04-23T10:26:00.089089+0000","last_became_active":"2024-04-23T10:24:53.495543+0000","last_became_peered":"2024-04-23T10:24:53.495543+0000","last_unstale":"2024-04-23T10:26:00.089089+0000","last_undegraded":"2024-04-23T10:26:00.089089+0000","last_fullsized":"2024-04-23T10:26:00.089089+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:03:29.327759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085962+0000","last_change":"2024-04-23T10:24:53.492305+0000","last_active":"2024-04-23T10:26:00.085962+0000","last_peered":"2024-04-23T10:26:00.085962+0000","last_clean":"2024-04-23T10:26:00.085962+0000","last_became_active":"2024-04-23T10:24:53.491980+0000","last_became_peered":"2024-04-23T10:24:53.491980+0000","last_unstale":"2024-04-23T10:26:00.085962+0000","last_undegraded":"2024-04-23T10:26:00.085962+0000","last_fullsized":"2024-04-23T10:26:00.085962+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:34.987447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215521+0000","last_change":"2024-04-23T10:24:53.492464+0000","last_active":"2024-04-23T10:26:00.215521+0000","last_peered":"2024-04-23T10:26:00.215521+0000","last_clean":"2024-04-23T10:26:00.215521+0000","last_became_active":"2024-04-23T10:24:53.492156+0000","last_became_peered":"2024-04-23T10:24:53.492156+0000","last_unstale":"2024-04-23T10:26:00.215521+0000","last_undegraded":"2024-04-23T10:26:00.215521+0000","last_fullsized":"2024-04-23T10:26:00.215521+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:07:15.414598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086155+0000","last_change":"2024-04-23T10:24:53.502208+0000","last_active":"2024-04-23T10:26:00.086155+0000","last_peered":"2024-04-23T10:26:00.086155+0000","last_clean":"2024-04-23T10:26:00.086155+0000","last_became_active":"2024-04-23T10:24:53.501921+0000","last_became_peered":"2024-04-23T10:24:53.501921+0000","last_unstale":"2024-04-23T10:26:00.086155+0000","last_undegraded":"2024-04-23T10:26:00.086155+0000","last_fullsized":"2024-04-23T10:26:00.086155+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:29:21.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089979+0000","last_change":"2024-04-23T10:24:53.495446+0000","last_active":"2024-04-23T10:26:00.089979+0000","last_peered":"2024-04-23T10:26:00.089979+0000","last_clean":"2024-04-23T10:26:00.089979+0000","last_became_active":"2024-04-23T10:24:53.495090+0000","last_became_peered":"2024-04-23T10:24:53.495090+0000","last_unstale":"2024-04-23T10:26:00.089979+0000","last_undegraded":"2024-04-23T10:26:00.089979+0000","last_fullsized":"2024-04-23T10:26:00.089979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:44:00.007468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083775+0000","last_change":"2024-04-23T10:24:53.503390+0000","last_active":"2024-04-23T10:26:00.083775+0000","last_peered":"2024-04-23T10:26:00.083775+0000","last_clean":"2024-04-23T10:26:00.083775+0000","last_became_active":"2024-04-23T10:24:53.503057+0000","last_became_peered":"2024-04-23T10:24:53.503057+0000","last_unstale":"2024-04-23T10:26:00.083775+0000","last_undegraded":"2024-04-23T10:26:00.083775+0000","last_fullsized":"2024-04-23T10:26:00.083775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:19:39.950651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089737+0000","last_change":"2024-04-23T10:24:53.498188+0000","last_active":"2024-04-23T10:26:00.089737+0000","last_peered":"2024-04-23T10:26:00.089737+0000","last_clean":"2024-04-23T10:26:00.089737+0000","last_became_active":"2024-04-23T10:24:53.497873+0000","last_became_peered":"2024-04-23T10:24:53.497873+0000","last_unstale":"2024-04-23T10:26:00.089737+0000","last_undegraded":"2024-04-23T10:26:00.089737+0000","last_fullsized":"2024-04-23T10:26:00.089737+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:48:05.001361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083115+0000","last_change":"2024-04-23T10:24:53.502260+0000","last_active":"2024-04-23T10:26:00.083115+0000","last_peered":"2024-04-23T10:26:00.083115+0000","last_clean":"2024-04-23T10:26:00.083115+0000","last_became_active":"2024-04-23T10:24:53.501525+0000","last_became_peered":"2024-04-23T10:24:53.501525+0000","last_unstale":"2024-04-23T10:26:00.083115+0000","last_undegraded":"2024-04-23T10:26:00.083115+0000","last_fullsized":"2024-04-23T10:26:00.083115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:04.379055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086030+0000","last_change":"2024-04-23T10:24:53.499306+0000","last_active":"2024-04-23T10:26:00.086030+0000","last_peered":"2024-04-23T10:26:00.086030+0000","last_clean":"2024-04-23T10:26:00.086030+0000","last_became_active":"2024-04-23T10:24:53.496717+0000","last_became_peered":"2024-04-23T10:24:53.496717+0000","last_unstale":"2024-04-23T10:26:00.086030+0000","last_undegraded":"2024-04-23T10:26:00.086030+0000","last_fullsized":"2024-04-23T10:26:00.086030+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:03:17.907117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215570+0000","last_change":"2024-04-23T10:24:53.496330+0000","last_active":"2024-04-23T10:26:00.215570+0000","last_peered":"2024-04-23T10:26:00.215570+0000","last_clean":"2024-04-23T10:26:00.215570+0000","last_became_active":"2024-04-23T10:24:53.496021+0000","last_became_peered":"2024-04-23T10:24:53.496021+0000","last_unstale":"2024-04-23T10:26:00.215570+0000","last_undegraded":"2024-04-23T10:26:00.215570+0000","last_fullsized":"2024-04-23T10:26:00.215570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:10:59.340265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086013+0000","last_change":"2024-04-23T10:24:53.501025+0000","last_active":"2024-04-23T10:26:00.086013+0000","last_peered":"2024-04-23T10:26:00.086013+0000","last_clean":"2024-04-23T10:26:00.086013+0000","last_became_active":"2024-04-23T10:24:53.500673+0000","last_became_peered":"2024-04-23T10:24:53.500673+0000","last_unstale":"2024-04-23T10:26:00.086013+0000","last_undegraded":"2024-04-23T10:26:00.086013+0000","last_fullsized":"2024-04-23T10:26:00.086013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:07.728645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246478,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64057,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":721,"num_read_kb":429,"num_write":232,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":192171,"data_compressed":5577,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351004,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":460844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612640,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1108726,"data_compressed":37539,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":460500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037804,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":460761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299441,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1053279,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462966,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":460100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":517866,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":461830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1040384,"data_stored":518477,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149764,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":459808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":460352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724603,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":1052566,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34039,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34039,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":58605,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59216,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":58980,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:26:10.141 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-23T10:26:10.382 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:11.164 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:10 smithi069 ceph-mon[29593]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:26:11.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:10 smithi146 ceph-mon[32800]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:26:11.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:10 smithi167 ceph-mon[32940]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:26:12.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.045+0000 7fcd0ff98700 1 -- 172.21.15.69:0/3929260948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd08101940 msgr2=0x7fcd08101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:12.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.045+0000 7fcd0ff98700 1 --2- 172.21.15.69:0/3929260948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd08101940 0x7fcd08101dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00b0a0 tx=0x7fccfc00b3b0 comp rx=0 tx=0).stop 2024-04-23T10:26:12.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.045+0000 7fcd0ff98700 1 -- 172.21.15.69:0/3929260948 shutdown_connections 2024-04-23T10:26:12.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.045+0000 7fcd0ff98700 1 --2- 172.21.15.69:0/3929260948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd08102300 0x7fcd0810e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:12.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.045+0000 7fcd0ff98700 1 --2- 172.21.15.69:0/3929260948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd08107990 0x7fcd08107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:12.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.045+0000 7fcd0ff98700 1 --2- 172.21.15.69:0/3929260948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd08101940 0x7fcd08101dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:12.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.045+0000 7fcd0ff98700 1 -- 172.21.15.69:0/3929260948 >> 172.21.15.69:0/3929260948 conn(0x7fcd080788f0 msgr2=0x7fcd08078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:12.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.045+0000 7fcd0ff98700 1 -- 172.21.15.69:0/3929260948 shutdown_connections 2024-04-23T10:26:12.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.046+0000 7fcd0ff98700 1 -- 172.21.15.69:0/3929260948 wait complete. 2024-04-23T10:26:12.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.046+0000 7fcd0ff98700 1 Processor -- start 2024-04-23T10:26:12.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.046+0000 7fcd0ff98700 1 -- start start 2024-04-23T10:26:12.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.046+0000 7fcd0ff98700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd08101940 0x7fcd0819b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:12.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.046+0000 7fcd0ff98700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd08102300 0x7fcd0819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:12.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.046+0000 7fcd0ff98700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd08107990 0x7fcd0819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:12.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.046+0000 7fcd0ff98700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fcd08111d10 con 0x7fcd08102300 2024-04-23T10:26:12.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.046+0000 7fcd0ff98700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd08111b90 con 0x7fcd08107990 2024-04-23T10:26:12.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.046+0000 7fcd0ff98700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcd08111e90 con 0x7fcd08101940 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.046+0000 7fcd0d533700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd08102300 0x7fcd0819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0d533700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd08102300 0x7fcd0819bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47544/0 (socket says 172.21.15.69:47544) 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0d533700 1 -- 172.21.15.69:0/2890454016 learned_addr learned my addr 172.21.15.69:0/2890454016 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0e535700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd08107990 0x7fcd0819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0dd34700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd08101940 0x7fcd0819b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0d533700 1 -- 172.21.15.69:0/2890454016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd08101940 msgr2=0x7fcd0819b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0d533700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd08101940 0x7fcd0819b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0d533700 1 -- 172.21.15.69:0/2890454016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd08107990 msgr2=0x7fcd0819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0d533700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd08107990 0x7fcd0819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0d533700 1 -- 172.21.15.69:0/2890454016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd081a0590 con 0x7fcd08102300 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0d533700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd08102300 0x7fcd0819bac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00b070 tx=0x7fccfc007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd06ffd700 1 -- 172.21.15.69:0/2890454016 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc021020 con 0x7fcd08102300 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd06ffd700 1 -- 172.21.15.69:0/2890454016 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fccfc007e10 con 0x7fcd08102300 2024-04-23T10:26:12.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd06ffd700 1 -- 172.21.15.69:0/2890454016 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc01bd80 con 0x7fcd08102300 2024-04-23T10:26:12.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0ff98700 1 -- 172.21.15.69:0/2890454016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd081a0820 con 0x7fcd08102300 2024-04-23T10:26:12.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.047+0000 7fcd0ff98700 1 -- 172.21.15.69:0/2890454016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd081a8100 con 0x7fcd08102300 2024-04-23T10:26:12.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.048+0000 7fcd0ff98700 1 -- 172.21.15.69:0/2890454016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd08103060 con 0x7fcd08102300 2024-04-23T10:26:12.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.049+0000 7fcd06ffd700 1 -- 172.21.15.69:0/2890454016 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fccfc024020 con 0x7fcd08102300 2024-04-23T10:26:12.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.050+0000 7fcd06ffd700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fccf00a3cd0 0x7fccf00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:12.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.050+0000 7fcd0dd34700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fccf00a3cd0 0x7fccf00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:12.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.050+0000 7fcd06ffd700 1 -- 172.21.15.69:0/2890454016 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fccfc00f020 con 0x7fcd08102300 2024-04-23T10:26:12.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.050+0000 7fcd0dd34700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fccf00a3cd0 0x7fccf00a6190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fccf8006fd0 tx=0x7fccf8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:12.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.054+0000 7fcd06ffd700 1 -- 172.21.15.69:0/2890454016 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fccfc09e320 con 0x7fcd08102300 2024-04-23T10:26:12.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:11 smithi146 ceph-mon[32800]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:12.234 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:11 smithi167 ceph-mon[32940]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:12.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:11 smithi069 ceph-mon[29593]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:12.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.249+0000 7fcd0ff98700 1 -- 172.21.15.69:0/2890454016 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd0806ae30 con 0x7fccf00a3cd0 2024-04-23T10:26:12.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.256+0000 7fcd06ffd700 1 -- 172.21.15.69:0/2890454016 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258970 (secure 0 0 0) 0x7fcd0806ae30 con 0x7fccf00a3cd0 2024-04-23T10:26:12.259 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:12.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 -- 172.21.15.69:0/2890454016 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fccf00a3cd0 msgr2=0x7fccf00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:12.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fccf00a3cd0 0x7fccf00a6190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fccf8006fd0 tx=0x7fccf8008040 comp rx=0 tx=0).stop 2024-04-23T10:26:12.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 -- 172.21.15.69:0/2890454016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd08102300 msgr2=0x7fcd0819bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:12.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd08102300 0x7fcd0819bac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00b070 tx=0x7fccfc007b40 comp rx=0 tx=0).stop 2024-04-23T10:26:12.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 -- 172.21.15.69:0/2890454016 shutdown_connections 2024-04-23T10:26:12.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fccf00a3cd0 0x7fccf00a6190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:12.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd08107990 0x7fcd0819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:12.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd08101940 0x7fcd0819b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:12.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 --2- 172.21.15.69:0/2890454016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd08102300 0x7fcd0819bac0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:12.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 -- 172.21.15.69:0/2890454016 >> 172.21.15.69:0/2890454016 conn(0x7fcd080788f0 msgr2=0x7fcd0806a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:12.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 -- 172.21.15.69:0/2890454016 shutdown_connections 2024-04-23T10:26:12.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:12.259+0000 7fcd0ff98700 1 -- 172.21.15.69:0/2890454016 wait complete. 2024-04-23T10:26:12.262 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-23T10:26:13.001 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-04-23T10:26:11.021719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654659,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":882,"num_read_kb":563,"num_write":415,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180853,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361012,"kb_used_data":11784,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580812,"statfs":{"total":1151940427776,"available":1151570751488,"internally_reserved":0,"allocated":12066816,"data_stored":7475109,"data_compressed":112617,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19139,"internal_metadata":357414205},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":117,"num_keys_recovered":7,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.941499"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086071+0000","last_change":"2024-04-23T10:24:53.504514+0000","last_active":"2024-04-23T10:26:00.086071+0000","last_peered":"2024-04-23T10:26:00.086071+0000","last_clean":"2024-04-23T10:26:00.086071+0000","last_became_active":"2024-04-23T10:24:53.504105+0000","last_became_peered":"2024-04-23T10:24:53.504105+0000","last_unstale":"2024-04-23T10:26:00.086071+0000","last_undegraded":"2024-04-23T10:26:00.086071+0000","last_fullsized":"2024-04-23T10:26:00.086071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:49.730698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086940+0000","last_change":"2024-04-23T10:24:53.504534+0000","last_active":"2024-04-23T10:26:00.086940+0000","last_peered":"2024-04-23T10:26:00.086940+0000","last_clean":"2024-04-23T10:26:00.086940+0000","last_became_active":"2024-04-23T10:24:53.504244+0000","last_became_peered":"2024-04-23T10:24:53.504244+0000","last_unstale":"2024-04-23T10:26:00.086940+0000","last_undegraded":"2024-04-23T10:26:00.086940+0000","last_fullsized":"2024-04-23T10:26:00.086940+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:12:57.447009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086041+0000","last_change":"2024-04-23T10:24:53.502922+0000","last_active":"2024-04-23T10:26:00.086041+0000","last_peered":"2024-04-23T10:26:00.086041+0000","last_clean":"2024-04-23T10:26:00.086041+0000","last_became_active":"2024-04-23T10:24:53.502519+0000","last_became_peered":"2024-04-23T10:24:53.502519+0000","last_unstale":"2024-04-23T10:26:00.086041+0000","last_undegraded":"2024-04-23T10:26:00.086041+0000","last_fullsized":"2024-04-23T10:26:00.086041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:58:35.871081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.282857+0000","last_change":"2024-04-23T10:24:53.500049+0000","last_active":"2024-04-23T10:26:00.282857+0000","last_peered":"2024-04-23T10:26:00.282857+0000","last_clean":"2024-04-23T10:26:00.282857+0000","last_became_active":"2024-04-23T10:24:53.499607+0000","last_became_peered":"2024-04-23T10:24:53.499607+0000","last_unstale":"2024-04-23T10:26:00.282857+0000","last_undegraded":"2024-04-23T10:26:00.282857+0000","last_fullsized":"2024-04-23T10:26:00.282857+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:10:27.104622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082378+0000","last_change":"2024-04-23T10:24:53.493739+0000","last_active":"2024-04-23T10:26:00.082378+0000","last_peered":"2024-04-23T10:26:00.082378+0000","last_clean":"2024-04-23T10:26:00.082378+0000","last_became_active":"2024-04-23T10:24:53.492471+0000","last_became_peered":"2024-04-23T10:24:53.492471+0000","last_unstale":"2024-04-23T10:26:00.082378+0000","last_undegraded":"2024-04-23T10:26:00.082378+0000","last_fullsized":"2024-04-23T10:26:00.082378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:43.267366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082307+0000","last_change":"2024-04-23T10:24:53.500426+0000","last_active":"2024-04-23T10:26:00.082307+0000","last_peered":"2024-04-23T10:26:00.082307+0000","last_clean":"2024-04-23T10:26:00.082307+0000","last_became_active":"2024-04-23T10:24:53.500052+0000","last_became_peered":"2024-04-23T10:24:53.500052+0000","last_unstale":"2024-04-23T10:26:00.082307+0000","last_undegraded":"2024-04-23T10:26:00.082307+0000","last_fullsized":"2024-04-23T10:26:00.082307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:21:36.361816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086739+0000","last_change":"2024-04-23T10:24:53.501672+0000","last_active":"2024-04-23T10:26:00.086739+0000","last_peered":"2024-04-23T10:26:00.086739+0000","last_clean":"2024-04-23T10:26:00.086739+0000","last_became_active":"2024-04-23T10:24:53.501345+0000","last_became_peered":"2024-04-23T10:24:53.501345+0000","last_unstale":"2024-04-23T10:26:00.086739+0000","last_undegraded":"2024-04-23T10:26:00.086739+0000","last_fullsized":"2024-04-23T10:26:00.086739+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:31:41.488482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083027+0000","last_change":"2024-04-23T10:24:53.499442+0000","last_active":"2024-04-23T10:26:00.083027+0000","last_peered":"2024-04-23T10:26:00.083027+0000","last_clean":"2024-04-23T10:26:00.083027+0000","last_became_active":"2024-04-23T10:24:53.499131+0000","last_became_peered":"2024-04-23T10:24:53.499131+0000","last_unstale":"2024-04-23T10:26:00.083027+0000","last_undegraded":"2024-04-23T10:26:00.083027+0000","last_fullsized":"2024-04-23T10:26:00.083027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:17:21.815851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086822+0000","last_change":"2024-04-23T10:24:53.501235+0000","last_active":"2024-04-23T10:26:00.086822+0000","last_peered":"2024-04-23T10:26:00.086822+0000","last_clean":"2024-04-23T10:26:00.086822+0000","last_became_active":"2024-04-23T10:24:53.500392+0000","last_became_peered":"2024-04-23T10:24:53.500392+0000","last_unstale":"2024-04-23T10:26:00.086822+0000","last_undegraded":"2024-04-23T10:26:00.086822+0000","last_fullsized":"2024-04-23T10:26:00.086822+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:58:20.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082699+0000","last_change":"2024-04-23T10:24:53.504235+0000","last_active":"2024-04-23T10:26:00.082699+0000","last_peered":"2024-04-23T10:26:00.082699+0000","last_clean":"2024-04-23T10:26:00.082699+0000","last_became_active":"2024-04-23T10:24:53.503743+0000","last_became_peered":"2024-04-23T10:24:53.503743+0000","last_unstale":"2024-04-23T10:26:00.082699+0000","last_undegraded":"2024-04-23T10:26:00.082699+0000","last_fullsized":"2024-04-23T10:26:00.082699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:25:53.881433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086074+0000","last_change":"2024-04-23T10:24:53.497355+0000","last_active":"2024-04-23T10:26:00.086074+0000","last_peered":"2024-04-23T10:26:00.086074+0000","last_clean":"2024-04-23T10:26:00.086074+0000","last_became_active":"2024-04-23T10:24:53.494195+0000","last_became_peered":"2024-04-23T10:24:53.494195+0000","last_unstale":"2024-04-23T10:26:00.086074+0000","last_undegraded":"2024-04-23T10:26:00.086074+0000","last_fullsized":"2024-04-23T10:26:00.086074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:19:48.638789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.282944+0000","last_change":"2024-04-23T10:24:53.504513+0000","last_active":"2024-04-23T10:26:00.282944+0000","last_peered":"2024-04-23T10:26:00.282944+0000","last_clean":"2024-04-23T10:26:00.282944+0000","last_became_active":"2024-04-23T10:24:53.504058+0000","last_became_peered":"2024-04-23T10:24:53.504058+0000","last_unstale":"2024-04-23T10:26:00.282944+0000","last_undegraded":"2024-04-23T10:26:00.282944+0000","last_fullsized":"2024-04-23T10:26:00.282944+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:16:34.302848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215459+0000","last_change":"2024-04-23T10:24:53.495277+0000","last_active":"2024-04-23T10:26:00.215459+0000","last_peered":"2024-04-23T10:26:00.215459+0000","last_clean":"2024-04-23T10:26:00.215459+0000","last_became_active":"2024-04-23T10:24:53.494925+0000","last_became_peered":"2024-04-23T10:24:53.494925+0000","last_unstale":"2024-04-23T10:26:00.215459+0000","last_undegraded":"2024-04-23T10:26:00.215459+0000","last_fullsized":"2024-04-23T10:26:00.215459+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:33.647408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085291+0000","last_change":"2024-04-23T10:24:53.504082+0000","last_active":"2024-04-23T10:26:00.085291+0000","last_peered":"2024-04-23T10:26:00.085291+0000","last_clean":"2024-04-23T10:26:00.085291+0000","last_became_active":"2024-04-23T10:24:53.503753+0000","last_became_peered":"2024-04-23T10:24:53.503753+0000","last_unstale":"2024-04-23T10:26:00.085291+0000","last_undegraded":"2024-04-23T10:26:00.085291+0000","last_fullsized":"2024-04-23T10:26:00.085291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:59.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.091416+0000","last_change":"2024-04-23T10:26:00.091416+0000","last_active":"2024-04-23T10:26:00.091416+0000","last_peered":"2024-04-23T10:26:00.091416+0000","last_clean":"2024-04-23T10:26:00.091416+0000","last_became_active":"2024-04-23T10:26:00.091030+0000","last_became_peered":"2024-04-23T10:26:00.091030+0000","last_unstale":"2024-04-23T10:26:00.091416+0000","last_undegraded":"2024-04-23T10:26:00.091416+0000","last_fullsized":"2024-04-23T10:26:00.091416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:28.835870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085470+0000","last_change":"2024-04-23T10:24:53.498916+0000","last_active":"2024-04-23T10:26:00.085470+0000","last_peered":"2024-04-23T10:26:00.085470+0000","last_clean":"2024-04-23T10:26:00.085470+0000","last_became_active":"2024-04-23T10:24:53.498560+0000","last_became_peered":"2024-04-23T10:24:53.498560+0000","last_unstale":"2024-04-23T10:26:00.085470+0000","last_undegraded":"2024-04-23T10:26:00.085470+0000","last_fullsized":"2024-04-23T10:26:00.085470+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:24:07.965091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086098+0000","last_change":"2024-04-23T10:24:53.505167+0000","last_active":"2024-04-23T10:26:00.086098+0000","last_peered":"2024-04-23T10:26:00.086098+0000","last_clean":"2024-04-23T10:26:00.086098+0000","last_became_active":"2024-04-23T10:24:53.504832+0000","last_became_peered":"2024-04-23T10:24:53.504832+0000","last_unstale":"2024-04-23T10:26:00.086098+0000","last_undegraded":"2024-04-23T10:26:00.086098+0000","last_fullsized":"2024-04-23T10:26:00.086098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:58:20.867496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.081482+0000","last_change":"2024-04-23T10:24:53.505363+0000","last_active":"2024-04-23T10:26:00.081482+0000","last_peered":"2024-04-23T10:26:00.081482+0000","last_clean":"2024-04-23T10:26:00.081482+0000","last_became_active":"2024-04-23T10:24:53.505029+0000","last_became_peered":"2024-04-23T10:24:53.505029+0000","last_unstale":"2024-04-23T10:26:00.081482+0000","last_undegraded":"2024-04-23T10:26:00.081482+0000","last_fullsized":"2024-04-23T10:26:00.081482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:22.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089910+0000","last_change":"2024-04-23T10:24:53.497666+0000","last_active":"2024-04-23T10:26:00.089910+0000","last_peered":"2024-04-23T10:26:00.089910+0000","last_clean":"2024-04-23T10:26:00.089910+0000","last_became_active":"2024-04-23T10:24:53.495144+0000","last_became_peered":"2024-04-23T10:24:53.495144+0000","last_unstale":"2024-04-23T10:26:00.089910+0000","last_undegraded":"2024-04-23T10:26:00.089910+0000","last_fullsized":"2024-04-23T10:26:00.089910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:23:27.148289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:06.420826+0000","last_change":"2024-04-23T10:24:52.496907+0000","last_active":"2024-04-23T10:26:06.420826+0000","last_peered":"2024-04-23T10:26:06.420826+0000","last_clean":"2024-04-23T10:26:06.420826+0000","last_became_active":"2024-04-23T10:24:52.496567+0000","last_became_peered":"2024-04-23T10:24:52.496567+0000","last_unstale":"2024-04-23T10:26:06.420826+0000","last_undegraded":"2024-04-23T10:26:06.420826+0000","last_fullsized":"2024-04-23T10:26:06.420826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:33.195504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.084171+0000","last_change":"2024-04-23T10:24:53.501140+0000","last_active":"2024-04-23T10:26:00.084171+0000","last_peered":"2024-04-23T10:26:00.084171+0000","last_clean":"2024-04-23T10:26:00.084171+0000","last_became_active":"2024-04-23T10:24:53.500826+0000","last_became_peered":"2024-04-23T10:24:53.500826+0000","last_unstale":"2024-04-23T10:26:00.084171+0000","last_undegraded":"2024-04-23T10:26:00.084171+0000","last_fullsized":"2024-04-23T10:26:00.084171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:39.178784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.084766+0000","last_change":"2024-04-23T10:24:52.494413+0000","last_active":"2024-04-23T10:26:00.084766+0000","last_peered":"2024-04-23T10:26:00.084766+0000","last_clean":"2024-04-23T10:26:00.084766+0000","last_became_active":"2024-04-23T10:24:52.494092+0000","last_became_peered":"2024-04-23T10:24:52.494092+0000","last_unstale":"2024-04-23T10:26:00.084766+0000","last_undegraded":"2024-04-23T10:26:00.084766+0000","last_fullsized":"2024-04-23T10:26:00.084766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:42:09.407787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086757+0000","last_change":"2024-04-23T10:24:53.495285+0000","last_active":"2024-04-23T10:26:00.086757+0000","last_peered":"2024-04-23T10:26:00.086757+0000","last_clean":"2024-04-23T10:26:00.086757+0000","last_became_active":"2024-04-23T10:24:53.494959+0000","last_became_peered":"2024-04-23T10:24:53.494959+0000","last_unstale":"2024-04-23T10:26:00.086757+0000","last_undegraded":"2024-04-23T10:26:00.086757+0000","last_fullsized":"2024-04-23T10:26:00.086757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:59.209505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082999+0000","last_change":"2024-04-23T10:24:52.496310+0000","last_active":"2024-04-23T10:26:00.082999+0000","last_peered":"2024-04-23T10:26:00.082999+0000","last_clean":"2024-04-23T10:26:00.082999+0000","last_became_active":"2024-04-23T10:24:52.496009+0000","last_became_peered":"2024-04-23T10:24:52.496009+0000","last_unstale":"2024-04-23T10:26:00.082999+0000","last_undegraded":"2024-04-23T10:26:00.082999+0000","last_fullsized":"2024-04-23T10:26:00.082999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:05:46.911691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086163+0000","last_change":"2024-04-23T10:24:53.498204+0000","last_active":"2024-04-23T10:26:00.086163+0000","last_peered":"2024-04-23T10:26:00.086163+0000","last_clean":"2024-04-23T10:26:00.086163+0000","last_became_active":"2024-04-23T10:24:53.496535+0000","last_became_peered":"2024-04-23T10:24:53.496535+0000","last_unstale":"2024-04-23T10:26:00.086163+0000","last_undegraded":"2024-04-23T10:26:00.086163+0000","last_fullsized":"2024-04-23T10:26:00.086163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:32.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082632+0000","last_change":"2024-04-23T10:24:52.493485+0000","last_active":"2024-04-23T10:26:00.082632+0000","last_peered":"2024-04-23T10:26:00.082632+0000","last_clean":"2024-04-23T10:26:00.082632+0000","last_became_active":"2024-04-23T10:24:52.493164+0000","last_became_peered":"2024-04-23T10:24:52.493164+0000","last_unstale":"2024-04-23T10:26:00.082632+0000","last_undegraded":"2024-04-23T10:26:00.082632+0000","last_fullsized":"2024-04-23T10:26:00.082632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:42:33.701248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.090646+0000","last_change":"2024-04-23T10:24:53.507145+0000","last_active":"2024-04-23T10:26:00.090646+0000","last_peered":"2024-04-23T10:26:00.090646+0000","last_clean":"2024-04-23T10:26:00.090646+0000","last_became_active":"2024-04-23T10:24:53.506824+0000","last_became_peered":"2024-04-23T10:24:53.506824+0000","last_unstale":"2024-04-23T10:26:00.090646+0000","last_undegraded":"2024-04-23T10:26:00.090646+0000","last_fullsized":"2024-04-23T10:26:00.090646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:37:54.870303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:05.419268+0000","last_change":"2024-04-23T10:24:52.498646+0000","last_active":"2024-04-23T10:26:05.419268+0000","last_peered":"2024-04-23T10:26:05.419268+0000","last_clean":"2024-04-23T10:26:05.419268+0000","last_became_active":"2024-04-23T10:24:52.498328+0000","last_became_peered":"2024-04-23T10:24:52.498328+0000","last_unstale":"2024-04-23T10:26:05.419268+0000","last_undegraded":"2024-04-23T10:26:05.419268+0000","last_fullsized":"2024-04-23T10:26:05.419268+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:26:33.646144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.216570+0000","last_change":"2024-04-23T10:26:00.216570+0000","last_active":"2024-04-23T10:26:00.216570+0000","last_peered":"2024-04-23T10:26:00.216570+0000","last_clean":"2024-04-23T10:26:00.216570+0000","last_became_active":"2024-04-23T10:26:00.216228+0000","last_became_peered":"2024-04-23T10:26:00.216228+0000","last_unstale":"2024-04-23T10:26:00.216570+0000","last_undegraded":"2024-04-23T10:26:00.216570+0000","last_fullsized":"2024-04-23T10:26:00.216570+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:57:54.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082265+0000","last_change":"2024-04-23T10:24:52.495242+0000","last_active":"2024-04-23T10:26:00.082265+0000","last_peered":"2024-04-23T10:26:00.082265+0000","last_clean":"2024-04-23T10:26:00.082265+0000","last_became_active":"2024-04-23T10:24:52.493255+0000","last_became_peered":"2024-04-23T10:24:52.493255+0000","last_unstale":"2024-04-23T10:26:00.082265+0000","last_undegraded":"2024-04-23T10:26:00.082265+0000","last_fullsized":"2024-04-23T10:26:00.082265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:33.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.090426+0000","last_change":"2024-04-23T10:24:53.499843+0000","last_active":"2024-04-23T10:26:00.090426+0000","last_peered":"2024-04-23T10:26:00.090426+0000","last_clean":"2024-04-23T10:26:00.090426+0000","last_became_active":"2024-04-23T10:24:53.499512+0000","last_became_peered":"2024-04-23T10:24:53.499512+0000","last_unstale":"2024-04-23T10:26:00.090426+0000","last_undegraded":"2024-04-23T10:26:00.090426+0000","last_fullsized":"2024-04-23T10:26:00.090426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:20.333479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215375+0000","last_change":"2024-04-23T10:24:52.495915+0000","last_active":"2024-04-23T10:26:00.215375+0000","last_peered":"2024-04-23T10:26:00.215375+0000","last_clean":"2024-04-23T10:26:00.215375+0000","last_became_active":"2024-04-23T10:24:52.495558+0000","last_became_peered":"2024-04-23T10:24:52.495558+0000","last_unstale":"2024-04-23T10:26:00.215375+0000","last_undegraded":"2024-04-23T10:26:00.215375+0000","last_fullsized":"2024-04-23T10:26:00.215375+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:41:09.080880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082956+0000","last_change":"2024-04-23T10:24:53.496376+0000","last_active":"2024-04-23T10:26:00.082956+0000","last_peered":"2024-04-23T10:26:00.082956+0000","last_clean":"2024-04-23T10:26:00.082956+0000","last_became_active":"2024-04-23T10:24:53.496067+0000","last_became_peered":"2024-04-23T10:24:53.496067+0000","last_unstale":"2024-04-23T10:26:00.082956+0000","last_undegraded":"2024-04-23T10:26:00.082956+0000","last_fullsized":"2024-04-23T10:26:00.082956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:02:51.252365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089619+0000","last_change":"2024-04-23T10:24:52.499566+0000","last_active":"2024-04-23T10:26:00.089619+0000","last_peered":"2024-04-23T10:26:00.089619+0000","last_clean":"2024-04-23T10:26:00.089619+0000","last_became_active":"2024-04-23T10:24:52.499277+0000","last_became_peered":"2024-04-23T10:24:52.499277+0000","last_unstale":"2024-04-23T10:26:00.089619+0000","last_undegraded":"2024-04-23T10:26:00.089619+0000","last_fullsized":"2024-04-23T10:26:00.089619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:38.716187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.081254+0000","last_change":"2024-04-23T10:24:53.499617+0000","last_active":"2024-04-23T10:26:00.081254+0000","last_peered":"2024-04-23T10:26:00.081254+0000","last_clean":"2024-04-23T10:26:00.081254+0000","last_became_active":"2024-04-23T10:24:53.499283+0000","last_became_peered":"2024-04-23T10:24:53.499283+0000","last_unstale":"2024-04-23T10:26:00.081254+0000","last_undegraded":"2024-04-23T10:26:00.081254+0000","last_fullsized":"2024-04-23T10:26:00.081254+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:36.931697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":168,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:09.424443+0000","last_change":"2024-04-23T10:24:52.492276+0000","last_active":"2024-04-23T10:26:09.424443+0000","last_peered":"2024-04-23T10:26:09.424443+0000","last_clean":"2024-04-23T10:26:09.424443+0000","last_became_active":"2024-04-23T10:24:52.491979+0000","last_became_peered":"2024-04-23T10:24:52.491979+0000","last_unstale":"2024-04-23T10:26:09.424443+0000","last_undegraded":"2024-04-23T10:26:09.424443+0000","last_fullsized":"2024-04-23T10:26:09.424443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:15:40.847446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":145,"num_read_kb":145,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086212+0000","last_change":"2024-04-23T10:24:53.500964+0000","last_active":"2024-04-23T10:26:00.086212+0000","last_peered":"2024-04-23T10:26:00.086212+0000","last_clean":"2024-04-23T10:26:00.086212+0000","last_became_active":"2024-04-23T10:24:53.499209+0000","last_became_peered":"2024-04-23T10:24:53.499209+0000","last_unstale":"2024-04-23T10:26:00.086212+0000","last_undegraded":"2024-04-23T10:26:00.086212+0000","last_fullsized":"2024-04-23T10:26:00.086212+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:27:29.539994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086637+0000","last_change":"2024-04-23T10:24:52.496016+0000","last_active":"2024-04-23T10:26:00.086637+0000","last_peered":"2024-04-23T10:26:00.086637+0000","last_clean":"2024-04-23T10:26:00.086637+0000","last_became_active":"2024-04-23T10:24:52.495711+0000","last_became_peered":"2024-04-23T10:24:52.495711+0000","last_unstale":"2024-04-23T10:26:00.086637+0000","last_undegraded":"2024-04-23T10:26:00.086637+0000","last_fullsized":"2024-04-23T10:26:00.086637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:31:30.970731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.091494+0000","last_change":"2024-04-23T10:26:00.091494+0000","last_active":"2024-04-23T10:26:00.091494+0000","last_peered":"2024-04-23T10:26:00.091494+0000","last_clean":"2024-04-23T10:26:00.091494+0000","last_became_active":"2024-04-23T10:26:00.091122+0000","last_became_peered":"2024-04-23T10:26:00.091122+0000","last_unstale":"2024-04-23T10:26:00.091494+0000","last_undegraded":"2024-04-23T10:26:00.091494+0000","last_fullsized":"2024-04-23T10:26:00.091494+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:32.833741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.090790+0000","last_change":"2024-04-23T10:24:52.497200+0000","last_active":"2024-04-23T10:26:00.090790+0000","last_peered":"2024-04-23T10:26:00.090790+0000","last_clean":"2024-04-23T10:26:00.090790+0000","last_became_active":"2024-04-23T10:24:52.496864+0000","last_became_peered":"2024-04-23T10:24:52.496864+0000","last_unstale":"2024-04-23T10:26:00.090790+0000","last_undegraded":"2024-04-23T10:26:00.090790+0000","last_fullsized":"2024-04-23T10:26:00.090790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:16.514060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086392+0000","last_change":"2024-04-23T10:24:53.498438+0000","last_active":"2024-04-23T10:26:00.086392+0000","last_peered":"2024-04-23T10:26:00.086392+0000","last_clean":"2024-04-23T10:26:00.086392+0000","last_became_active":"2024-04-23T10:24:53.496569+0000","last_became_peered":"2024-04-23T10:24:53.496569+0000","last_unstale":"2024-04-23T10:26:00.086392+0000","last_undegraded":"2024-04-23T10:26:00.086392+0000","last_fullsized":"2024-04-23T10:26:00.086392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:06:45.964699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'27","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:09.424874+0000","last_change":"2024-04-23T10:24:52.490058+0000","last_active":"2024-04-23T10:26:09.424874+0000","last_peered":"2024-04-23T10:26:09.424874+0000","last_clean":"2024-04-23T10:26:09.424874+0000","last_became_active":"2024-04-23T10:24:52.489720+0000","last_became_peered":"2024-04-23T10:24:52.489720+0000","last_unstale":"2024-04-23T10:26:09.424874+0000","last_undegraded":"2024-04-23T10:26:09.424874+0000","last_fullsized":"2024-04-23T10:26:09.424874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:41.049778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56853,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":155,"num_read_kb":132,"num_write":29,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082741+0000","last_change":"2024-04-23T10:24:53.507122+0000","last_active":"2024-04-23T10:26:00.082741+0000","last_peered":"2024-04-23T10:26:00.082741+0000","last_clean":"2024-04-23T10:26:00.082741+0000","last_became_active":"2024-04-23T10:24:53.506838+0000","last_became_peered":"2024-04-23T10:24:53.506838+0000","last_unstale":"2024-04-23T10:26:00.082741+0000","last_undegraded":"2024-04-23T10:26:00.082741+0000","last_fullsized":"2024-04-23T10:26:00.082741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:59:51.289630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089687+0000","last_change":"2024-04-23T10:24:52.499787+0000","last_active":"2024-04-23T10:26:00.089687+0000","last_peered":"2024-04-23T10:26:00.089687+0000","last_clean":"2024-04-23T10:26:00.089687+0000","last_became_active":"2024-04-23T10:24:52.499400+0000","last_became_peered":"2024-04-23T10:24:52.499400+0000","last_unstale":"2024-04-23T10:26:00.089687+0000","last_undegraded":"2024-04-23T10:26:00.089687+0000","last_fullsized":"2024-04-23T10:26:00.089687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:15:17.638984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215580+0000","last_change":"2024-04-23T10:24:53.495773+0000","last_active":"2024-04-23T10:26:00.215580+0000","last_peered":"2024-04-23T10:26:00.215580+0000","last_clean":"2024-04-23T10:26:00.215580+0000","last_became_active":"2024-04-23T10:24:53.495456+0000","last_became_peered":"2024-04-23T10:24:53.495456+0000","last_unstale":"2024-04-23T10:26:00.215580+0000","last_undegraded":"2024-04-23T10:26:00.215580+0000","last_fullsized":"2024-04-23T10:26:00.215580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:12:06.638141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.090186+0000","last_change":"2024-04-23T10:24:52.498660+0000","last_active":"2024-04-23T10:26:00.090186+0000","last_peered":"2024-04-23T10:26:00.090186+0000","last_clean":"2024-04-23T10:26:00.090186+0000","last_became_active":"2024-04-23T10:24:52.498302+0000","last_became_peered":"2024-04-23T10:24:52.498302+0000","last_unstale":"2024-04-23T10:26:00.090186+0000","last_undegraded":"2024-04-23T10:26:00.090186+0000","last_fullsized":"2024-04-23T10:26:00.090186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:49:23.826748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085878+0000","last_change":"2024-04-23T10:24:53.501718+0000","last_active":"2024-04-23T10:26:00.085878+0000","last_peered":"2024-04-23T10:26:00.085878+0000","last_clean":"2024-04-23T10:26:00.085878+0000","last_became_active":"2024-04-23T10:24:53.501359+0000","last_became_peered":"2024-04-23T10:24:53.501359+0000","last_unstale":"2024-04-23T10:26:00.085878+0000","last_undegraded":"2024-04-23T10:26:00.085878+0000","last_fullsized":"2024-04-23T10:26:00.085878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:51:42.474899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:06.421289+0000","last_change":"2024-04-23T10:24:52.493910+0000","last_active":"2024-04-23T10:26:06.421289+0000","last_peered":"2024-04-23T10:26:06.421289+0000","last_clean":"2024-04-23T10:26:06.421289+0000","last_became_active":"2024-04-23T10:24:52.493536+0000","last_became_peered":"2024-04-23T10:24:52.493536+0000","last_unstale":"2024-04-23T10:26:06.421289+0000","last_undegraded":"2024-04-23T10:26:06.421289+0000","last_fullsized":"2024-04-23T10:26:06.421289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:23.806993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085439+0000","last_change":"2024-04-23T10:24:53.498221+0000","last_active":"2024-04-23T10:26:00.085439+0000","last_peered":"2024-04-23T10:26:00.085439+0000","last_clean":"2024-04-23T10:26:00.085439+0000","last_became_active":"2024-04-23T10:24:53.497887+0000","last_became_peered":"2024-04-23T10:24:53.497887+0000","last_unstale":"2024-04-23T10:26:00.085439+0000","last_undegraded":"2024-04-23T10:26:00.085439+0000","last_fullsized":"2024-04-23T10:26:00.085439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:49:02.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082338+0000","last_change":"2024-04-23T10:24:52.498883+0000","last_active":"2024-04-23T10:26:00.082338+0000","last_peered":"2024-04-23T10:26:00.082338+0000","last_clean":"2024-04-23T10:26:00.082338+0000","last_became_active":"2024-04-23T10:24:52.498562+0000","last_became_peered":"2024-04-23T10:24:52.498562+0000","last_unstale":"2024-04-23T10:26:00.082338+0000","last_undegraded":"2024-04-23T10:26:00.082338+0000","last_fullsized":"2024-04-23T10:26:00.082338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:33.914481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089216+0000","last_change":"2024-04-23T10:24:53.506303+0000","last_active":"2024-04-23T10:26:00.089216+0000","last_peered":"2024-04-23T10:26:00.089216+0000","last_clean":"2024-04-23T10:26:00.089216+0000","last_became_active":"2024-04-23T10:24:53.505850+0000","last_became_peered":"2024-04-23T10:24:53.505850+0000","last_unstale":"2024-04-23T10:26:00.089216+0000","last_undegraded":"2024-04-23T10:26:00.089216+0000","last_fullsized":"2024-04-23T10:26:00.089216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:18.498188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082721+0000","last_change":"2024-04-23T10:24:52.493853+0000","last_active":"2024-04-23T10:26:00.082721+0000","last_peered":"2024-04-23T10:26:00.082721+0000","last_clean":"2024-04-23T10:26:00.082721+0000","last_became_active":"2024-04-23T10:24:52.492932+0000","last_became_peered":"2024-04-23T10:24:52.492932+0000","last_unstale":"2024-04-23T10:26:00.082721+0000","last_undegraded":"2024-04-23T10:26:00.082721+0000","last_fullsized":"2024-04-23T10:26:00.082721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:12:33.327611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.284417+0000","last_change":"2024-04-23T10:26:00.284417+0000","last_active":"2024-04-23T10:26:00.284417+0000","last_peered":"2024-04-23T10:26:00.284417+0000","last_clean":"2024-04-23T10:26:00.284417+0000","last_became_active":"2024-04-23T10:26:00.284097+0000","last_became_peered":"2024-04-23T10:26:00.284097+0000","last_unstale":"2024-04-23T10:26:00.284417+0000","last_undegraded":"2024-04-23T10:26:00.284417+0000","last_fullsized":"2024-04-23T10:26:00.284417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:53.114887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.081309+0000","last_change":"2024-04-23T10:24:52.494032+0000","last_active":"2024-04-23T10:26:00.081309+0000","last_peered":"2024-04-23T10:26:00.081309+0000","last_clean":"2024-04-23T10:26:00.081309+0000","last_became_active":"2024-04-23T10:24:52.493699+0000","last_became_peered":"2024-04-23T10:24:52.493699+0000","last_unstale":"2024-04-23T10:26:00.081309+0000","last_undegraded":"2024-04-23T10:26:00.081309+0000","last_fullsized":"2024-04-23T10:26:00.081309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:54.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082575+0000","last_change":"2024-04-23T10:24:53.494846+0000","last_active":"2024-04-23T10:26:00.082575+0000","last_peered":"2024-04-23T10:26:00.082575+0000","last_clean":"2024-04-23T10:26:00.082575+0000","last_became_active":"2024-04-23T10:24:53.494541+0000","last_became_peered":"2024-04-23T10:24:53.494541+0000","last_unstale":"2024-04-23T10:26:00.082575+0000","last_undegraded":"2024-04-23T10:26:00.082575+0000","last_fullsized":"2024-04-23T10:26:00.082575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:33:24.263803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:05.420058+0000","last_change":"2024-04-23T10:24:52.499078+0000","last_active":"2024-04-23T10:26:05.420058+0000","last_peered":"2024-04-23T10:26:05.420058+0000","last_clean":"2024-04-23T10:26:05.420058+0000","last_became_active":"2024-04-23T10:24:52.498764+0000","last_became_peered":"2024-04-23T10:24:52.498764+0000","last_unstale":"2024-04-23T10:26:05.420058+0000","last_undegraded":"2024-04-23T10:26:05.420058+0000","last_fullsized":"2024-04-23T10:26:05.420058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:10:51.634437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.087050+0000","last_change":"2024-04-23T10:26:00.087050+0000","last_active":"2024-04-23T10:26:00.087050+0000","last_peered":"2024-04-23T10:26:00.087050+0000","last_clean":"2024-04-23T10:26:00.087050+0000","last_became_active":"2024-04-23T10:26:00.086634+0000","last_became_peered":"2024-04-23T10:26:00.086634+0000","last_unstale":"2024-04-23T10:26:00.087050+0000","last_undegraded":"2024-04-23T10:26:00.087050+0000","last_fullsized":"2024-04-23T10:26:00.087050+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:40:38.242963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089830+0000","last_change":"2024-04-23T10:24:53.504787+0000","last_active":"2024-04-23T10:26:00.089830+0000","last_peered":"2024-04-23T10:26:00.089830+0000","last_clean":"2024-04-23T10:26:00.089830+0000","last_became_active":"2024-04-23T10:24:53.504423+0000","last_became_peered":"2024-04-23T10:24:53.504423+0000","last_unstale":"2024-04-23T10:26:00.089830+0000","last_undegraded":"2024-04-23T10:26:00.089830+0000","last_fullsized":"2024-04-23T10:26:00.089830+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:00.171449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:05.419607+0000","last_change":"2024-04-23T10:24:52.493600+0000","last_active":"2024-04-23T10:26:05.419607+0000","last_peered":"2024-04-23T10:26:05.419607+0000","last_clean":"2024-04-23T10:26:05.419607+0000","last_became_active":"2024-04-23T10:24:52.493310+0000","last_became_peered":"2024-04-23T10:24:52.493310+0000","last_unstale":"2024-04-23T10:26:05.419607+0000","last_undegraded":"2024-04-23T10:26:05.419607+0000","last_fullsized":"2024-04-23T10:26:05.419607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:07.144860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083517+0000","last_change":"2024-04-23T10:24:53.506311+0000","last_active":"2024-04-23T10:26:00.083517+0000","last_peered":"2024-04-23T10:26:00.083517+0000","last_clean":"2024-04-23T10:26:00.083517+0000","last_became_active":"2024-04-23T10:24:53.503910+0000","last_became_peered":"2024-04-23T10:24:53.503910+0000","last_unstale":"2024-04-23T10:26:00.083517+0000","last_undegraded":"2024-04-23T10:26:00.083517+0000","last_fullsized":"2024-04-23T10:26:00.083517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:01:32.620891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.282827+0000","last_change":"2024-04-23T10:24:52.485060+0000","last_active":"2024-04-23T10:26:00.282827+0000","last_peered":"2024-04-23T10:26:00.282827+0000","last_clean":"2024-04-23T10:26:00.282827+0000","last_became_active":"2024-04-23T10:24:52.484636+0000","last_became_peered":"2024-04-23T10:24:52.484636+0000","last_unstale":"2024-04-23T10:26:00.282827+0000","last_undegraded":"2024-04-23T10:26:00.282827+0000","last_fullsized":"2024-04-23T10:26:00.282827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:26:01.737147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":353,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085552+0000","last_change":"2024-04-23T10:23:43.804102+0000","last_active":"2024-04-23T10:26:00.085552+0000","last_peered":"2024-04-23T10:26:00.085552+0000","last_clean":"2024-04-23T10:26:00.085552+0000","last_became_active":"2024-04-23T10:23:43.803657+0000","last_became_peered":"2024-04-23T10:23:43.803657+0000","last_unstale":"2024-04-23T10:26:00.085552+0000","last_undegraded":"2024-04-23T10:26:00.085552+0000","last_fullsized":"2024-04-23T10:26:00.085552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_clean_scrub_stamp":"2024-04-23T10:20:19.875078+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:50.160735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215248+0000","last_change":"2024-04-23T10:24:53.499334+0000","last_active":"2024-04-23T10:26:00.215248+0000","last_peered":"2024-04-23T10:26:00.215248+0000","last_clean":"2024-04-23T10:26:00.215248+0000","last_became_active":"2024-04-23T10:24:53.499008+0000","last_became_peered":"2024-04-23T10:24:53.499008+0000","last_unstale":"2024-04-23T10:26:00.215248+0000","last_undegraded":"2024-04-23T10:26:00.215248+0000","last_fullsized":"2024-04-23T10:26:00.215248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:13.504789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085663+0000","last_change":"2024-04-23T10:24:52.493601+0000","last_active":"2024-04-23T10:26:00.085663+0000","last_peered":"2024-04-23T10:26:00.085663+0000","last_clean":"2024-04-23T10:26:00.085663+0000","last_became_active":"2024-04-23T10:24:52.493278+0000","last_became_peered":"2024-04-23T10:24:52.493278+0000","last_unstale":"2024-04-23T10:26:00.085663+0000","last_undegraded":"2024-04-23T10:26:00.085663+0000","last_fullsized":"2024-04-23T10:26:00.085663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:36:21.375233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082851+0000","last_change":"2024-04-23T10:24:52.495637+0000","last_active":"2024-04-23T10:26:00.082851+0000","last_peered":"2024-04-23T10:26:00.082851+0000","last_clean":"2024-04-23T10:26:00.082851+0000","last_became_active":"2024-04-23T10:24:52.495329+0000","last_became_peered":"2024-04-23T10:24:52.495329+0000","last_unstale":"2024-04-23T10:26:00.082851+0000","last_undegraded":"2024-04-23T10:26:00.082851+0000","last_fullsized":"2024-04-23T10:26:00.082851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:14.187803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215472+0000","last_change":"2024-04-23T10:24:53.500353+0000","last_active":"2024-04-23T10:26:00.215472+0000","last_peered":"2024-04-23T10:26:00.215472+0000","last_clean":"2024-04-23T10:26:00.215472+0000","last_became_active":"2024-04-23T10:24:53.499995+0000","last_became_peered":"2024-04-23T10:24:53.499995+0000","last_unstale":"2024-04-23T10:26:00.215472+0000","last_undegraded":"2024-04-23T10:26:00.215472+0000","last_fullsized":"2024-04-23T10:26:00.215472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:55:52.695375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.099289+0000","last_change":"2024-04-23T10:26:00.099289+0000","last_active":"2024-04-23T10:26:00.099289+0000","last_peered":"2024-04-23T10:26:00.099289+0000","last_clean":"2024-04-23T10:26:00.099289+0000","last_became_active":"2024-04-23T10:26:00.088425+0000","last_became_peered":"2024-04-23T10:26:00.088425+0000","last_unstale":"2024-04-23T10:26:00.099289+0000","last_undegraded":"2024-04-23T10:26:00.099289+0000","last_fullsized":"2024-04-23T10:26:00.099289+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:54:11.848553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083865+0000","last_change":"2024-04-23T10:24:53.498140+0000","last_active":"2024-04-23T10:26:00.083865+0000","last_peered":"2024-04-23T10:26:00.083865+0000","last_clean":"2024-04-23T10:26:00.083865+0000","last_became_active":"2024-04-23T10:24:53.496683+0000","last_became_peered":"2024-04-23T10:24:53.496683+0000","last_unstale":"2024-04-23T10:26:00.083865+0000","last_undegraded":"2024-04-23T10:26:00.083865+0000","last_fullsized":"2024-04-23T10:26:00.083865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:49:18.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.283236+0000","last_change":"2024-04-23T10:24:52.486505+0000","last_active":"2024-04-23T10:26:00.283236+0000","last_peered":"2024-04-23T10:26:00.283236+0000","last_clean":"2024-04-23T10:26:00.283236+0000","last_became_active":"2024-04-23T10:24:52.486185+0000","last_became_peered":"2024-04-23T10:24:52.486185+0000","last_unstale":"2024-04-23T10:26:00.283236+0000","last_undegraded":"2024-04-23T10:26:00.283236+0000","last_fullsized":"2024-04-23T10:26:00.283236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:46:27.052935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.087044+0000","last_change":"2024-04-23T10:24:53.496234+0000","last_active":"2024-04-23T10:26:00.087044+0000","last_peered":"2024-04-23T10:26:00.087044+0000","last_clean":"2024-04-23T10:26:00.087044+0000","last_became_active":"2024-04-23T10:24:53.495892+0000","last_became_peered":"2024-04-23T10:24:53.495892+0000","last_unstale":"2024-04-23T10:26:00.087044+0000","last_undegraded":"2024-04-23T10:26:00.087044+0000","last_fullsized":"2024-04-23T10:26:00.087044+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:11.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.094344+0000","last_change":"2024-04-23T10:26:00.094344+0000","last_active":"2024-04-23T10:26:00.094344+0000","last_peered":"2024-04-23T10:26:00.094344+0000","last_clean":"2024-04-23T10:26:00.094344+0000","last_became_active":"2024-04-23T10:26:00.090692+0000","last_became_peered":"2024-04-23T10:26:00.090692+0000","last_unstale":"2024-04-23T10:26:00.094344+0000","last_undegraded":"2024-04-23T10:26:00.094344+0000","last_fullsized":"2024-04-23T10:26:00.094344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082268+0000","last_change":"2024-04-23T10:24:53.497985+0000","last_active":"2024-04-23T10:26:00.082268+0000","last_peered":"2024-04-23T10:26:00.082268+0000","last_clean":"2024-04-23T10:26:00.082268+0000","last_became_active":"2024-04-23T10:24:53.497661+0000","last_became_peered":"2024-04-23T10:24:53.497661+0000","last_unstale":"2024-04-23T10:26:00.082268+0000","last_undegraded":"2024-04-23T10:26:00.082268+0000","last_fullsized":"2024-04-23T10:26:00.082268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:48.923714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083094+0000","last_change":"2024-04-23T10:24:52.490572+0000","last_active":"2024-04-23T10:26:00.083094+0000","last_peered":"2024-04-23T10:26:00.083094+0000","last_clean":"2024-04-23T10:26:00.083094+0000","last_became_active":"2024-04-23T10:24:52.490274+0000","last_became_peered":"2024-04-23T10:24:52.490274+0000","last_unstale":"2024-04-23T10:26:00.083094+0000","last_undegraded":"2024-04-23T10:26:00.083094+0000","last_fullsized":"2024-04-23T10:26:00.083094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:22.447399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085693+0000","last_change":"2024-04-23T10:24:53.509189+0000","last_active":"2024-04-23T10:26:00.085693+0000","last_peered":"2024-04-23T10:26:00.085693+0000","last_clean":"2024-04-23T10:26:00.085693+0000","last_became_active":"2024-04-23T10:24:53.508850+0000","last_became_peered":"2024-04-23T10:24:53.508850+0000","last_unstale":"2024-04-23T10:26:00.085693+0000","last_undegraded":"2024-04-23T10:26:00.085693+0000","last_fullsized":"2024-04-23T10:26:00.085693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:23.242999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089203+0000","last_change":"2024-04-23T10:24:52.497616+0000","last_active":"2024-04-23T10:26:00.089203+0000","last_peered":"2024-04-23T10:26:00.089203+0000","last_clean":"2024-04-23T10:26:00.089203+0000","last_became_active":"2024-04-23T10:24:52.497028+0000","last_became_peered":"2024-04-23T10:24:52.497028+0000","last_unstale":"2024-04-23T10:26:00.089203+0000","last_undegraded":"2024-04-23T10:26:00.089203+0000","last_fullsized":"2024-04-23T10:26:00.089203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:51:26.836718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083947+0000","last_change":"2024-04-23T10:24:53.498086+0000","last_active":"2024-04-23T10:26:00.083947+0000","last_peered":"2024-04-23T10:26:00.083947+0000","last_clean":"2024-04-23T10:26:00.083947+0000","last_became_active":"2024-04-23T10:24:53.497734+0000","last_became_peered":"2024-04-23T10:24:53.497734+0000","last_unstale":"2024-04-23T10:26:00.083947+0000","last_undegraded":"2024-04-23T10:26:00.083947+0000","last_fullsized":"2024-04-23T10:26:00.083947+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:57.602301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.082537+0000","last_change":"2024-04-23T10:24:52.496609+0000","last_active":"2024-04-23T10:26:00.082537+0000","last_peered":"2024-04-23T10:26:00.082537+0000","last_clean":"2024-04-23T10:26:00.082537+0000","last_became_active":"2024-04-23T10:24:52.495981+0000","last_became_peered":"2024-04-23T10:24:52.495981+0000","last_unstale":"2024-04-23T10:26:00.082537+0000","last_undegraded":"2024-04-23T10:26:00.082537+0000","last_fullsized":"2024-04-23T10:26:00.082537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:28.111644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086000+0000","last_change":"2024-04-23T10:24:53.503840+0000","last_active":"2024-04-23T10:26:00.086000+0000","last_peered":"2024-04-23T10:26:00.086000+0000","last_clean":"2024-04-23T10:26:00.086000+0000","last_became_active":"2024-04-23T10:24:53.503448+0000","last_became_peered":"2024-04-23T10:24:53.503448+0000","last_unstale":"2024-04-23T10:26:00.086000+0000","last_undegraded":"2024-04-23T10:26:00.086000+0000","last_fullsized":"2024-04-23T10:26:00.086000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:03.295985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:08.456197+0000","last_change":"2024-04-23T10:24:52.501792+0000","last_active":"2024-04-23T10:26:08.456197+0000","last_peered":"2024-04-23T10:26:08.456197+0000","last_clean":"2024-04-23T10:26:08.456197+0000","last_became_active":"2024-04-23T10:24:52.501404+0000","last_became_peered":"2024-04-23T10:24:52.501404+0000","last_unstale":"2024-04-23T10:26:08.456197+0000","last_undegraded":"2024-04-23T10:26:08.456197+0000","last_fullsized":"2024-04-23T10:26:08.456197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:03.529410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086056+0000","last_change":"2024-04-23T10:24:53.501649+0000","last_active":"2024-04-23T10:26:00.086056+0000","last_peered":"2024-04-23T10:26:00.086056+0000","last_clean":"2024-04-23T10:26:00.086056+0000","last_became_active":"2024-04-23T10:24:53.501307+0000","last_became_peered":"2024-04-23T10:24:53.501307+0000","last_unstale":"2024-04-23T10:26:00.086056+0000","last_undegraded":"2024-04-23T10:26:00.086056+0000","last_fullsized":"2024-04-23T10:26:00.086056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:37.863832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.090913+0000","last_change":"2024-04-23T10:24:52.495737+0000","last_active":"2024-04-23T10:26:00.090913+0000","last_peered":"2024-04-23T10:26:00.090913+0000","last_clean":"2024-04-23T10:26:00.090913+0000","last_became_active":"2024-04-23T10:24:52.495395+0000","last_became_peered":"2024-04-23T10:24:52.495395+0000","last_unstale":"2024-04-23T10:26:00.090913+0000","last_undegraded":"2024-04-23T10:26:00.090913+0000","last_fullsized":"2024-04-23T10:26:00.090913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:14:45.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.095511+0000","last_change":"2024-04-23T10:26:00.095511+0000","last_active":"2024-04-23T10:26:00.095511+0000","last_peered":"2024-04-23T10:26:00.095511+0000","last_clean":"2024-04-23T10:26:00.095511+0000","last_became_active":"2024-04-23T10:26:00.092403+0000","last_became_peered":"2024-04-23T10:26:00.092403+0000","last_unstale":"2024-04-23T10:26:00.095511+0000","last_undegraded":"2024-04-23T10:26:00.095511+0000","last_fullsized":"2024-04-23T10:26:00.095511+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:16:45.782094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215630+0000","last_change":"2024-04-23T10:24:52.494322+0000","last_active":"2024-04-23T10:26:00.215630+0000","last_peered":"2024-04-23T10:26:00.215630+0000","last_clean":"2024-04-23T10:26:00.215630+0000","last_became_active":"2024-04-23T10:24:52.494019+0000","last_became_peered":"2024-04-23T10:24:52.494019+0000","last_unstale":"2024-04-23T10:26:00.215630+0000","last_undegraded":"2024-04-23T10:26:00.215630+0000","last_fullsized":"2024-04-23T10:26:00.215630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:16.099197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085884+0000","last_change":"2024-04-23T10:24:53.507160+0000","last_active":"2024-04-23T10:26:00.085884+0000","last_peered":"2024-04-23T10:26:00.085884+0000","last_clean":"2024-04-23T10:26:00.085884+0000","last_became_active":"2024-04-23T10:24:53.506815+0000","last_became_peered":"2024-04-23T10:24:53.506815+0000","last_unstale":"2024-04-23T10:26:00.085884+0000","last_undegraded":"2024-04-23T10:26:00.085884+0000","last_fullsized":"2024-04-23T10:26:00.085884+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:24.657153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085835+0000","last_change":"2024-04-23T10:24:53.510511+0000","last_active":"2024-04-23T10:26:00.085835+0000","last_peered":"2024-04-23T10:26:00.085835+0000","last_clean":"2024-04-23T10:26:00.085835+0000","last_became_active":"2024-04-23T10:24:53.510174+0000","last_became_peered":"2024-04-23T10:24:53.510174+0000","last_unstale":"2024-04-23T10:26:00.085835+0000","last_undegraded":"2024-04-23T10:26:00.085835+0000","last_fullsized":"2024-04-23T10:26:00.085835+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:35.048697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089559+0000","last_change":"2024-04-23T10:24:53.497365+0000","last_active":"2024-04-23T10:26:00.089559+0000","last_peered":"2024-04-23T10:26:00.089559+0000","last_clean":"2024-04-23T10:26:00.089559+0000","last_became_active":"2024-04-23T10:24:53.496427+0000","last_became_peered":"2024-04-23T10:24:53.496427+0000","last_unstale":"2024-04-23T10:26:00.089559+0000","last_undegraded":"2024-04-23T10:26:00.089559+0000","last_fullsized":"2024-04-23T10:26:00.089559+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:22:35.867252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089089+0000","last_change":"2024-04-23T10:24:53.495913+0000","last_active":"2024-04-23T10:26:00.089089+0000","last_peered":"2024-04-23T10:26:00.089089+0000","last_clean":"2024-04-23T10:26:00.089089+0000","last_became_active":"2024-04-23T10:24:53.495543+0000","last_became_peered":"2024-04-23T10:24:53.495543+0000","last_unstale":"2024-04-23T10:26:00.089089+0000","last_undegraded":"2024-04-23T10:26:00.089089+0000","last_fullsized":"2024-04-23T10:26:00.089089+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:03:29.327759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.085962+0000","last_change":"2024-04-23T10:24:53.492305+0000","last_active":"2024-04-23T10:26:00.085962+0000","last_peered":"2024-04-23T10:26:00.085962+0000","last_clean":"2024-04-23T10:26:00.085962+0000","last_became_active":"2024-04-23T10:24:53.491980+0000","last_became_peered":"2024-04-23T10:24:53.491980+0000","last_unstale":"2024-04-23T10:26:00.085962+0000","last_undegraded":"2024-04-23T10:26:00.085962+0000","last_fullsized":"2024-04-23T10:26:00.085962+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:34.987447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215521+0000","last_change":"2024-04-23T10:24:53.492464+0000","last_active":"2024-04-23T10:26:00.215521+0000","last_peered":"2024-04-23T10:26:00.215521+0000","last_clean":"2024-04-23T10:26:00.215521+0000","last_became_active":"2024-04-23T10:24:53.492156+0000","last_became_peered":"2024-04-23T10:24:53.492156+0000","last_unstale":"2024-04-23T10:26:00.215521+0000","last_undegraded":"2024-04-23T10:26:00.215521+0000","last_fullsized":"2024-04-23T10:26:00.215521+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:07:15.414598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086155+0000","last_change":"2024-04-23T10:24:53.502208+0000","last_active":"2024-04-23T10:26:00.086155+0000","last_peered":"2024-04-23T10:26:00.086155+0000","last_clean":"2024-04-23T10:26:00.086155+0000","last_became_active":"2024-04-23T10:24:53.501921+0000","last_became_peered":"2024-04-23T10:24:53.501921+0000","last_unstale":"2024-04-23T10:26:00.086155+0000","last_undegraded":"2024-04-23T10:26:00.086155+0000","last_fullsized":"2024-04-23T10:26:00.086155+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:29:21.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089979+0000","last_change":"2024-04-23T10:24:53.495446+0000","last_active":"2024-04-23T10:26:00.089979+0000","last_peered":"2024-04-23T10:26:00.089979+0000","last_clean":"2024-04-23T10:26:00.089979+0000","last_became_active":"2024-04-23T10:24:53.495090+0000","last_became_peered":"2024-04-23T10:24:53.495090+0000","last_unstale":"2024-04-23T10:26:00.089979+0000","last_undegraded":"2024-04-23T10:26:00.089979+0000","last_fullsized":"2024-04-23T10:26:00.089979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:44:00.007468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083775+0000","last_change":"2024-04-23T10:24:53.503390+0000","last_active":"2024-04-23T10:26:00.083775+0000","last_peered":"2024-04-23T10:26:00.083775+0000","last_clean":"2024-04-23T10:26:00.083775+0000","last_became_active":"2024-04-23T10:24:53.503057+0000","last_became_peered":"2024-04-23T10:24:53.503057+0000","last_unstale":"2024-04-23T10:26:00.083775+0000","last_undegraded":"2024-04-23T10:26:00.083775+0000","last_fullsized":"2024-04-23T10:26:00.083775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:19:39.950651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.089737+0000","last_change":"2024-04-23T10:24:53.498188+0000","last_active":"2024-04-23T10:26:00.089737+0000","last_peered":"2024-04-23T10:26:00.089737+0000","last_clean":"2024-04-23T10:26:00.089737+0000","last_became_active":"2024-04-23T10:24:53.497873+0000","last_became_peered":"2024-04-23T10:24:53.497873+0000","last_unstale":"2024-04-23T10:26:00.089737+0000","last_undegraded":"2024-04-23T10:26:00.089737+0000","last_fullsized":"2024-04-23T10:26:00.089737+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:48:05.001361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.083115+0000","last_change":"2024-04-23T10:24:53.502260+0000","last_active":"2024-04-23T10:26:00.083115+0000","last_peered":"2024-04-23T10:26:00.083115+0000","last_clean":"2024-04-23T10:26:00.083115+0000","last_became_active":"2024-04-23T10:24:53.501525+0000","last_became_peered":"2024-04-23T10:24:53.501525+0000","last_unstale":"2024-04-23T10:26:00.083115+0000","last_undegraded":"2024-04-23T10:26:00.083115+0000","last_fullsized":"2024-04-23T10:26:00.083115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:04.379055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086030+0000","last_change":"2024-04-23T10:24:53.499306+0000","last_active":"2024-04-23T10:26:00.086030+0000","last_peered":"2024-04-23T10:26:00.086030+0000","last_clean":"2024-04-23T10:26:00.086030+0000","last_became_active":"2024-04-23T10:24:53.496717+0000","last_became_peered":"2024-04-23T10:24:53.496717+0000","last_unstale":"2024-04-23T10:26:00.086030+0000","last_undegraded":"2024-04-23T10:26:00.086030+0000","last_fullsized":"2024-04-23T10:26:00.086030+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:03:17.907117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.215570+0000","last_change":"2024-04-23T10:24:53.496330+0000","last_active":"2024-04-23T10:26:00.215570+0000","last_peered":"2024-04-23T10:26:00.215570+0000","last_clean":"2024-04-23T10:26:00.215570+0000","last_became_active":"2024-04-23T10:24:53.496021+0000","last_became_peered":"2024-04-23T10:24:53.496021+0000","last_unstale":"2024-04-23T10:26:00.215570+0000","last_undegraded":"2024-04-23T10:26:00.215570+0000","last_fullsized":"2024-04-23T10:26:00.215570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:10:59.340265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-23T10:26:00.086013+0000","last_change":"2024-04-23T10:24:53.501025+0000","last_active":"2024-04-23T10:26:00.086013+0000","last_peered":"2024-04-23T10:26:00.086013+0000","last_clean":"2024-04-23T10:26:00.086013+0000","last_became_active":"2024-04-23T10:24:53.500673+0000","last_became_peered":"2024-04-23T10:24:53.500673+0000","last_unstale":"2024-04-23T10:26:00.086013+0000","last_undegraded":"2024-04-23T10:26:00.086013+0000","last_fullsized":"2024-04-23T10:26:00.086013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:07.728645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246478,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64057,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":746,"num_read_kb":444,"num_write":232,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":192171,"data_compressed":5577,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351004,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":460844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612641,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1108726,"data_compressed":37539,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":460500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037804,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":460761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299441,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1053279,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462966,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":460100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":517866,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":461830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1040384,"data_stored":518477,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149764,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":459808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":460352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724603,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":1052566,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34039,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34039,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":58605,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59216,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":58980,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:26:13.005 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-23T10:26:13.006 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-23T10:26:13.006 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-23T10:26:13.006 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-23T10:26:13.245 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:14.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:14 smithi167 ceph-mon[32940]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:26:14.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:14 smithi167 ceph-mon[32940]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:14.356 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:14 smithi069 ceph-mon[29593]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:26:14.356 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:14 smithi069 ceph-mon[29593]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:14.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:14 smithi146 ceph-mon[32800]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:26:14.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:14 smithi146 ceph-mon[32800]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:14.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.928+0000 7f782311e700 1 -- 172.21.15.69:0/1820357813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f781c107b20 msgr2=0x7f781c107f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:14.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.928+0000 7f782311e700 1 --2- 172.21.15.69:0/1820357813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f781c107b20 0x7f781c107f00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f781400b0a0 tx=0x7f781400b3b0 comp rx=0 tx=0).stop 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.928+0000 7f782311e700 1 -- 172.21.15.69:0/1820357813 shutdown_connections 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.928+0000 7f782311e700 1 --2- 172.21.15.69:0/1820357813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f781c101dc0 0x7f781c10f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.928+0000 7f782311e700 1 --2- 172.21.15.69:0/1820357813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f781c107b20 0x7f781c107f00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.928+0000 7f782311e700 1 --2- 172.21.15.69:0/1820357813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f781c101400 0x7f781c101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.928+0000 7f782311e700 1 -- 172.21.15.69:0/1820357813 >> 172.21.15.69:0/1820357813 conn(0x7f781c076c60 msgr2=0x7f781c077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.928+0000 7f782311e700 1 -- 172.21.15.69:0/1820357813 shutdown_connections 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.928+0000 7f782311e700 1 -- 172.21.15.69:0/1820357813 wait complete. 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f782311e700 1 Processor -- start 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f782311e700 1 -- start start 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f782311e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f781c101400 0x7f781c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f782311e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f781c101dc0 0x7f781c199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f782311e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f781c107b20 0x7f781c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f782311e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f781c112e40 con 0x7f781c101dc0 2024-04-23T10:26:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f782311e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f781c112cc0 con 0x7f781c107b20 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f782311e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f781c112fc0 con 0x7f781c101400 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f781bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f781c101dc0 0x7f781c199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f781bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f781c101dc0 0x7f781c199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47562/0 (socket says 172.21.15.69:47562) 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f781bfff700 1 -- 172.21.15.69:0/528405157 learned_addr learned my addr 172.21.15.69:0/528405157 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.929+0000 7f7820eba700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f781c101400 0x7f781c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f78216bb700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f781c107b20 0x7f781c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f781bfff700 1 -- 172.21.15.69:0/528405157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f781c101400 msgr2=0x7f781c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f781bfff700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f781c101400 0x7f781c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f781bfff700 1 -- 172.21.15.69:0/528405157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f781c107b20 msgr2=0x7f781c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f781bfff700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f781c107b20 0x7f781c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f781bfff700 1 -- 172.21.15.69:0/528405157 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781c19e2e0 con 0x7f781c101dc0 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f781bfff700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f781c101dc0 0x7f781c199810 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f780c00b530 tx=0x7f780c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f7819ffb700 1 -- 172.21.15.69:0/528405157 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c015020 con 0x7f781c101dc0 2024-04-23T10:26:14.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f7819ffb700 1 -- 172.21.15.69:0/528405157 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f780c011d00 con 0x7f781c101dc0 2024-04-23T10:26:14.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f7819ffb700 1 -- 172.21.15.69:0/528405157 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c00f2e0 con 0x7f781c101dc0 2024-04-23T10:26:14.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f782311e700 1 -- 172.21.15.69:0/528405157 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781c19e5d0 con 0x7f781c101dc0 2024-04-23T10:26:14.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.930+0000 7f782311e700 1 -- 172.21.15.69:0/528405157 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f781c1a5e50 con 0x7f781c101dc0 2024-04-23T10:26:14.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.932+0000 7f782311e700 1 -- 172.21.15.69:0/528405157 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f781c069730 con 0x7f781c101dc0 2024-04-23T10:26:14.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.932+0000 7f7819ffb700 1 -- 172.21.15.69:0/528405157 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f780c018020 con 0x7f781c101dc0 2024-04-23T10:26:14.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.933+0000 7f7819ffb700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f78080a3cd0 0x7f78080a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:14.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.933+0000 7f7820eba700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f78080a3cd0 0x7f78080a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:14.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.933+0000 7f7819ffb700 1 -- 172.21.15.69:0/528405157 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f780c0cfca0 con 0x7f781c101dc0 2024-04-23T10:26:14.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.933+0000 7f7820eba700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f78080a3cd0 0x7f78080a6190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f78140062a0 tx=0x7f7814006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:14.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:14.937+0000 7f7819ffb700 1 -- 172.21.15.69:0/528405157 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f780c01f020 con 0x7f781c101dc0 2024-04-23T10:26:15.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.183+0000 7f782311e700 1 -- 172.21.15.69:0/528405157 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f781c02df80 con 0x7f781c101dc0 2024-04-23T10:26:15.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.183+0000 7f7819ffb700 1 -- 172.21.15.69:0/528405157 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f780c09c640 con 0x7f781c101dc0 2024-04-23T10:26:15.182 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:15.182 INFO:teuthology.orchestra.run.smithi069.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-23T10:26:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 -- 172.21.15.69:0/528405157 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f78080a3cd0 msgr2=0x7f78080a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f78080a3cd0 0x7f78080a6190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f78140062a0 tx=0x7f7814006210 comp rx=0 tx=0).stop 2024-04-23T10:26:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 -- 172.21.15.69:0/528405157 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f781c101dc0 msgr2=0x7f781c199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f781c101dc0 0x7f781c199810 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f780c00b530 tx=0x7f780c00b840 comp rx=0 tx=0).stop 2024-04-23T10:26:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 -- 172.21.15.69:0/528405157 shutdown_connections 2024-04-23T10:26:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f78080a3cd0 0x7f78080a6190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f781c107b20 0x7f781c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f781c101400 0x7f781c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 --2- 172.21.15.69:0/528405157 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f781c101dc0 0x7f781c199810 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 -- 172.21.15.69:0/528405157 >> 172.21.15.69:0/528405157 conn(0x7f781c076c60 msgr2=0x7f781c0fff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 -- 172.21.15.69:0/528405157 shutdown_connections 2024-04-23T10:26:15.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:15.185+0000 7f782311e700 1 -- 172.21.15.69:0/528405157 wait complete. 2024-04-23T10:26:15.913 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-23T10:26:15.913 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:26:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.017+0000 7f88843cd640 1 -- 172.21.15.69:0/2242527663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f887c103c00 msgr2=0x7f887c10a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.017+0000 7f88843cd640 1 --2- 172.21.15.69:0/2242527663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f887c103c00 0x7f887c10a490 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8874009cd0 tx=0x7f887402a8e0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.017+0000 7f88843cd640 1 -- 172.21.15.69:0/2242527663 shutdown_connections 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.017+0000 7f88843cd640 1 --2- 172.21.15.69:0/2242527663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f887c103c00 0x7f887c10a490 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.017+0000 7f88843cd640 1 --2- 172.21.15.69:0/2242527663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f887c103240 0x7f887c1036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.017+0000 7f88843cd640 1 --2- 172.21.15.69:0/2242527663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c100270 0x7f887c100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.017+0000 7f88843cd640 1 -- 172.21.15.69:0/2242527663 >> 172.21.15.69:0/2242527663 conn(0x7f887c0fbbc0 msgr2=0x7f887c0fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.017+0000 7f88843cd640 1 -- 172.21.15.69:0/2242527663 shutdown_connections 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.017+0000 7f88843cd640 1 -- 172.21.15.69:0/2242527663 wait complete. 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f88843cd640 1 Processor -- start 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f88843cd640 1 -- start start 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f88843cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f887c100270 0x7f887c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f88843cd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f887c103240 0x7f887c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f88843cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c103c00 0x7f887c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f88843cd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f887c10dc90 con 0x7f887c103240 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f88843cd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f887c10db10 con 0x7f887c100270 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f88843cd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f887c10de10 con 0x7f887c103c00 2024-04-23T10:26:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f8881968640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f887c103240 0x7f887c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f8881968640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f887c103240 0x7f887c1987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47584/0 (socket says 172.21.15.69:47584) 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f8881968640 1 -- 172.21.15.69:0/140818941 learned_addr learned my addr 172.21.15.69:0/140818941 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f8881968640 1 -- 172.21.15.69:0/140818941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c103c00 msgr2=0x7f887c19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f8881968640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c103c00 0x7f887c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f8881968640 1 -- 172.21.15.69:0/140818941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f887c100270 msgr2=0x7f887c198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f8881968640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f887c100270 0x7f887c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.018+0000 7f8881968640 1 -- 172.21.15.69:0/140818941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887c19fe90 con 0x7f887c103240 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.019+0000 7f8881968640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f887c103240 0x7f887c1987b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f886c00b4a0 tx=0x7f886c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.019+0000 7f88737fe640 1 -- 172.21.15.69:0/140818941 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c014070 con 0x7f887c103240 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.019+0000 7f88737fe640 1 -- 172.21.15.69:0/140818941 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f886c010ae0 con 0x7f887c103240 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.019+0000 7f88843cd640 1 -- 172.21.15.69:0/140818941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887c1a0180 con 0x7f887c103240 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.019+0000 7f88737fe640 1 -- 172.21.15.69:0/140818941 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c017ce0 con 0x7f887c103240 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.019+0000 7f88843cd640 1 -- 172.21.15.69:0/140818941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f887c1a07a0 con 0x7f887c103240 2024-04-23T10:26:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.020+0000 7f88843cd640 1 -- 172.21.15.69:0/140818941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f887c109370 con 0x7f887c103240 2024-04-23T10:26:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.021+0000 7f88737fe640 1 -- 172.21.15.69:0/140818941 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f886c017070 con 0x7f887c103240 2024-04-23T10:26:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.021+0000 7f88737fe640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f88680a3cc0 0x7f88680a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.022+0000 7f8882169640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f88680a3cc0 0x7f88680a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.022+0000 7f88737fe640 1 -- 172.21.15.69:0/140818941 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f886c0cfb70 con 0x7f887c103240 2024-04-23T10:26:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.022+0000 7f8882169640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f88680a3cc0 0x7f88680a6180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f887c06a3d0 tx=0x7f8878005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:16.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.025+0000 7f88737fe640 1 -- 172.21.15.69:0/140818941 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f886c09c510 con 0x7f887c103240 2024-04-23T10:26:16.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.205+0000 7f88843cd640 1 -- 172.21.15.69:0/140818941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f887c02d5c0 con 0x7f887c103240 2024-04-23T10:26:16.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.207+0000 7f88737fe640 1 -- 172.21.15.69:0/140818941 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22595 (secure 0 0 0) 0x7f886c09be10 con 0x7f887c103240 2024-04-23T10:26:16.206 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:16.206 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":88,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:26:00.078482+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:26:16.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 -- 172.21.15.69:0/140818941 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f88680a3cc0 msgr2=0x7f88680a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f88680a3cc0 0x7f88680a6180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f887c06a3d0 tx=0x7f8878005c90 comp rx=0 tx=0).stop 2024-04-23T10:26:16.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 -- 172.21.15.69:0/140818941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f887c103240 msgr2=0x7f887c1987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f887c103240 0x7f887c1987b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f886c00b4a0 tx=0x7f886c00b960 comp rx=0 tx=0).stop 2024-04-23T10:26:16.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 -- 172.21.15.69:0/140818941 shutdown_connections 2024-04-23T10:26:16.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f88680a3cc0 0x7f88680a6180 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f887c103240 0x7f887c1987b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f887c103c00 0x7f887c19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 --2- 172.21.15.69:0/140818941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f887c100270 0x7f887c198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 -- 172.21.15.69:0/140818941 >> 172.21.15.69:0/140818941 conn(0x7f887c0fbbc0 msgr2=0x7f887c106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:16.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 -- 172.21.15.69:0/140818941 shutdown_connections 2024-04-23T10:26:16.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.209+0000 7f88843cd640 1 -- 172.21.15.69:0/140818941 wait complete. 2024-04-23T10:26:16.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:16 smithi069 ceph-mon[29593]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:16.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:16 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/528405157' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-23T10:26:16.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:24:50.484063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:24:51.816315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:26:16.220 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.321+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/2111460914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c14102a00 msgr2=0x7f6c14109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.321+0000 7f6c1bbe1640 1 --2- 172.21.15.69:0/2111460914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c14102a00 0x7f6c14109320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009ca0 tx=0x7f6c0c02a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.321+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/2111460914 shutdown_connections 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.321+0000 7f6c1bbe1640 1 --2- 172.21.15.69:0/2111460914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c14102a00 0x7f6c14109320 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.321+0000 7f6c1bbe1640 1 --2- 172.21.15.69:0/2111460914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c14102040 0x7f6c141024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.321+0000 7f6c1bbe1640 1 --2- 172.21.15.69:0/2111460914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c14100e60 0x7f6c14101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.321+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/2111460914 >> 172.21.15.69:0/2111460914 conn(0x7f6c140fc420 msgr2=0x7f6c140fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.321+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/2111460914 shutdown_connections 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.321+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/2111460914 wait complete. 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1bbe1640 1 Processor -- start 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1bbe1640 1 -- start start 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1bbe1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c14100e60 0x7f6c141971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1bbe1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c14102040 0x7f6c14197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1bbe1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c14102a00 0x7f6c1419e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1bbe1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1410cbb0 con 0x7f6c14102a00 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1bbe1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1410ca30 con 0x7f6c14102040 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1bbe1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1410cd30 con 0x7f6c14100e60 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1a17e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c14102a00 0x7f6c1419e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1a17e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c14102a00 0x7f6c1419e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47610/0 (socket says 172.21.15.69:47610) 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1a17e640 1 -- 172.21.15.69:0/981941428 learned_addr learned my addr 172.21.15.69:0/981941428 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1997d640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c14100e60 0x7f6c141971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.322+0000 7f6c1917c640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c14102040 0x7f6c14197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c1a17e640 1 -- 172.21.15.69:0/981941428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c14100e60 msgr2=0x7f6c141971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c1a17e640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c14100e60 0x7f6c141971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c1a17e640 1 -- 172.21.15.69:0/981941428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c14102040 msgr2=0x7f6c14197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c1a17e640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c14102040 0x7f6c14197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c1a17e640 1 -- 172.21.15.69:0/981941428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1419ede0 con 0x7f6c14102a00 2024-04-23T10:26:16.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c1997d640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c14100e60 0x7f6c141971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:16.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c1917c640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c14102040 0x7f6c14197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:16.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c1a17e640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c14102a00 0x7f6c1419e770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009dc0 tx=0x7f6c0c02f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:16.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c0affd640 1 -- 172.21.15.69:0/981941428 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c003cf0 con 0x7f6c14102a00 2024-04-23T10:26:16.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/981941428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1419f070 con 0x7f6c14102a00 2024-04-23T10:26:16.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c0affd640 1 -- 172.21.15.69:0/981941428 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6c0c004510 con 0x7f6c14102a00 2024-04-23T10:26:16.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c0affd640 1 -- 172.21.15.69:0/981941428 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c02fdb0 con 0x7f6c14102a00 2024-04-23T10:26:16.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.323+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/981941428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1419f690 con 0x7f6c14102a00 2024-04-23T10:26:16.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.324+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/981941428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c14108200 con 0x7f6c14102a00 2024-04-23T10:26:16.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.325+0000 7f6c0affd640 1 -- 172.21.15.69:0/981941428 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6c0c0046c0 con 0x7f6c14102a00 2024-04-23T10:26:16.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.326+0000 7f6c0affd640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6c000a3c40 0x7f6c000a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.326+0000 7f6c1997d640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6c000a3c40 0x7f6c000a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.326+0000 7f6c0affd640 1 -- 172.21.15.69:0/981941428 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f6c0c0f1df0 con 0x7f6c14102a00 2024-04-23T10:26:16.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.326+0000 7f6c1997d640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6c000a3c40 0x7f6c000a6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c14101bb0 tx=0x7f6c04008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:16.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.329+0000 7f6c0affd640 1 -- 172.21.15.69:0/981941428 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6c0c0be770 con 0x7f6c14102a00 2024-04-23T10:26:16.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:16 smithi167 ceph-mon[32940]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:16.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:16 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/528405157' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-23T10:26:16.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:16 smithi146 ceph-mon[32800]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-04-23T10:26:16.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:16 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/528405157' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-23T10:26:16.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.506+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/981941428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6c14062b50 con 0x7f6c14102a00 2024-04-23T10:26:16.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.507+0000 7f6c0affd640 1 -- 172.21.15.69:0/981941428 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f6c0c0be070 con 0x7f6c14102a00 2024-04-23T10:26:16.505 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/981941428 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6c000a3c40 msgr2=0x7f6c000a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6c000a3c40 0x7f6c000a6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c14101bb0 tx=0x7f6c04008040 comp rx=0 tx=0).stop 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/981941428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c14102a00 msgr2=0x7f6c1419e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c14102a00 0x7f6c1419e770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009dc0 tx=0x7f6c0c02f460 comp rx=0 tx=0).stop 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/981941428 shutdown_connections 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6c000a3c40 0x7f6c000a6100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c14102a00 0x7f6c1419e770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c14102040 0x7f6c14197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 --2- 172.21.15.69:0/981941428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c14100e60 0x7f6c141971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/981941428 >> 172.21.15.69:0/981941428 conn(0x7f6c140fc420 msgr2=0x7f6c141053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/981941428 shutdown_connections 2024-04-23T10:26:16.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.509+0000 7f6c1bbe1640 1 -- 172.21.15.69:0/981941428 wait complete. 2024-04-23T10:26:16.519 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:26:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.621+0000 7f2bb48cb640 1 -- 172.21.15.69:0/300205829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0101ff0 msgr2=0x7f2bb0102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.621+0000 7f2bb48cb640 1 --2- 172.21.15.69:0/300205829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0101ff0 0x7f2bb0102470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009ca0 tx=0x7f2ba402a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.621+0000 7f2bb48cb640 1 -- 172.21.15.69:0/300205829 shutdown_connections 2024-04-23T10:26:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.621+0000 7f2bb48cb640 1 --2- 172.21.15.69:0/300205829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0101ff0 0x7f2bb0102470 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.621+0000 7f2bb48cb640 1 --2- 172.21.15.69:0/300205829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb01029b0 0x7f2bb01092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.621+0000 7f2bb48cb640 1 --2- 172.21.15.69:0/300205829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bb0100ea0 0x7f2bb01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.621+0000 7f2bb48cb640 1 -- 172.21.15.69:0/300205829 >> 172.21.15.69:0/300205829 conn(0x7f2bb00fc430 msgr2=0x7f2bb00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.621+0000 7f2bb48cb640 1 -- 172.21.15.69:0/300205829 shutdown_connections 2024-04-23T10:26:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.621+0000 7f2bb48cb640 1 -- 172.21.15.69:0/300205829 wait complete. 2024-04-23T10:26:16.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.621+0000 7f2bb48cb640 1 Processor -- start 2024-04-23T10:26:16.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.621+0000 7f2bb48cb640 1 -- start start 2024-04-23T10:26:16.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bb48cb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100ea0 0x7f2bb0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bb48cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bb0101ff0 0x7f2bb01987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bb48cb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb01029b0 0x7f2bb019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bb48cb640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb010cb40 con 0x7f2bb0100ea0 2024-04-23T10:26:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bb48cb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb010c9c0 con 0x7f2bb01029b0 2024-04-23T10:26:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bb48cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb010ccc0 con 0x7f2bb0101ff0 2024-04-23T10:26:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bae59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100ea0 0x7f2bb0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bae59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100ea0 0x7f2bb0198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47618/0 (socket says 172.21.15.69:47618) 2024-04-23T10:26:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bae59c640 1 -- 172.21.15.69:0/808430839 learned_addr learned my addr 172.21.15.69:0/808430839 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2baed9d640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb01029b0 0x7f2bb019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2badd9b640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bb0101ff0 0x7f2bb01987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bae59c640 1 -- 172.21.15.69:0/808430839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bb0101ff0 msgr2=0x7f2bb01987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bae59c640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bb0101ff0 0x7f2bb01987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bae59c640 1 -- 172.21.15.69:0/808430839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb01029b0 msgr2=0x7f2bb019f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bae59c640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb01029b0 0x7f2bb019f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bae59c640 1 -- 172.21.15.69:0/808430839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb019fea0 con 0x7f2bb0100ea0 2024-04-23T10:26:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.622+0000 7f2bae59c640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100ea0 0x7f2bb0198280 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800c970 tx=0x7f2ba800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.623+0000 7f2b9f7fe640 1 -- 172.21.15.69:0/808430839 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8007bb0 con 0x7f2bb0100ea0 2024-04-23T10:26:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.623+0000 7f2bb48cb640 1 -- 172.21.15.69:0/808430839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb01a0190 con 0x7f2bb0100ea0 2024-04-23T10:26:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.623+0000 7f2b9f7fe640 1 -- 172.21.15.69:0/808430839 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ba8007d50 con 0x7f2bb0100ea0 2024-04-23T10:26:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.623+0000 7f2b9f7fe640 1 -- 172.21.15.69:0/808430839 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800f450 con 0x7f2bb0100ea0 2024-04-23T10:26:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.623+0000 7f2bb48cb640 1 -- 172.21.15.69:0/808430839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb01a06b0 con 0x7f2bb0100ea0 2024-04-23T10:26:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.624+0000 7f2bb48cb640 1 -- 172.21.15.69:0/808430839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb01a0970 con 0x7f2bb0100ea0 2024-04-23T10:26:16.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.625+0000 7f2b9f7fe640 1 -- 172.21.15.69:0/808430839 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2ba80046c0 con 0x7f2bb0100ea0 2024-04-23T10:26:16.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.625+0000 7f2b9f7fe640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b980a3c40 0x7f2b980a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.625+0000 7f2badd9b640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b980a3c40 0x7f2b980a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.625+0000 7f2b9f7fe640 1 -- 172.21.15.69:0/808430839 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f2ba80d0620 con 0x7f2bb0100ea0 2024-04-23T10:26:16.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.626+0000 7f2badd9b640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b980a3c40 0x7f2b980a6100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4000f80 tx=0x7f2ba4005c30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:16.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.629+0000 7f2b9f7fe640 1 -- 172.21.15.69:0/808430839 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2ba8014030 con 0x7f2bb0100ea0 2024-04-23T10:26:16.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.806+0000 7f2bb48cb640 1 -- 172.21.15.69:0/808430839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2bb01a0b40 con 0x7f2bb0100ea0 2024-04-23T10:26:16.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.807+0000 7f2b9f7fe640 1 -- 172.21.15.69:0/808430839 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f2ba809c860 con 0x7f2bb0100ea0 2024-04-23T10:26:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-04-23T10:26:16.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 -- 172.21.15.69:0/808430839 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b980a3c40 msgr2=0x7f2b980a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b980a3c40 0x7f2b980a6100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4000f80 tx=0x7f2ba4005c30 comp rx=0 tx=0).stop 2024-04-23T10:26:16.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 -- 172.21.15.69:0/808430839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100ea0 msgr2=0x7f2bb0198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100ea0 0x7f2bb0198280 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800c970 tx=0x7f2ba800ce30 comp rx=0 tx=0).stop 2024-04-23T10:26:16.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 -- 172.21.15.69:0/808430839 shutdown_connections 2024-04-23T10:26:16.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f2b980a3c40 0x7f2b980a6100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb01029b0 0x7f2bb019f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bb0101ff0 0x7f2bb01987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 --2- 172.21.15.69:0/808430839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bb0100ea0 0x7f2bb0198280 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 -- 172.21.15.69:0/808430839 >> 172.21.15.69:0/808430839 conn(0x7f2bb00fc430 msgr2=0x7f2bb006a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:16.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 -- 172.21.15.69:0/808430839 shutdown_connections 2024-04-23T10:26:16.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.809+0000 7f2bb48cb640 1 -- 172.21.15.69:0/808430839 wait complete. 2024-04-23T10:26:16.819 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:26:16.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.920+0000 7f170b368640 1 -- 172.21.15.69:0/1219299124 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1704102a10 msgr2=0x7f1704104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.920+0000 7f170b368640 1 --2- 172.21.15.69:0/1219299124 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1704102a10 0x7f1704104e00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1700009900 tx=0x7f170002a410 comp rx=0 tx=0).stop 2024-04-23T10:26:16.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.920+0000 7f170b368640 1 -- 172.21.15.69:0/1219299124 shutdown_connections 2024-04-23T10:26:16.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.920+0000 7f170b368640 1 --2- 172.21.15.69:0/1219299124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1704107c70 0x7f170410a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.920+0000 7f170b368640 1 --2- 172.21.15.69:0/1219299124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1704105340 0x7f1704107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.920+0000 7f170b368640 1 --2- 172.21.15.69:0/1219299124 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1704102a10 0x7f1704104e00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.920+0000 7f170b368640 1 -- 172.21.15.69:0/1219299124 >> 172.21.15.69:0/1219299124 conn(0x7f17040fc400 msgr2=0x7f17040fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:16.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.920+0000 7f170b368640 1 -- 172.21.15.69:0/1219299124 shutdown_connections 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.920+0000 7f170b368640 1 -- 172.21.15.69:0/1219299124 wait complete. 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f170b368640 1 Processor -- start 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f170b368640 1 -- start start 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f170b368640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1704102a10 0x7f17041982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f170b368640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1704105340 0x7f1704198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f170b368640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1704107c70 0x7f170419f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f170b368640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f170410dc80 con 0x7f1704107c70 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f170b368640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f170410db00 con 0x7f1704102a10 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f170b368640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f170410de00 con 0x7f1704105340 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f1709905640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1704107c70 0x7f170419f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f1709905640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1704107c70 0x7f170419f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47640/0 (socket says 172.21.15.69:47640) 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f1709905640 1 -- 172.21.15.69:0/3477361394 learned_addr learned my addr 172.21.15.69:0/3477361394 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:16.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f1708903640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1704105340 0x7f1704198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f1709905640 1 -- 172.21.15.69:0/3477361394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1704105340 msgr2=0x7f1704198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f1709905640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1704105340 0x7f1704198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f1709905640 1 -- 172.21.15.69:0/3477361394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1704102a10 msgr2=0x7f17041982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f1709905640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1704102a10 0x7f17041982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f1709905640 1 -- 172.21.15.69:0/3477361394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170419fee0 con 0x7f1704107c70 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.921+0000 7f1708903640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1704105340 0x7f1704198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.922+0000 7f1709905640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1704107c70 0x7f170419f870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00b970 tx=0x7f16fc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.922+0000 7f16fa7fc640 1 -- 172.21.15.69:0/3477361394 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc019070 con 0x7f1704107c70 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.922+0000 7f16fa7fc640 1 -- 172.21.15.69:0/3477361394 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f16fc00cb40 con 0x7f1704107c70 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.922+0000 7f170b368640 1 -- 172.21.15.69:0/3477361394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17041a01d0 con 0x7f1704107c70 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.922+0000 7f16fa7fc640 1 -- 172.21.15.69:0/3477361394 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc007650 con 0x7f1704107c70 2024-04-23T10:26:16.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.922+0000 7f170b368640 1 -- 172.21.15.69:0/3477361394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17041a07f0 con 0x7f1704107c70 2024-04-23T10:26:16.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.923+0000 7f170b368640 1 -- 172.21.15.69:0/3477361394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17040fdef0 con 0x7f1704107c70 2024-04-23T10:26:16.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.924+0000 7f16fa7fc640 1 -- 172.21.15.69:0/3477361394 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f16fc01c070 con 0x7f1704107c70 2024-04-23T10:26:16.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.924+0000 7f16fa7fc640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f16f00a3cc0 0x7f16f00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:16.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.924+0000 7f1709104640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f16f00a3cc0 0x7f16f00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:16.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.924+0000 7f16fa7fc640 1 -- 172.21.15.69:0/3477361394 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f16fc0cfa20 con 0x7f1704107c70 2024-04-23T10:26:16.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.925+0000 7f1709104640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f16f00a3cc0 0x7f16f00a6180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f17000096c0 tx=0x7f1700000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:16.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:16.929+0000 7f16fa7fc640 1 -- 172.21.15.69:0/3477361394 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f16fc09c3c0 con 0x7f1704107c70 2024-04-23T10:26:17.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.112+0000 7f170b368640 1 -- 172.21.15.69:0/3477361394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1704062b50 con 0x7f1704107c70 2024-04-23T10:26:17.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.112+0000 7f16fa7fc640 1 -- 172.21.15.69:0/3477361394 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f16fc09bcc0 con 0x7f1704107c70 2024-04-23T10:26:17.111 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-04-23T10:26:17.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 -- 172.21.15.69:0/3477361394 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f16f00a3cc0 msgr2=0x7f16f00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f16f00a3cc0 0x7f16f00a6180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f17000096c0 tx=0x7f1700000bc0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 -- 172.21.15.69:0/3477361394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1704107c70 msgr2=0x7f170419f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1704107c70 0x7f170419f870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00b970 tx=0x7f16fc00be30 comp rx=0 tx=0).stop 2024-04-23T10:26:17.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 -- 172.21.15.69:0/3477361394 shutdown_connections 2024-04-23T10:26:17.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f16f00a3cc0 0x7f16f00a6180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1704107c70 0x7f170419f870 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1704105340 0x7f1704198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 --2- 172.21.15.69:0/3477361394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1704102a10 0x7f17041982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 -- 172.21.15.69:0/3477361394 >> 172.21.15.69:0/3477361394 conn(0x7f17040fc400 msgr2=0x7f1704103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:17.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 -- 172.21.15.69:0/3477361394 shutdown_connections 2024-04-23T10:26:17.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.114+0000 7f170b368640 1 -- 172.21.15.69:0/3477361394 wait complete. 2024-04-23T10:26:17.124 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:26:17.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.223+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/2969124659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e78101fe0 msgr2=0x7f3e78102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.223+0000 7f3e7ed0f640 1 --2- 172.21.15.69:0/2969124659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e78101fe0 0x7f3e78102460 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009900 tx=0x7f3e6402a410 comp rx=0 tx=0).stop 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.223+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/2969124659 shutdown_connections 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.223+0000 7f3e7ed0f640 1 --2- 172.21.15.69:0/2969124659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e78101fe0 0x7f3e78102460 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.223+0000 7f3e7ed0f640 1 --2- 172.21.15.69:0/2969124659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e781029a0 0x7f3e781092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.223+0000 7f3e7ed0f640 1 --2- 172.21.15.69:0/2969124659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e78100e90 0x7f3e781012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.223+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/2969124659 >> 172.21.15.69:0/2969124659 conn(0x7f3e780fc400 msgr2=0x7f3e780fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.223+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/2969124659 shutdown_connections 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.223+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/2969124659 wait complete. 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e7ed0f640 1 Processor -- start 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e7ed0f640 1 -- start start 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e7ed0f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e78100e90 0x7f3e78069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e7ed0f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e78101fe0 0x7f3e7819f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e7ed0f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e781029a0 0x7f3e781a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e7ed0f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7810cb10 con 0x7f3e78101fe0 2024-04-23T10:26:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e7ed0f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7810c990 con 0x7f3e78100e90 2024-04-23T10:26:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e7ed0f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7810cc90 con 0x7f3e781029a0 2024-04-23T10:26:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e77fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e78101fe0 0x7f3e7819f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e77fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e78101fe0 0x7f3e7819f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47664/0 (socket says 172.21.15.69:47664) 2024-04-23T10:26:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e77fff640 1 -- 172.21.15.69:0/96335997 learned_addr learned my addr 172.21.15.69:0/96335997 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e7caab640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e78100e90 0x7f3e78069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e77fff640 1 -- 172.21.15.69:0/96335997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e781029a0 msgr2=0x7f3e781a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e77fff640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e781029a0 0x7f3e781a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e77fff640 1 -- 172.21.15.69:0/96335997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e78100e90 msgr2=0x7f3e78069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e77fff640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e78100e90 0x7f3e78069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e77fff640 1 -- 172.21.15.69:0/96335997 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e781a2030 con 0x7f3e78101fe0 2024-04-23T10:26:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.224+0000 7f3e77fff640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e78101fe0 0x7f3e7819f2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3e64006010 tx=0x7f3e640043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.225+0000 7f3e75ffb640 1 -- 172.21.15.69:0/96335997 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6403f030 con 0x7f3e78101fe0 2024-04-23T10:26:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.225+0000 7f3e75ffb640 1 -- 172.21.15.69:0/96335997 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3e64003cd0 con 0x7f3e78101fe0 2024-04-23T10:26:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.225+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/96335997 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e781a2260 con 0x7f3e78101fe0 2024-04-23T10:26:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.225+0000 7f3e75ffb640 1 -- 172.21.15.69:0/96335997 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64035070 con 0x7f3e78101fe0 2024-04-23T10:26:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.225+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/96335997 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e781a2750 con 0x7f3e78101fe0 2024-04-23T10:26:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.226+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/96335997 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e781080d0 con 0x7f3e78101fe0 2024-04-23T10:26:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.228+0000 7f3e75ffb640 1 -- 172.21.15.69:0/96335997 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f3e64042030 con 0x7f3e78101fe0 2024-04-23T10:26:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.228+0000 7f3e75ffb640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3e680a3c70 0x7f3e680a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.228+0000 7f3e7caab640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3e680a3c70 0x7f3e680a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.228+0000 7f3e75ffb640 1 -- 172.21.15.69:0/96335997 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f3e640f1190 con 0x7f3e78101fe0 2024-04-23T10:26:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.229+0000 7f3e7caab640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3e680a3c70 0x7f3e680a6130 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c005e10 tx=0x7f3e6c005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:17.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.232+0000 7f3e75ffb640 1 -- 172.21.15.69:0/96335997 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3e640bda20 con 0x7f3e78101fe0 2024-04-23T10:26:17.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:17 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/140818941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:17.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:17 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/981941428' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:17.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:17 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/808430839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:17.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:17 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/140818941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:17.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:17 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/981941428' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:17.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:17 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/808430839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:17.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.448+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/96335997 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e7802d5c0 con 0x7f3e78101fe0 2024-04-23T10:26:17.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.449+0000 7f3e75ffb640 1 -- 172.21.15.69:0/96335997 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7f3e640bd320 con 0x7f3e78101fe0 2024-04-23T10:26:17.448 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:17.448 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:24:59.329454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24463,24421,24487,24416,24392]},"id":1}]} 2024-04-23T10:26:17.449 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 25 2024-04-23T10:26:17.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.451+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/96335997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3e680a3c70 msgr2=0x7f3e680a6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.451+0000 7f3e7ed0f640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3e680a3c70 0x7f3e680a6130 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c005e10 tx=0x7f3e6c005da0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.451+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/96335997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e78101fe0 msgr2=0x7f3e7819f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.451+0000 7f3e7ed0f640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e78101fe0 0x7f3e7819f2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3e64006010 tx=0x7f3e640043b0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.451+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/96335997 shutdown_connections 2024-04-23T10:26:17.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.451+0000 7f3e7ed0f640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3e680a3c70 0x7f3e680a6130 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.451+0000 7f3e7ed0f640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e78101fe0 0x7f3e7819f2f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.451+0000 7f3e7ed0f640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e781029a0 0x7f3e781a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.451+0000 7f3e7ed0f640 1 --2- 172.21.15.69:0/96335997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e78100e90 0x7f3e78069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.451+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/96335997 >> 172.21.15.69:0/96335997 conn(0x7f3e780fc400 msgr2=0x7f3e781052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:17.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.451+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/96335997 shutdown_connections 2024-04-23T10:26:17.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.452+0000 7f3e7ed0f640 1 -- 172.21.15.69:0/96335997 wait complete. 2024-04-23T10:26:17.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:17 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/140818941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:17.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:17 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/981941428' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:17.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:17 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/808430839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:17.462 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:26:17.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.560+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2570149027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3f4101ff0 msgr2=0x7fd3f4102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.560+0000 7fd3fa0dc640 1 --2- 172.21.15.69:0/2570149027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3f4101ff0 0x7fd3f4102470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009900 tx=0x7fd3dc02a410 comp rx=0 tx=0).stop 2024-04-23T10:26:17.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.560+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2570149027 shutdown_connections 2024-04-23T10:26:17.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.560+0000 7fd3fa0dc640 1 --2- 172.21.15.69:0/2570149027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3f4101ff0 0x7fd3f4102470 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.560+0000 7fd3fa0dc640 1 --2- 172.21.15.69:0/2570149027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3f41029b0 0x7fd3f41092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.560+0000 7fd3fa0dc640 1 --2- 172.21.15.69:0/2570149027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f4100ea0 0x7fd3f41012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.560+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2570149027 >> 172.21.15.69:0/2570149027 conn(0x7fd3f40fc430 msgr2=0x7fd3f40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:17.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.560+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2570149027 shutdown_connections 2024-04-23T10:26:17.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.560+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2570149027 wait complete. 2024-04-23T10:26:17.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3fa0dc640 1 Processor -- start 2024-04-23T10:26:17.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3fa0dc640 1 -- start start 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3fa0dc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3f4100ea0 0x7fd3f419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3fa0dc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3f4101ff0 0x7fd3f419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3fa0dc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f41029b0 0x7fd3f41a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3fa0dc640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f410cb30 con 0x7fd3f4100ea0 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3fa0dc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f410c9b0 con 0x7fd3f41029b0 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3fa0dc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f410ccb0 con 0x7fd3f4101ff0 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3f37fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3f4100ea0 0x7fd3f419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3f37fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3f4100ea0 0x7fd3f419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47678/0 (socket says 172.21.15.69:47678) 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3f37fe640 1 -- 172.21.15.69:0/2318279331 learned_addr learned my addr 172.21.15.69:0/2318279331 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.561+0000 7fd3f3fff640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f41029b0 0x7fd3f41a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3f37fe640 1 -- 172.21.15.69:0/2318279331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3f4101ff0 msgr2=0x7fd3f419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3f2ffd640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3f4101ff0 0x7fd3f419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:17.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3f37fe640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3f4101ff0 0x7fd3f419a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3f37fe640 1 -- 172.21.15.69:0/2318279331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f41029b0 msgr2=0x7fd3f41a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3f37fe640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f41029b0 0x7fd3f41a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3f37fe640 1 -- 172.21.15.69:0/2318279331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f41a20b0 con 0x7fd3f4100ea0 2024-04-23T10:26:17.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3f37fe640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3f4100ea0 0x7fd3f419a490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400eab0 tx=0x7fd3e400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:17.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3f0ff9640 1 -- 172.21.15.69:0/2318279331 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e400ce40 con 0x7fd3f4100ea0 2024-04-23T10:26:17.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3f0ff9640 1 -- 172.21.15.69:0/2318279331 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd3e4011940 con 0x7fd3f4100ea0 2024-04-23T10:26:17.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2318279331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f41a23a0 con 0x7fd3f4100ea0 2024-04-23T10:26:17.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3f0ff9640 1 -- 172.21.15.69:0/2318279331 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4010aa0 con 0x7fd3f4100ea0 2024-04-23T10:26:17.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.562+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2318279331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f41a2940 con 0x7fd3f4100ea0 2024-04-23T10:26:17.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.563+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2318279331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f41a2c00 con 0x7fd3f4100ea0 2024-04-23T10:26:17.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.564+0000 7fd3f0ff9640 1 -- 172.21.15.69:0/2318279331 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd3e4011af0 con 0x7fd3f4100ea0 2024-04-23T10:26:17.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.564+0000 7fd3f0ff9640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd3e00a3cc0 0x7fd3e00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.565+0000 7fd3f2ffd640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd3e00a3cc0 0x7fd3e00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:17.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.565+0000 7fd3f0ff9640 1 -- 172.21.15.69:0/2318279331 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fd3e40d0bb0 con 0x7fd3f4100ea0 2024-04-23T10:26:17.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.565+0000 7fd3f2ffd640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd3e00a3cc0 0x7fd3e00a6180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc031570 tx=0x7fd3dc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:17.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.569+0000 7fd3f0ff9640 1 -- 172.21.15.69:0/2318279331 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd3e4016030 con 0x7fd3f4100ea0 2024-04-23T10:26:17.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.749+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2318279331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3f41a2dd0 con 0x7fd3f4100ea0 2024-04-23T10:26:17.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.750+0000 7fd3f0ff9640 1 -- 172.21.15.69:0/2318279331 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22595 (secure 0 0 0) 0x7fd3e409d440 con 0x7fd3f4100ea0 2024-04-23T10:26:17.750 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:17.750 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":88,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:26:00.078482+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:26:17.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.752+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2318279331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd3e00a3cc0 msgr2=0x7fd3e00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.752+0000 7fd3fa0dc640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd3e00a3cc0 0x7fd3e00a6180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc031570 tx=0x7fd3dc000bc0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.752+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2318279331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3f4100ea0 msgr2=0x7fd3f419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.752+0000 7fd3fa0dc640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3f4100ea0 0x7fd3f419a490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400eab0 tx=0x7fd3e400ef70 comp rx=0 tx=0).stop 2024-04-23T10:26:17.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.752+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2318279331 shutdown_connections 2024-04-23T10:26:17.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.752+0000 7fd3fa0dc640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd3e00a3cc0 0x7fd3e00a6180 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.752+0000 7fd3fa0dc640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f41029b0 0x7fd3f41a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.752+0000 7fd3fa0dc640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3f4101ff0 0x7fd3f419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.752+0000 7fd3fa0dc640 1 --2- 172.21.15.69:0/2318279331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3f4100ea0 0x7fd3f419a490 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.752+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2318279331 >> 172.21.15.69:0/2318279331 conn(0x7fd3f40fc430 msgr2=0x7fd3f406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:17.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.753+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2318279331 shutdown_connections 2024-04-23T10:26:17.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.753+0000 7fd3fa0dc640 1 -- 172.21.15.69:0/2318279331 wait complete. 2024-04-23T10:26:17.763 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:24:50.484063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:24:51.816315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:26:17.764 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:26:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.865+0000 7fa158b4a640 1 -- 172.21.15.69:0/1557336724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154105340 msgr2=0x7fa154107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.865+0000 7fa158b4a640 1 --2- 172.21.15.69:0/1557336724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154105340 0x7fa154107730 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa148009900 tx=0x7fa14802a410 comp rx=0 tx=0).stop 2024-04-23T10:26:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 -- 172.21.15.69:0/1557336724 shutdown_connections 2024-04-23T10:26:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 --2- 172.21.15.69:0/1557336724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154105340 0x7fa154107730 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 --2- 172.21.15.69:0/1557336724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa154107c70 0x7fa15410a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 --2- 172.21.15.69:0/1557336724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa154102a10 0x7fa154104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 -- 172.21.15.69:0/1557336724 >> 172.21.15.69:0/1557336724 conn(0x7fa1540fc400 msgr2=0x7fa1540fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 -- 172.21.15.69:0/1557336724 shutdown_connections 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 -- 172.21.15.69:0/1557336724 wait complete. 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 Processor -- start 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 -- start start 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa154102a10 0x7fa1541982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154105340 0x7fa154198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa154107c70 0x7fa15419f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa15410dbe0 con 0x7fa154105340 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa15410da60 con 0x7fa154102a10 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.866+0000 7fa158b4a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa15410dd60 con 0x7fa154107c70 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa151d9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154105340 0x7fa154198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa151d9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154105340 0x7fa154198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47702/0 (socket says 172.21.15.69:47702) 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa151d9b640 1 -- 172.21.15.69:0/3324571650 learned_addr learned my addr 172.21.15.69:0/3324571650 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa15259c640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa154102a10 0x7fa1541982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa151d9b640 1 -- 172.21.15.69:0/3324571650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa154107c70 msgr2=0x7fa15419f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa152d9d640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa154107c70 0x7fa15419f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa151d9b640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa154107c70 0x7fa15419f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa151d9b640 1 -- 172.21.15.69:0/3324571650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa154102a10 msgr2=0x7fa1541982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa151d9b640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa154102a10 0x7fa1541982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa151d9b640 1 -- 172.21.15.69:0/3324571650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15419fee0 con 0x7fa154105340 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa151d9b640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154105340 0x7fa154198800 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa148006010 tx=0x7fa1480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa1437fe640 1 -- 172.21.15.69:0/3324571650 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14803f030 con 0x7fa154105340 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa1437fe640 1 -- 172.21.15.69:0/3324571650 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa148003cd0 con 0x7fa154105340 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa158b4a640 1 -- 172.21.15.69:0/3324571650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1541a0170 con 0x7fa154105340 2024-04-23T10:26:17.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa1437fe640 1 -- 172.21.15.69:0/3324571650 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa148035070 con 0x7fa154105340 2024-04-23T10:26:17.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.867+0000 7fa158b4a640 1 -- 172.21.15.69:0/3324571650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1541a0660 con 0x7fa154105340 2024-04-23T10:26:17.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.868+0000 7fa158b4a640 1 -- 172.21.15.69:0/3324571650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1540fdef0 con 0x7fa154105340 2024-04-23T10:26:17.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.869+0000 7fa1437fe640 1 -- 172.21.15.69:0/3324571650 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa148042030 con 0x7fa154105340 2024-04-23T10:26:17.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.870+0000 7fa1437fe640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa13c0a3c40 0x7fa13c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:17.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.870+0000 7fa15259c640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa13c0a3c40 0x7fa13c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:17.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.870+0000 7fa1437fe640 1 -- 172.21.15.69:0/3324571650 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fa1480f0c20 con 0x7fa154105340 2024-04-23T10:26:17.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.870+0000 7fa15259c640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa13c0a3c40 0x7fa13c0a6100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa144005d00 tx=0x7fa14400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:17.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:17.874+0000 7fa1437fe640 1 -- 172.21.15.69:0/3324571650 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa1480bd4b0 con 0x7fa154105340 2024-04-23T10:26:18.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.050+0000 7fa158b4a640 1 -- 172.21.15.69:0/3324571650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa15402d770 con 0x7fa154105340 2024-04-23T10:26:18.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.050+0000 7fa1437fe640 1 -- 172.21.15.69:0/3324571650 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7fa1480bcdb0 con 0x7fa154105340 2024-04-23T10:26:18.049 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:26:18.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 -- 172.21.15.69:0/3324571650 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa13c0a3c40 msgr2=0x7fa13c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa13c0a3c40 0x7fa13c0a6100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa144005d00 tx=0x7fa14400b410 comp rx=0 tx=0).stop 2024-04-23T10:26:18.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 -- 172.21.15.69:0/3324571650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154105340 msgr2=0x7fa154198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154105340 0x7fa154198800 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa148006010 tx=0x7fa1480042f0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 -- 172.21.15.69:0/3324571650 shutdown_connections 2024-04-23T10:26:18.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fa13c0a3c40 0x7fa13c0a6100 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa154105340 0x7fa154198800 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa154107c70 0x7fa15419f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 --2- 172.21.15.69:0/3324571650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa154102a10 0x7fa1541982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 -- 172.21.15.69:0/3324571650 >> 172.21.15.69:0/3324571650 conn(0x7fa1540fc400 msgr2=0x7fa154103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:18.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 -- 172.21.15.69:0/3324571650 shutdown_connections 2024-04-23T10:26:18.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.052+0000 7fa158b4a640 1 -- 172.21.15.69:0/3324571650 wait complete. 2024-04-23T10:26:18.062 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:26:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.165+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4283596007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e8101fc0 msgr2=0x7fb7e8102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.165+0000 7fb7eedfe640 1 --2- 172.21.15.69:0/4283596007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e8101fc0 0x7fb7e8102440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009900 tx=0x7fb7dc02a410 comp rx=0 tx=0).stop 2024-04-23T10:26:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.165+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4283596007 shutdown_connections 2024-04-23T10:26:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.165+0000 7fb7eedfe640 1 --2- 172.21.15.69:0/4283596007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e8101fc0 0x7fb7e8102440 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.165+0000 7fb7eedfe640 1 --2- 172.21.15.69:0/4283596007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7e8102980 0x7fb7e81092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.165+0000 7fb7eedfe640 1 --2- 172.21.15.69:0/4283596007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e8100e70 0x7fb7e8101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.165+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4283596007 >> 172.21.15.69:0/4283596007 conn(0x7fb7e80fc3e0 msgr2=0x7fb7e80fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.165+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4283596007 shutdown_connections 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.165+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4283596007 wait complete. 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7eedfe640 1 Processor -- start 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7eedfe640 1 -- start start 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7eedfe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e8100e70 0x7fb7e8198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7eedfe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e8101fc0 0x7fb7e8198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7eedfe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7e8102980 0x7fb7e819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7eedfe640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e810dc60 con 0x7fb7e8100e70 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7eedfe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e810dae0 con 0x7fb7e8101fc0 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7eedfe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e810dde0 con 0x7fb7e8102980 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7ecb9a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e8100e70 0x7fb7e8198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7ecb9a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e8100e70 0x7fb7e8198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47718/0 (socket says 172.21.15.69:47718) 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7ecb9a640 1 -- 172.21.15.69:0/4249332143 learned_addr learned my addr 172.21.15.69:0/4249332143 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7e7fff640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e8101fc0 0x7fb7e8198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7ecb9a640 1 -- 172.21.15.69:0/4249332143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7e8102980 msgr2=0x7fb7e819f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7ecb9a640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7e8102980 0x7fb7e819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7ecb9a640 1 -- 172.21.15.69:0/4249332143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e8101fc0 msgr2=0x7fb7e8198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7ecb9a640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e8101fc0 0x7fb7e8198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7ecb9a640 1 -- 172.21.15.69:0/4249332143 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e819ff20 con 0x7fb7e8100e70 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.166+0000 7fb7e7fff640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e8101fc0 0x7fb7e8198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.167+0000 7fb7ecb9a640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e8100e70 0x7fb7e8198300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800d950 tx=0x7fb7d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.167+0000 7fb7e5ffb640 1 -- 172.21.15.69:0/4249332143 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8017070 con 0x7fb7e8100e70 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.167+0000 7fb7e5ffb640 1 -- 172.21.15.69:0/4249332143 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb7d8009c30 con 0x7fb7e8100e70 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.167+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4249332143 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e81a0210 con 0x7fb7e8100e70 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.167+0000 7fb7e5ffb640 1 -- 172.21.15.69:0/4249332143 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d800f6b0 con 0x7fb7e8100e70 2024-04-23T10:26:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.167+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4249332143 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e81a07e0 con 0x7fb7e8100e70 2024-04-23T10:26:18.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.168+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4249332143 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e81081a0 con 0x7fb7e8100e70 2024-04-23T10:26:18.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.169+0000 7fb7e5ffb640 1 -- 172.21.15.69:0/4249332143 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb7d80109c0 con 0x7fb7e8100e70 2024-04-23T10:26:18.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.169+0000 7fb7e5ffb640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb7d00a3c40 0x7fb7d00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.170+0000 7fb7e7fff640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb7d00a3c40 0x7fb7d00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.170+0000 7fb7e5ffb640 1 -- 172.21.15.69:0/4249332143 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fb7d80d0260 con 0x7fb7e8100e70 2024-04-23T10:26:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.170+0000 7fb7e7fff640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb7d00a3c40 0x7fb7d00a6100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0096c0 tx=0x7fb7dc009650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.174+0000 7fb7e5ffb640 1 -- 172.21.15.69:0/4249332143 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb7d8009de0 con 0x7fb7e8100e70 2024-04-23T10:26:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.351+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4249332143 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb7e802d980 con 0x7fb7e8100e70 2024-04-23T10:26:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.352+0000 7fb7e5ffb640 1 -- 172.21.15.69:0/4249332143 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7fb7d809caf0 con 0x7fb7e8100e70 2024-04-23T10:26:18.351 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-04-23T10:26:18.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4249332143 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb7d00a3c40 msgr2=0x7fb7d00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb7d00a3c40 0x7fb7d00a6100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0096c0 tx=0x7fb7dc009650 comp rx=0 tx=0).stop 2024-04-23T10:26:18.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4249332143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e8100e70 msgr2=0x7fb7e8198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e8100e70 0x7fb7e8198300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800d950 tx=0x7fb7d800de10 comp rx=0 tx=0).stop 2024-04-23T10:26:18.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4249332143 shutdown_connections 2024-04-23T10:26:18.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb7d00a3c40 0x7fb7d00a6100 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7e8102980 0x7fb7e819f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e8101fc0 0x7fb7e8198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 --2- 172.21.15.69:0/4249332143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e8100e70 0x7fb7e8198300 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4249332143 >> 172.21.15.69:0/4249332143 conn(0x7fb7e80fc3e0 msgr2=0x7fb7e8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:18.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4249332143 shutdown_connections 2024-04-23T10:26:18.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.354+0000 7fb7eedfe640 1 -- 172.21.15.69:0/4249332143 wait complete. 2024-04-23T10:26:18.363 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:18 smithi069 ceph-mon[29593]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:26:18.363 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:18 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3477361394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:18.363 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:18 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/96335997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:18.363 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:18 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2318279331' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:18.363 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:18 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3324571650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:18.364 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:26:18.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:18 smithi146 ceph-mon[32800]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:26:18.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:18 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3477361394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:18.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:18 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/96335997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:18.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:18 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2318279331' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:18.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:18 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3324571650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:18.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.466+0000 7f0c58e31640 1 -- 172.21.15.69:0/2502149076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c54107c70 msgr2=0x7f0c5410a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.466+0000 7f0c58e31640 1 --2- 172.21.15.69:0/2502149076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c54107c70 0x7f0c5410a0c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009ca0 tx=0x7f0c4c02a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.466+0000 7f0c58e31640 1 -- 172.21.15.69:0/2502149076 shutdown_connections 2024-04-23T10:26:18.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.466+0000 7f0c58e31640 1 --2- 172.21.15.69:0/2502149076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c54107c70 0x7f0c5410a0c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.466+0000 7f0c58e31640 1 --2- 172.21.15.69:0/2502149076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c54105340 0x7f0c54107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.466+0000 7f0c58e31640 1 --2- 172.21.15.69:0/2502149076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c54102a10 0x7f0c54104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.466+0000 7f0c58e31640 1 -- 172.21.15.69:0/2502149076 >> 172.21.15.69:0/2502149076 conn(0x7f0c540fc400 msgr2=0x7f0c540fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.466+0000 7f0c58e31640 1 -- 172.21.15.69:0/2502149076 shutdown_connections 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.466+0000 7f0c58e31640 1 -- 172.21.15.69:0/2502149076 wait complete. 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c58e31640 1 Processor -- start 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c58e31640 1 -- start start 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c58e31640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c54102a10 0x7f0c54102380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c58e31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c54105340 0x7f0c541009c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c58e31640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c54107c70 0x7f0c54100f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c58e31640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410dc10 con 0x7f0c54107c70 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c58e31640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410da90 con 0x7f0c54102a10 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c58e31640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410dd90 con 0x7f0c54105340 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c52d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c54107c70 0x7f0c54100f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c52d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c54107c70 0x7f0c54100f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47742/0 (socket says 172.21.15.69:47742) 2024-04-23T10:26:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c52d9d640 1 -- 172.21.15.69:0/2662394484 learned_addr learned my addr 172.21.15.69:0/2662394484 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.467+0000 7f0c5259c640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c54102a10 0x7f0c54102380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c51d9b640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c54105340 0x7f0c541009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c52d9d640 1 -- 172.21.15.69:0/2662394484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c54105340 msgr2=0x7f0c541009c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c52d9d640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c54105340 0x7f0c541009c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c52d9d640 1 -- 172.21.15.69:0/2662394484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c54102a10 msgr2=0x7f0c54102380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c52d9d640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c54102a10 0x7f0c54102380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c52d9d640 1 -- 172.21.15.69:0/2662394484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c54101790 con 0x7f0c54107c70 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c52d9d640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c54107c70 0x7f0c54100f00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009dc0 tx=0x7f0c4c02f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c437fe640 1 -- 172.21.15.69:0/2662394484 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c003cf0 con 0x7f0c54107c70 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c58e31640 1 -- 172.21.15.69:0/2662394484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c541a23a0 con 0x7f0c54107c70 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c437fe640 1 -- 172.21.15.69:0/2662394484 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0c4c004510 con 0x7f0c54107c70 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c437fe640 1 -- 172.21.15.69:0/2662394484 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c02fdb0 con 0x7f0c54107c70 2024-04-23T10:26:18.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.468+0000 7f0c58e31640 1 -- 172.21.15.69:0/2662394484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c541a2940 con 0x7f0c54107c70 2024-04-23T10:26:18.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.469+0000 7f0c58e31640 1 -- 172.21.15.69:0/2662394484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c540fdef0 con 0x7f0c54107c70 2024-04-23T10:26:18.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.470+0000 7f0c437fe640 1 -- 172.21.15.69:0/2662394484 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0c4c0046c0 con 0x7f0c54107c70 2024-04-23T10:26:18.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.471+0000 7f0c437fe640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0c3c0a3c40 0x7f0c3c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.471+0000 7f0c5259c640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0c3c0a3c40 0x7f0c3c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:18.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.471+0000 7f0c437fe640 1 -- 172.21.15.69:0/2662394484 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f0c4c0f1b60 con 0x7f0c54107c70 2024-04-23T10:26:18.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.471+0000 7f0c5259c640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0c3c0a3c40 0x7f0c3c0a6100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800bbe0 tx=0x7f0c4800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:18.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.475+0000 7f0c437fe640 1 -- 172.21.15.69:0/2662394484 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0c4c0be500 con 0x7f0c54107c70 2024-04-23T10:26:18.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:18 smithi167 ceph-mon[32940]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:26:18.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:18 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3477361394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:18.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:18 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/96335997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:18.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:18 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2318279331' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:18.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:18 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3324571650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:18.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.651+0000 7f0c58e31640 1 -- 172.21.15.69:0/2662394484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0c5402d7c0 con 0x7f0c54107c70 2024-04-23T10:26:18.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.651+0000 7f0c437fe640 1 -- 172.21.15.69:0/2662394484 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f0c4c0bde00 con 0x7f0c54107c70 2024-04-23T10:26:18.650 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-04-23T10:26:18.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 -- 172.21.15.69:0/2662394484 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0c3c0a3c40 msgr2=0x7f0c3c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0c3c0a3c40 0x7f0c3c0a6100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800bbe0 tx=0x7f0c4800b390 comp rx=0 tx=0).stop 2024-04-23T10:26:18.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 -- 172.21.15.69:0/2662394484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c54107c70 msgr2=0x7f0c54100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c54107c70 0x7f0c54100f00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009dc0 tx=0x7f0c4c02f460 comp rx=0 tx=0).stop 2024-04-23T10:26:18.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 -- 172.21.15.69:0/2662394484 shutdown_connections 2024-04-23T10:26:18.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f0c3c0a3c40 0x7f0c3c0a6100 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c54107c70 0x7f0c54100f00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c54105340 0x7f0c541009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 --2- 172.21.15.69:0/2662394484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c54102a10 0x7f0c54102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 -- 172.21.15.69:0/2662394484 >> 172.21.15.69:0/2662394484 conn(0x7f0c540fc400 msgr2=0x7f0c54103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:18.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 -- 172.21.15.69:0/2662394484 shutdown_connections 2024-04-23T10:26:18.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.653+0000 7f0c58e31640 1 -- 172.21.15.69:0/2662394484 wait complete. 2024-04-23T10:26:18.664 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:26:18.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.763+0000 7fe4252c2640 1 -- 172.21.15.69:0/1535401494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe420102060 msgr2=0x7fe4201024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.763+0000 7fe4252c2640 1 --2- 172.21.15.69:0/1535401494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe420102060 0x7fe4201024e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe408009900 tx=0x7fe40802a410 comp rx=0 tx=0).stop 2024-04-23T10:26:18.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.763+0000 7fe4252c2640 1 -- 172.21.15.69:0/1535401494 shutdown_connections 2024-04-23T10:26:18.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.763+0000 7fe4252c2640 1 --2- 172.21.15.69:0/1535401494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe420102060 0x7fe4201024e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.763+0000 7fe4252c2640 1 --2- 172.21.15.69:0/1535401494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe420102a20 0x7fe420109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.763+0000 7fe4252c2640 1 --2- 172.21.15.69:0/1535401494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe420100f10 0x7fe420101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.763+0000 7fe4252c2640 1 -- 172.21.15.69:0/1535401494 >> 172.21.15.69:0/1535401494 conn(0x7fe4200fc4a0 msgr2=0x7fe4200fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:18.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.763+0000 7fe4252c2640 1 -- 172.21.15.69:0/1535401494 shutdown_connections 2024-04-23T10:26:18.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.763+0000 7fe4252c2640 1 -- 172.21.15.69:0/1535401494 wait complete. 2024-04-23T10:26:18.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe4252c2640 1 Processor -- start 2024-04-23T10:26:18.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe4252c2640 1 -- start start 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe4252c2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe420100f10 0x7fe420198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe4252c2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe420102060 0x7fe4201987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe4252c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe420102a20 0x7fe42019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe4252c2640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe42010cb20 con 0x7fe420100f10 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe4252c2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe42010c9a0 con 0x7fe420102a20 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe4252c2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe42010cca0 con 0x7fe420102060 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe41effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe420100f10 0x7fe420198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe41effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe420100f10 0x7fe420198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47768/0 (socket says 172.21.15.69:47768) 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe41effd640 1 -- 172.21.15.69:0/2707862717 learned_addr learned my addr 172.21.15.69:0/2707862717 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe41f7fe640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe420102a20 0x7fe42019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe41effd640 1 -- 172.21.15.69:0/2707862717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe420102060 msgr2=0x7fe4201987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe41effd640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe420102060 0x7fe4201987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe41effd640 1 -- 172.21.15.69:0/2707862717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe420102a20 msgr2=0x7fe42019f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe41effd640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe420102a20 0x7fe42019f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe41effd640 1 -- 172.21.15.69:0/2707862717 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42019fea0 con 0x7fe420100f10 2024-04-23T10:26:18.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe41f7fe640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe420102a20 0x7fe42019f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:18.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.764+0000 7fe41effd640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe420100f10 0x7fe420198280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe41000d950 tx=0x7fe41000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:18.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.765+0000 7fe41cff9640 1 -- 172.21.15.69:0/2707862717 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410017030 con 0x7fe420100f10 2024-04-23T10:26:18.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.765+0000 7fe4252c2640 1 -- 172.21.15.69:0/2707862717 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4201a0190 con 0x7fe420100f10 2024-04-23T10:26:18.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.765+0000 7fe41cff9640 1 -- 172.21.15.69:0/2707862717 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe410004020 con 0x7fe420100f10 2024-04-23T10:26:18.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.765+0000 7fe41cff9640 1 -- 172.21.15.69:0/2707862717 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4100047a0 con 0x7fe420100f10 2024-04-23T10:26:18.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.765+0000 7fe4252c2640 1 -- 172.21.15.69:0/2707862717 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4201a0730 con 0x7fe420100f10 2024-04-23T10:26:18.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.766+0000 7fe4252c2640 1 -- 172.21.15.69:0/2707862717 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4201a09f0 con 0x7fe420100f10 2024-04-23T10:26:18.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.767+0000 7fe41cff9640 1 -- 172.21.15.69:0/2707862717 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe4100041d0 con 0x7fe420100f10 2024-04-23T10:26:18.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.767+0000 7fe41cff9640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe40c0a3c40 0x7fe40c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:18.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.767+0000 7fe417fff640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe40c0a3c40 0x7fe40c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:18.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.767+0000 7fe41cff9640 1 -- 172.21.15.69:0/2707862717 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fe4100d00e0 con 0x7fe420100f10 2024-04-23T10:26:18.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.768+0000 7fe417fff640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe40c0a3c40 0x7fe40c0a6100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe4080096c0 tx=0x7fe408000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:18.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.772+0000 7fe41cff9640 1 -- 172.21.15.69:0/2707862717 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe41009c970 con 0x7fe420100f10 2024-04-23T10:26:18.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.989+0000 7fe4252c2640 1 -- 172.21.15.69:0/2707862717 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4201a0bc0 con 0x7fe420100f10 2024-04-23T10:26:18.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.990+0000 7fe41cff9640 1 -- 172.21.15.69:0/2707862717 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7fe41009c270 con 0x7fe420100f10 2024-04-23T10:26:18.989 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:18.989 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:24:59.329454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24463,24421,24487,24416,24392]},"id":1}]} 2024-04-23T10:26:18.989 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 25 2024-04-23T10:26:18.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 -- 172.21.15.69:0/2707862717 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe40c0a3c40 msgr2=0x7fe40c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe40c0a3c40 0x7fe40c0a6100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe4080096c0 tx=0x7fe408000bc0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 -- 172.21.15.69:0/2707862717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe420100f10 msgr2=0x7fe420198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:18.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe420100f10 0x7fe420198280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe41000d950 tx=0x7fe41000de10 comp rx=0 tx=0).stop 2024-04-23T10:26:18.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 -- 172.21.15.69:0/2707862717 shutdown_connections 2024-04-23T10:26:18.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe40c0a3c40 0x7fe40c0a6100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe420102a20 0x7fe42019f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe420102060 0x7fe4201987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 --2- 172.21.15.69:0/2707862717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe420100f10 0x7fe420198280 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:18.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 -- 172.21.15.69:0/2707862717 >> 172.21.15.69:0/2707862717 conn(0x7fe4200fc4a0 msgr2=0x7fe4200fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:18.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 -- 172.21.15.69:0/2707862717 shutdown_connections 2024-04-23T10:26:18.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:18.992+0000 7fe4252c2640 1 -- 172.21.15.69:0/2707862717 wait complete. 2024-04-23T10:26:19.002 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:26:19.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.103+0000 7fbc1b813640 1 -- 172.21.15.69:0/1376014078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc14103b70 msgr2=0x7fbc1410a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.103+0000 7fbc1b813640 1 --2- 172.21.15.69:0/1376014078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc14103b70 0x7fbc1410a400 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c009ca0 tx=0x7fbc0c02a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.103+0000 7fbc1b813640 1 -- 172.21.15.69:0/1376014078 shutdown_connections 2024-04-23T10:26:19.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.103+0000 7fbc1b813640 1 --2- 172.21.15.69:0/1376014078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc14103b70 0x7fbc1410a400 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.103+0000 7fbc1b813640 1 --2- 172.21.15.69:0/1376014078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc141031b0 0x7fbc14103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.103+0000 7fbc1b813640 1 --2- 172.21.15.69:0/1376014078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc14101fc0 0x7fbc141023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.103+0000 7fbc1b813640 1 -- 172.21.15.69:0/1376014078 >> 172.21.15.69:0/1376014078 conn(0x7fbc140fd550 msgr2=0x7fbc140ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.103+0000 7fbc1b813640 1 -- 172.21.15.69:0/1376014078 shutdown_connections 2024-04-23T10:26:19.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.103+0000 7fbc1b813640 1 -- 172.21.15.69:0/1376014078 wait complete. 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc1b813640 1 Processor -- start 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc1b813640 1 -- start start 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc1b813640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc14101fc0 0x7fbc14198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc1b813640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc141031b0 0x7fbc14198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc1b813640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc14103b70 0x7fbc1419f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc1b813640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1410dc80 con 0x7fbc14103b70 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc1b813640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1410db00 con 0x7fbc141031b0 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc1b813640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1410de00 con 0x7fbc14101fc0 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc19db0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc14103b70 0x7fbc1419f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc19db0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc14103b70 0x7fbc1419f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47782/0 (socket says 172.21.15.69:47782) 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc19db0640 1 -- 172.21.15.69:0/2664771534 learned_addr learned my addr 172.21.15.69:0/2664771534 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc195af640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc14101fc0 0x7fbc14198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc19db0640 1 -- 172.21.15.69:0/2664771534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc14101fc0 msgr2=0x7fbc14198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc19db0640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc14101fc0 0x7fbc14198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc19db0640 1 -- 172.21.15.69:0/2664771534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc141031b0 msgr2=0x7fbc14198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc18dae640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc141031b0 0x7fbc14198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc19db0640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc141031b0 0x7fbc14198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc19db0640 1 -- 172.21.15.69:0/2664771534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1419ff20 con 0x7fbc14103b70 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc18dae640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc141031b0 0x7fbc14198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc19db0640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc14103b70 0x7fbc1419f8b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c009dc0 tx=0x7fbc0c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc0a7fc640 1 -- 172.21.15.69:0/2664771534 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c004240 con 0x7fbc14103b70 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc0a7fc640 1 -- 172.21.15.69:0/2664771534 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbc0c031830 con 0x7fbc14103b70 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc1b813640 1 -- 172.21.15.69:0/2664771534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc141a01b0 con 0x7fbc14103b70 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.104+0000 7fbc0a7fc640 1 -- 172.21.15.69:0/2664771534 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c0305c0 con 0x7fbc14103b70 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.105+0000 7fbc1b813640 1 -- 172.21.15.69:0/2664771534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc141a07d0 con 0x7fbc14103b70 2024-04-23T10:26:19.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.105+0000 7fbc1b813640 1 -- 172.21.15.69:0/2664771534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc14109300 con 0x7fbc14103b70 2024-04-23T10:26:19.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.106+0000 7fbc0a7fc640 1 -- 172.21.15.69:0/2664771534 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fbc0c02f660 con 0x7fbc14103b70 2024-04-23T10:26:19.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.107+0000 7fbc0a7fc640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbc000a3cc0 0x7fbc000a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.107+0000 7fbc195af640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbc000a3cc0 0x7fbc000a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.107+0000 7fbc0a7fc640 1 -- 172.21.15.69:0/2664771534 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fbc0c0f1d90 con 0x7fbc14103b70 2024-04-23T10:26:19.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.107+0000 7fbc195af640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbc000a3cc0 0x7fbc000a6180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbc10005db0 tx=0x7fbc10005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.111+0000 7fbc0a7fc640 1 -- 172.21.15.69:0/2664771534 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbc0c0f5030 con 0x7fbc14103b70 2024-04-23T10:26:19.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.288+0000 7fbc1b813640 1 -- 172.21.15.69:0/2664771534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc14062b50 con 0x7fbc14103b70 2024-04-23T10:26:19.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.290+0000 7fbc0a7fc640 1 -- 172.21.15.69:0/2664771534 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22595 (secure 0 0 0) 0x7fbc0c0be730 con 0x7fbc14103b70 2024-04-23T10:26:19.289 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:19.290 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":88,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:26:00.078482+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:26:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 -- 172.21.15.69:0/2664771534 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbc000a3cc0 msgr2=0x7fbc000a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbc000a3cc0 0x7fbc000a6180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbc10005db0 tx=0x7fbc10005d40 comp rx=0 tx=0).stop 2024-04-23T10:26:19.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 -- 172.21.15.69:0/2664771534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc14103b70 msgr2=0x7fbc1419f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc14103b70 0x7fbc1419f8b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c009dc0 tx=0x7fbc0c003c20 comp rx=0 tx=0).stop 2024-04-23T10:26:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 -- 172.21.15.69:0/2664771534 shutdown_connections 2024-04-23T10:26:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbc000a3cc0 0x7fbc000a6180 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc14103b70 0x7fbc1419f8b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc141031b0 0x7fbc14198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 --2- 172.21.15.69:0/2664771534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc14101fc0 0x7fbc14198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 -- 172.21.15.69:0/2664771534 >> 172.21.15.69:0/2664771534 conn(0x7fbc140fd550 msgr2=0x7fbc141064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 -- 172.21.15.69:0/2664771534 shutdown_connections 2024-04-23T10:26:19.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.292+0000 7fbc1b813640 1 -- 172.21.15.69:0/2664771534 wait complete. 2024-04-23T10:26:19.301 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:19 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/4249332143' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:19.301 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:19 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2662394484' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:19.301 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:19 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2707862717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:19.303 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:26:19.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.401+0000 7f70fc889640 1 -- 172.21.15.69:0/1245131405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f8100e90 msgr2=0x7f70f81012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.401+0000 7f70fc889640 1 --2- 172.21.15.69:0/1245131405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f8100e90 0x7f70f81012b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009ca0 tx=0x7f70e802a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.401+0000 7f70fc889640 1 -- 172.21.15.69:0/1245131405 shutdown_connections 2024-04-23T10:26:19.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.401+0000 7f70fc889640 1 --2- 172.21.15.69:0/1245131405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f81029a0 0x7f70f81092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.401+0000 7f70fc889640 1 --2- 172.21.15.69:0/1245131405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f8101fe0 0x7f70f8102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.401+0000 7f70fc889640 1 --2- 172.21.15.69:0/1245131405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f8100e90 0x7f70f81012b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.401+0000 7f70fc889640 1 -- 172.21.15.69:0/1245131405 >> 172.21.15.69:0/1245131405 conn(0x7f70f80fc400 msgr2=0x7f70f80fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.401+0000 7f70fc889640 1 -- 172.21.15.69:0/1245131405 shutdown_connections 2024-04-23T10:26:19.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.401+0000 7f70fc889640 1 -- 172.21.15.69:0/1245131405 wait complete. 2024-04-23T10:26:19.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.402+0000 7f70fc889640 1 Processor -- start 2024-04-23T10:26:19.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.402+0000 7f70fc889640 1 -- start start 2024-04-23T10:26:19.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.402+0000 7f70fc889640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f8100e90 0x7f70f8198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.402+0000 7f70fc889640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f8101fe0 0x7f70f8198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.402+0000 7f70fc889640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f81029a0 0x7f70f819f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.402+0000 7f70fc889640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f70f810dc20 con 0x7f70f81029a0 2024-04-23T10:26:19.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.402+0000 7f70fc889640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f70f810daa0 con 0x7f70f8100e90 2024-04-23T10:26:19.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.402+0000 7f70fc889640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70f810dda0 con 0x7f70f8101fe0 2024-04-23T10:26:19.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.402+0000 7f70f6d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f81029a0 0x7f70f819f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.402+0000 7f70f6d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f81029a0 0x7f70f819f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47806/0 (socket says 172.21.15.69:47806) 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.402+0000 7f70f6d9d640 1 -- 172.21.15.69:0/1920121370 learned_addr learned my addr 172.21.15.69:0/1920121370 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70f659c640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f8100e90 0x7f70f8198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70f5d9b640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f8101fe0 0x7f70f8198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70f6d9d640 1 -- 172.21.15.69:0/1920121370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f8101fe0 msgr2=0x7f70f8198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70f6d9d640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f8101fe0 0x7f70f8198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70f6d9d640 1 -- 172.21.15.69:0/1920121370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f8100e90 msgr2=0x7f70f8198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70f6d9d640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f8100e90 0x7f70f8198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70f6d9d640 1 -- 172.21.15.69:0/1920121370 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f819fe20 con 0x7f70f81029a0 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70f6d9d640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f81029a0 0x7f70f819f7b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f70f000d750 tx=0x7f70f000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70e77fe640 1 -- 172.21.15.69:0/1920121370 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0017070 con 0x7f70f81029a0 2024-04-23T10:26:19.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70e77fe640 1 -- 172.21.15.69:0/1920121370 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f70f00054f0 con 0x7f70f81029a0 2024-04-23T10:26:19.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70fc889640 1 -- 172.21.15.69:0/1920121370 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f81a0110 con 0x7f70f81029a0 2024-04-23T10:26:19.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70e77fe640 1 -- 172.21.15.69:0/1920121370 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0004cd0 con 0x7f70f81029a0 2024-04-23T10:26:19.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.403+0000 7f70fc889640 1 -- 172.21.15.69:0/1920121370 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f81a0660 con 0x7f70f81029a0 2024-04-23T10:26:19.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.404+0000 7f70fc889640 1 -- 172.21.15.69:0/1920121370 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f8108140 con 0x7f70f81029a0 2024-04-23T10:26:19.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.405+0000 7f70e77fe640 1 -- 172.21.15.69:0/1920121370 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f70f0009bd0 con 0x7f70f81029a0 2024-04-23T10:26:19.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.406+0000 7f70e77fe640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70e00a3c40 0x7f70e00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.406+0000 7f70f659c640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70e00a3c40 0x7f70e00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.406+0000 7f70e77fe640 1 -- 172.21.15.69:0/1920121370 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f70f00d04e0 con 0x7f70f81029a0 2024-04-23T10:26:19.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.406+0000 7f70f659c640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70e00a3c40 0x7f70e00a6100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f70e8031ba0 tx=0x7f70e8005ef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.409+0000 7f70e77fe640 1 -- 172.21.15.69:0/1920121370 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f70f009cd70 con 0x7f70f81029a0 2024-04-23T10:26:19.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:19 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/4249332143' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:19.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:19 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2662394484' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:19.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:19 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2707862717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:19.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:19 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/4249332143' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:19.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:19 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2662394484' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:19.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:19 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2707862717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:19.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.626+0000 7f70fc889640 1 -- 172.21.15.69:0/1920121370 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70f802d5c0 con 0x7f70f81029a0 2024-04-23T10:26:19.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.627+0000 7f70e77fe640 1 -- 172.21.15.69:0/1920121370 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7f70f009c670 con 0x7f70f81029a0 2024-04-23T10:26:19.626 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:19.626 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:24:59.329454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24463,24421,24487,24416,24392]},"id":1}]} 2024-04-23T10:26:19.626 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 25 2024-04-23T10:26:19.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 -- 172.21.15.69:0/1920121370 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70e00a3c40 msgr2=0x7f70e00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70e00a3c40 0x7f70e00a6100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f70e8031ba0 tx=0x7f70e8005ef0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 -- 172.21.15.69:0/1920121370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f81029a0 msgr2=0x7f70f819f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f81029a0 0x7f70f819f7b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f70f000d750 tx=0x7f70f000dc10 comp rx=0 tx=0).stop 2024-04-23T10:26:19.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 -- 172.21.15.69:0/1920121370 shutdown_connections 2024-04-23T10:26:19.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f70e00a3c40 0x7f70e00a6100 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70f81029a0 0x7f70f819f7b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70f8101fe0 0x7f70f8198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 --2- 172.21.15.69:0/1920121370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f8100e90 0x7f70f8198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 -- 172.21.15.69:0/1920121370 >> 172.21.15.69:0/1920121370 conn(0x7f70f80fc400 msgr2=0x7f70f8105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 -- 172.21.15.69:0/1920121370 shutdown_connections 2024-04-23T10:26:19.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.629+0000 7f70fc889640 1 -- 172.21.15.69:0/1920121370 wait complete. 2024-04-23T10:26:19.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-23T10:24:52.877417+0000', 'modified': '2024-04-23T10:24:59.329454+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24487, 'mds_1': 24463, 'mds_2': 24421, 'mds_3': 24416, 'mds_4': 24392}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14631': {'gid': 14631, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.69:6839/441538329', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6838', 'nonce': 441538329}, {'type': 'v1', 'addr': '172.21.15.69:6839', 'nonce': 441538329}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14643': {'gid': 14643, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.69:6841/3448889268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6840', 'nonce': 3448889268}, {'type': 'v1', 'addr': '172.21.15.69:6841', 'nonce': 3448889268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24368': {'gid': 24368, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6833/318414865', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 318414865}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 318414865}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'e', 'rank': 4, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.146:6835/3824729166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 3824729166}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3824729166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'h', 'rank': 3, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.146:6837/1505523103', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 1505523103}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 1505523103}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.167:6833/977410598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6832', 'nonce': 977410598}, {'type': 'v1', 'addr': '172.21.15.167:6833', 'nonce': 977410598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'b', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6839/712940861', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6838', 'nonce': 712940861}, {'type': 'v1', 'addr': '172.21.15.146:6839', 'nonce': 712940861}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6835/2993393777', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 2993393777}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 2993393777}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.167:6837/1671189160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 1671189160}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 1671189160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.167:6839/1688975356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 1688975356}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 1688975356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24487, 'qdb_cluster': [24463, 24421, 24487, 24416, 24392]} 2024-04-23T10:26:19.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-23T10:26:19.640 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-23T10:26:19.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.739+0000 7f045a610640 1 -- 172.21.15.69:0/2026882591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0454101fc0 msgr2=0x7f04541023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.739+0000 7f045a610640 1 --2- 172.21.15.69:0/2026882591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0454101fc0 0x7f04541023e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0444009900 tx=0x7f044402a410 comp rx=0 tx=0).stop 2024-04-23T10:26:19.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.739+0000 7f045a610640 1 -- 172.21.15.69:0/2026882591 shutdown_connections 2024-04-23T10:26:19.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.739+0000 7f045a610640 1 --2- 172.21.15.69:0/2026882591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0454103b70 0x7f045410a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.739+0000 7f045a610640 1 --2- 172.21.15.69:0/2026882591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04541031b0 0x7f0454103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.739+0000 7f045a610640 1 --2- 172.21.15.69:0/2026882591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0454101fc0 0x7f04541023e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.739+0000 7f045a610640 1 -- 172.21.15.69:0/2026882591 >> 172.21.15.69:0/2026882591 conn(0x7f04540fd530 msgr2=0x7f04540ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.739+0000 7f045a610640 1 -- 172.21.15.69:0/2026882591 shutdown_connections 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.739+0000 7f045a610640 1 -- 172.21.15.69:0/2026882591 wait complete. 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f045a610640 1 Processor -- start 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f045a610640 1 -- start start 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f045a610640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0454101fc0 0x7f0454075d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f045a610640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04541031b0 0x7f0454074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f045a610640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0454103b70 0x7f0454074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f045a610640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f045410dc20 con 0x7f0454103b70 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f045a610640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f045410daa0 con 0x7f04541031b0 2024-04-23T10:26:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f045a610640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f045410dda0 con 0x7f0454101fc0 2024-04-23T10:26:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f0458bad640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0454103b70 0x7f0454074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f0458bad640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0454103b70 0x7f0454074880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46466/0 (socket says 172.21.15.69:46466) 2024-04-23T10:26:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f0458bad640 1 -- 172.21.15.69:0/2055663249 learned_addr learned my addr 172.21.15.69:0/2055663249 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f0453fff640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0454101fc0 0x7f0454075d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f0458bad640 1 -- 172.21.15.69:0/2055663249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0454101fc0 msgr2=0x7f0454075d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f0458bad640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0454101fc0 0x7f0454075d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f0458bad640 1 -- 172.21.15.69:0/2055663249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04541031b0 msgr2=0x7f0454074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f0458bad640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04541031b0 0x7f0454074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f0458bad640 1 -- 172.21.15.69:0/2055663249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0454075110 con 0x7f0454103b70 2024-04-23T10:26:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f0453fff640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0454101fc0 0x7f0454075d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.740+0000 7f0458bad640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0454103b70 0x7f0454074880 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f044c00eaa0 tx=0x7f044c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.741+0000 7f04517fa640 1 -- 172.21.15.69:0/2055663249 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c00cdb0 con 0x7f0454103b70 2024-04-23T10:26:19.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.741+0000 7f04517fa640 1 -- 172.21.15.69:0/2055663249 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f044c005020 con 0x7f0454103b70 2024-04-23T10:26:19.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.741+0000 7f04517fa640 1 -- 172.21.15.69:0/2055663249 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c0116d0 con 0x7f0454103b70 2024-04-23T10:26:19.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.741+0000 7f045a610640 1 -- 172.21.15.69:0/2055663249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04541a2390 con 0x7f0454103b70 2024-04-23T10:26:19.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.741+0000 7f045a610640 1 -- 172.21.15.69:0/2055663249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04541a28e0 con 0x7f0454103b70 2024-04-23T10:26:19.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f04517fa640 1 -- 172.21.15.69:0/2055663249 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f044c0051d0 con 0x7f0454103b70 2024-04-23T10:26:19.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f045d3ff740 1 Processor -- start 2024-04-23T10:26:19.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f045d3ff740 1 -- start start 2024-04-23T10:26:19.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a7b80 0x55bd431a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a8d50 0x55bd431a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a9710 0x55bd431affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f045d3ff740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bd4310cc50 con 0x55bd431a7b80 2024-04-23T10:26:19.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f045d3ff740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bd430a9830 con 0x55bd431a9710 2024-04-23T10:26:19.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f045d3ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bd43108c10 con 0x55bd431a8d50 2024-04-23T10:26:19.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f04537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a7b80 0x55bd431a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f04517fa640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f043c0a3cc0 0x7f043c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f04537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a7b80 0x55bd431a7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46468/0 (socket says 172.21.15.69:46468) 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f04537fe640 1 -- 172.21.15.69:0/1645838007 learned_addr learned my addr 172.21.15.69:0/1645838007 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f0453fff640 1 --2- 172.21.15.69:0/1645838007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a8d50 0x55bd431a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f0458bad640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f043c0a3cc0 0x7f043c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.743+0000 7f04537fe640 1 -- 172.21.15.69:0/1645838007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a8d50 msgr2=0x55bd431a91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.744+0000 7f04537fe640 1 --2- 172.21.15.69:0/1645838007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a8d50 0x55bd431a91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.744+0000 7f04537fe640 1 -- 172.21.15.69:0/1645838007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a9710 msgr2=0x55bd431affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.744+0000 7f04537fe640 1 --2- 172.21.15.69:0/1645838007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a9710 0x55bd431affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.744+0000 7f04537fe640 1 -- 172.21.15.69:0/1645838007 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd42e1f2d0 con 0x55bd431a7b80 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.744+0000 7f0453fff640 1 --2- 172.21.15.69:0/1645838007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a8d50 0x55bd431a91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.744+0000 7f04517fa640 1 -- 172.21.15.69:0/2055663249 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f044c0d0800 con 0x7f0454103b70 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.744+0000 7f04537fe640 1 --2- 172.21.15.69:0/1645838007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a7b80 0x55bd431a7fa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0448005fd0 tx=0x7f044800f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa54224769e05214 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.744+0000 7f0458bad640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f043c0a3cc0 0x7f043c0a6180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f044c06f4a0 tx=0x7f044c0c7aa0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.744+0000 7f043a7fc640 1 -- 172.21.15.69:0/1645838007 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448015020 con 0x55bd431a7b80 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.744+0000 7f043a7fc640 1 -- 172.21.15.69:0/1645838007 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f04480035f0 con 0x55bd431a7b80 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.744+0000 7f043a7fc640 1 -- 172.21.15.69:0/1645838007 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448011670 con 0x55bd431a7b80 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 -- 172.21.15.69:0/1645838007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a7b80 msgr2=0x55bd431a7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 --2- 172.21.15.69:0/1645838007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a7b80 0x55bd431a7fa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0448005fd0 tx=0x7f044800f6d0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 -- 172.21.15.69:0/1645838007 shutdown_connections 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 --2- 172.21.15.69:0/1645838007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a9710 0x55bd431affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 --2- 172.21.15.69:0/1645838007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a8d50 0x55bd431a91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 --2- 172.21.15.69:0/1645838007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a7b80 0x55bd431a7fa0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 -- 172.21.15.69:0/1645838007 >> 172.21.15.69:0/1645838007 conn(0x55bd431a3070 msgr2=0x55bd431a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 -- 172.21.15.69:0/1645838007 shutdown_connections 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 -- 172.21.15.69:0/1645838007 wait complete. 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 -- start start 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 Processor -- start 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a7b80 0x55bd431b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a9710 0x55bd431b9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bd431b0720 con 0x55bd431a8d50 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bd430a7470 con 0x55bd431a7b80 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bd431b08a0 con 0x55bd431a9710 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f045d3ff740 10 client.0 _ll_register_callbacks cb 0x55bd430ccf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.745+0000 7f0453fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f0453fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46474/0 (socket says 172.21.15.69:46474) 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f0453fff640 1 -- 172.21.15.69:0/8618136 learned_addr learned my addr 172.21.15.69:0/8618136 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f04537fe640 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a9710 0x55bd431b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f04537fe640 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a7b80 0x55bd431b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f0453fff640 1 -- 172.21.15.69:0/8618136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a9710 msgr2=0x55bd431b9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f0453fff640 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a9710 0x55bd431b9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f0453fff640 1 -- 172.21.15.69:0/8618136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a7b80 msgr2=0x55bd431b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f0453fff640 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a7b80 0x55bd431b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f0453fff640 1 -- 172.21.15.69:0/8618136 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd42ee96b0 con 0x55bd431a8d50 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f04537fe640 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a9710 0x55bd431b9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f0453fff640 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b24f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0444009900 tx=0x7f0444031940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fdec99a9798dce server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f04337fe640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f04337fe640 1 -- 172.21.15.69:0/8618136 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444035070 con 0x55bd431a8d50 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f04337fe640 1 -- 172.21.15.69:0/8618136 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f04440042c0 con 0x55bd431a8d50 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f045d3ff740 1 -- 172.21.15.69:0/8618136 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04480035f0 con 0x55bd431a8d50 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f04337fe640 1 -- 172.21.15.69:0/8618136 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f04440044c0 con 0x55bd431a8d50 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f045d3ff740 10 client.15060 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f045d3ff740 1 -- 172.21.15.69:0/8618136 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bd431bc910 con 0x55bd431a8d50 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.746+0000 7f04337fe640 1 -- 172.21.15.69:0/8618136 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f04480035f0 con 0x55bd431a8d50 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.747+0000 7f04337fe640 1 -- 172.21.15.69:0/8618136 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f04440035f0 con 0x55bd431a8d50 2024-04-23T10:26:19.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.747+0000 7f045d3ff740 10 client.15060 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.747+0000 7f045d3ff740 10 client.15060 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.747+0000 7f045d3ff740 20 client.15060 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.747+0000 7f045d3ff740 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55bd431bef60 0x55bd431c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.747+0000 7f045d3ff740 4 client.15060 mds_command: new command op to 24392 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.747+0000 7f045d3ff740 1 -- 172.21.15.69:0/8618136 --> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd4311a670 con 0x55bd431bef60 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.747+0000 7f04537fe640 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55bd431bef60 0x55bd431c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.747+0000 7f04537fe640 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55bd431bef60 0x55bd431c03d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5a8e1f4fe71c609c server_cookie=7d060ca23c3896f6 in_seq=0 out_seq=0 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.747+0000 7f04337fe640 10 client.15060 ms_handle_connect on v2:172.21.15.146:6834/3824729166 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f04337fe640 1 -- 172.21.15.69:0/8618136 <== mds.4 v2:172.21.15.146:6834/3824729166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bd4311a670 con 0x55bd431bef60 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f04337fe640 10 client.15060 handle_command_reply: tid=0 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f045d3ff740 1 client.15060 shutdown 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f045d3ff740 1 -- 172.21.15.69:0/8618136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 msgr2=0x55bd431b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f045d3ff740 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b24f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0444009900 tx=0x7f0444031940 comp rx=0 tx=0).stop 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f045d3ff740 1 -- 172.21.15.69:0/8618136 shutdown_connections 2024-04-23T10:26:19.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f045d3ff740 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55bd431bef60 0x55bd431c03d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f045d3ff740 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b24f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f045d3ff740 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a9710 0x55bd431b9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f045d3ff740 1 --2- 172.21.15.69:0/8618136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a7b80 0x55bd431b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f04337fe640 0 client.15060 ms_handle_reset on v2:172.21.15.146:6834/3824729166 2024-04-23T10:26:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f045d3ff740 1 -- 172.21.15.69:0/8618136 >> 172.21.15.69:0/8618136 conn(0x55bd431a3070 msgr2=0x55bd431a21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f045d3ff740 1 -- 172.21.15.69:0/8618136 shutdown_connections 2024-04-23T10:26:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.748+0000 7f045d3ff740 1 -- 172.21.15.69:0/8618136 wait complete. 2024-04-23T10:26:19.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.749+0000 7f045d3ff740 20 client.15060 trim_cache size 0 max 16384 2024-04-23T10:26:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.766+0000 7f045d3ff740 1 Processor -- start 2024-04-23T10:26:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.766+0000 7f045d3ff740 1 -- start start 2024-04-23T10:26:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a7b80 0x55bd431a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a9710 0x55bd431b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f045d3ff740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bd431be710 con 0x55bd431a8d50 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f045d3ff740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bd431bede0 con 0x55bd431a7b80 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f045d3ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bd431bf4b0 con 0x55bd431a9710 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0453fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0453fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46484/0 (socket says 172.21.15.69:46484) 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0453fff640 1 -- 172.21.15.69:0/3545439682 learned_addr learned my addr 172.21.15.69:0/3545439682 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0453fff640 1 -- 172.21.15.69:0/3545439682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a9710 msgr2=0x55bd431b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0453fff640 1 --2- 172.21.15.69:0/3545439682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a9710 0x55bd431b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0453fff640 1 -- 172.21.15.69:0/3545439682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a7b80 msgr2=0x55bd431a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0453fff640 1 --2- 172.21.15.69:0/3545439682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a7b80 0x55bd431a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0453fff640 1 -- 172.21.15.69:0/3545439682 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd431a87d0 con 0x55bd431a8d50 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0453fff640 1 --2- 172.21.15.69:0/3545439682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b94f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0444005940 tx=0x7f0444003830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f44c10f98c743a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0439ffb640 1 -- 172.21.15.69:0/3545439682 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444035070 con 0x55bd431a8d50 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0439ffb640 1 -- 172.21.15.69:0/3545439682 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0444004b90 con 0x55bd431a8d50 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.767+0000 7f0439ffb640 1 -- 172.21.15.69:0/3545439682 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444004000 con 0x55bd431a8d50 2024-04-23T10:26:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 -- 172.21.15.69:0/3545439682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 msgr2=0x55bd431b94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 --2- 172.21.15.69:0/3545439682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b94f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0444005940 tx=0x7f0444003830 comp rx=0 tx=0).stop 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 -- 172.21.15.69:0/3545439682 shutdown_connections 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 --2- 172.21.15.69:0/3545439682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a8d50 0x55bd431b94f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 --2- 172.21.15.69:0/3545439682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a9710 0x55bd431b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 --2- 172.21.15.69:0/3545439682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a7b80 0x55bd431a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 -- 172.21.15.69:0/3545439682 >> 172.21.15.69:0/3545439682 conn(0x55bd431a3070 msgr2=0x55bd431ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 -- 172.21.15.69:0/3545439682 shutdown_connections 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 -- 172.21.15.69:0/3545439682 wait complete. 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 -- start start 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 Processor -- start 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a7b80 0x55bd431b5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a8d50 0x55bd431b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a9710 0x55bd431b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bd431c0250 con 0x55bd431a9710 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bd431bfb80 con 0x55bd431a8d50 2024-04-23T10:26:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bd431c0920 con 0x55bd431a7b80 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f045d3ff740 10 client.0 _ll_register_callbacks cb 0x7f0444009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.768+0000 7f04537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a9710 0x55bd431b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a9710 0x55bd431b8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46486/0 (socket says 172.21.15.69:46486) 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04537fe640 1 -- 172.21.15.69:0/4190661648 learned_addr learned my addr 172.21.15.69:0/4190661648 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04537fe640 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a7b80 0x55bd431b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f0453fff640 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a8d50 0x55bd431b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04537fe640 1 -- 172.21.15.69:0/4190661648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a7b80 msgr2=0x55bd431b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04537fe640 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a7b80 0x55bd431b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04537fe640 1 -- 172.21.15.69:0/4190661648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a8d50 msgr2=0x55bd431b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04537fe640 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a8d50 0x55bd431b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04537fe640 1 -- 172.21.15.69:0/4190661648 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd431b8d60 con 0x55bd431a9710 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f0453fff640 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a8d50 0x55bd431b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04537fe640 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a9710 0x55bd431b8770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f044800bbe0 tx=0x7f04480057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d743c5a5e7c111d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04337fe640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04337fe640 1 -- 172.21.15.69:0/4190661648 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044802f060 con 0x55bd431a9710 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04337fe640 1 -- 172.21.15.69:0/4190661648 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f0448003a80 con 0x55bd431a9710 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f045d3ff740 1 -- 172.21.15.69:0/4190661648 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0444004b90 con 0x55bd431a9710 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04337fe640 1 -- 172.21.15.69:0/4190661648 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0448015070 con 0x55bd431a9710 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f045d3ff740 10 client.15066 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f045d3ff740 1 -- 172.21.15.69:0/4190661648 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bd432254f0 con 0x55bd431a9710 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04337fe640 1 -- 172.21.15.69:0/4190661648 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0444004b90 con 0x55bd431a9710 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.769+0000 7f04337fe640 1 -- 172.21.15.69:0/4190661648 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f04480042e0 con 0x55bd431a9710 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f045d3ff740 10 client.15066 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f045d3ff740 10 client.15066 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f045d3ff740 20 client.15066 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f045d3ff740 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55bd43229e00 0x55bd43228b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f045d3ff740 4 client.15066 mds_command: new command op to 24392 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f045d3ff740 1 -- 172.21.15.69:0/4190661648 --> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] -- command(tid 0: {"prefix": "status"}) -- 0x55bd431144e0 con 0x55bd43229e00 2024-04-23T10:26:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f0453fff640 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55bd43229e00 0x55bd43228b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f04337fe640 10 client.15066 ms_handle_connect on v2:172.21.15.146:6834/3824729166 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f0453fff640 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55bd43229e00 0x55bd43228b10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7786e02d91b5d880 server_cookie=130a84d2e302b32d in_seq=0 out_seq=0 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f04337fe640 1 -- 172.21.15.69:0/4190661648 <== mds.4 v2:172.21.15.146:6834/3824729166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bd431144e0 con 0x55bd43229e00 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f04337fe640 10 client.15066 handle_command_reply: tid=0 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.770+0000 7f045d3ff740 1 client.15066 shutdown 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045d3ff740 1 -- 172.21.15.69:0/4190661648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a9710 msgr2=0x55bd431b8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045d3ff740 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a9710 0x55bd431b8770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f044800bbe0 tx=0x7f04480057b0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045d3ff740 1 -- 172.21.15.69:0/4190661648 shutdown_connections 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045d3ff740 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55bd43229e00 0x55bd43228b10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045d3ff740 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd431a9710 0x55bd431b8770 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f04337fe640 0 client.15066 ms_handle_reset on v2:172.21.15.146:6834/3824729166 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045d3ff740 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bd431a8d50 0x55bd431b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045d3ff740 1 --2- 172.21.15.69:0/4190661648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd431a7b80 0x55bd431b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045d3ff740 1 -- 172.21.15.69:0/4190661648 >> 172.21.15.69:0/4190661648 conn(0x55bd431a3070 msgr2=0x55bd431ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045d3ff740 1 -- 172.21.15.69:0/4190661648 shutdown_connections 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045d3ff740 1 -- 172.21.15.69:0/4190661648 wait complete. 2024-04-23T10:26:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045d3ff740 20 client.15066 trim_cache size 0 max 16384 2024-04-23T10:26:19.777 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:26:19.777 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:26:19.777 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 4, 2024-04-23T10:26:19.777 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24392, 2024-04-23T10:26:19.777 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:26:19.777 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:26:19.777 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:26:19.777 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 81.444637870999998, 2024-04-23T10:26:19.777 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 25, 2024-04-23T10:26:19.777 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 88, 2024-04-23T10:26:19.777 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 86, 2024-04-23T10:26:19.778 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 111.270759056 2024-04-23T10:26:19.778 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:26:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 -- 172.21.15.69:0/2055663249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f043c0a3cc0 msgr2=0x7f043c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f043c0a3cc0 0x7f043c0a6180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f044c06f4a0 tx=0x7f044c0c7aa0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 -- 172.21.15.69:0/2055663249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0454103b70 msgr2=0x7f0454074880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0454103b70 0x7f0454074880 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f044c00eaa0 tx=0x7f044c00ef60 comp rx=0 tx=0).stop 2024-04-23T10:26:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 -- 172.21.15.69:0/2055663249 shutdown_connections 2024-04-23T10:26:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f043c0a3cc0 0x7f043c0a6180 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0454103b70 0x7f0454074880 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04541031b0 0x7f0454074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 --2- 172.21.15.69:0/2055663249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0454101fc0 0x7f0454075d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 -- 172.21.15.69:0/2055663249 >> 172.21.15.69:0/2055663249 conn(0x7f04540fd530 msgr2=0x7f04541064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 -- 172.21.15.69:0/2055663249 shutdown_connections 2024-04-23T10:26:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.771+0000 7f045a610640 1 -- 172.21.15.69:0/2055663249 wait complete. 2024-04-23T10:26:19.781 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-23T10:26:19.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.881+0000 7f658535d640 1 -- 172.21.15.69:0/3370207096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6580100e60 msgr2=0x7f6580101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.881+0000 7f658535d640 1 --2- 172.21.15.69:0/3370207096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6580100e60 0x7f6580101280 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6570009900 tx=0x7f657002a410 comp rx=0 tx=0).stop 2024-04-23T10:26:19.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.881+0000 7f658535d640 1 -- 172.21.15.69:0/3370207096 shutdown_connections 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.881+0000 7f658535d640 1 --2- 172.21.15.69:0/3370207096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6580102a00 0x7f6580109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.881+0000 7f658535d640 1 --2- 172.21.15.69:0/3370207096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6580102040 0x7f65801024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.881+0000 7f658535d640 1 --2- 172.21.15.69:0/3370207096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6580100e60 0x7f6580101280 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.881+0000 7f658535d640 1 -- 172.21.15.69:0/3370207096 >> 172.21.15.69:0/3370207096 conn(0x7f65800fc440 msgr2=0x7f65800fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.881+0000 7f658535d640 1 -- 172.21.15.69:0/3370207096 shutdown_connections 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.881+0000 7f658535d640 1 -- 172.21.15.69:0/3370207096 wait complete. 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f658535d640 1 Processor -- start 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f658535d640 1 -- start start 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f658535d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6580100e60 0x7f658006b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f658535d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6580102040 0x7f658019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f658535d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6580102a00 0x7f658019f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f658535d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f658010cb30 con 0x7f6580102a00 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f658535d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f658010c9b0 con 0x7f6580100e60 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f658535d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f658010ccb0 con 0x7f6580102040 2024-04-23T10:26:19.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6580102a00 0x7f658019f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6580102a00 0x7f658019f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46494/0 (socket says 172.21.15.69:46494) 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f657f7fe640 1 -- 172.21.15.69:0/795108647 learned_addr learned my addr 172.21.15.69:0/795108647 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f657e7fc640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6580102040 0x7f658019cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f657f7fe640 1 -- 172.21.15.69:0/795108647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6580102040 msgr2=0x7f658019cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f657f7fe640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6580102040 0x7f658019cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f657f7fe640 1 -- 172.21.15.69:0/795108647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6580100e60 msgr2=0x7f658006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f657f7fe640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6580100e60 0x7f658006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.882+0000 7f657f7fe640 1 -- 172.21.15.69:0/795108647 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658019fed0 con 0x7f6580102a00 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.883+0000 7f657f7fe640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6580102a00 0x7f658019f610 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f657800eaa0 tx=0x7f657800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.883+0000 7f6567fff640 1 -- 172.21.15.69:0/795108647 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657800cdb0 con 0x7f6580102a00 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.883+0000 7f658535d640 1 -- 172.21.15.69:0/795108647 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65801a01c0 con 0x7f6580102a00 2024-04-23T10:26:19.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.883+0000 7f6567fff640 1 -- 172.21.15.69:0/795108647 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6578005020 con 0x7f6580102a00 2024-04-23T10:26:19.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.883+0000 7f6567fff640 1 -- 172.21.15.69:0/795108647 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780116b0 con 0x7f6580102a00 2024-04-23T10:26:19.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.883+0000 7f658535d640 1 -- 172.21.15.69:0/795108647 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65801a0710 con 0x7f6580102a00 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.885+0000 7f6567fff640 1 -- 172.21.15.69:0/795108647 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f65780051d0 con 0x7f6580102a00 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f6588074740 1 Processor -- start 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f6588074740 1 -- start start 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f6588074740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198d8b80 0x55ae198d8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f6588074740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198da1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f6588074740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198da710 0x55ae198e0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f6588074740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ae1983dc50 con 0x55ae198d9d50 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f6588074740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ae197da830 con 0x55ae198d8b80 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f6588074740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae19839c10 con 0x55ae198da710 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198da1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198da1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46502/0 (socket says 172.21.15.69:46502) 2024-04-23T10:26:19.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657effd640 1 -- 172.21.15.69:0/2128417884 learned_addr learned my addr 172.21.15.69:0/2128417884 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f6567fff640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65680a3c40 0x7f65680a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657e7fc640 1 --2- 172.21.15.69:0/2128417884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198d8b80 0x55ae198d8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657e7fc640 1 --2- 172.21.15.69:0/2128417884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198da710 0x55ae198e0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657f7fe640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65680a3c40 0x7f65680a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657effd640 1 -- 172.21.15.69:0/2128417884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198da710 msgr2=0x55ae198e0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657effd640 1 --2- 172.21.15.69:0/2128417884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198da710 0x55ae198e0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657effd640 1 -- 172.21.15.69:0/2128417884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198d8b80 msgr2=0x55ae198d8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657effd640 1 --2- 172.21.15.69:0/2128417884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198d8b80 0x55ae198d8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657effd640 1 -- 172.21.15.69:0/2128417884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae195502d0 con 0x55ae198d9d50 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657e7fc640 1 --2- 172.21.15.69:0/2128417884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198da710 0x55ae198e0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f6567fff640 1 -- 172.21.15.69:0/795108647 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f65780d07d0 con 0x7f6580102a00 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.886+0000 7f657effd640 1 --2- 172.21.15.69:0/2128417884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198da1d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6570009a20 tx=0x7f6570005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38758524754d6c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f657f7fe640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65680a3c40 0x7f65680a6100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f657809c660 tx=0x7f657806b360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f65657fa640 1 -- 172.21.15.69:0/2128417884 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570040070 con 0x55ae198d9d50 2024-04-23T10:26:19.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f65657fa640 1 -- 172.21.15.69:0/2128417884 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6570004040 con 0x55ae198d9d50 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f65657fa640 1 -- 172.21.15.69:0/2128417884 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570035040 con 0x55ae198d9d50 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f6588074740 1 -- 172.21.15.69:0/2128417884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 msgr2=0x55ae198da1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f6588074740 1 --2- 172.21.15.69:0/2128417884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198da1d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6570009a20 tx=0x7f6570005e80 comp rx=0 tx=0).stop 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f6588074740 1 -- 172.21.15.69:0/2128417884 shutdown_connections 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f6588074740 1 --2- 172.21.15.69:0/2128417884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198da1d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f6588074740 1 --2- 172.21.15.69:0/2128417884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198da710 0x55ae198e0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f6588074740 1 --2- 172.21.15.69:0/2128417884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198d8b80 0x55ae198d8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f6588074740 1 -- 172.21.15.69:0/2128417884 >> 172.21.15.69:0/2128417884 conn(0x55ae198d4070 msgr2=0x55ae198d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f6588074740 1 -- 172.21.15.69:0/2128417884 shutdown_connections 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.887+0000 7f6588074740 1 -- 172.21.15.69:0/2128417884 wait complete. 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f6588074740 1 -- start start 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f6588074740 1 Processor -- start 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f6588074740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d8b80 0x55ae198e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f6588074740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198d9d50 0x55ae198e3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f6588074740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198da710 0x55ae198ea4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f6588074740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ae198e16c0 con 0x55ae198da710 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f6588074740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ae197d8470 con 0x55ae198d9d50 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f6588074740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae198e1840 con 0x55ae198d8b80 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f6588074740 10 client.0 _ll_register_callbacks cb 0x55ae197fdf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f657e7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198da710 0x55ae198ea4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f657e7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198da710 0x55ae198ea4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46504/0 (socket says 172.21.15.69:46504) 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f657e7fc640 1 -- 172.21.15.69:0/1061458688 learned_addr learned my addr 172.21.15.69:0/1061458688 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f657e7fc640 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d8b80 0x55ae198e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f657e7fc640 1 -- 172.21.15.69:0/1061458688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d8b80 msgr2=0x55ae198e2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f657e7fc640 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d8b80 0x55ae198e2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f657e7fc640 1 -- 172.21.15.69:0/1061458688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198d9d50 msgr2=0x55ae198e3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f657e7fc640 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198d9d50 0x55ae198e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f657e7fc640 1 -- 172.21.15.69:0/1061458688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae1961a6b0 con 0x55ae198da710 2024-04-23T10:26:19.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f657e7fc640 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198da710 0x55ae198ea4d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f657400e620 tx=0x7f6574005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1550e6ec8f8e1d61 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f6562ff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.888+0000 7f6562ff5640 1 -- 172.21.15.69:0/1061458688 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574011e80 con 0x55ae198da710 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6562ff5640 1 -- 172.21.15.69:0/1061458688 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f6574005020 con 0x55ae198da710 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6588074740 1 -- 172.21.15.69:0/1061458688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6570004040 con 0x55ae198da710 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6562ff5640 1 -- 172.21.15.69:0/1061458688 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6574027050 con 0x55ae198da710 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6588074740 10 client.15078 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6588074740 1 -- 172.21.15.69:0/1061458688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ae198ed820 con 0x55ae198da710 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6562ff5640 1 -- 172.21.15.69:0/1061458688 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6570004040 con 0x55ae198da710 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6562ff5640 1 -- 172.21.15.69:0/1061458688 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f657400f3c0 con 0x55ae198da710 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6588074740 10 client.15078 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6588074740 10 client.15078 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6588074740 20 client.15078 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6588074740 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55ae198eff20 0x55ae198f1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6588074740 4 client.15078 mds_command: new command op to 24416 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f6588074740 1 -- 172.21.15.69:0/1061458688 --> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae1984b670 con 0x55ae198eff20 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.889+0000 7f657effd640 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55ae198eff20 0x55ae198f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.890+0000 7f6562ff5640 10 client.15078 ms_handle_connect on v2:172.21.15.146:6836/1505523103 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.890+0000 7f657effd640 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55ae198eff20 0x55ae198f1390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=87036b86c7053e69 server_cookie=92aecb87d8afcf51 in_seq=0 out_seq=0 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6562ff5640 1 -- 172.21.15.69:0/1061458688 <== mds.3 v2:172.21.15.146:6836/1505523103 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ae1984b670 con 0x55ae198eff20 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6562ff5640 10 client.15078 handle_command_reply: tid=0 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 1 client.15078 shutdown 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 1 -- 172.21.15.69:0/1061458688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198da710 msgr2=0x55ae198ea4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198da710 0x55ae198ea4d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f657400e620 tx=0x7f6574005b00 comp rx=0 tx=0).stop 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 1 -- 172.21.15.69:0/1061458688 shutdown_connections 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55ae198eff20 0x55ae198f1390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198da710 0x55ae198ea4d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198d9d50 0x55ae198e3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6562ff5640 0 client.15078 ms_handle_reset on v2:172.21.15.146:6836/1505523103 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 1 --2- 172.21.15.69:0/1061458688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d8b80 0x55ae198e2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 1 -- 172.21.15.69:0/1061458688 >> 172.21.15.69:0/1061458688 conn(0x55ae198d4070 msgr2=0x55ae198d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 1 -- 172.21.15.69:0/1061458688 shutdown_connections 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 1 -- 172.21.15.69:0/1061458688 wait complete. 2024-04-23T10:26:19.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.891+0000 7f6588074740 20 client.15078 trim_cache size 0 max 16384 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f6588074740 1 Processor -- start 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f6588074740 1 -- start start 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f6588074740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d8b80 0x55ae198e2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f6588074740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d9d50 0x55ae198ea490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f6588074740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198da710 0x55ae198e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f6588074740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ae198ef6d0 con 0x55ae198d8b80 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f6588074740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ae198efda0 con 0x55ae198da710 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f6588074740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae198f0470 con 0x55ae198d9d50 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f657e7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d8b80 0x55ae198e2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f657e7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d8b80 0x55ae198e2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46518/0 (socket says 172.21.15.69:46518) 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f657e7fc640 1 -- 172.21.15.69:0/1307554306 learned_addr learned my addr 172.21.15.69:0/1307554306 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f657effd640 1 --2- 172.21.15.69:0/1307554306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d9d50 0x55ae198ea490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f657e7fc640 1 --2- 172.21.15.69:0/1307554306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198da710 0x55ae198e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f657e7fc640 1 -- 172.21.15.69:0/1307554306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d9d50 msgr2=0x55ae198ea490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f657e7fc640 1 --2- 172.21.15.69:0/1307554306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d9d50 0x55ae198ea490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f657e7fc640 1 -- 172.21.15.69:0/1307554306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198da710 msgr2=0x55ae198e30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f657e7fc640 1 --2- 172.21.15.69:0/1307554306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198da710 0x55ae198e30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.909+0000 7f657e7fc640 1 -- 172.21.15.69:0/1307554306 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae198dded0 con 0x55ae198d8b80 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f657e7fc640 1 --2- 172.21.15.69:0/1307554306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d8b80 0x55ae198e2b60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f65740059f0 tx=0x7f6574005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61311e0c3abc3ef server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6564ff9640 1 -- 172.21.15.69:0/1307554306 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574011e80 con 0x55ae198d8b80 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6564ff9640 1 -- 172.21.15.69:0/1307554306 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f657400ec30 con 0x55ae198d8b80 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6564ff9640 1 -- 172.21.15.69:0/1307554306 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740035f0 con 0x55ae198d8b80 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6588074740 1 -- 172.21.15.69:0/1307554306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d8b80 msgr2=0x55ae198e2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6588074740 1 --2- 172.21.15.69:0/1307554306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d8b80 0x55ae198e2b60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f65740059f0 tx=0x7f6574005fd0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6588074740 1 -- 172.21.15.69:0/1307554306 shutdown_connections 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6588074740 1 --2- 172.21.15.69:0/1307554306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198da710 0x55ae198e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6588074740 1 --2- 172.21.15.69:0/1307554306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d9d50 0x55ae198ea490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6588074740 1 --2- 172.21.15.69:0/1307554306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d8b80 0x55ae198e2b60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6588074740 1 -- 172.21.15.69:0/1307554306 >> 172.21.15.69:0/1307554306 conn(0x55ae198d4070 msgr2=0x55ae198d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6588074740 1 -- 172.21.15.69:0/1307554306 shutdown_connections 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.910+0000 7f6588074740 1 -- 172.21.15.69:0/1307554306 wait complete. 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6588074740 1 -- start start 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6588074740 1 Processor -- start 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6588074740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d8b80 0x55ae198e56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6588074740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6588074740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198da710 0x55ae198e8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6588074740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ae198f1210 con 0x55ae198d9d50 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6588074740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ae198f0b40 con 0x55ae198da710 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6588074740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae198f18e0 con 0x55ae198d8b80 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6588074740 10 client.0 _ll_register_callbacks cb 0x7f657400ea60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198e5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46526/0 (socket says 172.21.15.69:46526) 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657effd640 1 -- 172.21.15.69:0/775186898 learned_addr learned my addr 172.21.15.69:0/775186898 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:19.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657e7fc640 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d8b80 0x55ae198e56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657e7fc640 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198da710 0x55ae198e8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657effd640 1 -- 172.21.15.69:0/775186898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d8b80 msgr2=0x55ae198e56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657effd640 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d8b80 0x55ae198e56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657effd640 1 -- 172.21.15.69:0/775186898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198da710 msgr2=0x55ae198e8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657effd640 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198da710 0x55ae198e8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657effd640 1 -- 172.21.15.69:0/775186898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae198e91f0 con 0x55ae198d9d50 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657e7fc640 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198da710 0x55ae198e8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f657effd640 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198e5c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f65700099f0 tx=0x7f6570005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe466fce0b96d427 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6562ff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6562ff5640 1 -- 172.21.15.69:0/775186898 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570050070 con 0x55ae198d9d50 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6562ff5640 1 -- 172.21.15.69:0/775186898 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f657004cbc0 con 0x55ae198d9d50 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.911+0000 7f6588074740 1 -- 172.21.15.69:0/775186898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f657400ec30 con 0x55ae198d9d50 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f6562ff5640 1 -- 172.21.15.69:0/775186898 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f657005c050 con 0x55ae198d9d50 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f6588074740 10 client.15084 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:19.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f6588074740 1 -- 172.21.15.69:0/775186898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ae198ea4f0 con 0x55ae198d9d50 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f6562ff5640 1 -- 172.21.15.69:0/775186898 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f657400ec30 con 0x55ae198d9d50 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f6562ff5640 1 -- 172.21.15.69:0/775186898 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f657004c590 con 0x55ae198d9d50 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f6588074740 10 client.15084 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f6588074740 10 client.15084 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f6588074740 20 client.15084 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f6588074740 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55ae1995a1b0 0x55ae19958ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f6588074740 4 client.15084 mds_command: new command op to 24416 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f6588074740 1 -- 172.21.15.69:0/775186898 --> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] -- command(tid 0: {"prefix": "status"}) -- 0x55ae198454e0 con 0x55ae1995a1b0 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.912+0000 7f657e7fc640 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55ae1995a1b0 0x55ae19958ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6562ff5640 10 client.15084 ms_handle_connect on v2:172.21.15.146:6836/1505523103 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f657e7fc640 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55ae1995a1b0 0x55ae19958ec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aeb0906a58f2feaa server_cookie=867a57defa56d8f2 in_seq=0 out_seq=0 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6562ff5640 1 -- 172.21.15.69:0/775186898 <== mds.3 v2:172.21.15.146:6836/1505523103 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ae198454e0 con 0x55ae1995a1b0 2024-04-23T10:26:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6562ff5640 10 client.15084 handle_command_reply: tid=0 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 1 client.15084 shutdown 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 1 -- 172.21.15.69:0/775186898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 msgr2=0x55ae198e5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198e5c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f65700099f0 tx=0x7f6570005e00 comp rx=0 tx=0).stop 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 1 -- 172.21.15.69:0/775186898 shutdown_connections 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55ae1995a1b0 0x55ae19958ec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ae198d9d50 0x55ae198e5c30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ae198da710 0x55ae198e8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6562ff5640 0 client.15084 ms_handle_reset on v2:172.21.15.146:6836/1505523103 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 1 --2- 172.21.15.69:0/775186898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae198d8b80 0x55ae198e56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 1 -- 172.21.15.69:0/775186898 >> 172.21.15.69:0/775186898 conn(0x55ae198d4070 msgr2=0x55ae198e2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 1 -- 172.21.15.69:0/775186898 shutdown_connections 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 1 -- 172.21.15.69:0/775186898 wait complete. 2024-04-23T10:26:19.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f6588074740 20 client.15084 trim_cache size 0 max 16384 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 3, 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24416, 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 82.593624176999995, 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 25, 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 88, 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 86, 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 103.041625721 2024-04-23T10:26:19.920 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:26:19.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f658535d640 1 -- 172.21.15.69:0/795108647 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65680a3c40 msgr2=0x7f65680a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f658535d640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65680a3c40 0x7f65680a6100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f657809c660 tx=0x7f657806b360 comp rx=0 tx=0).stop 2024-04-23T10:26:19.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f658535d640 1 -- 172.21.15.69:0/795108647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6580102a00 msgr2=0x7f658019f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:19.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.913+0000 7f658535d640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6580102a00 0x7f658019f610 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f657800eaa0 tx=0x7f657800ef60 comp rx=0 tx=0).stop 2024-04-23T10:26:19.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.914+0000 7f658535d640 1 -- 172.21.15.69:0/795108647 shutdown_connections 2024-04-23T10:26:19.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.914+0000 7f658535d640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f65680a3c40 0x7f65680a6100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.914+0000 7f658535d640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6580102a00 0x7f658019f610 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.914+0000 7f658535d640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6580102040 0x7f658019cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.914+0000 7f658535d640 1 --2- 172.21.15.69:0/795108647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6580100e60 0x7f658006b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.914+0000 7f658535d640 1 -- 172.21.15.69:0/795108647 >> 172.21.15.69:0/795108647 conn(0x7f65800fc440 msgr2=0x7f65801053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.914+0000 7f658535d640 1 -- 172.21.15.69:0/795108647 shutdown_connections 2024-04-23T10:26:19.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:19.914+0000 7f658535d640 1 -- 172.21.15.69:0/795108647 wait complete. 2024-04-23T10:26:19.923 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-04-23T10:26:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 -- 172.21.15.69:0/830372436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe040102a40 msgr2=0x7fe040109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 --2- 172.21.15.69:0/830372436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe040102a40 0x7fe040109360 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe038009ca0 tx=0x7fe03802a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 -- 172.21.15.69:0/830372436 shutdown_connections 2024-04-23T10:26:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 --2- 172.21.15.69:0/830372436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe040102a40 0x7fe040109360 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 --2- 172.21.15.69:0/830372436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe040102080 0x7fe040102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 --2- 172.21.15.69:0/830372436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040100f30 0x7fe040101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 -- 172.21.15.69:0/830372436 >> 172.21.15.69:0/830372436 conn(0x7fe0400fc4a0 msgr2=0x7fe0400fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 -- 172.21.15.69:0/830372436 shutdown_connections 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 -- 172.21.15.69:0/830372436 wait complete. 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 Processor -- start 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 -- start start 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.023+0000 7fe044bd8640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe040100f30 0x7fe040198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe044bd8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe040102080 0x7fe0401987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe044bd8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040102a40 0x7fe04019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe044bd8640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe04010cbb0 con 0x7fe040100f30 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe044bd8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe04010ca30 con 0x7fe040102a40 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe044bd8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe04010cd30 con 0x7fe040102080 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03e59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe040100f30 0x7fe040198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03e59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe040100f30 0x7fe040198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46542/0 (socket says 172.21.15.69:46542) 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03e59c640 1 -- 172.21.15.69:0/627477487 learned_addr learned my addr 172.21.15.69:0/627477487 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03dd9b640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe040102080 0x7fe0401987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03ed9d640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040102a40 0x7fe04019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03e59c640 1 -- 172.21.15.69:0/627477487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe040102080 msgr2=0x7fe0401987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03e59c640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe040102080 0x7fe0401987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03e59c640 1 -- 172.21.15.69:0/627477487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040102a40 msgr2=0x7fe04019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03e59c640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040102a40 0x7fe04019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03e59c640 1 -- 172.21.15.69:0/627477487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04019fe80 con 0x7fe040100f30 2024-04-23T10:26:20.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03ed9d640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040102a40 0x7fe04019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:20.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe03e59c640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe040100f30 0x7fe040198260 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe03400d950 tx=0x7fe03400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe02f7fe640 1 -- 172.21.15.69:0/627477487 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034017070 con 0x7fe040100f30 2024-04-23T10:26:20.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe02f7fe640 1 -- 172.21.15.69:0/627477487 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe034009c30 con 0x7fe040100f30 2024-04-23T10:26:20.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe044bd8640 1 -- 172.21.15.69:0/627477487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0401a0170 con 0x7fe040100f30 2024-04-23T10:26:20.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe02f7fe640 1 -- 172.21.15.69:0/627477487 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03400f6b0 con 0x7fe040100f30 2024-04-23T10:26:20.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.024+0000 7fe044bd8640 1 -- 172.21.15.69:0/627477487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0401a06c0 con 0x7fe040100f30 2024-04-23T10:26:20.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.027+0000 7fe02f7fe640 1 -- 172.21.15.69:0/627477487 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe0340109c0 con 0x7fe040100f30 2024-04-23T10:26:20.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.027+0000 7fe0479c9740 1 Processor -- start 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.027+0000 7fe0479c9740 1 -- start start 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.027+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adab80 0x564032adafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.027+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032adc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.027+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adc710 0x564032ae2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.027+0000 7fe0479c9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564032a3fc50 con 0x564032adbd50 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.027+0000 7fe0479c9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5640329dc830 con 0x564032adab80 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.027+0000 7fe0479c9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564032a3bc10 con 0x564032adc710 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03e59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032adc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03e59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032adc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46556/0 (socket says 172.21.15.69:46556) 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03e59c640 1 -- 172.21.15.69:0/2493057555 learned_addr learned my addr 172.21.15.69:0/2493057555 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03ed9d640 1 --2- 172.21.15.69:0/2493057555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adab80 0x564032adafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03dd9b640 1 --2- 172.21.15.69:0/2493057555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adc710 0x564032ae2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe02f7fe640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe0280a3c40 0x7fe0280a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03ed9d640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe0280a3c40 0x7fe0280a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03e59c640 1 -- 172.21.15.69:0/2493057555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adc710 msgr2=0x564032ae2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03e59c640 1 --2- 172.21.15.69:0/2493057555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adc710 0x564032ae2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03e59c640 1 -- 172.21.15.69:0/2493057555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adab80 msgr2=0x564032adafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03e59c640 1 --2- 172.21.15.69:0/2493057555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adab80 0x564032adafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03e59c640 1 -- 172.21.15.69:0/2493057555 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640327522d0 con 0x564032adbd50 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe02f7fe640 1 -- 172.21.15.69:0/627477487 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fe0340d0260 con 0x7fe040100f30 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03e59c640 1 --2- 172.21.15.69:0/2493057555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032adc1d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe0340cdb60 tx=0x7fe034010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9588624203b69201 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe03ed9d640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe0280a3c40 0x7fe0280a6100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x564032adbc50 tx=0x7fe03802a8c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe02cff9640 1 -- 172.21.15.69:0/2493057555 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034020030 con 0x564032adbd50 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe02cff9640 1 -- 172.21.15.69:0/2493057555 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe034009de0 con 0x564032adbd50 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.028+0000 7fe02cff9640 1 -- 172.21.15.69:0/2493057555 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0340a5060 con 0x564032adbd50 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.029+0000 7fe0479c9740 1 -- 172.21.15.69:0/2493057555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 msgr2=0x564032adc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.029+0000 7fe0479c9740 1 --2- 172.21.15.69:0/2493057555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032adc1d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe0340cdb60 tx=0x7fe034010d60 comp rx=0 tx=0).stop 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.029+0000 7fe0479c9740 1 -- 172.21.15.69:0/2493057555 shutdown_connections 2024-04-23T10:26:20.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.029+0000 7fe0479c9740 1 --2- 172.21.15.69:0/2493057555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032adc1d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.029+0000 7fe0479c9740 1 --2- 172.21.15.69:0/2493057555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adc710 0x564032ae2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.029+0000 7fe0479c9740 1 --2- 172.21.15.69:0/2493057555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adab80 0x564032adafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.029+0000 7fe0479c9740 1 -- 172.21.15.69:0/2493057555 >> 172.21.15.69:0/2493057555 conn(0x564032ad6070 msgr2=0x564032ad6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.029+0000 7fe0479c9740 1 -- 172.21.15.69:0/2493057555 shutdown_connections 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.029+0000 7fe0479c9740 1 -- 172.21.15.69:0/2493057555 wait complete. 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.029+0000 7fe0479c9740 1 -- start start 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe0479c9740 1 Processor -- start 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adab80 0x564032ae4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032ae5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 0x564032aec550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe0479c9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564032ae3660 con 0x564032adbd50 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe0479c9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5640329da470 con 0x564032adc710 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe0479c9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564032ae37e0 con 0x564032adab80 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe0479c9740 10 client.0 _ll_register_callbacks cb 0x5640329fff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe03dd9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032ae5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe03dd9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032ae5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46562/0 (socket says 172.21.15.69:46562) 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe03dd9b640 1 -- 172.21.15.69:0/1256978298 learned_addr learned my addr 172.21.15.69:0/1256978298 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe03ed9d640 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 0x564032aec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe03e59c640 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adab80 0x564032ae4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe03dd9b640 1 -- 172.21.15.69:0/1256978298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adab80 msgr2=0x564032ae4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe03dd9b640 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adab80 0x564032ae4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe03dd9b640 1 -- 172.21.15.69:0/1256978298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 msgr2=0x564032aec550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe03dd9b640 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 0x564032aec550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe03dd9b640 1 -- 172.21.15.69:0/1256978298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403281c6b0 con 0x564032adbd50 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe03dd9b640 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032ae5510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe0300116d0 tx=0x7fe030011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef694d711714fd60 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe025ffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe025ffb640 1 -- 172.21.15.69:0/1256978298 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03001e060 con 0x564032adbd50 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe025ffb640 1 -- 172.21.15.69:0/1256978298 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fe03000fd50 con 0x564032adbd50 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.030+0000 7fe0479c9740 1 -- 172.21.15.69:0/1256978298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe034009de0 con 0x564032adbd50 2024-04-23T10:26:20.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe025ffb640 1 -- 172.21.15.69:0/1256978298 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe0300193f0 con 0x564032adbd50 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe0479c9740 10 client.15096 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe0479c9740 1 -- 172.21.15.69:0/1256978298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564032aef990 con 0x564032adbd50 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe025ffb640 1 -- 172.21.15.69:0/1256978298 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe034009de0 con 0x564032adbd50 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe025ffb640 1 -- 172.21.15.69:0/1256978298 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe030018030 con 0x564032adbd50 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe0479c9740 10 client.15096 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe0479c9740 10 client.15096 resolve_mds: resolved name 'l' to daemon mds.l 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe0479c9740 20 client.15096 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe0479c9740 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x564032af2090 0x564032af3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe0479c9740 4 client.15096 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe0479c9740 1 -- 172.21.15.69:0/1256978298 --> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564032a4d670 con 0x564032af2090 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.031+0000 7fe03e59c640 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x564032af2090 0x564032af3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.032+0000 7fe03e59c640 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x564032af2090 0x564032af3500 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c2799e90f34f1f3d server_cookie=7e9e0da77ab186e in_seq=0 out_seq=0 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.032+0000 7fe025ffb640 10 client.15096 ms_handle_connect on v2:172.21.15.167:6832/977410598 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.032+0000 7fe025ffb640 1 -- 172.21.15.69:0/1256978298 <== mds.2 v2:172.21.15.167:6832/977410598 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564032a4d670 con 0x564032af2090 2024-04-23T10:26:20.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.032+0000 7fe025ffb640 10 client.15096 handle_command_reply: tid=0 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.032+0000 7fe0479c9740 1 client.15096 shutdown 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe0479c9740 1 -- 172.21.15.69:0/1256978298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 msgr2=0x564032ae5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe0479c9740 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032ae5510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe0300116d0 tx=0x7fe030011b90 comp rx=0 tx=0).stop 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe0479c9740 1 -- 172.21.15.69:0/1256978298 shutdown_connections 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe0479c9740 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x564032af2090 0x564032af3500 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe0479c9740 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adbd50 0x564032ae5510 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe0479c9740 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 0x564032aec550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe025ffb640 0 client.15096 ms_handle_reset on v2:172.21.15.167:6832/977410598 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe0479c9740 1 --2- 172.21.15.69:0/1256978298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adab80 0x564032ae4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe0479c9740 1 -- 172.21.15.69:0/1256978298 >> 172.21.15.69:0/1256978298 conn(0x564032ad6070 msgr2=0x564032ad51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe0479c9740 1 -- 172.21.15.69:0/1256978298 shutdown_connections 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe0479c9740 1 -- 172.21.15.69:0/1256978298 wait complete. 2024-04-23T10:26:20.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.033+0000 7fe0479c9740 20 client.15096 trim_cache size 0 max 16384 2024-04-23T10:26:20.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.050+0000 7fe0479c9740 1 Processor -- start 2024-04-23T10:26:20.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.050+0000 7fe0479c9740 1 -- start start 2024-04-23T10:26:20.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ad10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adbd50 0x564032aec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 0x564032adf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe0479c9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564032af1840 con 0x564032adab80 2024-04-23T10:26:20.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe0479c9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564032af1f10 con 0x564032adc710 2024-04-23T10:26:20.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe0479c9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564032af25e0 con 0x564032adbd50 2024-04-23T10:26:20.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe03e59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ad10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe03e59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ad10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46578/0 (socket says 172.21.15.69:46578) 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe03e59c640 1 -- 172.21.15.69:0/2735851175 learned_addr learned my addr 172.21.15.69:0/2735851175 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe03e59c640 1 -- 172.21.15.69:0/2735851175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adbd50 msgr2=0x564032aec510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe03e59c640 1 --2- 172.21.15.69:0/2735851175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adbd50 0x564032aec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe03e59c640 1 -- 172.21.15.69:0/2735851175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 msgr2=0x564032adf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe03e59c640 1 --2- 172.21.15.69:0/2735851175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 0x564032adf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe03e59c640 1 -- 172.21.15.69:0/2735851175 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564032ada790 con 0x564032adab80 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe03e59c640 1 --2- 172.21.15.69:0/2735851175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ad10b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe0340cdca0 tx=0x7fe034098030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc25388feeb7de66 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe027fff640 1 -- 172.21.15.69:0/2735851175 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034020040 con 0x564032adab80 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe027fff640 1 -- 172.21.15.69:0/2735851175 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe03409caf0 con 0x564032adab80 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.051+0000 7fe027fff640 1 -- 172.21.15.69:0/2735851175 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034098a60 con 0x564032adab80 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 -- 172.21.15.69:0/2735851175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 msgr2=0x564032ad10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 --2- 172.21.15.69:0/2735851175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ad10b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe0340cdca0 tx=0x7fe034098030 comp rx=0 tx=0).stop 2024-04-23T10:26:20.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 -- 172.21.15.69:0/2735851175 shutdown_connections 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 --2- 172.21.15.69:0/2735851175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 0x564032adf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 --2- 172.21.15.69:0/2735851175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adbd50 0x564032aec510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 --2- 172.21.15.69:0/2735851175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ad10b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 -- 172.21.15.69:0/2735851175 >> 172.21.15.69:0/2735851175 conn(0x564032ad6070 msgr2=0x564032ad6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 -- 172.21.15.69:0/2735851175 shutdown_connections 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 -- 172.21.15.69:0/2735851175 wait complete. 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 -- start start 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 Processor -- start 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ae76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adbd50 0x564032ae7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 0x564032aeaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564032af3380 con 0x564032adab80 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564032af2cb0 con 0x564032adc710 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564032af3a50 con 0x564032adbd50 2024-04-23T10:26:20.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe0479c9740 10 client.0 _ll_register_callbacks cb 0x7fe030005be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe03e59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ae76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe03e59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ae76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46580/0 (socket says 172.21.15.69:46580) 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.052+0000 7fe03e59c640 1 -- 172.21.15.69:0/637199787 learned_addr learned my addr 172.21.15.69:0/637199787 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe03e59c640 1 -- 172.21.15.69:0/637199787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adbd50 msgr2=0x564032ae7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe03e59c640 1 --2- 172.21.15.69:0/637199787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adbd50 0x564032ae7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe03e59c640 1 -- 172.21.15.69:0/637199787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 msgr2=0x564032aeaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe03e59c640 1 --2- 172.21.15.69:0/637199787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 0x564032aeaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe03e59c640 1 -- 172.21.15.69:0/637199787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564032aeb190 con 0x564032adab80 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe03e59c640 1 --2- 172.21.15.69:0/637199787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ae76b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe03409c0f0 tx=0x7fe034010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd3161f63574652 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe025ffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe025ffb640 1 -- 172.21.15.69:0/637199787 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034020070 con 0x564032adab80 2024-04-23T10:26:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe025ffb640 1 -- 172.21.15.69:0/637199787 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fe0340d3c00 con 0x564032adab80 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe0479c9740 1 -- 172.21.15.69:0/637199787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe03409caf0 con 0x564032adab80 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe025ffb640 1 -- 172.21.15.69:0/637199787 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe0340a5060 con 0x564032adab80 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe0479c9740 10 client.15102 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe0479c9740 1 -- 172.21.15.69:0/637199787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564032aec490 con 0x564032adab80 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe025ffb640 1 -- 172.21.15.69:0/637199787 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe03409caf0 con 0x564032adab80 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe025ffb640 1 -- 172.21.15.69:0/637199787 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe034010580 con 0x564032adab80 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe0479c9740 10 client.15102 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe0479c9740 10 client.15102 resolve_mds: resolved name 'l' to daemon mds.l 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe0479c9740 20 client.15102 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe0479c9740 1 --2- 172.21.15.69:0/637199787 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x564032b5c030 0x564032b5ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe0479c9740 4 client.15102 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.053+0000 7fe0479c9740 1 -- 172.21.15.69:0/637199787 --> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] -- command(tid 0: {"prefix": "status"}) -- 0x564032a474e0 con 0x564032b5c030 2024-04-23T10:26:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe03dd9b640 1 --2- 172.21.15.69:0/637199787 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x564032b5c030 0x564032b5ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe025ffb640 10 client.15102 ms_handle_connect on v2:172.21.15.167:6832/977410598 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe03dd9b640 1 --2- 172.21.15.69:0/637199787 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x564032b5c030 0x564032b5ad40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=34ea4d63315502d7 server_cookie=7ada8152d358a141 in_seq=0 out_seq=0 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe025ffb640 1 -- 172.21.15.69:0/637199787 <== mds.2 v2:172.21.15.167:6832/977410598 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564032a474e0 con 0x564032b5c030 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe025ffb640 10 client.15102 handle_command_reply: tid=0 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 1 client.15102 shutdown 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 1 -- 172.21.15.69:0/637199787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 msgr2=0x564032ae76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 1 --2- 172.21.15.69:0/637199787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ae76b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe03409c0f0 tx=0x7fe034010cb0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 1 -- 172.21.15.69:0/637199787 shutdown_connections 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 1 --2- 172.21.15.69:0/637199787 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x564032b5c030 0x564032b5ad40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 1 --2- 172.21.15.69:0/637199787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564032adc710 0x564032aeaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 1 --2- 172.21.15.69:0/637199787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564032adbd50 0x564032ae7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe025ffb640 0 client.15102 ms_handle_reset on v2:172.21.15.167:6832/977410598 2024-04-23T10:26:20.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 1 --2- 172.21.15.69:0/637199787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564032adab80 0x564032ae76b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 1 -- 172.21.15.69:0/637199787 >> 172.21.15.69:0/637199787 conn(0x564032ad6070 msgr2=0x564032ad6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 1 -- 172.21.15.69:0/637199787 shutdown_connections 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 1 -- 172.21.15.69:0/637199787 wait complete. 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.054+0000 7fe0479c9740 20 client.15102 trim_cache size 0 max 16384 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 2, 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24421, 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:26:20.062 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 83.739167762999998, 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 25, 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 88, 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 86, 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 123.111646952 2024-04-23T10:26:20.063 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 -- 172.21.15.69:0/627477487 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe0280a3c40 msgr2=0x7fe0280a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe0280a3c40 0x7fe0280a6100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x564032adbc50 tx=0x7fe03802a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 -- 172.21.15.69:0/627477487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe040100f30 msgr2=0x7fe040198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe040100f30 0x7fe040198260 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe03400d950 tx=0x7fe03400de10 comp rx=0 tx=0).stop 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 -- 172.21.15.69:0/627477487 shutdown_connections 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fe0280a3c40 0x7fe0280a6100 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe040102a40 0x7fe04019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe040102080 0x7fe0401987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 --2- 172.21.15.69:0/627477487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe040100f30 0x7fe040198260 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 -- 172.21.15.69:0/627477487 >> 172.21.15.69:0/627477487 conn(0x7fe0400fc4a0 msgr2=0x7fe0400fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 -- 172.21.15.69:0/627477487 shutdown_connections 2024-04-23T10:26:20.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.055+0000 7fe044bd8640 1 -- 172.21.15.69:0/627477487 wait complete. 2024-04-23T10:26:20.065 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-23T10:26:20.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.165+0000 7fc27ce31640 1 -- 172.21.15.69:0/1799866151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc278102a40 msgr2=0x7fc278109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.165+0000 7fc27ce31640 1 --2- 172.21.15.69:0/1799866151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc278102a40 0x7fc278109360 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc268009ca0 tx=0x7fc26802a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.165+0000 7fc27ce31640 1 -- 172.21.15.69:0/1799866151 shutdown_connections 2024-04-23T10:26:20.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.165+0000 7fc27ce31640 1 --2- 172.21.15.69:0/1799866151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc278102a40 0x7fc278109360 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.165+0000 7fc27ce31640 1 --2- 172.21.15.69:0/1799866151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc278102080 0x7fc278102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.165+0000 7fc27ce31640 1 --2- 172.21.15.69:0/1799866151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc278100f30 0x7fc278101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.165+0000 7fc27ce31640 1 -- 172.21.15.69:0/1799866151 >> 172.21.15.69:0/1799866151 conn(0x7fc2780fc4a0 msgr2=0x7fc2780fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.165+0000 7fc27ce31640 1 -- 172.21.15.69:0/1799866151 shutdown_connections 2024-04-23T10:26:20.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.165+0000 7fc27ce31640 1 -- 172.21.15.69:0/1799866151 wait complete. 2024-04-23T10:26:20.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc27ce31640 1 Processor -- start 2024-04-23T10:26:20.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc27ce31640 1 -- start start 2024-04-23T10:26:20.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc27ce31640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc278100f30 0x7fc2781971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc27ce31640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc278102080 0x7fc2781976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc27ce31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc278102a40 0x7fc27819e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc27ce31640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc27810cbd0 con 0x7fc278102080 2024-04-23T10:26:20.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc27ce31640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc27810ca50 con 0x7fc278100f30 2024-04-23T10:26:20.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc27ce31640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc27810cd50 con 0x7fc278102a40 2024-04-23T10:26:20.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc275d9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc278102080 0x7fc2781976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc275d9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc278102080 0x7fc2781976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46602/0 (socket says 172.21.15.69:46602) 2024-04-23T10:26:20.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc275d9b640 1 -- 172.21.15.69:0/3056038200 learned_addr learned my addr 172.21.15.69:0/3056038200 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc276d9d640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc278102a40 0x7fc27819e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc27659c640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc278100f30 0x7fc2781971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc275d9b640 1 -- 172.21.15.69:0/3056038200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc278102a40 msgr2=0x7fc27819e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc275d9b640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc278102a40 0x7fc27819e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc275d9b640 1 -- 172.21.15.69:0/3056038200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc278100f30 msgr2=0x7fc2781971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc275d9b640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc278100f30 0x7fc2781971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc275d9b640 1 -- 172.21.15.69:0/3056038200 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27819edd0 con 0x7fc278102080 2024-04-23T10:26:20.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc276d9d640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc278102a40 0x7fc27819e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:20.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc275d9b640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc278102080 0x7fc2781976f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc26000d950 tx=0x7fc26000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc26f7fe640 1 -- 172.21.15.69:0/3056038200 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260017070 con 0x7fc278102080 2024-04-23T10:26:20.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc26f7fe640 1 -- 172.21.15.69:0/3056038200 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc260009c30 con 0x7fc278102080 2024-04-23T10:26:20.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc27ce31640 1 -- 172.21.15.69:0/3056038200 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27819f0c0 con 0x7fc278102080 2024-04-23T10:26:20.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.166+0000 7fc26f7fe640 1 -- 172.21.15.69:0/3056038200 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26000f620 con 0x7fc278102080 2024-04-23T10:26:20.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.167+0000 7fc27ce31640 1 -- 172.21.15.69:0/3056038200 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27819f5c0 con 0x7fc278102080 2024-04-23T10:26:20.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.169+0000 7fc26f7fe640 1 -- 172.21.15.69:0/3056038200 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc26001a070 con 0x7fc278102080 2024-04-23T10:26:20.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.169+0000 7fc27fc23740 1 Processor -- start 2024-04-23T10:26:20.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.169+0000 7fc27fc23740 1 -- start start 2024-04-23T10:26:20.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.169+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c17d90 0x556426c181b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.169+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c18f60 0x556426c193e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.169+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c19920 0x556426c201b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.169+0000 7fc27fc23740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556426b7ac50 con 0x556426c17d90 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.169+0000 7fc27fc23740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556426b17830 con 0x556426c19920 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.169+0000 7fc27fc23740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556426b76c10 con 0x556426c18f60 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.169+0000 7fc26f7fe640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc2640a3c40 0x7fc2640a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc276d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c17d90 0x556426c181b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc275d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c19920 0x556426c201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc276d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c17d90 0x556426c181b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46606/0 (socket says 172.21.15.69:46606) 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc276d9d640 1 -- 172.21.15.69:0/308862763 learned_addr learned my addr 172.21.15.69:0/308862763 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc276d9d640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc2640a3c40 0x7fc2640a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc27659c640 1 --2- 172.21.15.69:0/308862763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c18f60 0x556426c193e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc26f7fe640 1 -- 172.21.15.69:0/3056038200 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fc2600cffa0 con 0x7fc278102080 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc276d9d640 1 -- 172.21.15.69:0/308862763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c18f60 msgr2=0x556426c193e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc276d9d640 1 --2- 172.21.15.69:0/308862763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c18f60 0x556426c193e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc276d9d640 1 -- 172.21.15.69:0/308862763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c19920 msgr2=0x556426c201b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc276d9d640 1 --2- 172.21.15.69:0/308862763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c19920 0x556426c201b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc276d9d640 1 -- 172.21.15.69:0/308862763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55642688d2d0 con 0x556426c17d90 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc276d9d640 1 --2- 172.21.15.69:0/308862763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c17d90 0x556426c181b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc268009430 tx=0x7fc268031600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7b3f41b9017915 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc276d9d640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc2640a3c40 0x7fc2640a6100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc268005e30 tx=0x7fc268043000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc26cff9640 1 -- 172.21.15.69:0/308862763 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26804e070 con 0x556426c17d90 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc26cff9640 1 -- 172.21.15.69:0/308862763 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc268036040 con 0x556426c17d90 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.170+0000 7fc26cff9640 1 -- 172.21.15.69:0/308862763 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26802fa00 con 0x556426c17d90 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.171+0000 7fc27fc23740 1 -- 172.21.15.69:0/308862763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c17d90 msgr2=0x556426c181b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.171+0000 7fc27fc23740 1 --2- 172.21.15.69:0/308862763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c17d90 0x556426c181b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc268009430 tx=0x7fc268031600 comp rx=0 tx=0).stop 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.171+0000 7fc27fc23740 1 -- 172.21.15.69:0/308862763 shutdown_connections 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.171+0000 7fc27fc23740 1 --2- 172.21.15.69:0/308862763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c19920 0x556426c201b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.171+0000 7fc27fc23740 1 --2- 172.21.15.69:0/308862763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c18f60 0x556426c193e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.171+0000 7fc27fc23740 1 --2- 172.21.15.69:0/308862763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c17d90 0x556426c181b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.171+0000 7fc27fc23740 1 -- 172.21.15.69:0/308862763 >> 172.21.15.69:0/308862763 conn(0x556426c11070 msgr2=0x556426c11470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.171+0000 7fc27fc23740 1 -- 172.21.15.69:0/308862763 shutdown_connections 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.171+0000 7fc27fc23740 1 -- 172.21.15.69:0/308862763 wait complete. 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.171+0000 7fc27fc23740 1 -- start start 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.171+0000 7fc27fc23740 1 Processor -- start 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c17d90 0x556426c22240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c18f60 0x556426c22780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c297c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc27fc23740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556426c208d0 con 0x556426c19920 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc27fc23740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556426b15470 con 0x556426c17d90 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc27fc23740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556426c20a50 con 0x556426c18f60 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc27fc23740 10 client.0 _ll_register_callbacks cb 0x556426b3af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc276d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c297c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc276d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c297c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46608/0 (socket says 172.21.15.69:46608) 2024-04-23T10:26:20.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc276d9d640 1 -- 172.21.15.69:0/122461263 learned_addr learned my addr 172.21.15.69:0/122461263 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc275d9b640 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c18f60 0x556426c22780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc276d9d640 1 -- 172.21.15.69:0/122461263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c18f60 msgr2=0x556426c22780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc276d9d640 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c18f60 0x556426c22780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc276d9d640 1 -- 172.21.15.69:0/122461263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c17d90 msgr2=0x556426c22240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc276d9d640 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c17d90 0x556426c22240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc276d9d640 1 -- 172.21.15.69:0/122461263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564269576b0 con 0x556426c19920 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc276d9d640 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c297c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc268031a70 tx=0x7fc268004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9ed8eec4f073da server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc25dffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc25dffb640 1 -- 172.21.15.69:0/122461263 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26804e040 con 0x556426c19920 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc25dffb640 1 -- 172.21.15.69:0/122461263 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fc26802f740 con 0x556426c19920 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc27fc23740 1 -- 172.21.15.69:0/122461263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc268036040 con 0x556426c19920 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc25dffb640 1 -- 172.21.15.69:0/122461263 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc26802f940 con 0x556426c19920 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc27fc23740 10 client.15114 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.172+0000 7fc27fc23740 1 -- 172.21.15.69:0/122461263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556426c208d0 con 0x556426c19920 2024-04-23T10:26:20.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.173+0000 7fc25dffb640 1 -- 172.21.15.69:0/122461263 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc268036040 con 0x556426c19920 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.173+0000 7fc25dffb640 1 -- 172.21.15.69:0/122461263 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc268030c90 con 0x556426c19920 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.173+0000 7fc27fc23740 10 client.15114 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.173+0000 7fc27fc23740 10 client.15114 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.173+0000 7fc27fc23740 20 client.15114 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.173+0000 7fc27fc23740 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x556426c2edb0 0x556426c30220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.173+0000 7fc27fc23740 4 client.15114 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.173+0000 7fc27fc23740 1 -- 172.21.15.69:0/122461263 --> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556426b88670 con 0x556426c2edb0 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.173+0000 7fc27659c640 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x556426c2edb0 0x556426c30220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.174+0000 7fc27659c640 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x556426c2edb0 0x556426c30220 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=666ce0f252968d42 server_cookie=fcd7c4fe8031028e in_seq=0 out_seq=0 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.174+0000 7fc25dffb640 10 client.15114 ms_handle_connect on v2:172.21.15.167:6836/1671189160 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.174+0000 7fc25dffb640 1 -- 172.21.15.69:0/122461263 <== mds.1 v2:172.21.15.167:6836/1671189160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556426b88670 con 0x556426c2edb0 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.174+0000 7fc25dffb640 10 client.15114 handle_command_reply: tid=0 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.174+0000 7fc27fc23740 1 client.15114 shutdown 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc27fc23740 1 -- 172.21.15.69:0/122461263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 msgr2=0x556426c297c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc27fc23740 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c297c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc268031a70 tx=0x7fc268004640 comp rx=0 tx=0).stop 2024-04-23T10:26:20.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc27fc23740 1 -- 172.21.15.69:0/122461263 shutdown_connections 2024-04-23T10:26:20.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc27fc23740 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x556426c2edb0 0x556426c30220 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc27fc23740 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c297c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc25dffb640 0 client.15114 ms_handle_reset on v2:172.21.15.167:6836/1671189160 2024-04-23T10:26:20.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc27fc23740 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c18f60 0x556426c22780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc27fc23740 1 --2- 172.21.15.69:0/122461263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c17d90 0x556426c22240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc27fc23740 1 -- 172.21.15.69:0/122461263 >> 172.21.15.69:0/122461263 conn(0x556426c11070 msgr2=0x556426c101d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc27fc23740 1 -- 172.21.15.69:0/122461263 shutdown_connections 2024-04-23T10:26:20.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc27fc23740 1 -- 172.21.15.69:0/122461263 wait complete. 2024-04-23T10:26:20.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.175+0000 7fc27fc23740 20 client.15114 trim_cache size 0 max 16384 2024-04-23T10:26:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.192+0000 7fc27fc23740 1 Processor -- start 2024-04-23T10:26:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc27fc23740 1 -- start start 2024-04-23T10:26:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c17d90 0x556426c0c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c18f60 0x556426c29780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc27fc23740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556426c2e560 con 0x556426c19920 2024-04-23T10:26:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc27fc23740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556426c2ec30 con 0x556426c18f60 2024-04-23T10:26:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc27fc23740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556426c2f300 con 0x556426c17d90 2024-04-23T10:26:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc276d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc276d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46610/0 (socket says 172.21.15.69:46610) 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc276d9d640 1 -- 172.21.15.69:0/708498629 learned_addr learned my addr 172.21.15.69:0/708498629 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc276d9d640 1 -- 172.21.15.69:0/708498629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c17d90 msgr2=0x556426c0c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc276d9d640 1 --2- 172.21.15.69:0/708498629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c17d90 0x556426c0c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc276d9d640 1 -- 172.21.15.69:0/708498629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c18f60 msgr2=0x556426c29780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc276d9d640 1 --2- 172.21.15.69:0/708498629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c18f60 0x556426c29780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc276d9d640 1 -- 172.21.15.69:0/708498629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556426c11d40 con 0x556426c19920 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc276d9d640 1 --2- 172.21.15.69:0/708498629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1cb10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc26802ade0 tx=0x7fc2680095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc978b2b5008efd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc25ffff640 1 -- 172.21.15.69:0/708498629 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26804e070 con 0x556426c19920 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc25ffff640 1 -- 172.21.15.69:0/708498629 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc268036070 con 0x556426c19920 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.193+0000 7fc25ffff640 1 -- 172.21.15.69:0/708498629 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268053ad0 con 0x556426c19920 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 -- 172.21.15.69:0/708498629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 msgr2=0x556426c1cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 --2- 172.21.15.69:0/708498629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1cb10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc26802ade0 tx=0x7fc2680095d0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 -- 172.21.15.69:0/708498629 shutdown_connections 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 --2- 172.21.15.69:0/708498629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1cb10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 --2- 172.21.15.69:0/708498629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c18f60 0x556426c29780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 --2- 172.21.15.69:0/708498629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c17d90 0x556426c0c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 -- 172.21.15.69:0/708498629 >> 172.21.15.69:0/708498629 conn(0x556426c11070 msgr2=0x556426c20df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 -- 172.21.15.69:0/708498629 shutdown_connections 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 -- 172.21.15.69:0/708498629 wait complete. 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 -- start start 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 Processor -- start 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c17d90 0x556426c1dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c18f60 0x556426c296e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556426c300a0 con 0x556426c19920 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556426c2f9d0 con 0x556426c18f60 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556426c30770 con 0x556426c17d90 2024-04-23T10:26:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.194+0000 7fc27fc23740 10 client.0 _ll_register_callbacks cb 0x7fc2600983d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc276d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc276d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46612/0 (socket says 172.21.15.69:46612) 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc276d9d640 1 -- 172.21.15.69:0/610381627 learned_addr learned my addr 172.21.15.69:0/610381627 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc276d9d640 1 -- 172.21.15.69:0/610381627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c17d90 msgr2=0x556426c1dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc275d9b640 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c18f60 0x556426c296e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc276d9d640 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c17d90 0x556426c1dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc276d9d640 1 -- 172.21.15.69:0/610381627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c18f60 msgr2=0x556426c296e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc276d9d640 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c18f60 0x556426c296e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc276d9d640 1 -- 172.21.15.69:0/610381627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556426c1e820 con 0x556426c19920 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc276d9d640 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1dff0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc268031a70 tx=0x7fc268009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5563d87946a41dcf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc25dffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc25dffb640 1 -- 172.21.15.69:0/610381627 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26806d060 con 0x556426c19920 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc25dffb640 1 -- 172.21.15.69:0/610381627 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fc268053c80 con 0x556426c19920 2024-04-23T10:26:20.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc27fc23740 1 -- 172.21.15.69:0/610381627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc268036070 con 0x556426c19920 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc25dffb640 1 -- 172.21.15.69:0/610381627 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc26804e040 con 0x556426c19920 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc27fc23740 10 client.15120 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc27fc23740 1 -- 172.21.15.69:0/610381627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556426c94d60 con 0x556426c19920 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc25dffb640 1 -- 172.21.15.69:0/610381627 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc268036070 con 0x556426c19920 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc25dffb640 1 -- 172.21.15.69:0/610381627 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc268030c20 con 0x556426c19920 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc27fc23740 10 client.15120 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc27fc23740 10 client.15120 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc27fc23740 20 client.15120 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.195+0000 7fc27fc23740 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x556426c993d0 0x556426c980e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.196+0000 7fc27fc23740 4 client.15120 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.196+0000 7fc27fc23740 1 -- 172.21.15.69:0/610381627 --> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] -- command(tid 0: {"prefix": "status"}) -- 0x556426b824e0 con 0x556426c993d0 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.196+0000 7fc27659c640 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x556426c993d0 0x556426c980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.196+0000 7fc25dffb640 10 client.15120 ms_handle_connect on v2:172.21.15.167:6836/1671189160 2024-04-23T10:26:20.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.196+0000 7fc27659c640 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x556426c993d0 0x556426c980e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f7723b06fb3f409 server_cookie=2fe0bdc8581529de in_seq=0 out_seq=0 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.196+0000 7fc25dffb640 1 -- 172.21.15.69:0/610381627 <== mds.1 v2:172.21.15.167:6836/1671189160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x556426b824e0 con 0x556426c993d0 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.196+0000 7fc25dffb640 10 client.15120 handle_command_reply: tid=0 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.196+0000 7fc27fc23740 1 client.15120 shutdown 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27fc23740 1 -- 172.21.15.69:0/610381627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 msgr2=0x556426c1dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27fc23740 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1dff0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc268031a70 tx=0x7fc268009540 comp rx=0 tx=0).stop 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27fc23740 1 -- 172.21.15.69:0/610381627 shutdown_connections 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27fc23740 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x556426c993d0 0x556426c980e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27fc23740 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556426c19920 0x556426c1dff0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc25dffb640 0 client.15120 ms_handle_reset on v2:172.21.15.167:6836/1671189160 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27fc23740 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556426c18f60 0x556426c296e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27fc23740 1 --2- 172.21.15.69:0/610381627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556426c17d90 0x556426c1dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27fc23740 1 -- 172.21.15.69:0/610381627 >> 172.21.15.69:0/610381627 conn(0x556426c11070 msgr2=0x556426c1cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27fc23740 1 -- 172.21.15.69:0/610381627 shutdown_connections 2024-04-23T10:26:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27fc23740 1 -- 172.21.15.69:0/610381627 wait complete. 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27fc23740 20 client.15120 trim_cache size 0 max 16384 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 1, 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24463, 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 84.360467856, 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 25, 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 88, 2024-04-23T10:26:20.203 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 86, 2024-04-23T10:26:20.204 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 106.056070754 2024-04-23T10:26:20.204 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:26:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 -- 172.21.15.69:0/3056038200 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc2640a3c40 msgr2=0x7fc2640a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc2640a3c40 0x7fc2640a6100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc268005e30 tx=0x7fc268043000 comp rx=0 tx=0).stop 2024-04-23T10:26:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 -- 172.21.15.69:0/3056038200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc278102080 msgr2=0x7fc2781976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc278102080 0x7fc2781976f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc26000d950 tx=0x7fc26000de10 comp rx=0 tx=0).stop 2024-04-23T10:26:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 -- 172.21.15.69:0/3056038200 shutdown_connections 2024-04-23T10:26:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc2640a3c40 0x7fc2640a6100 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc278102080 0x7fc2781976f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc278102a40 0x7fc27819e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 --2- 172.21.15.69:0/3056038200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc278100f30 0x7fc2781971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 -- 172.21.15.69:0/3056038200 >> 172.21.15.69:0/3056038200 conn(0x7fc2780fc4a0 msgr2=0x7fc2781053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 -- 172.21.15.69:0/3056038200 shutdown_connections 2024-04-23T10:26:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.197+0000 7fc27ce31640 1 -- 172.21.15.69:0/3056038200 wait complete. 2024-04-23T10:26:20.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:20 smithi069 ceph-mon[29593]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:20.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:20 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2664771534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:20.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:20 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1920121370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:20.207 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-23T10:26:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.306+0000 7f342e0e1640 1 -- 172.21.15.69:0/1094552759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34281029a0 msgr2=0x7f34281092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.306+0000 7f342e0e1640 1 --2- 172.21.15.69:0/1094552759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34281029a0 0x7f34281092c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3420009ca0 tx=0x7f342002a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.306+0000 7f342e0e1640 1 -- 172.21.15.69:0/1094552759 shutdown_connections 2024-04-23T10:26:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.306+0000 7f342e0e1640 1 --2- 172.21.15.69:0/1094552759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34281029a0 0x7f34281092c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.306+0000 7f342e0e1640 1 --2- 172.21.15.69:0/1094552759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3428101fe0 0x7f3428102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 --2- 172.21.15.69:0/1094552759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3428100e90 0x7f34281012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 -- 172.21.15.69:0/1094552759 >> 172.21.15.69:0/1094552759 conn(0x7f34280fc400 msgr2=0x7f34280fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 -- 172.21.15.69:0/1094552759 shutdown_connections 2024-04-23T10:26:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 -- 172.21.15.69:0/1094552759 wait complete. 2024-04-23T10:26:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 Processor -- start 2024-04-23T10:26:20.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 -- start start 2024-04-23T10:26:20.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3428100e90 0x7f3428069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3428101fe0 0x7f342819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34281029a0 0x7f342819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f342810cb10 con 0x7f3428100e90 2024-04-23T10:26:20.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f342810c990 con 0x7f34281029a0 2024-04-23T10:26:20.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f342e0e1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f342810cc90 con 0x7f3428101fe0 2024-04-23T10:26:20.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f34277fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3428100e90 0x7f3428069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f34277fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3428100e90 0x7f3428069c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46626/0 (socket says 172.21.15.69:46626) 2024-04-23T10:26:20.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f34277fe640 1 -- 172.21.15.69:0/3318255327 learned_addr learned my addr 172.21.15.69:0/3318255327 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.307+0000 7f341ffff640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3428101fe0 0x7f342819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f3427fff640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34281029a0 0x7f342819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f34277fe640 1 -- 172.21.15.69:0/3318255327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3428101fe0 msgr2=0x7f342819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f34277fe640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3428101fe0 0x7f342819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f34277fe640 1 -- 172.21.15.69:0/3318255327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34281029a0 msgr2=0x7f342819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f34277fe640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34281029a0 0x7f342819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f34277fe640 1 -- 172.21.15.69:0/3318255327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342819fe70 con 0x7f3428100e90 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f3427fff640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34281029a0 0x7f342819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f34277fe640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3428100e90 0x7f3428069c50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f341800d950 tx=0x7f341800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f34257fa640 1 -- 172.21.15.69:0/3318255327 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418017030 con 0x7f3428100e90 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f34257fa640 1 -- 172.21.15.69:0/3318255327 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3418004020 con 0x7f3428100e90 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f342e0e1640 1 -- 172.21.15.69:0/3318255327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34281a0100 con 0x7f3428100e90 2024-04-23T10:26:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f34257fa640 1 -- 172.21.15.69:0/3318255327 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34180047a0 con 0x7f3428100e90 2024-04-23T10:26:20.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.308+0000 7f342e0e1640 1 -- 172.21.15.69:0/3318255327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34281a0650 con 0x7f3428100e90 2024-04-23T10:26:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.310+0000 7f34257fa640 1 -- 172.21.15.69:0/3318255327 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f34180041d0 con 0x7f3428100e90 2024-04-23T10:26:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.310+0000 7f3430df9740 1 Processor -- start 2024-04-23T10:26:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.310+0000 7f3430df9740 1 -- start start 2024-04-23T10:26:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f34257fa640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34140a3c40 0x7f34140a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f3430df9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cdcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f3430df9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24cde1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f3430df9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ce4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f3430df9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555c24c41c50 con 0x555c24cdcb80 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f3430df9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555c24bde830 con 0x555c24cde710 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f3430df9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555c24c3dc10 con 0x555c24cddd50 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f3427fff640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34140a3c40 0x7f34140a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f34277fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cdcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f34257fa640 1 -- 172.21.15.69:0/3318255327 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f34180d00b0 con 0x7f3428100e90 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f34277fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cdcfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46640/0 (socket says 172.21.15.69:46640) 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f34277fe640 1 -- 172.21.15.69:0/529504665 learned_addr learned my addr 172.21.15.69:0/529504665 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f3427fff640 1 --2- 172.21.15.69:0/529504665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ce4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f341ffff640 1 --2- 172.21.15.69:0/529504665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24cde1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f34277fe640 1 -- 172.21.15.69:0/529504665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 msgr2=0x555c24cde1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f34277fe640 1 --2- 172.21.15.69:0/529504665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24cde1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f34277fe640 1 -- 172.21.15.69:0/529504665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 msgr2=0x555c24ce4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f34277fe640 1 --2- 172.21.15.69:0/529504665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ce4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f34277fe640 1 -- 172.21.15.69:0/529504665 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c249542d0 con 0x555c24cdcb80 2024-04-23T10:26:20.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f3427fff640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34140a3c40 0x7f34140a6100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3420009ca0 tx=0x7f3420031450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f34277fe640 1 --2- 172.21.15.69:0/529504665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cdcfa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3418000c00 tx=0x7f341809c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bc9a6da38affff server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f341dffb640 1 -- 172.21.15.69:0/529504665 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341809c940 con 0x555c24cdcb80 2024-04-23T10:26:20.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f341dffb640 1 -- 172.21.15.69:0/529504665 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f341809c240 con 0x555c24cdcb80 2024-04-23T10:26:20.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.311+0000 7f341dffb640 1 -- 172.21.15.69:0/529504665 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34180988b0 con 0x555c24cdcb80 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.312+0000 7f3430df9740 1 -- 172.21.15.69:0/529504665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 msgr2=0x555c24cdcfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.312+0000 7f3430df9740 1 --2- 172.21.15.69:0/529504665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cdcfa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3418000c00 tx=0x7f341809c140 comp rx=0 tx=0).stop 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.312+0000 7f3430df9740 1 -- 172.21.15.69:0/529504665 shutdown_connections 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.312+0000 7f3430df9740 1 --2- 172.21.15.69:0/529504665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ce4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.312+0000 7f3430df9740 1 --2- 172.21.15.69:0/529504665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24cde1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.312+0000 7f3430df9740 1 --2- 172.21.15.69:0/529504665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cdcfa0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.312+0000 7f3430df9740 1 -- 172.21.15.69:0/529504665 >> 172.21.15.69:0/529504665 conn(0x555c24cd8070 msgr2=0x555c24cd8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.312+0000 7f3430df9740 1 -- 172.21.15.69:0/529504665 shutdown_connections 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.312+0000 7f3430df9740 1 -- 172.21.15.69:0/529504665 wait complete. 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.312+0000 7f3430df9740 1 -- start start 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3430df9740 1 Processor -- start 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3430df9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cdcb80 0x555c24ce7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3430df9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24ce75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3430df9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cde710 0x555c24cee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3430df9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555c24ce5720 con 0x555c24cde710 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3430df9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555c24bdc470 con 0x555c24cdcb80 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3430df9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555c24ce58a0 con 0x555c24cddd50 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3430df9740 10 client.0 _ll_register_callbacks cb 0x555c24c01f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3427fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cde710 0x555c24cee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3427fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cde710 0x555c24cee5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46650/0 (socket says 172.21.15.69:46650) 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3427fff640 1 -- 172.21.15.69:0/3055060972 learned_addr learned my addr 172.21.15.69:0/3055060972 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f34277fe640 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cdcb80 0x555c24ce7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f341ffff640 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24ce75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3427fff640 1 -- 172.21.15.69:0/3055060972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 msgr2=0x555c24ce75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3427fff640 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24ce75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3427fff640 1 -- 172.21.15.69:0/3055060972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cdcb80 msgr2=0x555c24ce7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3427fff640 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cdcb80 0x555c24ce7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3427fff640 1 -- 172.21.15.69:0/3055060972 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c24a1e6b0 con 0x555c24cde710 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3427fff640 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cde710 0x555c24cee5f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3420003a90 tx=0x7f342002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5287fb42f0e3459f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3406ffd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.313+0000 7f3406ffd640 1 -- 172.21.15.69:0/3055060972 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420004d40 con 0x555c24cde710 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3406ffd640 1 -- 172.21.15.69:0/3055060972 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f342002f660 con 0x555c24cde710 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3430df9740 1 -- 172.21.15.69:0/3055060972 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f341809c240 con 0x555c24cde710 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3406ffd640 1 -- 172.21.15.69:0/3055060972 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f342002f860 con 0x555c24cde710 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3430df9740 10 client.15132 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3430df9740 1 -- 172.21.15.69:0/3055060972 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555c24cf19d0 con 0x555c24cde710 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3406ffd640 1 -- 172.21.15.69:0/3055060972 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f341809c240 con 0x555c24cde710 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3406ffd640 1 -- 172.21.15.69:0/3055060972 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3420030ac0 con 0x555c24cde710 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3430df9740 10 client.15132 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3430df9740 10 client.15132 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3430df9740 20 client.15132 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3430df9740 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x555c24cf40e0 0x555c24cf5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3430df9740 4 client.15132 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f3430df9740 1 -- 172.21.15.69:0/3055060972 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c24c4f670 con 0x555c24cf40e0 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.314+0000 7f34277fe640 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x555c24cf40e0 0x555c24cf5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.315+0000 7f3406ffd640 10 client.15132 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.315+0000 7f34277fe640 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x555c24cf40e0 0x555c24cf5550 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a15086db564bbef6 server_cookie=bd85058dda4e14a3 in_seq=0 out_seq=0 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.315+0000 7f3406ffd640 1 -- 172.21.15.69:0/3055060972 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555c24c4f670 con 0x555c24cf40e0 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.315+0000 7f3406ffd640 10 client.15132 handle_command_reply: tid=0 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.315+0000 7f3430df9740 1 client.15132 shutdown 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3430df9740 1 -- 172.21.15.69:0/3055060972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cde710 msgr2=0x555c24cee5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3430df9740 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cde710 0x555c24cee5f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3420003a90 tx=0x7f342002a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3430df9740 1 -- 172.21.15.69:0/3055060972 shutdown_connections 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3430df9740 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x555c24cf40e0 0x555c24cf5550 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3430df9740 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cde710 0x555c24cee5f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3406ffd640 0 client.15132 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3430df9740 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24ce75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3430df9740 1 --2- 172.21.15.69:0/3055060972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cdcb80 0x555c24ce7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3430df9740 1 -- 172.21.15.69:0/3055060972 >> 172.21.15.69:0/3055060972 conn(0x555c24cd8070 msgr2=0x555c24cd71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3430df9740 1 -- 172.21.15.69:0/3055060972 shutdown_connections 2024-04-23T10:26:20.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3430df9740 1 -- 172.21.15.69:0/3055060972 wait complete. 2024-04-23T10:26:20.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.316+0000 7f3430df9740 20 client.15132 trim_cache size 0 max 16384 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.333+0000 7f3430df9740 1 Processor -- start 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.333+0000 7f3430df9740 1 -- start start 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.333+0000 7f3430df9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cdcb80 0x555c24ce4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.333+0000 7f3430df9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cddd50 0x555c24cee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.333+0000 7f3430df9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ce0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.333+0000 7f3430df9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555c24cf3890 con 0x555c24cddd50 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.333+0000 7f3430df9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555c24cf3f60 con 0x555c24cde710 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.333+0000 7f3430df9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555c24cf4630 con 0x555c24cdcb80 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cddd50 0x555c24cee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cddd50 0x555c24cee5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46664/0 (socket says 172.21.15.69:46664) 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341ffff640 1 -- 172.21.15.69:0/1159425249 learned_addr learned my addr 172.21.15.69:0/1159425249 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341ffff640 1 -- 172.21.15.69:0/1159425249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cdcb80 msgr2=0x555c24ce4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341ffff640 1 --2- 172.21.15.69:0/1159425249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cdcb80 0x555c24ce4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341ffff640 1 -- 172.21.15.69:0/1159425249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 msgr2=0x555c24ce0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341ffff640 1 --2- 172.21.15.69:0/1159425249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ce0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341ffff640 1 -- 172.21.15.69:0/1159425249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c24cdd7d0 con 0x555c24cddd50 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341ffff640 1 --2- 172.21.15.69:0/1159425249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cddd50 0x555c24cee5b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f34100045f0 tx=0x7f341000eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee99cab9ab4c616 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341d7fa640 1 -- 172.21.15.69:0/1159425249 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410003ab0 con 0x555c24cddd50 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341d7fa640 1 -- 172.21.15.69:0/1159425249 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3410003c50 con 0x555c24cddd50 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.334+0000 7f341d7fa640 1 -- 172.21.15.69:0/1159425249 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410010790 con 0x555c24cddd50 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 -- 172.21.15.69:0/1159425249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cddd50 msgr2=0x555c24cee5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 --2- 172.21.15.69:0/1159425249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cddd50 0x555c24cee5b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f34100045f0 tx=0x7f341000eb00 comp rx=0 tx=0).stop 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 -- 172.21.15.69:0/1159425249 shutdown_connections 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 --2- 172.21.15.69:0/1159425249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cddd50 0x555c24cee5b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 --2- 172.21.15.69:0/1159425249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ce0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 --2- 172.21.15.69:0/1159425249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cdcb80 0x555c24ce4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 -- 172.21.15.69:0/1159425249 >> 172.21.15.69:0/1159425249 conn(0x555c24cd8070 msgr2=0x555c24cd8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 -- 172.21.15.69:0/1159425249 shutdown_connections 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 -- 172.21.15.69:0/1159425249 wait complete. 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 -- start start 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 Processor -- start 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24ceca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ced0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555c24cf53d0 con 0x555c24cdcb80 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555c24cf4d00 con 0x555c24cde710 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555c24cf5aa0 con 0x555c24cddd50 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f3430df9740 10 client.0 _ll_register_callbacks cb 0x7f3420009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.335+0000 7f34277fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f34277fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cea4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46678/0 (socket says 172.21.15.69:46678) 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f34277fe640 1 -- 172.21.15.69:0/640099805 learned_addr learned my addr 172.21.15.69:0/640099805 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f341ffff640 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24ceca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f3427fff640 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ced0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f34277fe640 1 -- 172.21.15.69:0/640099805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 msgr2=0x555c24ceca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f34277fe640 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24ceca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f34277fe640 1 -- 172.21.15.69:0/640099805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 msgr2=0x555c24ced0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f34277fe640 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ced0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f34277fe640 1 -- 172.21.15.69:0/640099805 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c24ced910 con 0x555c24cdcb80 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f3427fff640 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ced0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f34277fe640 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cea4f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f341809bf40 tx=0x7f341800b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4f85342c287672 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f3406ffd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f3406ffd640 1 -- 172.21.15.69:0/640099805 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34180b4070 con 0x555c24cdcb80 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f3406ffd640 1 -- 172.21.15.69:0/640099805 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f34180cdcc0 con 0x555c24cdcb80 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f3430df9740 1 -- 172.21.15.69:0/640099805 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3410003c50 con 0x555c24cdcb80 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f3406ffd640 1 -- 172.21.15.69:0/640099805 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f341807f020 con 0x555c24cdcb80 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f3430df9740 10 client.15138 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f3430df9740 1 -- 172.21.15.69:0/640099805 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555c24d5a1c0 con 0x555c24cdcb80 2024-04-23T10:26:20.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f3406ffd640 1 -- 172.21.15.69:0/640099805 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3410003c50 con 0x555c24cdcb80 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.336+0000 7f3406ffd640 1 -- 172.21.15.69:0/640099805 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f34180b0ce0 con 0x555c24cdcb80 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f3430df9740 10 client.15138 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f3430df9740 10 client.15138 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f3430df9740 20 client.15138 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f3430df9740 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x555c24d5e960 0x555c24d5d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f3430df9740 4 client.15138 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f3430df9740 1 -- 172.21.15.69:0/640099805 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "status"}) -- 0x555c24c494e0 con 0x555c24d5e960 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f341ffff640 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x555c24d5e960 0x555c24d5d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f3406ffd640 10 client.15138 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f341ffff640 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x555c24d5e960 0x555c24d5d670 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=693cfe8121df487b server_cookie=d01189041e320d12 in_seq=0 out_seq=0 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f3406ffd640 1 -- 172.21.15.69:0/640099805 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555c24c494e0 con 0x555c24d5e960 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f3406ffd640 10 client.15138 handle_command_reply: tid=0 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.337+0000 7f3430df9740 1 client.15138 shutdown 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3430df9740 1 -- 172.21.15.69:0/640099805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 msgr2=0x555c24cea4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3430df9740 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cea4f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f341809bf40 tx=0x7f341800b530 comp rx=0 tx=0).stop 2024-04-23T10:26:20.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3430df9740 1 -- 172.21.15.69:0/640099805 shutdown_connections 2024-04-23T10:26:20.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3430df9740 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x555c24d5e960 0x555c24d5d670 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3430df9740 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555c24cde710 0x555c24ced0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3430df9740 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c24cddd50 0x555c24ceca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3406ffd640 0 client.15138 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:26:20.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3430df9740 1 --2- 172.21.15.69:0/640099805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555c24cdcb80 0x555c24cea4f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3430df9740 1 -- 172.21.15.69:0/640099805 >> 172.21.15.69:0/640099805 conn(0x555c24cd8070 msgr2=0x555c24cd30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3430df9740 1 -- 172.21.15.69:0/640099805 shutdown_connections 2024-04-23T10:26:20.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3430df9740 1 -- 172.21.15.69:0/640099805 wait complete. 2024-04-23T10:26:20.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f3430df9740 20 client.15138 trim_cache size 0 max 16384 2024-04-23T10:26:20.402 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:26:20.402 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:26:20.403 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2024-04-23T10:26:20.403 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24487, 2024-04-23T10:26:20.403 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:26:20.403 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:26:20.403 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:26:20.403 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 86.518161023999994, 2024-04-23T10:26:20.403 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 25, 2024-04-23T10:26:20.403 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 88, 2024-04-23T10:26:20.403 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 86, 2024-04-23T10:26:20.403 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 100.716260674 2024-04-23T10:26:20.403 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:26:20.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 -- 172.21.15.69:0/3318255327 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34140a3c40 msgr2=0x7f34140a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34140a3c40 0x7f34140a6100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3420009ca0 tx=0x7f3420031450 comp rx=0 tx=0).stop 2024-04-23T10:26:20.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 -- 172.21.15.69:0/3318255327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3428100e90 msgr2=0x7f3428069c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:20.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3428100e90 0x7f3428069c50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f341800d950 tx=0x7f341800de10 comp rx=0 tx=0).stop 2024-04-23T10:26:20.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 -- 172.21.15.69:0/3318255327 shutdown_connections 2024-04-23T10:26:20.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f34140a3c40 0x7f34140a6100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34281029a0 0x7f342819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3428101fe0 0x7f342819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 --2- 172.21.15.69:0/3318255327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3428100e90 0x7f3428069c50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:20.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 -- 172.21.15.69:0/3318255327 >> 172.21.15.69:0/3318255327 conn(0x7f34280fc400 msgr2=0x7f34281052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:20.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 -- 172.21.15.69:0/3318255327 shutdown_connections 2024-04-23T10:26:20.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:20.338+0000 7f342e0e1640 1 -- 172.21.15.69:0/3318255327 wait complete. 2024-04-23T10:26:20.405 INFO:tasks.cephadm:Setup complete, yielding 2024-04-23T10:26:20.406 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T10:26:20.413 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-04-23T10:26:20.413 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-23T10:26:20.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:20 smithi146 ceph-mon[32800]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:20.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:20 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2664771534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:20.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:20 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1920121370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:20.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:20 smithi167 ceph-mon[32940]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:20.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:20 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2664771534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:20.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:20 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1920121370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:20.651 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:22.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.288+0000 7fae3b172700 1 -- 172.21.15.69:0/1502964435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae34102aa0 msgr2=0x7fae34102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:22.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.288+0000 7fae3b172700 1 --2- 172.21.15.69:0/1502964435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae34102aa0 0x7fae34102ec0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fae280099c0 tx=0x7fae28009cd0 comp rx=0 tx=0).stop 2024-04-23T10:26:22.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.288+0000 7fae3b172700 1 -- 172.21.15.69:0/1502964435 shutdown_connections 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.288+0000 7fae3b172700 1 --2- 172.21.15.69:0/1502964435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae34104640 0x7fae3410aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.288+0000 7fae3b172700 1 --2- 172.21.15.69:0/1502964435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae34102aa0 0x7fae34102ec0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.288+0000 7fae3b172700 1 --2- 172.21.15.69:0/1502964435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae34103ca0 0x7fae34104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.288+0000 7fae3b172700 1 -- 172.21.15.69:0/1502964435 >> 172.21.15.69:0/1502964435 conn(0x7fae340fe040 msgr2=0x7fae34100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.288+0000 7fae3b172700 1 -- 172.21.15.69:0/1502964435 shutdown_connections 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.288+0000 7fae3b172700 1 -- 172.21.15.69:0/1502964435 wait complete. 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae3b172700 1 Processor -- start 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae3b172700 1 -- start start 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae3b172700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae34102aa0 0x7fae34198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae3b172700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae34103ca0 0x7fae34199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae3b172700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae34104640 0x7fae341a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae3b172700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fae3410e670 con 0x7fae34103ca0 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae3b172700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fae3410e4f0 con 0x7fae34102aa0 2024-04-23T10:26:22.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae3b172700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fae3410e7f0 con 0x7fae34104640 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae33fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae34103ca0 0x7fae34199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae33fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae34103ca0 0x7fae34199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46704/0 (socket says 172.21.15.69:46704) 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae33fff700 1 -- 172.21.15.69:0/1909188365 learned_addr learned my addr 172.21.15.69:0/1909188365 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae38f0e700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae34102aa0 0x7fae34198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae3970f700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae34104640 0x7fae341a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae33fff700 1 -- 172.21.15.69:0/1909188365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae34104640 msgr2=0x7fae341a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae33fff700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae34104640 0x7fae341a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae33fff700 1 -- 172.21.15.69:0/1909188365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae34102aa0 msgr2=0x7fae34198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae33fff700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae34102aa0 0x7fae34198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.289+0000 7fae33fff700 1 -- 172.21.15.69:0/1909188365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae341a0960 con 0x7fae34103ca0 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.290+0000 7fae33fff700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae34103ca0 0x7fae34199250 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fae2000c970 tx=0x7fae2000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.290+0000 7fae31ffb700 1 -- 172.21.15.69:0/1909188365 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20007aa0 con 0x7fae34103ca0 2024-04-23T10:26:22.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.290+0000 7fae3b172700 1 -- 172.21.15.69:0/1909188365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae341a0c50 con 0x7fae34103ca0 2024-04-23T10:26:22.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.290+0000 7fae31ffb700 1 -- 172.21.15.69:0/1909188365 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fae20004d00 con 0x7fae34103ca0 2024-04-23T10:26:22.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.290+0000 7fae31ffb700 1 -- 172.21.15.69:0/1909188365 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20005670 con 0x7fae34103ca0 2024-04-23T10:26:22.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.290+0000 7fae3b172700 1 -- 172.21.15.69:0/1909188365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae341a1190 con 0x7fae34103ca0 2024-04-23T10:26:22.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.291+0000 7fae3b172700 1 -- 172.21.15.69:0/1909188365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae34069730 con 0x7fae34103ca0 2024-04-23T10:26:22.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.292+0000 7fae31ffb700 1 -- 172.21.15.69:0/1909188365 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fae20007cd0 con 0x7fae34103ca0 2024-04-23T10:26:22.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.292+0000 7fae31ffb700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fae240a3cd0 0x7fae240a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:22.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.292+0000 7fae38f0e700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fae240a3cd0 0x7fae240a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:22.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.292+0000 7fae31ffb700 1 -- 172.21.15.69:0/1909188365 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fae200d03a0 con 0x7fae34103ca0 2024-04-23T10:26:22.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.293+0000 7fae38f0e700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fae240a3cd0 0x7fae240a6190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fae28009990 tx=0x7fae28005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:22.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.297+0000 7fae31ffb700 1 -- 172.21.15.69:0/1909188365 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fae2009ccc0 con 0x7fae34103ca0 2024-04-23T10:26:22.296 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:22 smithi069 ceph-mon[29593]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-23T10:26:22.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:22 smithi146 ceph-mon[32800]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-23T10:26:22.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.515+0000 7fae3b172700 1 -- 172.21.15.69:0/1909188365 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fae34062e80 con 0x7fae240a3cd0 2024-04-23T10:26:22.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.517+0000 7fae31ffb700 1 -- 172.21.15.69:0/1909188365 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fae34062e80 con 0x7fae240a3cd0 2024-04-23T10:26:22.516 INFO:teuthology.orchestra.run.smithi069.stdout:Backend: cephadm 2024-04-23T10:26:22.516 INFO:teuthology.orchestra.run.smithi069.stdout:Available: Yes 2024-04-23T10:26:22.516 INFO:teuthology.orchestra.run.smithi069.stdout:Paused: No 2024-04-23T10:26:22.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 -- 172.21.15.69:0/1909188365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fae240a3cd0 msgr2=0x7fae240a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:22.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fae240a3cd0 0x7fae240a6190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fae28009990 tx=0x7fae28005e80 comp rx=0 tx=0).stop 2024-04-23T10:26:22.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 -- 172.21.15.69:0/1909188365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae34103ca0 msgr2=0x7fae34199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:22.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae34103ca0 0x7fae34199250 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fae2000c970 tx=0x7fae2000cd30 comp rx=0 tx=0).stop 2024-04-23T10:26:22.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 -- 172.21.15.69:0/1909188365 shutdown_connections 2024-04-23T10:26:22.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fae240a3cd0 0x7fae240a6190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:22.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae34104640 0x7fae341a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:22.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae34102aa0 0x7fae34198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:22.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 --2- 172.21.15.69:0/1909188365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae34103ca0 0x7fae34199250 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:22.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 -- 172.21.15.69:0/1909188365 >> 172.21.15.69:0/1909188365 conn(0x7fae340fe040 msgr2=0x7fae34107010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:22.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 -- 172.21.15.69:0/1909188365 shutdown_connections 2024-04-23T10:26:22.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:22.519+0000 7fae3b172700 1 -- 172.21.15.69:0/1909188365 wait complete. 2024-04-23T10:26:22.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:22 smithi167 ceph-mon[32940]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-23T10:26:23.195 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-23T10:26:23.455 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:24.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:24 smithi069 ceph-mon[29593]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:24.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:24 smithi069 ceph-mon[29593]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:24.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:24 smithi167 ceph-mon[32940]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:24.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:24 smithi167 ceph-mon[32940]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:24.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:24 smithi146 ceph-mon[32800]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:24.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:24 smithi146 ceph-mon[32800]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.147+0000 7f821c614700 1 -- 172.21.15.69:0/661006144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8214102cf0 msgr2=0x7f82141095a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.147+0000 7f821c614700 1 --2- 172.21.15.69:0/661006144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8214102cf0 0x7f82141095a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f820c00b0d0 tx=0x7f820c00b3e0 comp rx=0 tx=0).stop 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.147+0000 7f821c614700 1 -- 172.21.15.69:0/661006144 shutdown_connections 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.147+0000 7f821c614700 1 --2- 172.21.15.69:0/661006144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8214102cf0 0x7f82141095a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.147+0000 7f821c614700 1 --2- 172.21.15.69:0/661006144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8214101150 0x7f8214101570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.147+0000 7f821c614700 1 --2- 172.21.15.69:0/661006144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8214102350 0x7f82141027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.147+0000 7f821c614700 1 -- 172.21.15.69:0/661006144 >> 172.21.15.69:0/661006144 conn(0x7f82140fc6f0 msgr2=0x7f82140feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.147+0000 7f821c614700 1 -- 172.21.15.69:0/661006144 shutdown_connections 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.147+0000 7f821c614700 1 -- 172.21.15.69:0/661006144 wait complete. 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.148+0000 7f821c614700 1 Processor -- start 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.148+0000 7f821c614700 1 -- start start 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.148+0000 7f821c614700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8214101150 0x7f8214196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.148+0000 7f821c614700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8214102350 0x7f8214196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.148+0000 7f821c614700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8214102cf0 0x7f821419def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.148+0000 7f821c614700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f821410c4b0 con 0x7f8214101150 2024-04-23T10:26:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.148+0000 7f821c614700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f821410c330 con 0x7f8214102350 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.148+0000 7f821c614700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f821410c630 con 0x7f8214102cf0 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.148+0000 7f821a3b0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8214101150 0x7f8214196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.148+0000 7f821a3b0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8214101150 0x7f8214196930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46718/0 (socket says 172.21.15.69:46718) 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.148+0000 7f821a3b0700 1 -- 172.21.15.69:0/4077654599 learned_addr learned my addr 172.21.15.69:0/4077654599 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f8219baf700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8214102350 0x7f8214196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f821abb1700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8214102cf0 0x7f821419def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f821a3b0700 1 -- 172.21.15.69:0/4077654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8214102cf0 msgr2=0x7f821419def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f821a3b0700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8214102cf0 0x7f821419def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f821a3b0700 1 -- 172.21.15.69:0/4077654599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8214102350 msgr2=0x7f8214196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f821a3b0700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8214102350 0x7f8214196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f821a3b0700 1 -- 172.21.15.69:0/4077654599 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82141a07a0 con 0x7f8214101150 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f821a3b0700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8214101150 0x7f8214196930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f820400c9c0 tx=0x7f820400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f820b7fe700 1 -- 172.21.15.69:0/4077654599 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820400ce60 con 0x7f8214101150 2024-04-23T10:26:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f821c614700 1 -- 172.21.15.69:0/4077654599 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82141a0a90 con 0x7f8214101150 2024-04-23T10:26:25.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f820b7fe700 1 -- 172.21.15.69:0/4077654599 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f820400f450 con 0x7f8214101150 2024-04-23T10:26:25.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f820b7fe700 1 -- 172.21.15.69:0/4077654599 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204018660 con 0x7f8214101150 2024-04-23T10:26:25.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.149+0000 7f821c614700 1 -- 172.21.15.69:0/4077654599 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82141a0fd0 con 0x7f8214101150 2024-04-23T10:26:25.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.150+0000 7f821c614700 1 -- 172.21.15.69:0/4077654599 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8214069730 con 0x7f8214101150 2024-04-23T10:26:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.151+0000 7f820b7fe700 1 -- 172.21.15.69:0/4077654599 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8204007ac0 con 0x7f8214101150 2024-04-23T10:26:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.152+0000 7f820b7fe700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82000a3cd0 0x7f82000a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.152+0000 7f8219baf700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82000a3cd0 0x7f82000a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.152+0000 7f820b7fe700 1 -- 172.21.15.69:0/4077654599 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f82040d0440 con 0x7f8214101150 2024-04-23T10:26:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.152+0000 7f8219baf700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82000a3cd0 0x7f82000a6190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8210005950 tx=0x7f821000b510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:25.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.156+0000 7f820b7fe700 1 -- 172.21.15.69:0/4077654599 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8204014030 con 0x7f8214101150 2024-04-23T10:26:25.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.365+0000 7f821c614700 1 -- 172.21.15.69:0/4077654599 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8214062e80 con 0x7f82000a3cd0 2024-04-23T10:26:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.380+0000 7f820b7fe700 1 -- 172.21.15.69:0/4077654599 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f8214062e80 con 0x7f82000a3cd0 2024-04-23T10:26:25.379 INFO:teuthology.orchestra.run.smithi069.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-23T10:26:25.379 INFO:teuthology.orchestra.run.smithi069.stdout:mds.a smithi069 running (100s) 17s ago 100s 17.0M - 19.0.0-3156-gd69f13d8 da4b004c09e8 04975c6805ae 2024-04-23T10:26:25.379 INFO:teuthology.orchestra.run.smithi069.stdout:mds.b smithi146 running (97s) 30s ago 96s 16.8M - 19.0.0-3156-gd69f13d8 da4b004c09e8 322631e48542 2024-04-23T10:26:25.379 INFO:teuthology.orchestra.run.smithi069.stdout:mds.c smithi167 running (111s) 30s ago 111s 17.1M - 19.0.0-3156-gd69f13d8 da4b004c09e8 e331412a22cb 2024-04-23T10:26:25.379 INFO:teuthology.orchestra.run.smithi069.stdout:mds.d smithi069 running (119s) 17s ago 119s 13.0M - 19.0.0-3156-gd69f13d8 da4b004c09e8 58820d4574a2 2024-04-23T10:26:25.379 INFO:teuthology.orchestra.run.smithi069.stdout:mds.e smithi146 running (117s) 30s ago 116s 17.2M - 19.0.0-3156-gd69f13d8 da4b004c09e8 b35ec06be20e 2024-04-23T10:26:25.379 INFO:teuthology.orchestra.run.smithi069.stdout:mds.f smithi167 running (114s) 30s ago 113s 18.1M - 19.0.0-3156-gd69f13d8 da4b004c09e8 e7e7cde3c441 2024-04-23T10:26:25.379 INFO:teuthology.orchestra.run.smithi069.stdout:mds.g smithi069 running (103s) 17s ago 102s 17.1M - 19.0.0-3156-gd69f13d8 da4b004c09e8 2558f26a2e85 2024-04-23T10:26:25.379 INFO:teuthology.orchestra.run.smithi069.stdout:mds.h smithi146 running (108s) 30s ago 108s 19.1M - 19.0.0-3156-gd69f13d8 da4b004c09e8 9bad60ebc270 2024-04-23T10:26:25.379 INFO:teuthology.orchestra.run.smithi069.stdout:mds.i smithi167 running (106s) 30s ago 105s 28.4M - 19.0.0-3156-gd69f13d8 da4b004c09e8 7c5cf81471da 2024-04-23T10:26:25.379 INFO:teuthology.orchestra.run.smithi069.stdout:mds.j smithi069 running (2m) 17s ago 2m 14.0M - 19.0.0-3156-gd69f13d8 da4b004c09e8 b4575144dc05 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:mds.k smithi146 running (2m) 30s ago 2m 16.8M - 19.0.0-3156-gd69f13d8 da4b004c09e8 a4269f1a8f15 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:mds.l smithi167 running (2m) 30s ago 2m 18.3M - 19.0.0-3156-gd69f13d8 da4b004c09e8 bdebef762c53 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.x smithi069 *:9283,8765 running (9m) 17s ago 9m 514M - 19.0.0-3156-gd69f13d8 da4b004c09e8 63ea1f36ea85 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.y smithi146 *:8443,8765 running (7m) 30s ago 7m 454M - 19.0.0-3156-gd69f13d8 da4b004c09e8 0677732d8478 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.z smithi167 *:8443,8765 running (7m) 30s ago 7m 454M - 19.0.0-3156-gd69f13d8 da4b004c09e8 0ea68b9ad7c2 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:mon.a smithi069 running (9m) 17s ago 9m 49.4M 2048M 19.0.0-3156-gd69f13d8 da4b004c09e8 ef0b3ec76fa3 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:mon.b smithi146 running (7m) 30s ago 7m 42.5M 2048M 19.0.0-3156-gd69f13d8 da4b004c09e8 0deb56145c1a 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:mon.c smithi167 running (7m) 30s ago 7m 38.3M 2048M 19.0.0-3156-gd69f13d8 da4b004c09e8 c50689af9ecd 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0 smithi069 running (7m) 17s ago 7m 48.2M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 d8b45af83a55 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:osd.1 smithi146 running (6m) 30s ago 6m 45.9M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 071a456353b1 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2 smithi167 running (6m) 30s ago 6m 57.4M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 4cb46314dbec 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:osd.3 smithi069 running (5m) 17s ago 5m 57.9M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 0aadaeb31c6e 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:osd.4 smithi146 running (5m) 30s ago 5m 42.4M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 1cfb1d864e0c 2024-04-23T10:26:25.380 INFO:teuthology.orchestra.run.smithi069.stdout:osd.5 smithi167 running (5m) 30s ago 5m 53.6M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 d1834549fc8b 2024-04-23T10:26:25.381 INFO:teuthology.orchestra.run.smithi069.stdout:osd.6 smithi069 running (4m) 17s ago 4m 42.4M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 2d5639e4a259 2024-04-23T10:26:25.381 INFO:teuthology.orchestra.run.smithi069.stdout:osd.7 smithi146 running (4m) 30s ago 4m 46.3M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 e3709b9987f9 2024-04-23T10:26:25.381 INFO:teuthology.orchestra.run.smithi069.stdout:osd.8 smithi167 running (3m) 30s ago 3m 57.4M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 6b3b918fb4f7 2024-04-23T10:26:25.381 INFO:teuthology.orchestra.run.smithi069.stdout:osd.9 smithi069 running (3m) 17s ago 3m 53.2M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 f357472248e6 2024-04-23T10:26:25.381 INFO:teuthology.orchestra.run.smithi069.stdout:osd.10 smithi146 running (2m) 30s ago 2m 43.1M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 6eca31fa590f 2024-04-23T10:26:25.381 INFO:teuthology.orchestra.run.smithi069.stdout:osd.11 smithi167 running (2m) 30s ago 2m 40.2M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 f6f76d953fbc 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 -- 172.21.15.69:0/4077654599 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82000a3cd0 msgr2=0x7f82000a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82000a3cd0 0x7f82000a6190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8210005950 tx=0x7f821000b510 comp rx=0 tx=0).stop 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 -- 172.21.15.69:0/4077654599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8214101150 msgr2=0x7f8214196930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8214101150 0x7f8214196930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f820400c9c0 tx=0x7f820400ccd0 comp rx=0 tx=0).stop 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 -- 172.21.15.69:0/4077654599 shutdown_connections 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82000a3cd0 0x7f82000a6190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8214102cf0 0x7f821419def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8214101150 0x7f8214196930 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 --2- 172.21.15.69:0/4077654599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8214102350 0x7f8214196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 -- 172.21.15.69:0/4077654599 >> 172.21.15.69:0/4077654599 conn(0x7f82140fc6f0 msgr2=0x7f8214105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 -- 172.21.15.69:0/4077654599 shutdown_connections 2024-04-23T10:26:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:25.382+0000 7f821c614700 1 -- 172.21.15.69:0/4077654599 wait complete. 2024-04-23T10:26:26.055 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-23T10:26:26.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:26 smithi069 ceph-mon[29593]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T10:26:26.296 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:26.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:26 smithi146 ceph-mon[32800]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T10:26:26.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:26 smithi167 ceph-mon[32940]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-23T10:26:27.400 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:27 smithi069 ceph-mon[29593]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:27.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:27 smithi146 ceph-mon[32800]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:27.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:27 smithi167 ceph-mon[32940]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.948+0000 7f6f540d7700 1 -- 172.21.15.69:0/3587030989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4c102330 msgr2=0x7f6f4c102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.948+0000 7f6f540d7700 1 --2- 172.21.15.69:0/3587030989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4c102330 0x7f6f4c102790 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0099c0 tx=0x7f6f3c009cd0 comp rx=0 tx=0).stop 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.948+0000 7f6f540d7700 1 -- 172.21.15.69:0/3587030989 shutdown_connections 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.948+0000 7f6f540d7700 1 --2- 172.21.15.69:0/3587030989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f4c102cd0 0x7f6f4c109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.948+0000 7f6f540d7700 1 --2- 172.21.15.69:0/3587030989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c101130 0x7f6f4c101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.948+0000 7f6f540d7700 1 --2- 172.21.15.69:0/3587030989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4c102330 0x7f6f4c102790 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.948+0000 7f6f540d7700 1 -- 172.21.15.69:0/3587030989 >> 172.21.15.69:0/3587030989 conn(0x7f6f4c0fc6b0 msgr2=0x7f6f4c0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.948+0000 7f6f540d7700 1 -- 172.21.15.69:0/3587030989 shutdown_connections 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.948+0000 7f6f540d7700 1 -- 172.21.15.69:0/3587030989 wait complete. 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f540d7700 1 Processor -- start 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f540d7700 1 -- start start 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f540d7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f4c101130 0x7f6f4c196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f540d7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c102330 0x7f6f4c196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:27.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f540d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4c102cd0 0x7f6f4c19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f540d7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c10c4d0 con 0x7f6f4c102cd0 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f540d7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c10c350 con 0x7f6f4c102330 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f540d7700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c10c650 con 0x7f6f4c101130 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f52674700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4c102cd0 0x7f6f4c19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f52674700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4c102cd0 0x7f6f4c19dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46734/0 (socket says 172.21.15.69:46734) 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f52674700 1 -- 172.21.15.69:0/262145722 learned_addr learned my addr 172.21.15.69:0/262145722 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f51672700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c102330 0x7f6f4c196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f51e73700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f4c101130 0x7f6f4c196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f52674700 1 -- 172.21.15.69:0/262145722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f4c101130 msgr2=0x7f6f4c196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f52674700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f4c101130 0x7f6f4c196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f52674700 1 -- 172.21.15.69:0/262145722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c102330 msgr2=0x7f6f4c196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f52674700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c102330 0x7f6f4c196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f52674700 1 -- 172.21.15.69:0/262145722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c19e690 con 0x7f6f4c102cd0 2024-04-23T10:26:27.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.949+0000 7f6f51e73700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f4c101130 0x7f6f4c196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:27.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.950+0000 7f6f52674700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4c102cd0 0x7f6f4c19dff0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6f48007f10 tx=0x7f6f4800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:27.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.950+0000 7f6f42ffd700 1 -- 172.21.15.69:0/262145722 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48004bb0 con 0x7f6f4c102cd0 2024-04-23T10:26:27.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.950+0000 7f6f42ffd700 1 -- 172.21.15.69:0/262145722 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6f48004d50 con 0x7f6f4c102cd0 2024-04-23T10:26:27.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.950+0000 7f6f540d7700 1 -- 172.21.15.69:0/262145722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4c19e980 con 0x7f6f4c102cd0 2024-04-23T10:26:27.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.950+0000 7f6f42ffd700 1 -- 172.21.15.69:0/262145722 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f480133f0 con 0x7f6f4c102cd0 2024-04-23T10:26:27.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.950+0000 7f6f540d7700 1 -- 172.21.15.69:0/262145722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f4c19ef10 con 0x7f6f4c102cd0 2024-04-23T10:26:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.951+0000 7f6f540d7700 1 -- 172.21.15.69:0/262145722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f4c069730 con 0x7f6f4c102cd0 2024-04-23T10:26:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.952+0000 7f6f42ffd700 1 -- 172.21.15.69:0/262145722 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6f4801a020 con 0x7f6f4c102cd0 2024-04-23T10:26:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.952+0000 7f6f42ffd700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6f380a5f60 0x7f6f380a8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.952+0000 7f6f51e73700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6f380a5f60 0x7f6f380a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.952+0000 7f6f42ffd700 1 -- 172.21.15.69:0/262145722 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f6f480d0300 con 0x7f6f4c102cd0 2024-04-23T10:26:27.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.953+0000 7f6f51e73700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6f380a5f60 0x7f6f380a8420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6f44005fd0 tx=0x7f6f44005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:27.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:27.956+0000 7f6f42ffd700 1 -- 172.21.15.69:0/262145722 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6f48010070 con 0x7f6f4c102cd0 2024-04-23T10:26:28.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.165+0000 7f6f540d7700 1 -- 172.21.15.69:0/262145722 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f6f4c062e80 con 0x7f6f380a5f60 2024-04-23T10:26:28.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.171+0000 7f6f42ffd700 1 -- 172.21.15.69:0/262145722 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f6f4c062e80 con 0x7f6f380a5f60 2024-04-23T10:26:28.170 INFO:teuthology.orchestra.run.smithi069.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-23T10:26:28.171 INFO:teuthology.orchestra.run.smithi069.stdout:mds.all 12/12 33s ago 2m smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-04-23T10:26:28.171 INFO:teuthology.orchestra.run.smithi069.stdout:mgr 3/3 33s ago 7m smithi069=x;smithi146=y;smithi167=z;count:3 2024-04-23T10:26:28.171 INFO:teuthology.orchestra.run.smithi069.stdout:mon 3/3 33s ago 7m smithi069:172.21.15.69=a;smithi146:172.21.15.146=b;smithi167:172.21.15.167=c;count:3 2024-04-23T10:26:28.171 INFO:teuthology.orchestra.run.smithi069.stdout:osd 12 33s ago - 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.173+0000 7f6f540d7700 1 -- 172.21.15.69:0/262145722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6f380a5f60 msgr2=0x7f6f380a8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.173+0000 7f6f540d7700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6f380a5f60 0x7f6f380a8420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6f44005fd0 tx=0x7f6f44005f00 comp rx=0 tx=0).stop 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.173+0000 7f6f540d7700 1 -- 172.21.15.69:0/262145722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4c102cd0 msgr2=0x7f6f4c19dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.173+0000 7f6f540d7700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4c102cd0 0x7f6f4c19dff0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6f48007f10 tx=0x7f6f4800d3b0 comp rx=0 tx=0).stop 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.173+0000 7f6f540d7700 1 -- 172.21.15.69:0/262145722 shutdown_connections 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.173+0000 7f6f540d7700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6f380a5f60 0x7f6f380a8420 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.173+0000 7f6f540d7700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4c102cd0 0x7f6f4c19dff0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.173+0000 7f6f540d7700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f4c101130 0x7f6f4c196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.173+0000 7f6f540d7700 1 --2- 172.21.15.69:0/262145722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c102330 0x7f6f4c196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.173+0000 7f6f540d7700 1 -- 172.21.15.69:0/262145722 >> 172.21.15.69:0/262145722 conn(0x7f6f4c0fc6b0 msgr2=0x7f6f4c105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.174+0000 7f6f540d7700 1 -- 172.21.15.69:0/262145722 shutdown_connections 2024-04-23T10:26:28.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:28.174+0000 7f6f540d7700 1 -- 172.21.15.69:0/262145722 wait complete. 2024-04-23T10:26:28.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:28 smithi146 ceph-mon[32800]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:26:28.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:28 smithi069 ceph-mon[29593]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:26:28.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:28 smithi167 ceph-mon[32940]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-23T10:26:28.875 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-23T10:26:29.145 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:30.418 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:30 smithi069 ceph-mon[29593]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:30.418 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:30 smithi069 ceph-mon[29593]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:30.418 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:30 smithi069 ceph-mon[29593]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-04-23T10:26:30.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:30 smithi146 ceph-mon[32800]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:30.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:30 smithi146 ceph-mon[32800]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:30.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:30 smithi146 ceph-mon[32800]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-04-23T10:26:30.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:30 smithi167 ceph-mon[32940]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:30.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:30 smithi167 ceph-mon[32940]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-23T10:26:30.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:30 smithi167 ceph-mon[32940]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-04-23T10:26:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.959+0000 7f86258b1700 1 -- 172.21.15.69:0/2717153691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8620100af0 msgr2=0x7f8620100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.959+0000 7f86258b1700 1 --2- 172.21.15.69:0/2717153691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8620100af0 0x7f8620100f50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8608009990 tx=0x7f8608009ca0 comp rx=0 tx=0).stop 2024-04-23T10:26:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.959+0000 7f86258b1700 1 -- 172.21.15.69:0/2717153691 shutdown_connections 2024-04-23T10:26:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.959+0000 7f86258b1700 1 --2- 172.21.15.69:0/2717153691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8620101490 0x7f862010b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.959+0000 7f86258b1700 1 --2- 172.21.15.69:0/2717153691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8620104070 0x7f8620104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.959+0000 7f86258b1700 1 --2- 172.21.15.69:0/2717153691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8620100af0 0x7f8620100f50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.959+0000 7f86258b1700 1 -- 172.21.15.69:0/2717153691 >> 172.21.15.69:0/2717153691 conn(0x7f86200fc6d0 msgr2=0x7f86200feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.959+0000 7f86258b1700 1 -- 172.21.15.69:0/2717153691 shutdown_connections 2024-04-23T10:26:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.959+0000 7f86258b1700 1 -- 172.21.15.69:0/2717153691 wait complete. 2024-04-23T10:26:30.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.959+0000 7f86258b1700 1 Processor -- start 2024-04-23T10:26:30.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.959+0000 7f86258b1700 1 -- start start 2024-04-23T10:26:30.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f86258b1700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8620100af0 0x7f8620103770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:30.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f86258b1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8620101490 0x7f8620101dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:30.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f86258b1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8620104070 0x7f8620102300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:30.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f86258b1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f862010e700 con 0x7f8620104070 2024-04-23T10:26:30.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f86258b1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f862010e580 con 0x7f8620101490 2024-04-23T10:26:30.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f86258b1700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f862010e880 con 0x7f8620100af0 2024-04-23T10:26:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f861f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8620104070 0x7f8620102300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f861f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8620104070 0x7f8620102300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58314/0 (socket says 172.21.15.69:58314) 2024-04-23T10:26:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f861f7fe700 1 -- 172.21.15.69:0/1257191761 learned_addr learned my addr 172.21.15.69:0/1257191761 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f861effd700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8620100af0 0x7f8620103770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f86167fc700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8620101490 0x7f8620101dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f861f7fe700 1 -- 172.21.15.69:0/1257191761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8620100af0 msgr2=0x7f8620103770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f861f7fe700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8620100af0 0x7f8620103770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f861f7fe700 1 -- 172.21.15.69:0/1257191761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8620101490 msgr2=0x7f8620101dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:30.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f861f7fe700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8620101490 0x7f8620101dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f861f7fe700 1 -- 172.21.15.69:0/1257191761 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8620102bb0 con 0x7f8620104070 2024-04-23T10:26:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f86167fc700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8620101490 0x7f8620101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.960+0000 7f861f7fe700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8620104070 0x7f8620102300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8618007ee0 tx=0x7f861800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.961+0000 7f86248af700 1 -- 172.21.15.69:0/1257191761 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861800dbd0 con 0x7f8620104070 2024-04-23T10:26:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.961+0000 7f86248af700 1 -- 172.21.15.69:0/1257191761 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f861800dd70 con 0x7f8620104070 2024-04-23T10:26:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.961+0000 7f86258b1700 1 -- 172.21.15.69:0/1257191761 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86201a2e80 con 0x7f8620104070 2024-04-23T10:26:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.961+0000 7f86248af700 1 -- 172.21.15.69:0/1257191761 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618005a50 con 0x7f8620104070 2024-04-23T10:26:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.961+0000 7f86258b1700 1 -- 172.21.15.69:0/1257191761 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86201a32e0 con 0x7f8620104070 2024-04-23T10:26:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.961+0000 7f86258b1700 1 -- 172.21.15.69:0/1257191761 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8620069730 con 0x7f8620104070 2024-04-23T10:26:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.963+0000 7f86248af700 1 -- 172.21.15.69:0/1257191761 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f861801a020 con 0x7f8620104070 2024-04-23T10:26:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.963+0000 7f86248af700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f860c0a3de0 0x7f860c0a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.963+0000 7f861effd700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f860c0a3de0 0x7f860c0a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.963+0000 7f86248af700 1 -- 172.21.15.69:0/1257191761 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f86180d01d0 con 0x7f8620104070 2024-04-23T10:26:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.964+0000 7f861effd700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f860c0a3de0 0x7f860c0a62a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f862006a440 tx=0x7f8610009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:30.967+0000 7f86248af700 1 -- 172.21.15.69:0/1257191761 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8618010070 con 0x7f8620104070 2024-04-23T10:26:31.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.173+0000 7f86258b1700 1 -- 172.21.15.69:0/1257191761 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f8620062e80 con 0x7f860c0a3de0 2024-04-23T10:26:31.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.174+0000 7f86248af700 1 -- 172.21.15.69:0/1257191761 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f8620062e80 con 0x7f860c0a3de0 2024-04-23T10:26:31.174 INFO:teuthology.orchestra.run.smithi069.stdout:HOST ADDR LABELS STATUS 2024-04-23T10:26:31.174 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069 172.21.15.69 2024-04-23T10:26:31.174 INFO:teuthology.orchestra.run.smithi069.stdout:smithi146 172.21.15.146 2024-04-23T10:26:31.174 INFO:teuthology.orchestra.run.smithi069.stdout:smithi167 172.21.15.167 2024-04-23T10:26:31.174 INFO:teuthology.orchestra.run.smithi069.stdout:3 hosts in cluster 2024-04-23T10:26:31.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.176+0000 7f86258b1700 1 -- 172.21.15.69:0/1257191761 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f860c0a3de0 msgr2=0x7f860c0a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.176+0000 7f86258b1700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f860c0a3de0 0x7f860c0a62a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f862006a440 tx=0x7f8610009190 comp rx=0 tx=0).stop 2024-04-23T10:26:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.176+0000 7f86258b1700 1 -- 172.21.15.69:0/1257191761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8620104070 msgr2=0x7f8620102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.176+0000 7f86258b1700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8620104070 0x7f8620102300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8618007ee0 tx=0x7f861800d3b0 comp rx=0 tx=0).stop 2024-04-23T10:26:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.177+0000 7f86258b1700 1 -- 172.21.15.69:0/1257191761 shutdown_connections 2024-04-23T10:26:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.177+0000 7f86258b1700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f860c0a3de0 0x7f860c0a62a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.177+0000 7f86258b1700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8620104070 0x7f8620102300 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.177+0000 7f86258b1700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8620100af0 0x7f8620103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.177+0000 7f86258b1700 1 --2- 172.21.15.69:0/1257191761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8620101490 0x7f8620101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.177+0000 7f86258b1700 1 -- 172.21.15.69:0/1257191761 >> 172.21.15.69:0/1257191761 conn(0x7f86200fc6d0 msgr2=0x7f8620107110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.177+0000 7f86258b1700 1 -- 172.21.15.69:0/1257191761 shutdown_connections 2024-04-23T10:26:31.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:31.177+0000 7f86258b1700 1 -- 172.21.15.69:0/1257191761 wait complete. 2024-04-23T10:26:31.795 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-23T10:26:32.034 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:32.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:32 smithi069 ceph-mon[29593]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T10:26:32.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:32 smithi146 ceph-mon[32800]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T10:26:32.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:32 smithi167 ceph-mon[32940]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-23T10:26:33.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:33 smithi146 ceph-mon[32800]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:33.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:33 smithi069 ceph-mon[29593]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:33.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:33 smithi167 ceph-mon[32940]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.867+0000 7fbff8247700 1 -- 172.21.15.69:0/2908616426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff01019a0 msgr2=0x7fbff0101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.867+0000 7fbff8247700 1 --2- 172.21.15.69:0/2908616426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff01019a0 0x7fbff0101dc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00099c0 tx=0x7fbfe0009cd0 comp rx=0 tx=0).stop 2024-04-23T10:26:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.867+0000 7fbff8247700 1 -- 172.21.15.69:0/2908616426 shutdown_connections 2024-04-23T10:26:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.867+0000 7fbff8247700 1 --2- 172.21.15.69:0/2908616426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff0103540 0x7fbff0109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.867+0000 7fbff8247700 1 --2- 172.21.15.69:0/2908616426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff01019a0 0x7fbff0101dc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.867+0000 7fbff8247700 1 --2- 172.21.15.69:0/2908616426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbff0102ba0 0x7fbff0103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.867+0000 7fbff8247700 1 -- 172.21.15.69:0/2908616426 >> 172.21.15.69:0/2908616426 conn(0x7fbff00fcf40 msgr2=0x7fbff00ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.867+0000 7fbff8247700 1 -- 172.21.15.69:0/2908616426 shutdown_connections 2024-04-23T10:26:33.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.867+0000 7fbff8247700 1 -- 172.21.15.69:0/2908616426 wait complete. 2024-04-23T10:26:33.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.868+0000 7fbff8247700 1 Processor -- start 2024-04-23T10:26:33.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.868+0000 7fbff8247700 1 -- start start 2024-04-23T10:26:33.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.868+0000 7fbff8247700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff01019a0 0x7fbff006bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:33.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.868+0000 7fbff8247700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff0102ba0 0x7fbff019da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:33.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.868+0000 7fbff8247700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbff0103540 0x7fbff01a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:33.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.868+0000 7fbff8247700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbff010d5d0 con 0x7fbff01019a0 2024-04-23T10:26:33.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.868+0000 7fbff8247700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbff010d450 con 0x7fbff0102ba0 2024-04-23T10:26:33.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.868+0000 7fbff8247700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbff010d750 con 0x7fbff0103540 2024-04-23T10:26:33.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.868+0000 7fbff5fe3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff01019a0 0x7fbff006bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.868+0000 7fbff5fe3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff01019a0 0x7fbff006bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58336/0 (socket says 172.21.15.69:58336) 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.868+0000 7fbff5fe3700 1 -- 172.21.15.69:0/1523723892 learned_addr learned my addr 172.21.15.69:0/1523723892 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff57e2700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff0102ba0 0x7fbff019da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff5fe3700 1 -- 172.21.15.69:0/1523723892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbff0103540 msgr2=0x7fbff01a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff67e4700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbff0103540 0x7fbff01a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff5fe3700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbff0103540 0x7fbff01a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff5fe3700 1 -- 172.21.15.69:0/1523723892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff0102ba0 msgr2=0x7fbff019da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff5fe3700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff0102ba0 0x7fbff019da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff5fe3700 1 -- 172.21.15.69:0/1523723892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff01a0930 con 0x7fbff01019a0 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff57e2700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff0102ba0 0x7fbff019da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff67e4700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbff0103540 0x7fbff01a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff5fe3700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff01019a0 0x7fbff006bcd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0006010 tx=0x7fbfe00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:33.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbfe6ffd700 1 -- 172.21.15.69:0/1523723892 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0027070 con 0x7fbff01019a0 2024-04-23T10:26:33.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff8247700 1 -- 172.21.15.69:0/1523723892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff01a0bc0 con 0x7fbff01019a0 2024-04-23T10:26:33.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbfe6ffd700 1 -- 172.21.15.69:0/1523723892 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbfe0022470 con 0x7fbff01019a0 2024-04-23T10:26:33.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbff8247700 1 -- 172.21.15.69:0/1523723892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff01a1070 con 0x7fbff01019a0 2024-04-23T10:26:33.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.869+0000 7fbfe6ffd700 1 -- 172.21.15.69:0/1523723892 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000f6e0 con 0x7fbff01019a0 2024-04-23T10:26:33.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.870+0000 7fbff8247700 1 -- 172.21.15.69:0/1523723892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff0069730 con 0x7fbff01019a0 2024-04-23T10:26:33.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.872+0000 7fbfe6ffd700 1 -- 172.21.15.69:0/1523723892 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fbfe002a070 con 0x7fbff01019a0 2024-04-23T10:26:33.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.872+0000 7fbfe6ffd700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbfdc0a3c40 0x7fbfdc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:33.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.872+0000 7fbff57e2700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbfdc0a3c40 0x7fbfdc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:33.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.872+0000 7fbfe6ffd700 1 -- 172.21.15.69:0/1523723892 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fbfe00d1590 con 0x7fbff01019a0 2024-04-23T10:26:33.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.873+0000 7fbff57e2700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbfdc0a3c40 0x7fbfdc0a6100 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbff006c250 tx=0x7fbfec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:33.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:33.876+0000 7fbfe6ffd700 1 -- 172.21.15.69:0/1523723892 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbfe0013070 con 0x7fbff01019a0 2024-04-23T10:26:34.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.083+0000 7fbff8247700 1 -- 172.21.15.69:0/1523723892 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fbff0062e80 con 0x7fbfdc0a3c40 2024-04-23T10:26:34.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.085+0000 7fbfe6ffd700 1 -- 172.21.15.69:0/1523723892 <== mgr.14152 v2:172.21.15.69:6800/847729550 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fbff0062e80 con 0x7fbfdc0a3c40 2024-04-23T10:26:34.084 INFO:teuthology.orchestra.run.smithi069.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-23T10:26:34.084 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y0400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-23T10:26:34.084 INFO:teuthology.orchestra.run.smithi069.stdout:smithi146 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GB400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-23T10:26:34.084 INFO:teuthology.orchestra.run.smithi069.stdout:smithi167 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330080400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-23T10:26:34.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 -- 172.21.15.69:0/1523723892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbfdc0a3c40 msgr2=0x7fbfdc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:34.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbfdc0a3c40 0x7fbfdc0a6100 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbff006c250 tx=0x7fbfec008040 comp rx=0 tx=0).stop 2024-04-23T10:26:34.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 -- 172.21.15.69:0/1523723892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff01019a0 msgr2=0x7fbff006bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:34.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff01019a0 0x7fbff006bcd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0006010 tx=0x7fbfe00047b0 comp rx=0 tx=0).stop 2024-04-23T10:26:34.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 -- 172.21.15.69:0/1523723892 shutdown_connections 2024-04-23T10:26:34.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbfdc0a3c40 0x7fbfdc0a6100 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:34.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbff0103540 0x7fbff01a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:34.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff01019a0 0x7fbff006bcd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:34.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 --2- 172.21.15.69:0/1523723892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff0102ba0 0x7fbff019da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:34.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 -- 172.21.15.69:0/1523723892 >> 172.21.15.69:0/1523723892 conn(0x7fbff00fcf40 msgr2=0x7fbff0105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:34.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 -- 172.21.15.69:0/1523723892 shutdown_connections 2024-04-23T10:26:34.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:34.087+0000 7fbff8247700 1 -- 172.21.15.69:0/1523723892 wait complete. 2024-04-23T10:26:34.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:34 smithi146 ceph-mon[32800]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-04-23T10:26:34.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:34 smithi069 ceph-mon[29593]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-04-23T10:26:34.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:34 smithi167 ceph-mon[32940]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-04-23T10:26:34.902 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-23T10:26:34.911 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-04-23T10:26:34.911 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-23T10:26:35.157 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:35.417 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:35 smithi069 ceph-mon[29593]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:35.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:35 smithi146 ceph-mon[32800]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:35.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:35 smithi167 ceph-mon[32940]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:36.304 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:36 smithi069 ceph-mon[29593]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T10:26:36.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:36 smithi146 ceph-mon[32800]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T10:26:36.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:36 smithi167 ceph-mon[32940]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T10:26:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.860+0000 7fcfb3998700 1 -- 172.21.15.69:0/3979276046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfac103580 msgr2=0x7fcfac109e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.860+0000 7fcfb3998700 1 --2- 172.21.15.69:0/3979276046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfac103580 0x7fcfac109e30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400b0d0 tx=0x7fcfa400b3e0 comp rx=0 tx=0).stop 2024-04-23T10:26:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.860+0000 7fcfb3998700 1 -- 172.21.15.69:0/3979276046 shutdown_connections 2024-04-23T10:26:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.860+0000 7fcfb3998700 1 --2- 172.21.15.69:0/3979276046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfac103580 0x7fcfac109e30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.860+0000 7fcfb3998700 1 --2- 172.21.15.69:0/3979276046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfac1019e0 0x7fcfac101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.860+0000 7fcfb3998700 1 --2- 172.21.15.69:0/3979276046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfac102be0 0x7fcfac103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.860+0000 7fcfb3998700 1 -- 172.21.15.69:0/3979276046 >> 172.21.15.69:0/3979276046 conn(0x7fcfac0fcfa0 msgr2=0x7fcfac0ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.860+0000 7fcfb3998700 1 -- 172.21.15.69:0/3979276046 shutdown_connections 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.860+0000 7fcfb3998700 1 -- 172.21.15.69:0/3979276046 wait complete. 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb3998700 1 Processor -- start 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb3998700 1 -- start start 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb3998700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfac1019e0 0x7fcfac06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb3998700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfac102be0 0x7fcfac19daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb3998700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfac103580 0x7fcfac1a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb3998700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fcfac10d6b0 con 0x7fcfac103580 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb3998700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcfac10d530 con 0x7fcfac1019e0 2024-04-23T10:26:36.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb3998700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcfac10d830 con 0x7fcfac102be0 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb1f35700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfac103580 0x7fcfac1a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb1f35700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfac103580 0x7fcfac1a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58354/0 (socket says 172.21.15.69:58354) 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb1f35700 1 -- 172.21.15.69:0/707804634 learned_addr learned my addr 172.21.15.69:0/707804634 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb1734700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfac1019e0 0x7fcfac06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb0f33700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfac102be0 0x7fcfac19daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.861+0000 7fcfb1f35700 1 -- 172.21.15.69:0/707804634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfac102be0 msgr2=0x7fcfac19daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.862+0000 7fcfb1f35700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfac102be0 0x7fcfac19daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.862+0000 7fcfb1f35700 1 -- 172.21.15.69:0/707804634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfac1019e0 msgr2=0x7fcfac06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.862+0000 7fcfb1f35700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfac1019e0 0x7fcfac06bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.862+0000 7fcfb1f35700 1 -- 172.21.15.69:0/707804634 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfac1a0a00 con 0x7fcfac103580 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.862+0000 7fcfb1f35700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfac103580 0x7fcfac1a0130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009cd0 tx=0x7fcfa4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.862+0000 7fcfa27fc700 1 -- 172.21.15.69:0/707804634 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4021070 con 0x7fcfac103580 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.862+0000 7fcfa27fc700 1 -- 172.21.15.69:0/707804634 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfa401dd30 con 0x7fcfac103580 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.862+0000 7fcfa27fc700 1 -- 172.21.15.69:0/707804634 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa401bdc0 con 0x7fcfac103580 2024-04-23T10:26:36.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.862+0000 7fcfb3998700 1 -- 172.21.15.69:0/707804634 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfac1a0c90 con 0x7fcfac103580 2024-04-23T10:26:36.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.862+0000 7fcfb3998700 1 -- 172.21.15.69:0/707804634 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfac1a1110 con 0x7fcfac103580 2024-04-23T10:26:36.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.863+0000 7fcfb3998700 1 -- 172.21.15.69:0/707804634 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfac02df80 con 0x7fcfac103580 2024-04-23T10:26:36.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.864+0000 7fcfa27fc700 1 -- 172.21.15.69:0/707804634 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fcfa4024070 con 0x7fcfac103580 2024-04-23T10:26:36.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.864+0000 7fcfa27fc700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fcf980a3c40 0x7fcf980a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:36.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.865+0000 7fcfb1734700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fcf980a3c40 0x7fcf980a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:36.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.865+0000 7fcfa27fc700 1 -- 172.21.15.69:0/707804634 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fcfa400f020 con 0x7fcfac103580 2024-04-23T10:26:36.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.865+0000 7fcfb1734700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fcf980a3c40 0x7fcf980a6100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcfac102a40 tx=0x7fcf9c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:36.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:36.868+0000 7fcfa27fc700 1 -- 172.21.15.69:0/707804634 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcfa402b020 con 0x7fcfac103580 2024-04-23T10:26:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.112+0000 7fcfb3998700 1 -- 172.21.15.69:0/707804634 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fcfac02e1a0 con 0x7fcfac103580 2024-04-23T10:26:37.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.112+0000 7fcfa27fc700 1 -- 172.21.15.69:0/707804634 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3089 (secure 0 0 0) 0x7fcfa409ea50 con 0x7fcfac103580 2024-04-23T10:26:37.112 INFO:teuthology.orchestra.run.smithi069.stdout:e25 2024-04-23T10:26:37.112 INFO:teuthology.orchestra.run.smithi069.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-23T10:26:37.112 INFO:teuthology.orchestra.run.smithi069.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T10:26:37.112 INFO:teuthology.orchestra.run.smithi069.stdout:legacy client fscid: 1 2024-04-23T10:26:37.112 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:37.112 INFO:teuthology.orchestra.run.smithi069.stdout:Filesystem 'cephfs' (1) 2024-04-23T10:26:37.112 INFO:teuthology.orchestra.run.smithi069.stdout:fs_name cephfs 2024-04-23T10:26:37.112 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 25 2024-04-23T10:26:37.112 INFO:teuthology.orchestra.run.smithi069.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-23T10:26:37.112 INFO:teuthology.orchestra.run.smithi069.stdout:created 2024-04-23T10:24:52.877417+0000 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:modified 2024-04-23T10:24:59.329454+0000 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:tableserver 0 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:root 0 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:session_timeout 300 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:session_autoclose 300 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:max_file_size 1099511627776 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:max_xattr_size 65536 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:required_client_features {} 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:last_failure 0 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:last_failure_osd_epoch 0 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:max_mds 5 2024-04-23T10:26:37.113 INFO:teuthology.orchestra.run.smithi069.stdout:in 0,1,2,3,4 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:up {0=24487,1=24463,2=24421,3=24416,4=24392} 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:failed 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:damaged 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:stopped 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:data_pools [3] 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:metadata_pool 2 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:inline_data disabled 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:balancer 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:bal_rank_mask -1 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:standby_count_wanted 0 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:qdb_cluster leader: 24487 members: 24463,24421,24487,24416,24392 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.i{0:24487} state up:active seq 5 addr [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.114 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.f{0:24454} state up:standby-replay seq 1 addr [v2:172.21.15.167:6834/2993393777,v1:172.21.15.167:6835/2993393777] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c{1:24463} state up:active seq 7 addr [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b{1:24449} state up:standby-replay seq 1 addr [v2:172.21.15.146:6838/712940861,v1:172.21.15.146:6839/712940861] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.l{2:24421} state up:active seq 11 addr [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.k{2:24368} state up:standby-replay seq 1 addr [v2:172.21.15.146:6832/318414865,v1:172.21.15.146:6833/318414865] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.h{3:24416} state up:active seq 7 addr [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a{3:14643} state up:standby-replay seq 1 addr [v2:172.21.15.69:6840/3448889268,v1:172.21.15.69:6841/3448889268] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.e{4:24392} state up:active seq 9 addr [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.g{4:14631} state up:standby-replay seq 1 addr [v2:172.21.15.69:6838/441538329,v1:172.21.15.69:6839/441538329] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout:Standby daemons: 2024-04-23T10:26:37.115 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:37.116 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.j{-1:14544} state up:standby seq 1 addr [v2:172.21.15.69:6834/731475212,v1:172.21.15.69:6835/731475212] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.116 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d{-1:14562} state up:standby seq 1 addr [v2:172.21.15.69:6836/3924839786,v1:172.21.15.69:6837/3924839786] compat {c=[1],r=[1],i=[1fff]}] 2024-04-23T10:26:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.114+0000 7fcfb3998700 1 -- 172.21.15.69:0/707804634 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fcf980a3c40 msgr2=0x7fcf980a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.114+0000 7fcfb3998700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fcf980a3c40 0x7fcf980a6100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcfac102a40 tx=0x7fcf9c009190 comp rx=0 tx=0).stop 2024-04-23T10:26:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.114+0000 7fcfb3998700 1 -- 172.21.15.69:0/707804634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfac103580 msgr2=0x7fcfac1a0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.114+0000 7fcfb3998700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfac103580 0x7fcfac1a0130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009cd0 tx=0x7fcfa4007d90 comp rx=0 tx=0).stop 2024-04-23T10:26:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.114+0000 7fcfb3998700 1 -- 172.21.15.69:0/707804634 shutdown_connections 2024-04-23T10:26:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.114+0000 7fcfb3998700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fcf980a3c40 0x7fcf980a6100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.114+0000 7fcfb3998700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfac103580 0x7fcfac1a0130 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:37.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.114+0000 7fcfb3998700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfac1019e0 0x7fcfac06bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.114+0000 7fcfb3998700 1 --2- 172.21.15.69:0/707804634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfac102be0 0x7fcfac19daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.114+0000 7fcfb3998700 1 -- 172.21.15.69:0/707804634 >> 172.21.15.69:0/707804634 conn(0x7fcfac0fcfa0 msgr2=0x7fcfac105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.115+0000 7fcfb3998700 1 -- 172.21.15.69:0/707804634 shutdown_connections 2024-04-23T10:26:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:37.115+0000 7fcfb3998700 1 -- 172.21.15.69:0/707804634 wait complete. 2024-04-23T10:26:37.118 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 25 2024-04-23T10:26:37.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:37 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/707804634' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T10:26:37.487 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:37 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/707804634' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T10:26:37.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:37 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/707804634' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-23T10:26:37.933 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-23T10:26:38.172 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:38.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:38 smithi069 ceph-mon[29593]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2024-04-23T10:26:38.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:38 smithi146 ceph-mon[32800]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2024-04-23T10:26:38.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:38 smithi167 ceph-mon[32940]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2024-04-23T10:26:39.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.911+0000 7fd0eec6c700 1 -- 172.21.15.69:0/914799683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0e8103540 msgr2=0x7fd0e8109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:39.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.911+0000 7fd0eec6c700 1 --2- 172.21.15.69:0/914799683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0e8103540 0x7fd0e8109df0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000b0d0 tx=0x7fd0e000b3e0 comp rx=0 tx=0).stop 2024-04-23T10:26:39.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.911+0000 7fd0eec6c700 1 -- 172.21.15.69:0/914799683 shutdown_connections 2024-04-23T10:26:39.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.911+0000 7fd0eec6c700 1 --2- 172.21.15.69:0/914799683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0e8103540 0x7fd0e8109df0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:39.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.911+0000 7fd0eec6c700 1 --2- 172.21.15.69:0/914799683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e81019a0 0x7fd0e8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:39.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.911+0000 7fd0eec6c700 1 --2- 172.21.15.69:0/914799683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0e8102ba0 0x7fd0e8103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:39.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.911+0000 7fd0eec6c700 1 -- 172.21.15.69:0/914799683 >> 172.21.15.69:0/914799683 conn(0x7fd0e80fcf40 msgr2=0x7fd0e80ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:39.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.911+0000 7fd0eec6c700 1 -- 172.21.15.69:0/914799683 shutdown_connections 2024-04-23T10:26:39.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.911+0000 7fd0eec6c700 1 -- 172.21.15.69:0/914799683 wait complete. 2024-04-23T10:26:39.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0eec6c700 1 Processor -- start 2024-04-23T10:26:39.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0eec6c700 1 -- start start 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0eec6c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e81019a0 0x7fd0e8196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0eec6c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0e8102ba0 0x7fd0e8196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0eec6c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0e8103540 0x7fd0e819dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0eec6c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e810c4a0 con 0x7fd0e8102ba0 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0eec6c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e810c320 con 0x7fd0e8103540 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0eec6c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e810c620 con 0x7fd0e81019a0 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0e8102ba0 0x7fd0e8196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0e8102ba0 0x7fd0e8196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47028/0 (socket says 172.21.15.69:47028) 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0e7fff700 1 -- 172.21.15.69:0/3567133633 learned_addr learned my addr 172.21.15.69:0/3567133633 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0ed209700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0e8103540 0x7fd0e819dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.912+0000 7fd0eca08700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e81019a0 0x7fd0e8196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:39.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.913+0000 7fd0e7fff700 1 -- 172.21.15.69:0/3567133633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e81019a0 msgr2=0x7fd0e8196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:39.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.913+0000 7fd0e7fff700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e81019a0 0x7fd0e8196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:39.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.913+0000 7fd0e7fff700 1 -- 172.21.15.69:0/3567133633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0e8103540 msgr2=0x7fd0e819dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:39.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.913+0000 7fd0e7fff700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0e8103540 0x7fd0e819dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:39.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.913+0000 7fd0e7fff700 1 -- 172.21.15.69:0/3567133633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e819e680 con 0x7fd0e8102ba0 2024-04-23T10:26:39.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.913+0000 7fd0e7fff700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0e8102ba0 0x7fd0e8196f60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400c950 tx=0x7fd0d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:39.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.913+0000 7fd0e5ffb700 1 -- 172.21.15.69:0/3567133633 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40078d0 con 0x7fd0e8102ba0 2024-04-23T10:26:39.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.913+0000 7fd0e5ffb700 1 -- 172.21.15.69:0/3567133633 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd0d400f450 con 0x7fd0e8102ba0 2024-04-23T10:26:39.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.913+0000 7fd0eec6c700 1 -- 172.21.15.69:0/3567133633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e819e970 con 0x7fd0e8102ba0 2024-04-23T10:26:39.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.913+0000 7fd0e5ffb700 1 -- 172.21.15.69:0/3567133633 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4018660 con 0x7fd0e8102ba0 2024-04-23T10:26:39.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.913+0000 7fd0eec6c700 1 -- 172.21.15.69:0/3567133633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e819ef00 con 0x7fd0e8102ba0 2024-04-23T10:26:39.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.914+0000 7fd0eec6c700 1 -- 172.21.15.69:0/3567133633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e8069730 con 0x7fd0e8102ba0 2024-04-23T10:26:39.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.915+0000 7fd0e5ffb700 1 -- 172.21.15.69:0/3567133633 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fd0d400f600 con 0x7fd0e8102ba0 2024-04-23T10:26:39.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.915+0000 7fd0e5ffb700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd0d80a5ed0 0x7fd0d80a8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:39.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.916+0000 7fd0eca08700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd0d80a5ed0 0x7fd0d80a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:39.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.916+0000 7fd0e5ffb700 1 -- 172.21.15.69:0/3567133633 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fd0d40d0270 con 0x7fd0e8102ba0 2024-04-23T10:26:39.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.916+0000 7fd0eca08700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd0d80a5ed0 0x7fd0d80a8390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8102a00 tx=0x7fd0dc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:39.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:39.920+0000 7fd0e5ffb700 1 -- 172.21.15.69:0/3567133633 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd0d4014030 con 0x7fd0e8102ba0 2024-04-23T10:26:40.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.122+0000 7fd0eec6c700 1 -- 172.21.15.69:0/3567133633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fd0e8063650 con 0x7fd0e8102ba0 2024-04-23T10:26:40.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.122+0000 7fd0e5ffb700 1 -- 172.21.15.69:0/3567133633 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5282 (secure 0 0 0) 0x7fd0d4016300 con 0x7fd0e8102ba0 2024-04-23T10:26:40.122 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 88 2024-04-23T10:26:40.122 INFO:teuthology.orchestra.run.smithi069.stdout:fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:26:40.122 INFO:teuthology.orchestra.run.smithi069.stdout:created 2024-04-23T10:17:06.615299+0000 2024-04-23T10:26:40.122 INFO:teuthology.orchestra.run.smithi069.stdout:modified 2024-04-23T10:26:00.078482+0000 2024-04-23T10:26:40.122 INFO:teuthology.orchestra.run.smithi069.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-23T10:26:40.122 INFO:teuthology.orchestra.run.smithi069.stdout:crush_version 26 2024-04-23T10:26:40.122 INFO:teuthology.orchestra.run.smithi069.stdout:full_ratio 0.95 2024-04-23T10:26:40.122 INFO:teuthology.orchestra.run.smithi069.stdout:backfillfull_ratio 0.9 2024-04-23T10:26:40.122 INFO:teuthology.orchestra.run.smithi069.stdout:nearfull_ratio 0.85 2024-04-23T10:26:40.122 INFO:teuthology.orchestra.run.smithi069.stdout:require_min_compat_client luminous 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:min_compat_client luminous 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:require_osd_release squid 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:stretch_mode_enabled false 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:max_osd 12 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6802/3356554384,v1:172.21.15.69:6803/3356554384] [v2:172.21.15.69:6804/3356554384,v1:172.21.15.69:6805/3356554384] exists,up 923a3db0-8499-4796-95e0-e95c2edfe544 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:osd.1 up in weight 1 up_from 13 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6800/3367484957,v1:172.21.15.146:6801/3367484957] [v2:172.21.15.146:6802/3367484957,v1:172.21.15.146:6803/3367484957] exists,up 17631476-4d26-4024-8f2c-189f271784e2 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6800/683605644,v1:172.21.15.167:6801/683605644] [v2:172.21.15.167:6802/683605644,v1:172.21.15.167:6803/683605644] exists,up 8acd12b7-4162-4f91-b3c6-772c8602c23c 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6810/4041470719,v1:172.21.15.69:6811/4041470719] [v2:172.21.15.69:6812/4041470719,v1:172.21.15.69:6813/4041470719] exists,up 98a9cc15-ea9d-49a8-9173-3011a6547589 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:osd.4 up in weight 1 up_from 34 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6808/1408511598,v1:172.21.15.146:6809/1408511598] [v2:172.21.15.146:6810/1408511598,v1:172.21.15.146:6811/1408511598] exists,up 510df960-9801-46ba-8a2d-c4e89df94af9 2024-04-23T10:26:40.123 INFO:teuthology.orchestra.run.smithi069.stdout:osd.5 up in weight 1 up_from 39 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6808/2875657496,v1:172.21.15.167:6809/2875657496] [v2:172.21.15.167:6810/2875657496,v1:172.21.15.167:6811/2875657496] exists,up 9d20822f-0707-4836-96ac-f7dde45401f3 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:osd.6 up in weight 1 up_from 47 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6818/556723413,v1:172.21.15.69:6819/556723413] [v2:172.21.15.69:6820/556723413,v1:172.21.15.69:6821/556723413] exists,up a6e4d748-c616-4ae4-a9ad-96a45037a58d 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:osd.7 up in weight 1 up_from 52 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6816/2492628604,v1:172.21.15.146:6817/2492628604] [v2:172.21.15.146:6818/2492628604,v1:172.21.15.146:6819/2492628604] exists,up f7ee0b7c-ea72-4bbc-9b24-543d6925263c 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:osd.8 up in weight 1 up_from 60 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6816/625996667,v1:172.21.15.167:6817/625996667] [v2:172.21.15.167:6818/625996667,v1:172.21.15.167:6819/625996667] exists,up 517269ab-67bb-46bf-9033-10bc65126107 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:osd.9 up in weight 1 up_from 68 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6826/2332420509,v1:172.21.15.69:6827/2332420509] [v2:172.21.15.69:6828/2332420509,v1:172.21.15.69:6829/2332420509] exists,up e141cd07-18ba-42c3-b3c8-86b81eee032b 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:osd.10 up in weight 1 up_from 73 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6824/1086639302,v1:172.21.15.146:6825/1086639302] [v2:172.21.15.146:6826/1086639302,v1:172.21.15.146:6827/1086639302] exists,up 5b6dcefa-91b3-4973-a57e-bda851fa473e 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:osd.11 up in weight 1 up_from 81 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6824/2968784052,v1:172.21.15.167:6825/2968784052] [v2:172.21.15.167:6826/2968784052,v1:172.21.15.167:6827/2968784052] exists,up d0630ee1-83c8-478f-951f-1175ca84eb16 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 2.6 [8,11] 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 2.8 [2,11] 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.3 [4,9] 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.c [3,9] 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.e [5,9] 2024-04-23T10:26:40.124 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.17 [4,8] 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.1a [5,6] 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.31 [4,7] 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6801/3345837257 expires 2024-04-24T10:17:58.923795+0000 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/2765886879 expires 2024-04-24T10:17:58.923795+0000 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/2817046344 expires 2024-04-24T10:17:58.923795+0000 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6800/2746602813 expires 2024-04-24T10:17:32.944635+0000 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6801/2746602813 expires 2024-04-24T10:17:32.944635+0000 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/3571277589 expires 2024-04-24T10:17:32.944635+0000 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6800/3345837257 expires 2024-04-24T10:17:58.923795+0000 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/617257351 expires 2024-04-24T10:17:32.944635+0000 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/1291208672 expires 2024-04-24T10:17:32.944635+0000 2024-04-23T10:26:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/1162910246 expires 2024-04-24T10:17:58.923795+0000 2024-04-23T10:26:40.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 -- 172.21.15.69:0/3567133633 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd0d80a5ed0 msgr2=0x7fd0d80a8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:40.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd0d80a5ed0 0x7fd0d80a8390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8102a00 tx=0x7fd0dc00a380 comp rx=0 tx=0).stop 2024-04-23T10:26:40.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 -- 172.21.15.69:0/3567133633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0e8102ba0 msgr2=0x7fd0e8196f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:40.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0e8102ba0 0x7fd0e8196f60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400c950 tx=0x7fd0d400cc60 comp rx=0 tx=0).stop 2024-04-23T10:26:40.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 -- 172.21.15.69:0/3567133633 shutdown_connections 2024-04-23T10:26:40.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fd0d80a5ed0 0x7fd0d80a8390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:40.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0e8103540 0x7fd0e819dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:40.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e81019a0 0x7fd0e8196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:40.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 --2- 172.21.15.69:0/3567133633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0e8102ba0 0x7fd0e8196f60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:40.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 -- 172.21.15.69:0/3567133633 >> 172.21.15.69:0/3567133633 conn(0x7fd0e80fcf40 msgr2=0x7fd0e8105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:40.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 -- 172.21.15.69:0/3567133633 shutdown_connections 2024-04-23T10:26:40.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.125+0000 7fd0eec6c700 1 -- 172.21.15.69:0/3567133633 wait complete. 2024-04-23T10:26:40.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:40 smithi069 ceph-mon[29593]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-23T10:26:40.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:40 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3567133633' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-23T10:26:40.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:40 smithi146 ceph-mon[32800]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-23T10:26:40.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:40 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3567133633' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-23T10:26:40.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:40 smithi167 ceph-mon[32940]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-23T10:26:40.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:40 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3567133633' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-23T10:26:40.824 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-23T10:26:40.836 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:26:40.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.940+0000 7fc1cee31640 1 -- 172.21.15.69:0/1890543075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1c8100e90 msgr2=0x7fc1c81012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:40.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.940+0000 7fc1cee31640 1 --2- 172.21.15.69:0/1890543075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1c8100e90 0x7fc1c81012b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009900 tx=0x7fc1bc02a410 comp rx=0 tx=0).stop 2024-04-23T10:26:40.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.940+0000 7fc1cee31640 1 -- 172.21.15.69:0/1890543075 shutdown_connections 2024-04-23T10:26:40.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.940+0000 7fc1cee31640 1 --2- 172.21.15.69:0/1890543075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c81029a0 0x7fc1c81092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:40.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.940+0000 7fc1cee31640 1 --2- 172.21.15.69:0/1890543075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1c8101fe0 0x7fc1c8102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:40.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.940+0000 7fc1cee31640 1 --2- 172.21.15.69:0/1890543075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1c8100e90 0x7fc1c81012b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:40.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.940+0000 7fc1cee31640 1 -- 172.21.15.69:0/1890543075 >> 172.21.15.69:0/1890543075 conn(0x7fc1c80fc400 msgr2=0x7fc1c80fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:40.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.940+0000 7fc1cee31640 1 -- 172.21.15.69:0/1890543075 shutdown_connections 2024-04-23T10:26:40.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.940+0000 7fc1cee31640 1 -- 172.21.15.69:0/1890543075 wait complete. 2024-04-23T10:26:40.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.940+0000 7fc1cee31640 1 Processor -- start 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1cee31640 1 -- start start 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1cee31640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1c8100e90 0x7fc1c8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1cee31640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1c8101fe0 0x7fc1c8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1cee31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c81029a0 0x7fc1c819fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1cee31640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c810dd20 con 0x7fc1c8100e90 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1cee31640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c810dba0 con 0x7fc1c8101fe0 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1cee31640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c810dea0 con 0x7fc1c81029a0 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1ccbcd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1c8100e90 0x7fc1c8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1ccbcd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1c8100e90 0x7fc1c8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47052/0 (socket says 172.21.15.69:47052) 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1ccbcd640 1 -- 172.21.15.69:0/1713162010 learned_addr learned my addr 172.21.15.69:0/1713162010 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1ccbcd640 1 -- 172.21.15.69:0/1713162010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c81029a0 msgr2=0x7fc1c819fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1ccbcd640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c81029a0 0x7fc1c819fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1ccbcd640 1 -- 172.21.15.69:0/1713162010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1c8101fe0 msgr2=0x7fc1c8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:40.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1ccbcd640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1c8101fe0 0x7fc1c8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:40.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1ccbcd640 1 -- 172.21.15.69:0/1713162010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c81a0070 con 0x7fc1c8100e90 2024-04-23T10:26:40.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1ccbcd640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1c8100e90 0x7fc1c8198450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc031570 tx=0x7fc1bc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:40.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1c5ffb640 1 -- 172.21.15.69:0/1713162010 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc03f030 con 0x7fc1c8100e90 2024-04-23T10:26:40.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1c5ffb640 1 -- 172.21.15.69:0/1713162010 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc1bc003cd0 con 0x7fc1c8100e90 2024-04-23T10:26:40.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1cee31640 1 -- 172.21.15.69:0/1713162010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c81a0300 con 0x7fc1c8100e90 2024-04-23T10:26:40.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.941+0000 7fc1c5ffb640 1 -- 172.21.15.69:0/1713162010 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc035070 con 0x7fc1c8100e90 2024-04-23T10:26:40.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.942+0000 7fc1cee31640 1 -- 172.21.15.69:0/1713162010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c81a08c0 con 0x7fc1c8100e90 2024-04-23T10:26:40.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.943+0000 7fc1cee31640 1 -- 172.21.15.69:0/1713162010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c8108270 con 0x7fc1c8100e90 2024-04-23T10:26:40.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.944+0000 7fc1c5ffb640 1 -- 172.21.15.69:0/1713162010 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fc1bc003800 con 0x7fc1c8100e90 2024-04-23T10:26:40.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.944+0000 7fc1c5ffb640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc1b80a3c30 0x7fc1b80a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:40.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.944+0000 7fc1c7fff640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc1b80a3c30 0x7fc1b80a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:40.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.944+0000 7fc1c5ffb640 1 -- 172.21.15.69:0/1713162010 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fc1bc0f0f10 con 0x7fc1c8100e90 2024-04-23T10:26:40.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.945+0000 7fc1c7fff640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc1b80a3c30 0x7fc1b80a60f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8199960 tx=0x7fc1b4006c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:40.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:40.948+0000 7fc1c5ffb640 1 -- 172.21.15.69:0/1713162010 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc1bc003af0 con 0x7fc1c8100e90 2024-04-23T10:26:41.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.130+0000 7fc1cee31640 1 -- 172.21.15.69:0/1713162010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1c8062bf0 con 0x7fc1c8100e90 2024-04-23T10:26:41.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.131+0000 7fc1c5ffb640 1 -- 172.21.15.69:0/1713162010 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22595 (secure 0 0 0) 0x7fc1bc0bd8a0 con 0x7fc1c8100e90 2024-04-23T10:26:41.131 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:41.131 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":88,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:26:00.078482+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:26:41.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.133+0000 7fc1cee31640 1 -- 172.21.15.69:0/1713162010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc1b80a3c30 msgr2=0x7fc1b80a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.133+0000 7fc1cee31640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc1b80a3c30 0x7fc1b80a60f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8199960 tx=0x7fc1b4006c90 comp rx=0 tx=0).stop 2024-04-23T10:26:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.133+0000 7fc1cee31640 1 -- 172.21.15.69:0/1713162010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1c8100e90 msgr2=0x7fc1c8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.133+0000 7fc1cee31640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1c8100e90 0x7fc1c8198450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc031570 tx=0x7fc1bc004430 comp rx=0 tx=0).stop 2024-04-23T10:26:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.134+0000 7fc1cee31640 1 -- 172.21.15.69:0/1713162010 shutdown_connections 2024-04-23T10:26:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.134+0000 7fc1cee31640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fc1b80a3c30 0x7fc1b80a60f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.134+0000 7fc1cee31640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c81029a0 0x7fc1c819fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.134+0000 7fc1cee31640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1c8101fe0 0x7fc1c8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.134+0000 7fc1cee31640 1 --2- 172.21.15.69:0/1713162010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc1c8100e90 0x7fc1c8198450 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.134+0000 7fc1cee31640 1 -- 172.21.15.69:0/1713162010 >> 172.21.15.69:0/1713162010 conn(0x7fc1c80fc400 msgr2=0x7fc1c8105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.134+0000 7fc1cee31640 1 -- 172.21.15.69:0/1713162010 shutdown_connections 2024-04-23T10:26:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.134+0000 7fc1cee31640 1 -- 172.21.15.69:0/1713162010 wait complete. 2024-04-23T10:26:41.144 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:24:50.484063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:24:51.816315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:26:41.145 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:26:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.267+0000 7f9b1840b640 1 -- 172.21.15.69:0/449547937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b10101f90 msgr2=0x7f9b101023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.267+0000 7f9b1840b640 1 --2- 172.21.15.69:0/449547937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b10101f90 0x7f9b101023b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009900 tx=0x7f9b0002a410 comp rx=0 tx=0).stop 2024-04-23T10:26:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.267+0000 7f9b1840b640 1 -- 172.21.15.69:0/449547937 shutdown_connections 2024-04-23T10:26:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.267+0000 7f9b1840b640 1 --2- 172.21.15.69:0/449547937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b10103b40 0x7f9b1010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.267+0000 7f9b1840b640 1 --2- 172.21.15.69:0/449547937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b10103180 0x7f9b10103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.267+0000 7f9b1840b640 1 --2- 172.21.15.69:0/449547937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b10101f90 0x7f9b101023b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.267+0000 7f9b1840b640 1 -- 172.21.15.69:0/449547937 >> 172.21.15.69:0/449547937 conn(0x7f9b100fd500 msgr2=0x7f9b100ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.267+0000 7f9b1840b640 1 -- 172.21.15.69:0/449547937 shutdown_connections 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.267+0000 7f9b1840b640 1 -- 172.21.15.69:0/449547937 wait complete. 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.267+0000 7f9b1840b640 1 Processor -- start 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b1840b640 1 -- start start 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b1840b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b10101f90 0x7f9b10198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b1840b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b10103180 0x7f9b10198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b1840b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b10103b40 0x7f9b1019f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b1840b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1010dbf0 con 0x7f9b10101f90 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b1840b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1010da70 con 0x7f9b10103180 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b1840b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1010dd70 con 0x7f9b10103b40 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b161a7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b10101f90 0x7f9b10198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b161a7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b10101f90 0x7f9b10198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47070/0 (socket says 172.21.15.69:47070) 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b161a7640 1 -- 172.21.15.69:0/2101419264 learned_addr learned my addr 172.21.15.69:0/2101419264 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b159a6640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b10103180 0x7f9b10198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b169a8640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b10103b40 0x7f9b1019f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b161a7640 1 -- 172.21.15.69:0/2101419264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b10103b40 msgr2=0x7f9b1019f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b161a7640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b10103b40 0x7f9b1019f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b161a7640 1 -- 172.21.15.69:0/2101419264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b10103180 msgr2=0x7f9b10198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b161a7640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b10103180 0x7f9b10198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b161a7640 1 -- 172.21.15.69:0/2101419264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1019ff20 con 0x7f9b10101f90 2024-04-23T10:26:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.268+0000 7f9b161a7640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b10101f90 0x7f9b10198300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9b00006010 tx=0x7f9b000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.269+0000 7f9b077fe640 1 -- 172.21.15.69:0/2101419264 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0003f030 con 0x7f9b10101f90 2024-04-23T10:26:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.269+0000 7f9b1840b640 1 -- 172.21.15.69:0/2101419264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b101a01b0 con 0x7f9b10101f90 2024-04-23T10:26:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.269+0000 7f9b077fe640 1 -- 172.21.15.69:0/2101419264 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9b00003cd0 con 0x7f9b10101f90 2024-04-23T10:26:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.269+0000 7f9b077fe640 1 -- 172.21.15.69:0/2101419264 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00035070 con 0x7f9b10101f90 2024-04-23T10:26:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.269+0000 7f9b1840b640 1 -- 172.21.15.69:0/2101419264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b101a06f0 con 0x7f9b10101f90 2024-04-23T10:26:41.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.270+0000 7f9b1840b640 1 -- 172.21.15.69:0/2101419264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b10109380 con 0x7f9b10101f90 2024-04-23T10:26:41.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.271+0000 7f9b077fe640 1 -- 172.21.15.69:0/2101419264 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f9b00042030 con 0x7f9b10101f90 2024-04-23T10:26:41.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.272+0000 7f9b077fe640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9afc0a3bb0 0x7f9afc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.272+0000 7f9b077fe640 1 -- 172.21.15.69:0/2101419264 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f9b000f0a60 con 0x7f9b10101f90 2024-04-23T10:26:41.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.272+0000 7f9b159a6640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9afc0a3bb0 0x7f9afc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.272+0000 7f9b159a6640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9afc0a3bb0 0x7f9afc0a6070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9b10199810 tx=0x7f9b0c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:41.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.277+0000 7f9b077fe640 1 -- 172.21.15.69:0/2101419264 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9b000bd450 con 0x7f9b10101f90 2024-04-23T10:26:41.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:41 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1713162010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:41.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.455+0000 7f9b1840b640 1 -- 172.21.15.69:0/2101419264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9b10062b50 con 0x7f9b10101f90 2024-04-23T10:26:41.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.456+0000 7f9b077fe640 1 -- 172.21.15.69:0/2101419264 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f9b000bcd50 con 0x7f9b10101f90 2024-04-23T10:26:41.455 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:26:41.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 -- 172.21.15.69:0/2101419264 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9afc0a3bb0 msgr2=0x7f9afc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9afc0a3bb0 0x7f9afc0a6070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9b10199810 tx=0x7f9b0c00b390 comp rx=0 tx=0).stop 2024-04-23T10:26:41.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 -- 172.21.15.69:0/2101419264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b10101f90 msgr2=0x7f9b10198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b10101f90 0x7f9b10198300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9b00006010 tx=0x7f9b000042f0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 -- 172.21.15.69:0/2101419264 shutdown_connections 2024-04-23T10:26:41.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f9afc0a3bb0 0x7f9afc0a6070 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b10103b40 0x7f9b1019f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b10103180 0x7f9b10198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 --2- 172.21.15.69:0/2101419264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b10101f90 0x7f9b10198300 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 -- 172.21.15.69:0/2101419264 >> 172.21.15.69:0/2101419264 conn(0x7f9b100fd500 msgr2=0x7f9b10106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:41.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 -- 172.21.15.69:0/2101419264 shutdown_connections 2024-04-23T10:26:41.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.458+0000 7f9b1840b640 1 -- 172.21.15.69:0/2101419264 wait complete. 2024-04-23T10:26:41.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:41 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1713162010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:41.468 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:26:41.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 -- 172.21.15.69:0/1704216933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb578074930 msgr2=0x7fb578074d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 --2- 172.21.15.69:0/1704216933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb578074930 0x7fb578074d90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb560009900 tx=0x7fb56002a480 comp rx=0 tx=0).stop 2024-04-23T10:26:41.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 -- 172.21.15.69:0/1704216933 shutdown_connections 2024-04-23T10:26:41.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 --2- 172.21.15.69:0/1704216933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb578074930 0x7fb578074d90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 --2- 172.21.15.69:0/1704216933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb578109e30 0x7fb57810c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 --2- 172.21.15.69:0/1704216933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb578075f10 0x7fb578074360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 -- 172.21.15.69:0/1704216933 >> 172.21.15.69:0/1704216933 conn(0x7fb5780fd510 msgr2=0x7fb5780ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 -- 172.21.15.69:0/1704216933 shutdown_connections 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 -- 172.21.15.69:0/1704216933 wait complete. 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 Processor -- start 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 -- start start 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb578074930 0x7fb57819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb578075f10 0x7fb57819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb578109e30 0x7fb5781a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb57810fdd0 con 0x7fb578075f10 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb57810fc50 con 0x7fb578109e30 2024-04-23T10:26:41.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb57d607640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb57810ff50 con 0x7fb578074930 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.570+0000 7fb56ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb578075f10 0x7fb57819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb56ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb578075f10 0x7fb57819a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47094/0 (socket says 172.21.15.69:47094) 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb56ffff640 1 -- 172.21.15.69:0/3136312036 learned_addr learned my addr 172.21.15.69:0/3136312036 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb5777fe640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb578109e30 0x7fb5781a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb56ffff640 1 -- 172.21.15.69:0/3136312036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb578074930 msgr2=0x7fb57819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb576ffd640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb578074930 0x7fb57819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb56ffff640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb578074930 0x7fb57819a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb56ffff640 1 -- 172.21.15.69:0/3136312036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb578109e30 msgr2=0x7fb5781a19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb56ffff640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb578109e30 0x7fb5781a19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb56ffff640 1 -- 172.21.15.69:0/3136312036 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5781a2020 con 0x7fb578075f10 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb5777fe640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb578109e30 0x7fb5781a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb56ffff640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb578075f10 0x7fb57819a940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb560031570 tx=0x7fb560004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb574ff9640 1 -- 172.21.15.69:0/3136312036 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56003f030 con 0x7fb578075f10 2024-04-23T10:26:41.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb574ff9640 1 -- 172.21.15.69:0/3136312036 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb560003cd0 con 0x7fb578075f10 2024-04-23T10:26:41.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb57d607640 1 -- 172.21.15.69:0/3136312036 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5781a22b0 con 0x7fb578075f10 2024-04-23T10:26:41.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb574ff9640 1 -- 172.21.15.69:0/3136312036 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560035070 con 0x7fb578075f10 2024-04-23T10:26:41.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.571+0000 7fb57d607640 1 -- 172.21.15.69:0/3136312036 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5781a27f0 con 0x7fb578075f10 2024-04-23T10:26:41.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.572+0000 7fb57d607640 1 -- 172.21.15.69:0/3136312036 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb578108bf0 con 0x7fb578075f10 2024-04-23T10:26:41.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.573+0000 7fb574ff9640 1 -- 172.21.15.69:0/3136312036 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fb560003800 con 0x7fb578075f10 2024-04-23T10:26:41.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.574+0000 7fb574ff9640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb5640a3c30 0x7fb5640a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.574+0000 7fb576ffd640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb5640a3c30 0x7fb5640a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.574+0000 7fb574ff9640 1 -- 172.21.15.69:0/3136312036 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fb5600f0e90 con 0x7fb578075f10 2024-04-23T10:26:41.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.574+0000 7fb576ffd640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb5640a3c30 0x7fb5640a60f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb56800ba40 tx=0x7fb568005cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:41.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.578+0000 7fb574ff9640 1 -- 172.21.15.69:0/3136312036 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb560003af0 con 0x7fb578075f10 2024-04-23T10:26:41.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:41 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1713162010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:41.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.758+0000 7fb57d607640 1 -- 172.21.15.69:0/3136312036 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb578062b50 con 0x7fb578075f10 2024-04-23T10:26:41.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.758+0000 7fb574ff9640 1 -- 172.21.15.69:0/3136312036 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7fb5600bd880 con 0x7fb578075f10 2024-04-23T10:26:41.757 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-04-23T10:26:41.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 -- 172.21.15.69:0/3136312036 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb5640a3c30 msgr2=0x7fb5640a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb5640a3c30 0x7fb5640a60f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb56800ba40 tx=0x7fb568005cc0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 -- 172.21.15.69:0/3136312036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb578075f10 msgr2=0x7fb57819a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb578075f10 0x7fb57819a940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb560031570 tx=0x7fb560004430 comp rx=0 tx=0).stop 2024-04-23T10:26:41.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 -- 172.21.15.69:0/3136312036 shutdown_connections 2024-04-23T10:26:41.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb5640a3c30 0x7fb5640a60f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb578075f10 0x7fb57819a940 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb578109e30 0x7fb5781a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 --2- 172.21.15.69:0/3136312036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb578074930 0x7fb57819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 -- 172.21.15.69:0/3136312036 >> 172.21.15.69:0/3136312036 conn(0x7fb5780fd510 msgr2=0x7fb578105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:41.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 -- 172.21.15.69:0/3136312036 shutdown_connections 2024-04-23T10:26:41.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.760+0000 7fb57d607640 1 -- 172.21.15.69:0/3136312036 wait complete. 2024-04-23T10:26:41.770 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:26:41.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.871+0000 7f4a71a59640 1 -- 172.21.15.69:0/3000455885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c103190 msgr2=0x7f4a6c103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.871+0000 7f4a71a59640 1 --2- 172.21.15.69:0/3000455885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c103190 0x7f4a6c103610 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009900 tx=0x7f4a6002a410 comp rx=0 tx=0).stop 2024-04-23T10:26:41.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 -- 172.21.15.69:0/3000455885 shutdown_connections 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 --2- 172.21.15.69:0/3000455885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c103190 0x7f4a6c103610 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 --2- 172.21.15.69:0/3000455885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6c103b50 0x7f4a6c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 --2- 172.21.15.69:0/3000455885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a6c101fa0 0x7f4a6c1023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 -- 172.21.15.69:0/3000455885 >> 172.21.15.69:0/3000455885 conn(0x7f4a6c0fd530 msgr2=0x7f4a6c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 -- 172.21.15.69:0/3000455885 shutdown_connections 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 -- 172.21.15.69:0/3000455885 wait complete. 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 Processor -- start 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 -- start start 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a6c101fa0 0x7f4a6c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6c103190 0x7f4a6c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c103b50 0x7f4a6c19f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c10dc80 con 0x7f4a6c103b50 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c10db00 con 0x7f4a6c103190 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.872+0000 7f4a71a59640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c10de00 con 0x7f4a6c101fa0 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c103b50 0x7f4a6c19f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c103b50 0x7f4a6c19f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47106/0 (socket says 172.21.15.69:47106) 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6b7fe640 1 -- 172.21.15.69:0/919490897 learned_addr learned my addr 172.21.15.69:0/919490897 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6affd640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a6c101fa0 0x7f4a6c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6a7fc640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6c103190 0x7f4a6c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6b7fe640 1 -- 172.21.15.69:0/919490897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a6c101fa0 msgr2=0x7f4a6c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6b7fe640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a6c101fa0 0x7f4a6c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6b7fe640 1 -- 172.21.15.69:0/919490897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6c103190 msgr2=0x7f4a6c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6b7fe640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6c103190 0x7f4a6c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6b7fe640 1 -- 172.21.15.69:0/919490897 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6c19ff50 con 0x7f4a6c103b50 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6a7fc640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6c103190 0x7f4a6c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a6b7fe640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c103b50 0x7f4a6c19f8e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400c970 tx=0x7f4a6400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a70a57640 1 -- 172.21.15.69:0/919490897 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64007bb0 con 0x7f4a6c103b50 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a70a57640 1 -- 172.21.15.69:0/919490897 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a64007d50 con 0x7f4a6c103b50 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a71a59640 1 -- 172.21.15.69:0/919490897 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6c1a0240 con 0x7f4a6c103b50 2024-04-23T10:26:41.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a70a57640 1 -- 172.21.15.69:0/919490897 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a640187c0 con 0x7f4a6c103b50 2024-04-23T10:26:41.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.873+0000 7f4a71a59640 1 -- 172.21.15.69:0/919490897 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a6c1a0810 con 0x7f4a6c103b50 2024-04-23T10:26:41.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.874+0000 7f4a71a59640 1 -- 172.21.15.69:0/919490897 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a6c1092c0 con 0x7f4a6c103b50 2024-04-23T10:26:41.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.875+0000 7f4a70a57640 1 -- 172.21.15.69:0/919490897 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f4a6400fa40 con 0x7f4a6c103b50 2024-04-23T10:26:41.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.876+0000 7f4a70a57640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4a540a3c30 0x7f4a540a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:41.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.876+0000 7f4a70a57640 1 -- 172.21.15.69:0/919490897 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f4a640d0500 con 0x7f4a6c103b50 2024-04-23T10:26:41.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.876+0000 7f4a6affd640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4a540a3c30 0x7f4a540a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:41.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.876+0000 7f4a6affd640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4a540a3c30 0x7f4a540a60f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c102ff0 tx=0x7f4a5c00d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:41.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:41.879+0000 7f4a70a57640 1 -- 172.21.15.69:0/919490897 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4a64014030 con 0x7f4a6c103b50 2024-04-23T10:26:42.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.056+0000 7f4a71a59640 1 -- 172.21.15.69:0/919490897 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4a6c02d5c0 con 0x7f4a6c103b50 2024-04-23T10:26:42.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.056+0000 7f4a70a57640 1 -- 172.21.15.69:0/919490897 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f4a6409d000 con 0x7f4a6c103b50 2024-04-23T10:26:42.055 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-04-23T10:26:42.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.058+0000 7f4a71a59640 1 -- 172.21.15.69:0/919490897 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4a540a3c30 msgr2=0x7f4a540a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.058+0000 7f4a71a59640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4a540a3c30 0x7f4a540a60f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c102ff0 tx=0x7f4a5c00d040 comp rx=0 tx=0).stop 2024-04-23T10:26:42.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.058+0000 7f4a71a59640 1 -- 172.21.15.69:0/919490897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c103b50 msgr2=0x7f4a6c19f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.058+0000 7f4a71a59640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c103b50 0x7f4a6c19f8e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400c970 tx=0x7f4a6400ce30 comp rx=0 tx=0).stop 2024-04-23T10:26:42.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.058+0000 7f4a71a59640 1 -- 172.21.15.69:0/919490897 shutdown_connections 2024-04-23T10:26:42.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.058+0000 7f4a71a59640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f4a540a3c30 0x7f4a540a60f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.058+0000 7f4a71a59640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4a6c103b50 0x7f4a6c19f8e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.058+0000 7f4a71a59640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6c103190 0x7f4a6c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.058+0000 7f4a71a59640 1 --2- 172.21.15.69:0/919490897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a6c101fa0 0x7f4a6c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.058+0000 7f4a71a59640 1 -- 172.21.15.69:0/919490897 >> 172.21.15.69:0/919490897 conn(0x7f4a6c0fd530 msgr2=0x7f4a6c106490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:42.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.059+0000 7f4a71a59640 1 -- 172.21.15.69:0/919490897 shutdown_connections 2024-04-23T10:26:42.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.059+0000 7f4a71a59640 1 -- 172.21.15.69:0/919490897 wait complete. 2024-04-23T10:26:42.068 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:26:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.168+0000 7f9517885640 1 -- 172.21.15.69:0/3290489026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9510103c00 msgr2=0x7f951010a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.168+0000 7f9517885640 1 --2- 172.21.15.69:0/3290489026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9510103c00 0x7f951010a490 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f950c009930 tx=0x7f950c02a420 comp rx=0 tx=0).stop 2024-04-23T10:26:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.168+0000 7f9517885640 1 -- 172.21.15.69:0/3290489026 shutdown_connections 2024-04-23T10:26:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.168+0000 7f9517885640 1 --2- 172.21.15.69:0/3290489026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9510103c00 0x7f951010a490 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.168+0000 7f9517885640 1 --2- 172.21.15.69:0/3290489026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9510103240 0x7f95101036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.168+0000 7f9517885640 1 --2- 172.21.15.69:0/3290489026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9510100270 0x7f9510100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.168+0000 7f9517885640 1 -- 172.21.15.69:0/3290489026 >> 172.21.15.69:0/3290489026 conn(0x7f95100fbbc0 msgr2=0x7f95100fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.168+0000 7f9517885640 1 -- 172.21.15.69:0/3290489026 shutdown_connections 2024-04-23T10:26:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.168+0000 7f9517885640 1 -- 172.21.15.69:0/3290489026 wait complete. 2024-04-23T10:26:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.168+0000 7f9517885640 1 Processor -- start 2024-04-23T10:26:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9517885640 1 -- start start 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9517885640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9510100270 0x7f9510198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9517885640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9510103240 0x7f9510198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9517885640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9510103c00 0x7f951019f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9517885640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f951010dcb0 con 0x7f9510103c00 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9517885640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f951010db30 con 0x7f9510100270 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9517885640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f951010de30 con 0x7f9510103240 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9515e22640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9510103c00 0x7f951019f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9515e22640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9510103c00 0x7f951019f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47114/0 (socket says 172.21.15.69:47114) 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9515e22640 1 -- 172.21.15.69:0/2343928064 learned_addr learned my addr 172.21.15.69:0/2343928064 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9514e20640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9510103240 0x7f9510198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9515e22640 1 -- 172.21.15.69:0/2343928064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9510103240 msgr2=0x7f9510198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9515e22640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9510103240 0x7f9510198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9515e22640 1 -- 172.21.15.69:0/2343928064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9510100270 msgr2=0x7f9510198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9515621640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9510100270 0x7f9510198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9515e22640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9510100270 0x7f9510198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9515e22640 1 -- 172.21.15.69:0/2343928064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951019ff40 con 0x7f9510103c00 2024-04-23T10:26:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9514e20640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9510103240 0x7f9510198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9515621640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9510100270 0x7f9510198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9515e22640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9510103c00 0x7f951019f8d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f950c005940 tx=0x7f950c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f95027fc640 1 -- 172.21.15.69:0/2343928064 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c03f030 con 0x7f9510103c00 2024-04-23T10:26:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9517885640 1 -- 172.21.15.69:0/2343928064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95101a01d0 con 0x7f9510103c00 2024-04-23T10:26:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f95027fc640 1 -- 172.21.15.69:0/2343928064 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f950c003cd0 con 0x7f9510103c00 2024-04-23T10:26:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f95027fc640 1 -- 172.21.15.69:0/2343928064 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c035070 con 0x7f9510103c00 2024-04-23T10:26:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.169+0000 7f9517885640 1 -- 172.21.15.69:0/2343928064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95101a0740 con 0x7f9510103c00 2024-04-23T10:26:42.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.170+0000 7f9517885640 1 -- 172.21.15.69:0/2343928064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9510109390 con 0x7f9510103c00 2024-04-23T10:26:42.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.172+0000 7f95027fc640 1 -- 172.21.15.69:0/2343928064 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f950c042030 con 0x7f9510103c00 2024-04-23T10:26:42.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.172+0000 7f95027fc640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f94fc0a3bb0 0x7f94fc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.172+0000 7f9515621640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f94fc0a3bb0 0x7f94fc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:42.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.172+0000 7f95027fc640 1 -- 172.21.15.69:0/2343928064 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f950c0f0ff0 con 0x7f9510103c00 2024-04-23T10:26:42.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.173+0000 7f9515621640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f94fc0a3bb0 0x7f94fc0a6070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9508006fd0 tx=0x7f9508008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:42.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.176+0000 7f95027fc640 1 -- 172.21.15.69:0/2343928064 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f950c0bd9e0 con 0x7f9510103c00 2024-04-23T10:26:42.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.392+0000 7f9517885640 1 -- 172.21.15.69:0/2343928064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f951002d5c0 con 0x7f9510103c00 2024-04-23T10:26:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.392+0000 7f95027fc640 1 -- 172.21.15.69:0/2343928064 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7f950c0bd2e0 con 0x7f9510103c00 2024-04-23T10:26:42.391 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:42.391 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:24:59.329454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24463,24421,24487,24416,24392]},"id":1}]} 2024-04-23T10:26:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 25 2024-04-23T10:26:42.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.394+0000 7f9517885640 1 -- 172.21.15.69:0/2343928064 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f94fc0a3bb0 msgr2=0x7f94fc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.394+0000 7f9517885640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f94fc0a3bb0 0x7f94fc0a6070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9508006fd0 tx=0x7f9508008040 comp rx=0 tx=0).stop 2024-04-23T10:26:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.394+0000 7f9517885640 1 -- 172.21.15.69:0/2343928064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9510103c00 msgr2=0x7f951019f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.394+0000 7f9517885640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9510103c00 0x7f951019f8d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f950c005940 tx=0x7f950c004430 comp rx=0 tx=0).stop 2024-04-23T10:26:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.394+0000 7f9517885640 1 -- 172.21.15.69:0/2343928064 shutdown_connections 2024-04-23T10:26:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.394+0000 7f9517885640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f94fc0a3bb0 0x7f94fc0a6070 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.394+0000 7f9517885640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9510103c00 0x7f951019f8d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.394+0000 7f9517885640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9510103240 0x7f9510198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.394+0000 7f9517885640 1 --2- 172.21.15.69:0/2343928064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9510100270 0x7f9510198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.394+0000 7f9517885640 1 -- 172.21.15.69:0/2343928064 >> 172.21.15.69:0/2343928064 conn(0x7f95100fbbc0 msgr2=0x7f9510106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.395+0000 7f9517885640 1 -- 172.21.15.69:0/2343928064 shutdown_connections 2024-04-23T10:26:42.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.395+0000 7f9517885640 1 -- 172.21.15.69:0/2343928064 wait complete. 2024-04-23T10:26:42.403 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:42 smithi069 ceph-mon[29593]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-23T10:26:42.403 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:42 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2101419264' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:42.404 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:42 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3136312036' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:42.404 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:42 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/919490897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:42.405 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:26:42.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:42 smithi146 ceph-mon[32800]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-23T10:26:42.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:42 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2101419264' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:42.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:42 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3136312036' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:42.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:42 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/919490897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:42.483 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:42 smithi167 ceph-mon[32940]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-04-23T10:26:42.484 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:42 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2101419264' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:42.484 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:42 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3136312036' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:42.484 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:42 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/919490897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:42.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.504+0000 7f835d0cf640 1 -- 172.21.15.69:0/364275940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8358103b50 msgr2=0x7f835810a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.504+0000 7f835d0cf640 1 --2- 172.21.15.69:0/364275940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8358103b50 0x7f835810a3e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8350009ca0 tx=0x7f835002a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.504+0000 7f835d0cf640 1 -- 172.21.15.69:0/364275940 shutdown_connections 2024-04-23T10:26:42.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.504+0000 7f835d0cf640 1 --2- 172.21.15.69:0/364275940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8358103b50 0x7f835810a3e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.504+0000 7f835d0cf640 1 --2- 172.21.15.69:0/364275940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8358103190 0x7f8358103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.504+0000 7f835d0cf640 1 --2- 172.21.15.69:0/364275940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8358101fa0 0x7f83581023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.504+0000 7f835d0cf640 1 -- 172.21.15.69:0/364275940 >> 172.21.15.69:0/364275940 conn(0x7f83580fd530 msgr2=0x7f83580ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:42.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.504+0000 7f835d0cf640 1 -- 172.21.15.69:0/364275940 shutdown_connections 2024-04-23T10:26:42.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.504+0000 7f835d0cf640 1 -- 172.21.15.69:0/364275940 wait complete. 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.505+0000 7f835d0cf640 1 Processor -- start 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.505+0000 7f835d0cf640 1 -- start start 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.505+0000 7f835d0cf640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8358101fa0 0x7f8358075d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.505+0000 7f835d0cf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8358103190 0x7f8358074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.505+0000 7f835d0cf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8358103b50 0x7f8358074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.505+0000 7f835d0cf640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f835810dc00 con 0x7f8358101fa0 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.505+0000 7f835d0cf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f835810da80 con 0x7f8358103190 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.505+0000 7f835d0cf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f835810dd80 con 0x7f8358103b50 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.505+0000 7f8356d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8358101fa0 0x7f8358075d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.505+0000 7f8356d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8358101fa0 0x7f8358075d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47142/0 (socket says 172.21.15.69:47142) 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.505+0000 7f8356d9d640 1 -- 172.21.15.69:0/3173909245 learned_addr learned my addr 172.21.15.69:0/3173909245 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:42.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f835659c640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8358103190 0x7f8358074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f835759e640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8358103b50 0x7f8358074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f8356d9d640 1 -- 172.21.15.69:0/3173909245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8358103b50 msgr2=0x7f8358074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f8356d9d640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8358103b50 0x7f8358074880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f8356d9d640 1 -- 172.21.15.69:0/3173909245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8358103190 msgr2=0x7f8358074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f8356d9d640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8358103190 0x7f8358074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f8356d9d640 1 -- 172.21.15.69:0/3173909245 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8358075110 con 0x7f8358101fa0 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f835659c640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8358103190 0x7f8358074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f8356d9d640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8358101fa0 0x7f8358075d00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f834800d950 tx=0x7f834800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f833ffff640 1 -- 172.21.15.69:0/3173909245 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8348017070 con 0x7f8358101fa0 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f833ffff640 1 -- 172.21.15.69:0/3173909245 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8348009c30 con 0x7f8358101fa0 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f835d0cf640 1 -- 172.21.15.69:0/3173909245 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83581a2390 con 0x7f8358101fa0 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f833ffff640 1 -- 172.21.15.69:0/3173909245 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834800f620 con 0x7f8358101fa0 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.506+0000 7f835d0cf640 1 -- 172.21.15.69:0/3173909245 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83581a2890 con 0x7f8358101fa0 2024-04-23T10:26:42.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.507+0000 7f835d0cf640 1 -- 172.21.15.69:0/3173909245 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83581092c0 con 0x7f8358101fa0 2024-04-23T10:26:42.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.508+0000 7f833ffff640 1 -- 172.21.15.69:0/3173909245 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f834801a070 con 0x7f8358101fa0 2024-04-23T10:26:42.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.509+0000 7f833ffff640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83400a3bb0 0x7f83400a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.509+0000 7f835659c640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83400a3bb0 0x7f83400a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:42.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.509+0000 7f833ffff640 1 -- 172.21.15.69:0/3173909245 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f83480cff50 con 0x7f8358101fa0 2024-04-23T10:26:42.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.509+0000 7f835659c640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83400a3bb0 0x7f83400a6070 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f834c005d00 tx=0x7f834c009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:42.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.512+0000 7f833ffff640 1 -- 172.21.15.69:0/3173909245 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8348009de0 con 0x7f8358101fa0 2024-04-23T10:26:42.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.690+0000 7f835d0cf640 1 -- 172.21.15.69:0/3173909245 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f835802d870 con 0x7f8358101fa0 2024-04-23T10:26:42.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.692+0000 7f833ffff640 1 -- 172.21.15.69:0/3173909245 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22595 (secure 0 0 0) 0x7f834809c940 con 0x7f8358101fa0 2024-04-23T10:26:42.691 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:42.691 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":88,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:26:00.078482+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:26:42.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 -- 172.21.15.69:0/3173909245 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83400a3bb0 msgr2=0x7f83400a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83400a3bb0 0x7f83400a6070 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f834c005d00 tx=0x7f834c009550 comp rx=0 tx=0).stop 2024-04-23T10:26:42.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 -- 172.21.15.69:0/3173909245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8358101fa0 msgr2=0x7f8358075d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8358101fa0 0x7f8358075d00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f834800d950 tx=0x7f834800de10 comp rx=0 tx=0).stop 2024-04-23T10:26:42.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 -- 172.21.15.69:0/3173909245 shutdown_connections 2024-04-23T10:26:42.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f83400a3bb0 0x7f83400a6070 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8358103b50 0x7f8358074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8358103190 0x7f8358074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 --2- 172.21.15.69:0/3173909245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8358101fa0 0x7f8358075d00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 -- 172.21.15.69:0/3173909245 >> 172.21.15.69:0/3173909245 conn(0x7f83580fd530 msgr2=0x7f8358106490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:42.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 -- 172.21.15.69:0/3173909245 shutdown_connections 2024-04-23T10:26:42.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.694+0000 7f835d0cf640 1 -- 172.21.15.69:0/3173909245 wait complete. 2024-04-23T10:26:42.704 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:24:50.484063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:24:51.816315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:26:42.704 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:26:42.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.805+0000 7f027effe640 1 -- 172.21.15.69:0/4074679688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0278101fe0 msgr2=0x7f0278102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.805+0000 7f027effe640 1 --2- 172.21.15.69:0/4074679688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0278101fe0 0x7f0278102460 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0264009900 tx=0x7f026402a410 comp rx=0 tx=0).stop 2024-04-23T10:26:42.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.805+0000 7f027effe640 1 -- 172.21.15.69:0/4074679688 shutdown_connections 2024-04-23T10:26:42.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.805+0000 7f027effe640 1 --2- 172.21.15.69:0/4074679688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0278101fe0 0x7f0278102460 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.805+0000 7f027effe640 1 --2- 172.21.15.69:0/4074679688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02781029a0 0x7f02781092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.805+0000 7f027effe640 1 --2- 172.21.15.69:0/4074679688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0278100e90 0x7f02781012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.805+0000 7f027effe640 1 -- 172.21.15.69:0/4074679688 >> 172.21.15.69:0/4074679688 conn(0x7f02780fc400 msgr2=0x7f02780fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.805+0000 7f027effe640 1 -- 172.21.15.69:0/4074679688 shutdown_connections 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.805+0000 7f027effe640 1 -- 172.21.15.69:0/4074679688 wait complete. 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027effe640 1 Processor -- start 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027effe640 1 -- start start 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027effe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0278100e90 0x7f0278069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027effe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0278101fe0 0x7f027819d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027effe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02781029a0 0x7f027819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027effe640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f027810cb80 con 0x7f0278100e90 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027effe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f027810ca00 con 0x7f0278101fe0 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027effe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f027810cd00 con 0x7f02781029a0 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027cd9a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0278100e90 0x7f0278069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027cd9a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0278100e90 0x7f0278069c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47154/0 (socket says 172.21.15.69:47154) 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027cd9a640 1 -- 172.21.15.69:0/832294298 learned_addr learned my addr 172.21.15.69:0/832294298 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027d59b640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02781029a0 0x7f027819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027cd9a640 1 -- 172.21.15.69:0/832294298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02781029a0 msgr2=0x7f027819f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027cd9a640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02781029a0 0x7f027819f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027cd9a640 1 -- 172.21.15.69:0/832294298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0278101fe0 msgr2=0x7f027819d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027cd9a640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0278101fe0 0x7f027819d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.806+0000 7f027cd9a640 1 -- 172.21.15.69:0/832294298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027819ffd0 con 0x7f0278100e90 2024-04-23T10:26:42.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.807+0000 7f027cd9a640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0278100e90 0x7f0278069c50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c890 tx=0x7f026c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:42.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.807+0000 7f0275ffb640 1 -- 172.21.15.69:0/832294298 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c004220 con 0x7f0278100e90 2024-04-23T10:26:42.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.807+0000 7f027effe640 1 -- 172.21.15.69:0/832294298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02781a0260 con 0x7f0278100e90 2024-04-23T10:26:42.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.807+0000 7f0275ffb640 1 -- 172.21.15.69:0/832294298 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f026c0043c0 con 0x7f0278100e90 2024-04-23T10:26:42.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.807+0000 7f0275ffb640 1 -- 172.21.15.69:0/832294298 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c0049e0 con 0x7f0278100e90 2024-04-23T10:26:42.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.807+0000 7f027effe640 1 -- 172.21.15.69:0/832294298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02781a0880 con 0x7f0278100e90 2024-04-23T10:26:42.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.808+0000 7f027effe640 1 -- 172.21.15.69:0/832294298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0278108270 con 0x7f0278100e90 2024-04-23T10:26:42.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.809+0000 7f0275ffb640 1 -- 172.21.15.69:0/832294298 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f026c005140 con 0x7f0278100e90 2024-04-23T10:26:42.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.809+0000 7f0275ffb640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f02680a3bb0 0x7f02680a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:42.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.809+0000 7f0277fff640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f02680a3bb0 0x7f02680a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:42.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.809+0000 7f0275ffb640 1 -- 172.21.15.69:0/832294298 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f026c0d0150 con 0x7f0278100e90 2024-04-23T10:26:42.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.810+0000 7f0277fff640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f02680a3bb0 0x7f02680a6070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f02640096c0 tx=0x7f0264000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:42.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.814+0000 7f0275ffb640 1 -- 172.21.15.69:0/832294298 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f026c014030 con 0x7f0278100e90 2024-04-23T10:26:42.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.990+0000 7f027effe640 1 -- 172.21.15.69:0/832294298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0278062b50 con 0x7f0278100e90 2024-04-23T10:26:42.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.991+0000 7f0275ffb640 1 -- 172.21.15.69:0/832294298 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f026c09cb40 con 0x7f0278100e90 2024-04-23T10:26:42.990 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:26:42.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 -- 172.21.15.69:0/832294298 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f02680a3bb0 msgr2=0x7f02680a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f02680a3bb0 0x7f02680a6070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f02640096c0 tx=0x7f0264000bc0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 -- 172.21.15.69:0/832294298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0278100e90 msgr2=0x7f0278069c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:42.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0278100e90 0x7f0278069c50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c890 tx=0x7f026c00cd50 comp rx=0 tx=0).stop 2024-04-23T10:26:42.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 -- 172.21.15.69:0/832294298 shutdown_connections 2024-04-23T10:26:42.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f02680a3bb0 0x7f02680a6070 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02781029a0 0x7f027819f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0278101fe0 0x7f027819d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 --2- 172.21.15.69:0/832294298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0278100e90 0x7f0278069c50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:42.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 -- 172.21.15.69:0/832294298 >> 172.21.15.69:0/832294298 conn(0x7f02780fc400 msgr2=0x7f0278105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:42.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 -- 172.21.15.69:0/832294298 shutdown_connections 2024-04-23T10:26:42.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:42.993+0000 7f027effe640 1 -- 172.21.15.69:0/832294298 wait complete. 2024-04-23T10:26:43.003 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:26:43.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.105+0000 7f1391c7c640 1 -- 172.21.15.69:0/1745319771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f138c103b30 msgr2=0x7f138c10a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.105+0000 7f1391c7c640 1 --2- 172.21.15.69:0/1745319771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f138c103b30 0x7f138c10a3c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1384009ca0 tx=0x7f138402a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.105+0000 7f1391c7c640 1 -- 172.21.15.69:0/1745319771 shutdown_connections 2024-04-23T10:26:43.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.105+0000 7f1391c7c640 1 --2- 172.21.15.69:0/1745319771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f138c103b30 0x7f138c10a3c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.105+0000 7f1391c7c640 1 --2- 172.21.15.69:0/1745319771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f138c103170 0x7f138c1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.105+0000 7f1391c7c640 1 --2- 172.21.15.69:0/1745319771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f138c101f80 0x7f138c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.105+0000 7f1391c7c640 1 -- 172.21.15.69:0/1745319771 >> 172.21.15.69:0/1745319771 conn(0x7f138c0fd510 msgr2=0x7f138c0ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:43.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.105+0000 7f1391c7c640 1 -- 172.21.15.69:0/1745319771 shutdown_connections 2024-04-23T10:26:43.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.105+0000 7f1391c7c640 1 -- 172.21.15.69:0/1745319771 wait complete. 2024-04-23T10:26:43.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f1391c7c640 1 Processor -- start 2024-04-23T10:26:43.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f1391c7c640 1 -- start start 2024-04-23T10:26:43.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f1391c7c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f138c101f80 0x7f138c198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f1391c7c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f138c103170 0x7f138c1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f1391c7c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f138c103b30 0x7f138c19f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f1391c7c640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f138c10dbe0 con 0x7f138c103b30 2024-04-23T10:26:43.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f1391c7c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f138c10da60 con 0x7f138c101f80 2024-04-23T10:26:43.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f1391c7c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f138c10dd60 con 0x7f138c103170 2024-04-23T10:26:43.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f138bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f138c103b30 0x7f138c19f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f138bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f138c103b30 0x7f138c19f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47164/0 (socket says 172.21.15.69:47164) 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f138bfff640 1 -- 172.21.15.69:0/3410543481 learned_addr learned my addr 172.21.15.69:0/3410543481 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f138b7fe640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f138c101f80 0x7f138c198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.106+0000 7f138affd640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f138c103170 0x7f138c1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.107+0000 7f138bfff640 1 -- 172.21.15.69:0/3410543481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f138c103170 msgr2=0x7f138c1986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.107+0000 7f138bfff640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f138c103170 0x7f138c1986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.107+0000 7f138bfff640 1 -- 172.21.15.69:0/3410543481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f138c101f80 msgr2=0x7f138c198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.107+0000 7f138bfff640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f138c101f80 0x7f138c198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.107+0000 7f138bfff640 1 -- 172.21.15.69:0/3410543481 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138c19fdb0 con 0x7f138c103b30 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.107+0000 7f138bfff640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f138c103b30 0x7f138c19f740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1384009dc0 tx=0x7f138402f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.107+0000 7f1388ff9640 1 -- 172.21.15.69:0/3410543481 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384003cf0 con 0x7f138c103b30 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.107+0000 7f1388ff9640 1 -- 172.21.15.69:0/3410543481 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1384004510 con 0x7f138c103b30 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.107+0000 7f1391c7c640 1 -- 172.21.15.69:0/3410543481 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138c1a0040 con 0x7f138c103b30 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.107+0000 7f1388ff9640 1 -- 172.21.15.69:0/3410543481 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138402fdb0 con 0x7f138c103b30 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.107+0000 7f1391c7c640 1 -- 172.21.15.69:0/3410543481 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138c1a0590 con 0x7f138c103b30 2024-04-23T10:26:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.108+0000 7f1391c7c640 1 -- 172.21.15.69:0/3410543481 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138c109240 con 0x7f138c103b30 2024-04-23T10:26:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.109+0000 7f1388ff9640 1 -- 172.21.15.69:0/3410543481 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f13840046c0 con 0x7f138c103b30 2024-04-23T10:26:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.110+0000 7f1388ff9640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f13740a3bb0 0x7f13740a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.110+0000 7f138b7fe640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f13740a3bb0 0x7f13740a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:43.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.110+0000 7f1388ff9640 1 -- 172.21.15.69:0/3410543481 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f13840f1a30 con 0x7f138c103b30 2024-04-23T10:26:43.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.110+0000 7f138b7fe640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f13740a3bb0 0x7f13740a6070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f138c102fd0 tx=0x7f137c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:43.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.114+0000 7f1388ff9640 1 -- 172.21.15.69:0/3410543481 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f13840be420 con 0x7f138c103b30 2024-04-23T10:26:43.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.293+0000 7f1391c7c640 1 -- 172.21.15.69:0/3410543481 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f138c062b50 con 0x7f138c103b30 2024-04-23T10:26:43.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.293+0000 7f1388ff9640 1 -- 172.21.15.69:0/3410543481 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f13840bdd20 con 0x7f138c103b30 2024-04-23T10:26:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-04-23T10:26:43.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 -- 172.21.15.69:0/3410543481 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f13740a3bb0 msgr2=0x7f13740a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f13740a3bb0 0x7f13740a6070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f138c102fd0 tx=0x7f137c005f90 comp rx=0 tx=0).stop 2024-04-23T10:26:43.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 -- 172.21.15.69:0/3410543481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f138c103b30 msgr2=0x7f138c19f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f138c103b30 0x7f138c19f740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1384009dc0 tx=0x7f138402f460 comp rx=0 tx=0).stop 2024-04-23T10:26:43.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 -- 172.21.15.69:0/3410543481 shutdown_connections 2024-04-23T10:26:43.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f13740a3bb0 0x7f13740a6070 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f138c103b30 0x7f138c19f740 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f138c103170 0x7f138c1986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 --2- 172.21.15.69:0/3410543481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f138c101f80 0x7f138c198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 -- 172.21.15.69:0/3410543481 >> 172.21.15.69:0/3410543481 conn(0x7f138c0fd510 msgr2=0x7f138c106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:43.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 -- 172.21.15.69:0/3410543481 shutdown_connections 2024-04-23T10:26:43.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.295+0000 7f1391c7c640 1 -- 172.21.15.69:0/3410543481 wait complete. 2024-04-23T10:26:43.304 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:43 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2343928064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:43.304 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:43 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3173909245' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:43.304 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:43 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/832294298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:43.305 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:26:43.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.408+0000 7f7bb9607640 1 -- 172.21.15.69:0/652693052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb4101fa0 msgr2=0x7f7bb41023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.408+0000 7f7bb9607640 1 --2- 172.21.15.69:0/652693052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb4101fa0 0x7f7bb41023c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4009900 tx=0x7f7ba402a410 comp rx=0 tx=0).stop 2024-04-23T10:26:43.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 -- 172.21.15.69:0/652693052 shutdown_connections 2024-04-23T10:26:43.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 --2- 172.21.15.69:0/652693052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb4103b50 0x7f7bb410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 --2- 172.21.15.69:0/652693052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bb4103190 0x7f7bb4103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 --2- 172.21.15.69:0/652693052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb4101fa0 0x7f7bb41023c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 -- 172.21.15.69:0/652693052 >> 172.21.15.69:0/652693052 conn(0x7f7bb40fd530 msgr2=0x7f7bb40ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 -- 172.21.15.69:0/652693052 shutdown_connections 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 -- 172.21.15.69:0/652693052 wait complete. 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 Processor -- start 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 -- start start 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb4101fa0 0x7f7bb4198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb4103190 0x7f7bb41987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bb4103b50 0x7f7bb419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb410dc00 con 0x7f7bb4101fa0 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb410da80 con 0x7f7bb4103b50 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.409+0000 7f7bb9607640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb410dd80 con 0x7f7bb4103190 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb2ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb4101fa0 0x7f7bb4198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb2ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb4101fa0 0x7f7bb4198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47184/0 (socket says 172.21.15.69:47184) 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb2ffd640 1 -- 172.21.15.69:0/2732554974 learned_addr learned my addr 172.21.15.69:0/2732554974 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb27fc640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb4103190 0x7f7bb41987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb37fe640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bb4103b50 0x7f7bb419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:43.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb2ffd640 1 -- 172.21.15.69:0/2732554974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb4103190 msgr2=0x7f7bb41987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb2ffd640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb4103190 0x7f7bb41987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb2ffd640 1 -- 172.21.15.69:0/2732554974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bb4103b50 msgr2=0x7f7bb419f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb2ffd640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bb4103b50 0x7f7bb419f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb2ffd640 1 -- 172.21.15.69:0/2732554974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb419fe90 con 0x7f7bb4101fa0 2024-04-23T10:26:43.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb2ffd640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb4101fa0 0x7f7bb4198270 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4006010 tx=0x7f7ba40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:43.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7babfff640 1 -- 172.21.15.69:0/2732554974 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba403f030 con 0x7f7bb4101fa0 2024-04-23T10:26:43.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7babfff640 1 -- 172.21.15.69:0/2732554974 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7ba4003cd0 con 0x7f7bb4101fa0 2024-04-23T10:26:43.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb9607640 1 -- 172.21.15.69:0/2732554974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb41a0120 con 0x7f7bb4101fa0 2024-04-23T10:26:43.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7babfff640 1 -- 172.21.15.69:0/2732554974 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4035070 con 0x7f7bb4101fa0 2024-04-23T10:26:43.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.410+0000 7f7bb9607640 1 -- 172.21.15.69:0/2732554974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb41a0610 con 0x7f7bb4101fa0 2024-04-23T10:26:43.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.411+0000 7f7bb9607640 1 -- 172.21.15.69:0/2732554974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb41092c0 con 0x7f7bb4101fa0 2024-04-23T10:26:43.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.412+0000 7f7babfff640 1 -- 172.21.15.69:0/2732554974 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f7ba4042030 con 0x7f7bb4101fa0 2024-04-23T10:26:43.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.413+0000 7f7babfff640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ba00a3bb0 0x7f7ba00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.413+0000 7f7bb27fc640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ba00a3bb0 0x7f7ba00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:43.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.413+0000 7f7babfff640 1 -- 172.21.15.69:0/2732554974 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f7ba40f0a20 con 0x7f7bb4101fa0 2024-04-23T10:26:43.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.413+0000 7f7bb27fc640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ba00a3bb0 0x7f7ba00a6070 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4199780 tx=0x7f7b9c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:43.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.417+0000 7f7babfff640 1 -- 172.21.15.69:0/2732554974 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7ba40bd410 con 0x7f7bb4101fa0 2024-04-23T10:26:43.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:43 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2343928064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:43.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:43 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3173909245' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:43.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:43 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/832294298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:43.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:43 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2343928064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:43.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:43 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3173909245' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:43.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:43 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/832294298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:43.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.594+0000 7f7bb9607640 1 -- 172.21.15.69:0/2732554974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7bb4062b50 con 0x7f7bb4101fa0 2024-04-23T10:26:43.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.594+0000 7f7babfff640 1 -- 172.21.15.69:0/2732554974 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f7ba40bcd10 con 0x7f7bb4101fa0 2024-04-23T10:26:43.593 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-04-23T10:26:43.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 -- 172.21.15.69:0/2732554974 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ba00a3bb0 msgr2=0x7f7ba00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ba00a3bb0 0x7f7ba00a6070 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4199780 tx=0x7f7b9c00a2d0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 -- 172.21.15.69:0/2732554974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb4101fa0 msgr2=0x7f7bb4198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb4101fa0 0x7f7bb4198270 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4006010 tx=0x7f7ba40042f0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 -- 172.21.15.69:0/2732554974 shutdown_connections 2024-04-23T10:26:43.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f7ba00a3bb0 0x7f7ba00a6070 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bb4103b50 0x7f7bb419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb4103190 0x7f7bb41987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 --2- 172.21.15.69:0/2732554974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb4101fa0 0x7f7bb4198270 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 -- 172.21.15.69:0/2732554974 >> 172.21.15.69:0/2732554974 conn(0x7f7bb40fd530 msgr2=0x7f7bb4106490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:43.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 -- 172.21.15.69:0/2732554974 shutdown_connections 2024-04-23T10:26:43.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.596+0000 7f7bb9607640 1 -- 172.21.15.69:0/2732554974 wait complete. 2024-04-23T10:26:43.606 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:26:43.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.704+0000 7f8784631640 1 -- 172.21.15.69:0/4054316655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f877c102a90 msgr2=0x7f877c104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.704+0000 7f8784631640 1 --2- 172.21.15.69:0/4054316655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f877c102a90 0x7f877c104e80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f876c009900 tx=0x7f876c02a410 comp rx=0 tx=0).stop 2024-04-23T10:26:43.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.704+0000 7f8784631640 1 -- 172.21.15.69:0/4054316655 shutdown_connections 2024-04-23T10:26:43.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.704+0000 7f8784631640 1 --2- 172.21.15.69:0/4054316655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f877c107cf0 0x7f877c10a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.704+0000 7f8784631640 1 --2- 172.21.15.69:0/4054316655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f877c1053c0 0x7f877c1077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.704+0000 7f8784631640 1 --2- 172.21.15.69:0/4054316655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f877c102a90 0x7f877c104e80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.704+0000 7f8784631640 1 -- 172.21.15.69:0/4054316655 >> 172.21.15.69:0/4054316655 conn(0x7f877c0fc400 msgr2=0x7f877c0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:43.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.704+0000 7f8784631640 1 -- 172.21.15.69:0/4054316655 shutdown_connections 2024-04-23T10:26:43.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.704+0000 7f8784631640 1 -- 172.21.15.69:0/4054316655 wait complete. 2024-04-23T10:26:43.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8784631640 1 Processor -- start 2024-04-23T10:26:43.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8784631640 1 -- start start 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8784631640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f877c102a90 0x7f877c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8784631640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f877c1053c0 0x7f877c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8784631640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f877c107cf0 0x7f877c1a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8784631640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f877c10dc00 con 0x7f877c107cf0 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8784631640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f877c10da80 con 0x7f877c1053c0 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8782bce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f877c107cf0 0x7f877c1a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8784631640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f877c10dd80 con 0x7f877c102a90 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8782bce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f877c107cf0 0x7f877c1a1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47200/0 (socket says 172.21.15.69:47200) 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8782bce640 1 -- 172.21.15.69:0/2871447193 learned_addr learned my addr 172.21.15.69:0/2871447193 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8781bcc640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f877c1053c0 0x7f877c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8782bce640 1 -- 172.21.15.69:0/2871447193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f877c102a90 msgr2=0x7f877c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8782bce640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f877c102a90 0x7f877c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8782bce640 1 -- 172.21.15.69:0/2871447193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f877c1053c0 msgr2=0x7f877c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8782bce640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f877c1053c0 0x7f877c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8782bce640 1 -- 172.21.15.69:0/2871447193 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877c1a20f0 con 0x7f877c107cf0 2024-04-23T10:26:43.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8781bcc640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f877c1053c0 0x7f877c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:43.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f8782bce640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f877c107cf0 0x7f877c1a1a80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f877400cad0 tx=0x7f877400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:43.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.705+0000 7f87737fe640 1 -- 172.21.15.69:0/2871447193 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877400ae20 con 0x7f877c107cf0 2024-04-23T10:26:43.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.706+0000 7f8784631640 1 -- 172.21.15.69:0/2871447193 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877c1a23e0 con 0x7f877c107cf0 2024-04-23T10:26:43.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.706+0000 7f87737fe640 1 -- 172.21.15.69:0/2871447193 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8774005020 con 0x7f877c107cf0 2024-04-23T10:26:43.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.706+0000 7f87737fe640 1 -- 172.21.15.69:0/2871447193 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877400f6b0 con 0x7f877c107cf0 2024-04-23T10:26:43.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.706+0000 7f8784631640 1 -- 172.21.15.69:0/2871447193 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877c1a28e0 con 0x7f877c107cf0 2024-04-23T10:26:43.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.707+0000 7f8784631640 1 -- 172.21.15.69:0/2871447193 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f877c1097e0 con 0x7f877c107cf0 2024-04-23T10:26:43.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.708+0000 7f87737fe640 1 -- 172.21.15.69:0/2871447193 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f87740051d0 con 0x7f877c107cf0 2024-04-23T10:26:43.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.708+0000 7f87737fe640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f87680a3bb0 0x7f87680a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:43.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.708+0000 7f87823cd640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f87680a3bb0 0x7f87680a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:43.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.708+0000 7f87737fe640 1 -- 172.21.15.69:0/2871447193 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f87740d0900 con 0x7f877c107cf0 2024-04-23T10:26:43.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.709+0000 7f87823cd640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f87680a3bb0 0x7f87680a6070 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f876c0096c0 tx=0x7f876c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:43.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.712+0000 7f87737fe640 1 -- 172.21.15.69:0/2871447193 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8774014030 con 0x7f877c107cf0 2024-04-23T10:26:43.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.927+0000 7f8784631640 1 -- 172.21.15.69:0/2871447193 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f877c02d5c0 con 0x7f877c107cf0 2024-04-23T10:26:43.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.927+0000 7f87737fe640 1 -- 172.21.15.69:0/2871447193 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7f877409d2d0 con 0x7f877c107cf0 2024-04-23T10:26:43.926 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:43.926 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:24:59.329454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24463,24421,24487,24416,24392]},"id":1}]} 2024-04-23T10:26:43.927 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 25 2024-04-23T10:26:43.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 -- 172.21.15.69:0/2871447193 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f87680a3bb0 msgr2=0x7f87680a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f87680a3bb0 0x7f87680a6070 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f876c0096c0 tx=0x7f876c000bc0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 -- 172.21.15.69:0/2871447193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f877c107cf0 msgr2=0x7f877c1a1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:43.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f877c107cf0 0x7f877c1a1a80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f877400cad0 tx=0x7f877400cf90 comp rx=0 tx=0).stop 2024-04-23T10:26:43.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 -- 172.21.15.69:0/2871447193 shutdown_connections 2024-04-23T10:26:43.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f87680a3bb0 0x7f87680a6070 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f877c107cf0 0x7f877c1a1a80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f877c1053c0 0x7f877c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 --2- 172.21.15.69:0/2871447193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f877c102a90 0x7f877c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:43.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 -- 172.21.15.69:0/2871447193 >> 172.21.15.69:0/2871447193 conn(0x7f877c0fc400 msgr2=0x7f877c102140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:43.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 -- 172.21.15.69:0/2871447193 shutdown_connections 2024-04-23T10:26:43.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:43.929+0000 7f8784631640 1 -- 172.21.15.69:0/2871447193 wait complete. 2024-04-23T10:26:43.940 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:26:44.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.039+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1920711810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f8102a90 msgr2=0x7f14f8104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.039+0000 7f14fd3f7640 1 --2- 172.21.15.69:0/1920711810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f8102a90 0x7f14f8104e80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009ca0 tx=0x7f14e802a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.039+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1920711810 shutdown_connections 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.039+0000 7f14fd3f7640 1 --2- 172.21.15.69:0/1920711810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14f8107cf0 0x7f14f810a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.039+0000 7f14fd3f7640 1 --2- 172.21.15.69:0/1920711810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14f81053c0 0x7f14f81077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.039+0000 7f14fd3f7640 1 --2- 172.21.15.69:0/1920711810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f8102a90 0x7f14f8104e80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.039+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1920711810 >> 172.21.15.69:0/1920711810 conn(0x7f14f80fc400 msgr2=0x7f14f80fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.039+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1920711810 shutdown_connections 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.039+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1920711810 wait complete. 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14fd3f7640 1 Processor -- start 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14fd3f7640 1 -- start start 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14fd3f7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f8102a90 0x7f14f8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14fd3f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14f81053c0 0x7f14f81988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14fd3f7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14f8107cf0 0x7f14f819f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14fd3f7640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f14f810dc70 con 0x7f14f8102a90 2024-04-23T10:26:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14fd3f7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f14f810daf0 con 0x7f14f8107cf0 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14fd3f7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14f810ddf0 con 0x7f14f81053c0 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14f6ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f8102a90 0x7f14f8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14f6ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f8102a90 0x7f14f8198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47224/0 (socket says 172.21.15.69:47224) 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14f6ffd640 1 -- 172.21.15.69:0/1657942156 learned_addr learned my addr 172.21.15.69:0/1657942156 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14f77fe640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14f8107cf0 0x7f14f819f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.040+0000 7f14f67fc640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14f81053c0 0x7f14f81988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.041+0000 7f14f6ffd640 1 -- 172.21.15.69:0/1657942156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14f81053c0 msgr2=0x7f14f81988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.041+0000 7f14f6ffd640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14f81053c0 0x7f14f81988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.041+0000 7f14f6ffd640 1 -- 172.21.15.69:0/1657942156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14f8107cf0 msgr2=0x7f14f819f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.041+0000 7f14f6ffd640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14f8107cf0 0x7f14f819f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.041+0000 7f14f6ffd640 1 -- 172.21.15.69:0/1657942156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f819ff90 con 0x7f14f8102a90 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.041+0000 7f14f6ffd640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f8102a90 0x7f14f8198370 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009dc0 tx=0x7f14e8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.041+0000 7f14dffff640 1 -- 172.21.15.69:0/1657942156 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e8004040 con 0x7f14f8102a90 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.041+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1657942156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f81a0220 con 0x7f14f8102a90 2024-04-23T10:26:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.041+0000 7f14dffff640 1 -- 172.21.15.69:0/1657942156 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14e80046b0 con 0x7f14f8102a90 2024-04-23T10:26:44.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.041+0000 7f14dffff640 1 -- 172.21.15.69:0/1657942156 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e80305c0 con 0x7f14f8102a90 2024-04-23T10:26:44.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.041+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1657942156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f81a0840 con 0x7f14f8102a90 2024-04-23T10:26:44.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.042+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1657942156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f80fdef0 con 0x7f14f8102a90 2024-04-23T10:26:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.043+0000 7f14dffff640 1 -- 172.21.15.69:0/1657942156 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f14e802f7f0 con 0x7f14f8102a90 2024-04-23T10:26:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.044+0000 7f14dffff640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f14e00a3bb0 0x7f14e00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.044+0000 7f14f67fc640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f14e00a3bb0 0x7f14e00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.044+0000 7f14dffff640 1 -- 172.21.15.69:0/1657942156 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f14e80f1df0 con 0x7f14f8102a90 2024-04-23T10:26:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.044+0000 7f14f67fc640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f14e00a3bb0 0x7f14e00a6070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f14f8199880 tx=0x7f14ec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.048+0000 7f14dffff640 1 -- 172.21.15.69:0/1657942156 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f14e80be7e0 con 0x7f14f8102a90 2024-04-23T10:26:44.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.226+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1657942156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14f8062b50 con 0x7f14f8102a90 2024-04-23T10:26:44.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.227+0000 7f14dffff640 1 -- 172.21.15.69:0/1657942156 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22595 (secure 0 0 0) 0x7f14e80be0e0 con 0x7f14f8102a90 2024-04-23T10:26:44.226 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:44.226 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":88,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:26:00.078482+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:26:44.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1657942156 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f14e00a3bb0 msgr2=0x7f14e00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f14e00a3bb0 0x7f14e00a6070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f14f8199880 tx=0x7f14ec008040 comp rx=0 tx=0).stop 2024-04-23T10:26:44.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1657942156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f8102a90 msgr2=0x7f14f8198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f8102a90 0x7f14f8198370 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009dc0 tx=0x7f14e8003ba0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1657942156 shutdown_connections 2024-04-23T10:26:44.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f14e00a3bb0 0x7f14e00a6070 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14f8107cf0 0x7f14f819f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14f81053c0 0x7f14f81988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 --2- 172.21.15.69:0/1657942156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f8102a90 0x7f14f8198370 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1657942156 >> 172.21.15.69:0/1657942156 conn(0x7f14f80fc400 msgr2=0x7f14f8103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1657942156 shutdown_connections 2024-04-23T10:26:44.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.229+0000 7f14fd3f7640 1 -- 172.21.15.69:0/1657942156 wait complete. 2024-04-23T10:26:44.238 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:44 smithi069 ceph-mon[29593]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T10:26:44.238 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:44 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3410543481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:44.238 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:44 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2732554974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:44.238 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:44 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2871447193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:44.240 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-23T10:24:52.877417+0000', 'modified': '2024-04-23T10:24:59.329454+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24487, 'mds_1': 24463, 'mds_2': 24421, 'mds_3': 24416, 'mds_4': 24392}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14631': {'gid': 14631, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.69:6839/441538329', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6838', 'nonce': 441538329}, {'type': 'v1', 'addr': '172.21.15.69:6839', 'nonce': 441538329}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14643': {'gid': 14643, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.69:6841/3448889268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6840', 'nonce': 3448889268}, {'type': 'v1', 'addr': '172.21.15.69:6841', 'nonce': 3448889268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24368': {'gid': 24368, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6833/318414865', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 318414865}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 318414865}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'e', 'rank': 4, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.146:6835/3824729166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 3824729166}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3824729166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'h', 'rank': 3, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.146:6837/1505523103', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 1505523103}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 1505523103}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.167:6833/977410598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6832', 'nonce': 977410598}, {'type': 'v1', 'addr': '172.21.15.167:6833', 'nonce': 977410598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'b', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6839/712940861', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6838', 'nonce': 712940861}, {'type': 'v1', 'addr': '172.21.15.146:6839', 'nonce': 712940861}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6835/2993393777', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 2993393777}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 2993393777}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.167:6837/1671189160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 1671189160}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 1671189160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.167:6839/1688975356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 1688975356}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 1688975356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24487, 'qdb_cluster': [24463, 24421, 24487, 24416, 24392]} 2024-04-23T10:26:44.240 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-23T10:26:44.240 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-23T10:26:44.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.340+0000 7fbdc616f640 1 -- 172.21.15.69:0/1207596664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc0102a30 msgr2=0x7fbdc0104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.340+0000 7fbdc616f640 1 --2- 172.21.15.69:0/1207596664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc0102a30 0x7fbdc0104e20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009900 tx=0x7fbdb402a410 comp rx=0 tx=0).stop 2024-04-23T10:26:44.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.340+0000 7fbdc616f640 1 -- 172.21.15.69:0/1207596664 shutdown_connections 2024-04-23T10:26:44.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.340+0000 7fbdc616f640 1 --2- 172.21.15.69:0/1207596664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdc0107c90 0x7fbdc010a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.340+0000 7fbdc616f640 1 --2- 172.21.15.69:0/1207596664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc0105360 0x7fbdc0107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.340+0000 7fbdc616f640 1 --2- 172.21.15.69:0/1207596664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc0102a30 0x7fbdc0104e20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.340+0000 7fbdc616f640 1 -- 172.21.15.69:0/1207596664 >> 172.21.15.69:0/1207596664 conn(0x7fbdc00fc440 msgr2=0x7fbdc00fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.340+0000 7fbdc616f640 1 -- 172.21.15.69:0/1207596664 shutdown_connections 2024-04-23T10:26:44.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.340+0000 7fbdc616f640 1 -- 172.21.15.69:0/1207596664 wait complete. 2024-04-23T10:26:44.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.340+0000 7fbdc616f640 1 Processor -- start 2024-04-23T10:26:44.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdc616f640 1 -- start start 2024-04-23T10:26:44.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdc616f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdc0102a30 0x7fbdc0198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdc616f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc0105360 0x7fbdc0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdc616f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc0107c90 0x7fbdc019f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdc616f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc010dc10 con 0x7fbdc0107c90 2024-04-23T10:26:44.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdc616f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc010da90 con 0x7fbdc0105360 2024-04-23T10:26:44.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdc616f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc010dd90 con 0x7fbdc0102a30 2024-04-23T10:26:44.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc0107c90 0x7fbdc019f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc0107c90 0x7fbdc019f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47234/0 (socket says 172.21.15.69:47234) 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbffff640 1 -- 172.21.15.69:0/3132405359 learned_addr learned my addr 172.21.15.69:0/3132405359 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbf7fe640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdc0102a30 0x7fbdc0198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbffff640 1 -- 172.21.15.69:0/3132405359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdc0102a30 msgr2=0x7fbdc0198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbffff640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdc0102a30 0x7fbdc0198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbffff640 1 -- 172.21.15.69:0/3132405359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc0105360 msgr2=0x7fbdc0198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbffff640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc0105360 0x7fbdc0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbffff640 1 -- 172.21.15.69:0/3132405359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc019ff30 con 0x7fbdc0107c90 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbffff640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc0107c90 0x7fbdc019f8c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009fd0 tx=0x7fbdb800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbcff9640 1 -- 172.21.15.69:0/3132405359 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8017070 con 0x7fbdc0107c90 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbcff9640 1 -- 172.21.15.69:0/3132405359 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbdb8003e40 con 0x7fbdc0107c90 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdc616f640 1 -- 172.21.15.69:0/3132405359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc01a0220 con 0x7fbdc0107c90 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdbcff9640 1 -- 172.21.15.69:0/3132405359 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8004820 con 0x7fbdc0107c90 2024-04-23T10:26:44.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.341+0000 7fbdc616f640 1 -- 172.21.15.69:0/3132405359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc01a0720 con 0x7fbdc0107c90 2024-04-23T10:26:44.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.343+0000 7fbdbcff9640 1 -- 172.21.15.69:0/3132405359 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fbdb8003970 con 0x7fbdc0107c90 2024-04-23T10:26:44.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdc8f65740 1 Processor -- start 2024-04-23T10:26:44.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdc8f65740 1 -- start start 2024-04-23T10:26:44.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db59fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdbcff9640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbda80a3bb0 0x7fbda80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5ad50 0x55aa4db5b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 0x55aa4db61fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55aa4dabec50 con 0x55aa4db59b80 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55aa4da5b830 con 0x55aa4db5ad50 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aa4dabac10 con 0x55aa4db5b710 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdbeffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db59fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdbf7fe640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbda80a3bb0 0x7fbda80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdbeffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db59fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47246/0 (socket says 172.21.15.69:47246) 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdbeffd640 1 -- 172.21.15.69:0/2452695301 learned_addr learned my addr 172.21.15.69:0/2452695301 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.344+0000 7fbdbcff9640 1 -- 172.21.15.69:0/3132405359 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fbdb80d0260 con 0x7fbdc0107c90 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbdbeffd640 1 -- 172.21.15.69:0/2452695301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 msgr2=0x55aa4db61fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbdbeffd640 1 --2- 172.21.15.69:0/2452695301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 0x55aa4db61fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbdbeffd640 1 -- 172.21.15.69:0/2452695301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5ad50 msgr2=0x55aa4db5b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbdbeffd640 1 --2- 172.21.15.69:0/2452695301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5ad50 0x55aa4db5b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbdbeffd640 1 -- 172.21.15.69:0/2452695301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa4d7d12d0 con 0x55aa4db59b80 2024-04-23T10:26:44.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbdbf7fe640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbda80a3bb0 0x7fbda80a6070 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4000c00 tx=0x7fbdb4031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbdbeffd640 1 --2- 172.21.15.69:0/2452695301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db59fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000bb50 tx=0x7fbdb000f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cb605253151df1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbda5ffb640 1 -- 172.21.15.69:0/2452695301 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0015030 con 0x55aa4db59b80 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbda5ffb640 1 -- 172.21.15.69:0/2452695301 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbdb000bc40 con 0x55aa4db59b80 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbda5ffb640 1 -- 172.21.15.69:0/2452695301 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00185d0 con 0x55aa4db59b80 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbdc8f65740 1 -- 172.21.15.69:0/2452695301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 msgr2=0x55aa4db59fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.345+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/2452695301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db59fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000bb50 tx=0x7fbdb000f6d0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 -- 172.21.15.69:0/2452695301 shutdown_connections 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/2452695301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 0x55aa4db61fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/2452695301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5ad50 0x55aa4db5b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/2452695301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db59fa0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 -- 172.21.15.69:0/2452695301 >> 172.21.15.69:0/2452695301 conn(0x55aa4db55070 msgr2=0x55aa4db55470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 -- 172.21.15.69:0/2452695301 shutdown_connections 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 -- 172.21.15.69:0/2452695301 wait complete. 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 -- start start 2024-04-23T10:26:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 Processor -- start 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5ad50 0x55aa4db64600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5b710 0x55aa4db6b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55aa4db62720 con 0x55aa4db59b80 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55aa4da59470 con 0x55aa4db5b710 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aa4db628a0 con 0x55aa4db5ad50 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdc8f65740 10 client.0 _ll_register_callbacks cb 0x55aa4da7ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdbf7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdbf7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db640c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47248/0 (socket says 172.21.15.69:47248) 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.346+0000 7fbdbf7fe640 1 -- 172.21.15.69:0/1245270993 learned_addr learned my addr 172.21.15.69:0/1245270993 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdbffff640 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5b710 0x55aa4db6b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdbeffd640 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5ad50 0x55aa4db64600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdbf7fe640 1 -- 172.21.15.69:0/1245270993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5ad50 msgr2=0x55aa4db64600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdbf7fe640 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5ad50 0x55aa4db64600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdbf7fe640 1 -- 172.21.15.69:0/1245270993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5b710 msgr2=0x55aa4db6b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdbf7fe640 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5b710 0x55aa4db6b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdbf7fe640 1 -- 172.21.15.69:0/1245270993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa4d89b6b0 con 0x55aa4db59b80 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdbeffd640 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5ad50 0x55aa4db64600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdbf7fe640 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db640c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009900 tx=0x7fbdb4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6340b1f24bc3f401 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbd9effd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbd9effd640 1 -- 172.21.15.69:0/1245270993 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb404c070 con 0x55aa4db59b80 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdc8f65740 1 -- 172.21.15.69:0/1245270993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdb000bc40 con 0x55aa4db59b80 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbd9effd640 1 -- 172.21.15.69:0/1245270993 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fbdb4004250 con 0x55aa4db59b80 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbd9effd640 1 -- 172.21.15.69:0/1245270993 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbdb4058050 con 0x55aa4db59b80 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdc8f65740 10 client.15258 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdc8f65740 1 -- 172.21.15.69:0/1245270993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55aa4db6ea70 con 0x55aa4db59b80 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbd9effd640 1 -- 172.21.15.69:0/1245270993 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbdb000bc40 con 0x55aa4db59b80 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbd9effd640 1 -- 172.21.15.69:0/1245270993 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fbdb403c440 con 0x55aa4db59b80 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdc8f65740 10 client.15258 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:44.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.347+0000 7fbdc8f65740 10 client.15258 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:26:44.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.348+0000 7fbdc8f65740 20 client.15258 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:44.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.348+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55aa4db710c0 0x55aa4db72530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.348+0000 7fbdc8f65740 4 client.15258 mds_command: new command op to 24392 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:44.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.348+0000 7fbdc8f65740 1 -- 172.21.15.69:0/1245270993 --> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa4dacc670 con 0x55aa4db710c0 2024-04-23T10:26:44.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.348+0000 7fbdbeffd640 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55aa4db710c0 0x55aa4db72530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.348+0000 7fbd9effd640 10 client.15258 ms_handle_connect on v2:172.21.15.146:6834/3824729166 2024-04-23T10:26:44.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.348+0000 7fbdbeffd640 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55aa4db710c0 0x55aa4db72530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7d76e4999b5aab75 server_cookie=46bc67a45b80308f in_seq=0 out_seq=0 2024-04-23T10:26:44.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbd9effd640 1 -- 172.21.15.69:0/1245270993 <== mds.4 v2:172.21.15.146:6834/3824729166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aa4dacc670 con 0x55aa4db710c0 2024-04-23T10:26:44.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbd9effd640 10 client.15258 handle_command_reply: tid=0 2024-04-23T10:26:44.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 1 client.15258 shutdown 2024-04-23T10:26:44.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 1 -- 172.21.15.69:0/1245270993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 msgr2=0x55aa4db640c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db640c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009900 tx=0x7fbdb4009260 comp rx=0 tx=0).stop 2024-04-23T10:26:44.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 1 -- 172.21.15.69:0/1245270993 shutdown_connections 2024-04-23T10:26:44.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55aa4db710c0 0x55aa4db72530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5b710 0x55aa4db6b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5ad50 0x55aa4db64600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/1245270993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db640c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbd9effd640 0 client.15258 ms_handle_reset on v2:172.21.15.146:6834/3824729166 2024-04-23T10:26:44.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 1 -- 172.21.15.69:0/1245270993 >> 172.21.15.69:0/1245270993 conn(0x55aa4db55070 msgr2=0x55aa4db541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 1 -- 172.21.15.69:0/1245270993 shutdown_connections 2024-04-23T10:26:44.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 1 -- 172.21.15.69:0/1245270993 wait complete. 2024-04-23T10:26:44.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.349+0000 7fbdc8f65740 20 client.15258 trim_cache size 0 max 16384 2024-04-23T10:26:44.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdc8f65740 1 Processor -- start 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdc8f65740 1 -- start start 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5ad50 0x55aa4db6b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 0x55aa4db5e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55aa4db70870 con 0x55aa4db59b80 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55aa4db70f40 con 0x55aa4db5ad50 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aa4db71610 con 0x55aa4db5b710 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdbf7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdbf7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47262/0 (socket says 172.21.15.69:47262) 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdbf7fe640 1 -- 172.21.15.69:0/3783244721 learned_addr learned my addr 172.21.15.69:0/3783244721 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdbf7fe640 1 -- 172.21.15.69:0/3783244721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 msgr2=0x55aa4db5e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdbf7fe640 1 --2- 172.21.15.69:0/3783244721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 0x55aa4db5e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdbf7fe640 1 -- 172.21.15.69:0/3783244721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5ad50 msgr2=0x55aa4db6b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdbf7fe640 1 --2- 172.21.15.69:0/3783244721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5ad50 0x55aa4db6b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdbf7fe640 1 -- 172.21.15.69:0/3783244721 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa4db50960 con 0x55aa4db59b80 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbdbf7fe640 1 --2- 172.21.15.69:0/3783244721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db500b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbdb402a930 tx=0x7fbdb403cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18bb39a2f4c6b69 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.367+0000 7fbda57fa640 1 -- 172.21.15.69:0/3783244721 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb404c040 con 0x55aa4db59b80 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbda57fa640 1 -- 172.21.15.69:0/3783244721 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbdb4061070 con 0x55aa4db59b80 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbda57fa640 1 -- 172.21.15.69:0/3783244721 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4035040 con 0x55aa4db59b80 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbdc8f65740 1 -- 172.21.15.69:0/3783244721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 msgr2=0x55aa4db500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/3783244721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db500b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbdb402a930 tx=0x7fbdb403cd90 comp rx=0 tx=0).stop 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbdc8f65740 1 -- 172.21.15.69:0/3783244721 shutdown_connections 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/3783244721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 0x55aa4db5e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/3783244721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db5ad50 0x55aa4db6b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/3783244721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db59b80 0x55aa4db500b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbdc8f65740 1 -- 172.21.15.69:0/3783244721 >> 172.21.15.69:0/3783244721 conn(0x55aa4db55070 msgr2=0x55aa4db55450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbdc8f65740 1 -- 172.21.15.69:0/3783244721 shutdown_connections 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbdc8f65740 1 -- 172.21.15.69:0/3783244721 wait complete. 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.368+0000 7fbdc8f65740 1 -- start start 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdc8f65740 1 Processor -- start 2024-04-23T10:26:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db59b80 0x55aa4db668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db5ad50 0x55aa4db66de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdc8f65740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 0x55aa4db69e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55aa4db723b0 con 0x55aa4db5ad50 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55aa4db71ce0 con 0x55aa4db59b80 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdc8f65740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aa4db72a80 con 0x55aa4db5b710 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdc8f65740 10 client.0 _ll_register_callbacks cb 0x7fbdb4040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdbeffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db5ad50 0x55aa4db66de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdbeffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db5ad50 0x55aa4db66de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47266/0 (socket says 172.21.15.69:47266) 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdbeffd640 1 -- 172.21.15.69:0/663617574 learned_addr learned my addr 172.21.15.69:0/663617574 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdbffff640 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 0x55aa4db69e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdbeffd640 1 -- 172.21.15.69:0/663617574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 msgr2=0x55aa4db69e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdbeffd640 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 0x55aa4db69e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdbeffd640 1 -- 172.21.15.69:0/663617574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db59b80 msgr2=0x55aa4db668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdbeffd640 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db59b80 0x55aa4db668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdbeffd640 1 -- 172.21.15.69:0/663617574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa4db6a3f0 con 0x55aa4db5ad50 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbdbeffd640 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db5ad50 0x55aa4db66de0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c010 tx=0x7fbdb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b3994b0b5c0bab server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbd9effd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.369+0000 7fbd9effd640 1 -- 172.21.15.69:0/663617574 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0015040 con 0x55aa4db5ad50 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbdc8f65740 1 -- 172.21.15.69:0/663617574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdb4061070 con 0x55aa4db5ad50 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbd9effd640 1 -- 172.21.15.69:0/663617574 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fbdb0004350 con 0x55aa4db5ad50 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbd9effd640 1 -- 172.21.15.69:0/663617574 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbdb000bc40 con 0x55aa4db5ad50 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbdc8f65740 10 client.15264 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbdc8f65740 1 -- 172.21.15.69:0/663617574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55aa4db6b790 con 0x55aa4db5ad50 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbd9effd640 1 -- 172.21.15.69:0/663617574 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbdb4061070 con 0x55aa4db5ad50 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbd9effd640 1 -- 172.21.15.69:0/663617574 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fbdb00047a0 con 0x55aa4db5ad50 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbdc8f65740 10 client.15264 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbdc8f65740 10 client.15264 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbdc8f65740 20 client.15264 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55aa4dbdb5b0 0x55aa4dbda2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbdc8f65740 4 client.15264 mds_command: new command op to 24392 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbdc8f65740 1 -- 172.21.15.69:0/663617574 --> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] -- command(tid 0: {"prefix": "status"}) -- 0x55aa4dac64e0 con 0x55aa4dbdb5b0 2024-04-23T10:26:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.370+0000 7fbdbf7fe640 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55aa4dbdb5b0 0x55aa4dbda2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdbf7fe640 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55aa4dbdb5b0 0x55aa4dbda2c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6c1bff8293d95a5c server_cookie=587432518757a163 in_seq=0 out_seq=0 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbd9effd640 10 client.15264 ms_handle_connect on v2:172.21.15.146:6834/3824729166 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbd9effd640 1 -- 172.21.15.69:0/663617574 <== mds.4 v2:172.21.15.146:6834/3824729166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55aa4dac64e0 con 0x55aa4dbdb5b0 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbd9effd640 10 client.15264 handle_command_reply: tid=0 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 1 client.15264 shutdown 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 1 -- 172.21.15.69:0/663617574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db5ad50 msgr2=0x55aa4db66de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db5ad50 0x55aa4db66de0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c010 tx=0x7fbdb000b330 comp rx=0 tx=0).stop 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 1 -- 172.21.15.69:0/663617574 shutdown_connections 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x55aa4dbdb5b0 0x55aa4dbda2c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aa4db5ad50 0x55aa4db66de0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aa4db5b710 0x55aa4db69e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbd9effd640 0 client.15264 ms_handle_reset on v2:172.21.15.146:6834/3824729166 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 1 --2- 172.21.15.69:0/663617574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aa4db59b80 0x55aa4db668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 1 -- 172.21.15.69:0/663617574 >> 172.21.15.69:0/663617574 conn(0x55aa4db55070 msgr2=0x55aa4db500b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 1 -- 172.21.15.69:0/663617574 shutdown_connections 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 1 -- 172.21.15.69:0/663617574 wait complete. 2024-04-23T10:26:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.371+0000 7fbdc8f65740 20 client.15264 trim_cache size 0 max 16384 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 4, 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24392, 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 106.045046024, 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 25, 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 88, 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 86, 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 135.87116659200001 2024-04-23T10:26:44.376 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:26:44.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 -- 172.21.15.69:0/3132405359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbda80a3bb0 msgr2=0x7fbda80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbda80a3bb0 0x7fbda80a6070 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4000c00 tx=0x7fbdb4031510 comp rx=0 tx=0).stop 2024-04-23T10:26:44.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 -- 172.21.15.69:0/3132405359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc0107c90 msgr2=0x7fbdc019f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc0107c90 0x7fbdc019f8c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009fd0 tx=0x7fbdb800b260 comp rx=0 tx=0).stop 2024-04-23T10:26:44.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 -- 172.21.15.69:0/3132405359 shutdown_connections 2024-04-23T10:26:44.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fbda80a3bb0 0x7fbda80a6070 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc0107c90 0x7fbdc019f8c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc0105360 0x7fbdc0198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 --2- 172.21.15.69:0/3132405359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdc0102a30 0x7fbdc0198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 -- 172.21.15.69:0/3132405359 >> 172.21.15.69:0/3132405359 conn(0x7fbdc00fc440 msgr2=0x7fbdc01032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 -- 172.21.15.69:0/3132405359 shutdown_connections 2024-04-23T10:26:44.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.372+0000 7fbdc616f640 1 -- 172.21.15.69:0/3132405359 wait complete. 2024-04-23T10:26:44.381 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-23T10:26:44.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:44 smithi146 ceph-mon[32800]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T10:26:44.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:44 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3410543481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:44.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:44 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2732554974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:44.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:44 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2871447193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:44.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.480+0000 7f821d243640 1 -- 172.21.15.69:0/3092261113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8218103b40 msgr2=0x7f821810a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.480+0000 7f821d243640 1 --2- 172.21.15.69:0/3092261113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8218103b40 0x7f821810a3d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8208009900 tx=0x7f820802a410 comp rx=0 tx=0).stop 2024-04-23T10:26:44.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.480+0000 7f821d243640 1 -- 172.21.15.69:0/3092261113 shutdown_connections 2024-04-23T10:26:44.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.480+0000 7f821d243640 1 --2- 172.21.15.69:0/3092261113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8218103b40 0x7f821810a3d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.480+0000 7f821d243640 1 --2- 172.21.15.69:0/3092261113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8218103180 0x7f8218103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.480+0000 7f821d243640 1 --2- 172.21.15.69:0/3092261113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8218101f90 0x7f82181023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.480+0000 7f821d243640 1 -- 172.21.15.69:0/3092261113 >> 172.21.15.69:0/3092261113 conn(0x7f82180fd500 msgr2=0x7f82180ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.480+0000 7f821d243640 1 -- 172.21.15.69:0/3092261113 shutdown_connections 2024-04-23T10:26:44.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.480+0000 7f821d243640 1 -- 172.21.15.69:0/3092261113 wait complete. 2024-04-23T10:26:44.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.481+0000 7f821d243640 1 Processor -- start 2024-04-23T10:26:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.481+0000 7f821d243640 1 -- start start 2024-04-23T10:26:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.481+0000 7f821d243640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8218101f90 0x7f821819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.481+0000 7f821d243640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8218103180 0x7f821819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.481+0000 7f821d243640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8218103b40 0x7f82181a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.481+0000 7f821d243640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f821810dbf0 con 0x7f8218101f90 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.481+0000 7f821d243640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f821810da70 con 0x7f8218103b40 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.481+0000 7f821d243640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f821810dd70 con 0x7f8218103180 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.481+0000 7f8216d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8218101f90 0x7f821819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.481+0000 7f8216d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8218101f90 0x7f821819a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47288/0 (socket says 172.21.15.69:47288) 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.481+0000 7f8216d9d640 1 -- 172.21.15.69:0/2813847397 learned_addr learned my addr 172.21.15.69:0/2813847397 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f821659c640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8218103180 0x7f821819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f821759e640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8218103b40 0x7f82181a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f8216d9d640 1 -- 172.21.15.69:0/2813847397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8218103180 msgr2=0x7f821819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f8216d9d640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8218103180 0x7f821819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f8216d9d640 1 -- 172.21.15.69:0/2813847397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8218103b40 msgr2=0x7f82181a1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f8216d9d640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8218103b40 0x7f82181a1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f8216d9d640 1 -- 172.21.15.69:0/2813847397 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82181a2070 con 0x7f8218101f90 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f821759e640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8218103b40 0x7f82181a1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f8216d9d640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8218101f90 0x7f821819a450 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8210009fd0 tx=0x7f821000c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f820ffff640 1 -- 172.21.15.69:0/2813847397 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210011470 con 0x7f8218101f90 2024-04-23T10:26:44.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f821d243640 1 -- 172.21.15.69:0/2813847397 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82181a2360 con 0x7f8218101f90 2024-04-23T10:26:44.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f820ffff640 1 -- 172.21.15.69:0/2813847397 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8210011ae0 con 0x7f8218101f90 2024-04-23T10:26:44.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f820ffff640 1 -- 172.21.15.69:0/2813847397 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821001abe0 con 0x7f8218101f90 2024-04-23T10:26:44.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.482+0000 7f821d243640 1 -- 172.21.15.69:0/2813847397 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82181a28b0 con 0x7f8218101f90 2024-04-23T10:26:44.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.484+0000 7f820ffff640 1 -- 172.21.15.69:0/2813847397 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f8210011c90 con 0x7f8218101f90 2024-04-23T10:26:44.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.484+0000 7f8220039740 1 Processor -- start 2024-04-23T10:26:44.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.484+0000 7f8220039740 1 -- start start 2024-04-23T10:26:44.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f8220039740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641db80 0x55cd9641dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f8220039740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 0x55cd9641f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f8220039740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd96425fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f8220039740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cd96382c50 con 0x55cd9641f710 2024-04-23T10:26:44.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f8220039740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cd9631f830 con 0x55cd9641db80 2024-04-23T10:26:44.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f8220039740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cd9637ec10 con 0x55cd9641ed50 2024-04-23T10:26:44.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821659c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd96425fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821659c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd96425fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47292/0 (socket says 172.21.15.69:47292) 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f820ffff640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82040a3bb0 0x7f82040a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821659c640 1 -- 172.21.15.69:0/1706380772 learned_addr learned my addr 172.21.15.69:0/1706380772 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f8216d9d640 1 --2- 172.21.15.69:0/1706380772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 0x55cd9641f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821759e640 1 --2- 172.21.15.69:0/1706380772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641db80 0x55cd9641dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821759e640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82040a3bb0 0x7f82040a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821659c640 1 -- 172.21.15.69:0/1706380772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 msgr2=0x55cd9641f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821659c640 1 --2- 172.21.15.69:0/1706380772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 0x55cd9641f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821659c640 1 -- 172.21.15.69:0/1706380772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641db80 msgr2=0x55cd9641dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821659c640 1 --2- 172.21.15.69:0/1706380772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641db80 0x55cd9641dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821659c640 1 -- 172.21.15.69:0/1706380772 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd960952d0 con 0x55cd9641f710 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f8216d9d640 1 --2- 172.21.15.69:0/1706380772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 0x55cd9641f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f820ffff640 1 -- 172.21.15.69:0/2813847397 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f82100d0970 con 0x7f8218101f90 2024-04-23T10:26:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821659c640 1 --2- 172.21.15.69:0/1706380772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd96425fa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8200009c20 tx=0x7f8200011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0118f7be182afb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f820d7fa640 1 -- 172.21.15.69:0/1706380772 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200004230 con 0x55cd9641f710 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.485+0000 7f821759e640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82040a3bb0 0x7f82040a6070 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f820802a930 tx=0x7f8208005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.486+0000 7f820d7fa640 1 -- 172.21.15.69:0/1706380772 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f82000043d0 con 0x55cd9641f710 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.486+0000 7f820d7fa640 1 -- 172.21.15.69:0/1706380772 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200004d40 con 0x55cd9641f710 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.486+0000 7f8220039740 1 -- 172.21.15.69:0/1706380772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 msgr2=0x55cd96425fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.486+0000 7f8220039740 1 --2- 172.21.15.69:0/1706380772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd96425fa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8200009c20 tx=0x7f8200011810 comp rx=0 tx=0).stop 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.486+0000 7f8220039740 1 -- 172.21.15.69:0/1706380772 shutdown_connections 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.486+0000 7f8220039740 1 --2- 172.21.15.69:0/1706380772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd96425fa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.486+0000 7f8220039740 1 --2- 172.21.15.69:0/1706380772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 0x55cd9641f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.486+0000 7f8220039740 1 --2- 172.21.15.69:0/1706380772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641db80 0x55cd9641dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.486+0000 7f8220039740 1 -- 172.21.15.69:0/1706380772 >> 172.21.15.69:0/1706380772 conn(0x55cd96419070 msgr2=0x55cd96419470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.486+0000 7f8220039740 1 -- 172.21.15.69:0/1706380772 shutdown_connections 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.486+0000 7f8220039740 1 -- 172.21.15.69:0/1706380772 wait complete. 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f8220039740 1 -- start start 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f8220039740 1 Processor -- start 2024-04-23T10:26:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f8220039740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641db80 0x55cd96427f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f8220039740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 0x55cd964284c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f8220039740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f8220039740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cd96426720 con 0x55cd9641f710 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f8220039740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cd9631d470 con 0x55cd9641db80 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f8220039740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cd964268a0 con 0x55cd9641ed50 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f8220039740 10 client.0 _ll_register_callbacks cb 0x55cd96342f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f821759e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f821759e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47298/0 (socket says 172.21.15.69:47298) 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f821759e640 1 -- 172.21.15.69:0/3753057457 learned_addr learned my addr 172.21.15.69:0/3753057457 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f8216d9d640 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641db80 0x55cd96427f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f821659c640 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 0x55cd964284c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f821759e640 1 -- 172.21.15.69:0/3753057457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 msgr2=0x55cd964284c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f821759e640 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 0x55cd964284c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f821759e640 1 -- 172.21.15.69:0/3753057457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641db80 msgr2=0x55cd96427f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f821759e640 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641db80 0x55cd96427f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f821759e640 1 -- 172.21.15.69:0/3753057457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd9615f6b0 con 0x55cd9641f710 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f821659c640 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 0x55cd964284c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f821759e640 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f500 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8208033000 tx=0x7f8208009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e42fec587da109 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f81fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f81fe7fc640 1 -- 172.21.15.69:0/3753057457 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820804c030 con 0x55cd9641f710 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f81fe7fc640 1 -- 172.21.15.69:0/3753057457 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f82080035f0 con 0x55cd9641f710 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.487+0000 7f8220039740 1 -- 172.21.15.69:0/3753057457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82000043d0 con 0x55cd9641f710 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f81fe7fc640 1 -- 172.21.15.69:0/3753057457 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8208042070 con 0x55cd9641f710 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f8220039740 10 client.15276 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f8220039740 1 -- 172.21.15.69:0/3753057457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cd964328e0 con 0x55cd9641f710 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f81fe7fc640 1 -- 172.21.15.69:0/3753057457 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f82000043d0 con 0x55cd9641f710 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f81fe7fc640 1 -- 172.21.15.69:0/3753057457 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f820803a070 con 0x55cd9641f710 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f8220039740 10 client.15276 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f8220039740 10 client.15276 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-23T10:26:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f8220039740 20 client.15276 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f8220039740 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55cd96435030 0x55cd964364a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f8220039740 4 client.15276 mds_command: new command op to 24416 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f8220039740 1 -- 172.21.15.69:0/3753057457 --> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd96390670 con 0x55cd96435030 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.488+0000 7f8216d9d640 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55cd96435030 0x55cd964364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.489+0000 7f8216d9d640 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55cd96435030 0x55cd964364a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3e994a13093827a6 server_cookie=a2ff06799e0ac001 in_seq=0 out_seq=0 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.489+0000 7f81fe7fc640 10 client.15276 ms_handle_connect on v2:172.21.15.146:6836/1505523103 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.489+0000 7f81fe7fc640 1 -- 172.21.15.69:0/3753057457 <== mds.3 v2:172.21.15.146:6836/1505523103 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cd96390670 con 0x55cd96435030 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.489+0000 7f81fe7fc640 10 client.15276 handle_command_reply: tid=0 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.489+0000 7f8220039740 1 client.15276 shutdown 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f8220039740 1 -- 172.21.15.69:0/3753057457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 msgr2=0x55cd9642f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f8220039740 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f500 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8208033000 tx=0x7f8208009260 comp rx=0 tx=0).stop 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f8220039740 1 -- 172.21.15.69:0/3753057457 shutdown_connections 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f8220039740 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55cd96435030 0x55cd964364a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f8220039740 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f500 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f8220039740 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641ed50 0x55cd964284c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f81fe7fc640 0 client.15276 ms_handle_reset on v2:172.21.15.146:6836/1505523103 2024-04-23T10:26:44.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f8220039740 1 --2- 172.21.15.69:0/3753057457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641db80 0x55cd96427f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f8220039740 1 -- 172.21.15.69:0/3753057457 >> 172.21.15.69:0/3753057457 conn(0x55cd96419070 msgr2=0x55cd964181d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f8220039740 1 -- 172.21.15.69:0/3753057457 shutdown_connections 2024-04-23T10:26:44.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f8220039740 1 -- 172.21.15.69:0/3753057457 wait complete. 2024-04-23T10:26:44.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.490+0000 7f8220039740 20 client.15276 trim_cache size 0 max 16384 2024-04-23T10:26:44.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f8220039740 1 Processor -- start 2024-04-23T10:26:44.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f8220039740 1 -- start start 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f8220039740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641db80 0x55cd96413e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f8220039740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641ed50 0x55cd964143b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f8220039740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f8220039740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cd964347e0 con 0x55cd9641f710 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f8220039740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cd96434eb0 con 0x55cd9641ed50 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f8220039740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cd96435580 con 0x55cd9641db80 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f821759e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f821659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641ed50 0x55cd964143b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f821759e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47306/0 (socket says 172.21.15.69:47306) 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f821759e640 1 -- 172.21.15.69:0/1324416225 learned_addr learned my addr 172.21.15.69:0/1324416225 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f8216d9d640 1 --2- 172.21.15.69:0/1324416225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641db80 0x55cd96413e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f821759e640 1 -- 172.21.15.69:0/1324416225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641db80 msgr2=0x55cd96413e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f821759e640 1 --2- 172.21.15.69:0/1324416225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641db80 0x55cd96413e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f821759e640 1 -- 172.21.15.69:0/1324416225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641ed50 msgr2=0x55cd964143b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f821759e640 1 --2- 172.21.15.69:0/1324416225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641ed50 0x55cd964143b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.509+0000 7f821759e640 1 -- 172.21.15.69:0/1324416225 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd96419d40 con 0x55cd9641f710 2024-04-23T10:26:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.510+0000 7f821759e640 1 --2- 172.21.15.69:0/1324416225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f4c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8208009340 tx=0x7f82080092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ea39c34f4687e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.510+0000 7f820cff9640 1 -- 172.21.15.69:0/1324416225 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208060020 con 0x55cd9641f710 2024-04-23T10:26:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.510+0000 7f820cff9640 1 -- 172.21.15.69:0/1324416225 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8208048620 con 0x55cd9641f710 2024-04-23T10:26:44.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.510+0000 7f820cff9640 1 -- 172.21.15.69:0/1324416225 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820804c040 con 0x55cd9641f710 2024-04-23T10:26:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.510+0000 7f8220039740 1 -- 172.21.15.69:0/1324416225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 msgr2=0x55cd9642f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.510+0000 7f8220039740 1 --2- 172.21.15.69:0/1324416225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f4c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8208009340 tx=0x7f82080092d0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 -- 172.21.15.69:0/1324416225 shutdown_connections 2024-04-23T10:26:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 --2- 172.21.15.69:0/1324416225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642f4c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 --2- 172.21.15.69:0/1324416225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641ed50 0x55cd964143b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 --2- 172.21.15.69:0/1324416225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641db80 0x55cd96413e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 -- 172.21.15.69:0/1324416225 >> 172.21.15.69:0/1324416225 conn(0x55cd96419070 msgr2=0x55cd96419450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 -- 172.21.15.69:0/1324416225 shutdown_connections 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 -- 172.21.15.69:0/1324416225 wait complete. 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 -- start start 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 Processor -- start 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641db80 0x55cd9642ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641ed50 0x55cd9642b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cd96436320 con 0x55cd9641f710 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cd96435c50 con 0x55cd9641ed50 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cd964369f0 con 0x55cd9641db80 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8220039740 10 client.0 _ll_register_callbacks cb 0x7f8200005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f821759e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f821759e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47322/0 (socket says 172.21.15.69:47322) 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f821759e640 1 -- 172.21.15.69:0/4080742879 learned_addr learned my addr 172.21.15.69:0/4080742879 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f8216d9d640 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641db80 0x55cd9642ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.511+0000 7f821659c640 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641ed50 0x55cd9642b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f821759e640 1 -- 172.21.15.69:0/4080742879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641db80 msgr2=0x55cd9642ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f821759e640 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641db80 0x55cd9642ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f821759e640 1 -- 172.21.15.69:0/4080742879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641ed50 msgr2=0x55cd9642b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f821759e640 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641ed50 0x55cd9642b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f821759e640 1 -- 172.21.15.69:0/4080742879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd9642e770 con 0x55cd9641f710 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f821659c640 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641ed50 0x55cd9642b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f821759e640 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642e180 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8208048f70 tx=0x7f820802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b2a8a0b1f2cef server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f81fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f81fe7fc640 1 -- 172.21.15.69:0/4080742879 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820806a060 con 0x55cd9641f710 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f81fe7fc640 1 -- 172.21.15.69:0/4080742879 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f8208003e40 con 0x55cd9641f710 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f8220039740 1 -- 172.21.15.69:0/4080742879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8208048620 con 0x55cd9641f710 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f81fe7fc640 1 -- 172.21.15.69:0/4080742879 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8208060030 con 0x55cd9641f710 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f8220039740 10 client.15282 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f8220039740 1 -- 172.21.15.69:0/4080742879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cd9649afe0 con 0x55cd9641f710 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f81fe7fc640 1 -- 172.21.15.69:0/4080742879 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8208048620 con 0x55cd9641f710 2024-04-23T10:26:44.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f81fe7fc640 1 -- 172.21.15.69:0/4080742879 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f820803a040 con 0x55cd9641f710 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f8220039740 10 client.15282 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f8220039740 10 client.15282 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f8220039740 20 client.15282 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f8220039740 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55cd9649f7b0 0x55cd9649e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f8220039740 4 client.15282 mds_command: new command op to 24416 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.512+0000 7f8220039740 1 -- 172.21.15.69:0/4080742879 --> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] -- command(tid 0: {"prefix": "status"}) -- 0x55cd9638a4e0 con 0x55cd9649f7b0 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f8216d9d640 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55cd9649f7b0 0x55cd9649e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f81fe7fc640 10 client.15282 ms_handle_connect on v2:172.21.15.146:6836/1505523103 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f8216d9d640 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55cd9649f7b0 0x55cd9649e4c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b90737612d6fb1ab server_cookie=71687bf33fa32b76 in_seq=0 out_seq=0 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f81fe7fc640 1 -- 172.21.15.69:0/4080742879 <== mds.3 v2:172.21.15.146:6836/1505523103 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55cd9638a4e0 con 0x55cd9649f7b0 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f81fe7fc640 10 client.15282 handle_command_reply: tid=0 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f8220039740 1 client.15282 shutdown 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f8220039740 1 -- 172.21.15.69:0/4080742879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 msgr2=0x55cd9642e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f8220039740 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642e180 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8208048f70 tx=0x7f820802a410 comp rx=0 tx=0).stop 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f8220039740 1 -- 172.21.15.69:0/4080742879 shutdown_connections 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f8220039740 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x55cd9649f7b0 0x55cd9649e4c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f8220039740 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cd9641f710 0x55cd9642e180 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f8220039740 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd9641ed50 0x55cd9642b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f8220039740 1 --2- 172.21.15.69:0/4080742879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cd9641db80 0x55cd9642ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f81fe7fc640 0 client.15282 ms_handle_reset on v2:172.21.15.146:6836/1505523103 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.513+0000 7f8220039740 1 -- 172.21.15.69:0/4080742879 >> 172.21.15.69:0/4080742879 conn(0x55cd96419070 msgr2=0x55cd96413e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f8220039740 1 -- 172.21.15.69:0/4080742879 shutdown_connections 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f8220039740 1 -- 172.21.15.69:0/4080742879 wait complete. 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f8220039740 20 client.15282 trim_cache size 0 max 16384 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 3, 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24416, 2024-04-23T10:26:44.518 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:26:44.519 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:26:44.519 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:26:44.519 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 107.194138357, 2024-04-23T10:26:44.519 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 25, 2024-04-23T10:26:44.519 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 88, 2024-04-23T10:26:44.519 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 86, 2024-04-23T10:26:44.519 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 127.64214003799999 2024-04-23T10:26:44.519 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 -- 172.21.15.69:0/2813847397 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82040a3bb0 msgr2=0x7f82040a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82040a3bb0 0x7f82040a6070 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f820802a930 tx=0x7f8208005fd0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 -- 172.21.15.69:0/2813847397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8218101f90 msgr2=0x7f821819a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8218101f90 0x7f821819a450 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8210009fd0 tx=0x7f821000c270 comp rx=0 tx=0).stop 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 -- 172.21.15.69:0/2813847397 shutdown_connections 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f82040a3bb0 0x7f82040a6070 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8218103b40 0x7f82181a1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8218103180 0x7f821819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 --2- 172.21.15.69:0/2813847397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8218101f90 0x7f821819a450 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 -- 172.21.15.69:0/2813847397 >> 172.21.15.69:0/2813847397 conn(0x7f82180fd500 msgr2=0x7f8218074180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 -- 172.21.15.69:0/2813847397 shutdown_connections 2024-04-23T10:26:44.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.514+0000 7f821d243640 1 -- 172.21.15.69:0/2813847397 wait complete. 2024-04-23T10:26:44.524 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-04-23T10:26:44.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:44 smithi167 ceph-mon[32940]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T10:26:44.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:44 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3410543481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:44.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:44 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2732554974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:44.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:44 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2871447193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:26:44.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.623+0000 7f737cde5640 1 -- 172.21.15.69:0/852697041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7378102a70 msgr2=0x7f7378104e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.623+0000 7f737cde5640 1 --2- 172.21.15.69:0/852697041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7378102a70 0x7f7378104e60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7368009ca0 tx=0x7f736802a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.623+0000 7f737cde5640 1 -- 172.21.15.69:0/852697041 shutdown_connections 2024-04-23T10:26:44.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.623+0000 7f737cde5640 1 --2- 172.21.15.69:0/852697041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7378107cd0 0x7f737810a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.623+0000 7f737cde5640 1 --2- 172.21.15.69:0/852697041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73781053a0 0x7f7378107790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.623+0000 7f737cde5640 1 --2- 172.21.15.69:0/852697041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7378102a70 0x7f7378104e60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.623+0000 7f737cde5640 1 -- 172.21.15.69:0/852697041 >> 172.21.15.69:0/852697041 conn(0x7f73780fc400 msgr2=0x7f73780fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.623+0000 7f737cde5640 1 -- 172.21.15.69:0/852697041 shutdown_connections 2024-04-23T10:26:44.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.623+0000 7f737cde5640 1 -- 172.21.15.69:0/852697041 wait complete. 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f737cde5640 1 Processor -- start 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f737cde5640 1 -- start start 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f737cde5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7378102a70 0x7f73781982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f737cde5640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73781053a0 0x7f7378198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f737cde5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378107cd0 0x7f737819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f737cde5640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f737810dc10 con 0x7f73781053a0 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f737cde5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f737810da90 con 0x7f7378102a70 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f737cde5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f737810dd90 con 0x7f7378107cd0 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f7375d9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73781053a0 0x7f7378198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f7375d9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73781053a0 0x7f7378198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47346/0 (socket says 172.21.15.69:47346) 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f7375d9b640 1 -- 172.21.15.69:0/1859558767 learned_addr learned my addr 172.21.15.69:0/1859558767 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f7376d9d640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378107cd0 0x7f737819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f7375d9b640 1 -- 172.21.15.69:0/1859558767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378107cd0 msgr2=0x7f737819f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.624+0000 7f7375d9b640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378107cd0 0x7f737819f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.625+0000 7f7375d9b640 1 -- 172.21.15.69:0/1859558767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7378102a70 msgr2=0x7f73781982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.625+0000 7f7375d9b640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7378102a70 0x7f73781982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.625+0000 7f7375d9b640 1 -- 172.21.15.69:0/1859558767 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737819ff10 con 0x7f73781053a0 2024-04-23T10:26:44.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.625+0000 7f7375d9b640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73781053a0 0x7f7378198830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f736c00e9f0 tx=0x7f736c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.625+0000 7f73677fe640 1 -- 172.21.15.69:0/1859558767 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c00ccc0 con 0x7f73781053a0 2024-04-23T10:26:44.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.625+0000 7f737cde5640 1 -- 172.21.15.69:0/1859558767 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73781a0200 con 0x7f73781053a0 2024-04-23T10:26:44.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.625+0000 7f73677fe640 1 -- 172.21.15.69:0/1859558767 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f736c0054f0 con 0x7f73781053a0 2024-04-23T10:26:44.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.625+0000 7f73677fe640 1 -- 172.21.15.69:0/1859558767 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c010690 con 0x7f73781053a0 2024-04-23T10:26:44.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.625+0000 7f737cde5640 1 -- 172.21.15.69:0/1859558767 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73781a0700 con 0x7f73781053a0 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.627+0000 7f73677fe640 1 -- 172.21.15.69:0/1859558767 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f736c0046c0 con 0x7f73781053a0 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.627+0000 7f737fbdb740 1 Processor -- start 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f737fbdb740 1 -- start start 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bdb80 0x5647842bdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bed50 0x5647842bf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 0x5647842c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f737fbdb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564784222c50 con 0x5647842bdb80 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f737fbdb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5647841bf830 con 0x5647842bf710 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f737fbdb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56478421ec10 con 0x5647842bed50 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f73677fe640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f73600a3bb0 0x7f73600a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7376d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bdb80 0x5647842bdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7376d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bdb80 0x5647842bdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47352/0 (socket says 172.21.15.69:47352) 2024-04-23T10:26:44.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7376d9d640 1 -- 172.21.15.69:0/2690206378 learned_addr learned my addr 172.21.15.69:0/2690206378 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7376d9d640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f73600a3bb0 0x7f73600a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7375d9b640 1 --2- 172.21.15.69:0/2690206378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 0x5647842c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f73677fe640 1 -- 172.21.15.69:0/1859558767 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f736c0d0900 con 0x7f73781053a0 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f737659c640 1 --2- 172.21.15.69:0/2690206378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bed50 0x5647842bf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7376d9d640 1 -- 172.21.15.69:0/2690206378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bed50 msgr2=0x5647842bf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7376d9d640 1 --2- 172.21.15.69:0/2690206378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bed50 0x5647842bf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7376d9d640 1 -- 172.21.15.69:0/2690206378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 msgr2=0x5647842c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7376d9d640 1 --2- 172.21.15.69:0/2690206378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 0x5647842c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7376d9d640 1 -- 172.21.15.69:0/2690206378 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564783f352d0 con 0x5647842bdb80 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f737659c640 1 --2- 172.21.15.69:0/2690206378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bed50 0x5647842bf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7375d9b640 1 --2- 172.21.15.69:0/2690206378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 0x5647842c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7376d9d640 1 --2- 172.21.15.69:0/2690206378 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bdb80 0x5647842bdfa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7370005fd0 tx=0x7f73700107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e69b07240027ab server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7376d9d640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f73600a3bb0 0x7f73600a6070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f73700058c0 tx=0x7f7370015000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.628+0000 7f7364ff9640 1 -- 172.21.15.69:0/2690206378 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737000ad20 con 0x5647842bdb80 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.629+0000 7f7364ff9640 1 -- 172.21.15.69:0/2690206378 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f73700035f0 con 0x5647842bdb80 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.629+0000 7f7364ff9640 1 -- 172.21.15.69:0/2690206378 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737001d630 con 0x5647842bdb80 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.629+0000 7f737fbdb740 1 -- 172.21.15.69:0/2690206378 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bdb80 msgr2=0x5647842bdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.629+0000 7f737fbdb740 1 --2- 172.21.15.69:0/2690206378 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bdb80 0x5647842bdfa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7370005fd0 tx=0x7f73700107a0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.629+0000 7f737fbdb740 1 -- 172.21.15.69:0/2690206378 shutdown_connections 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.629+0000 7f737fbdb740 1 --2- 172.21.15.69:0/2690206378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 0x5647842c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.629+0000 7f737fbdb740 1 --2- 172.21.15.69:0/2690206378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bed50 0x5647842bf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.629+0000 7f737fbdb740 1 --2- 172.21.15.69:0/2690206378 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bdb80 0x5647842bdfa0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.629+0000 7f737fbdb740 1 -- 172.21.15.69:0/2690206378 >> 172.21.15.69:0/2690206378 conn(0x5647842b9070 msgr2=0x5647842b9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.629+0000 7f737fbdb740 1 -- 172.21.15.69:0/2690206378 shutdown_connections 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.629+0000 7f737fbdb740 1 -- 172.21.15.69:0/2690206378 wait complete. 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f737fbdb740 1 -- start start 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f737fbdb740 1 Processor -- start 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bdb80 0x5647842c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bed50 0x5647842c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f737fbdb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5647842c66c0 con 0x5647842bf710 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f737fbdb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5647841bd470 con 0x5647842bdb80 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f737fbdb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5647842c6840 con 0x5647842bed50 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f737fbdb740 10 client.0 _ll_register_callbacks cb 0x5647841e2f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f7376d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f7376d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47362/0 (socket says 172.21.15.69:47362) 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f7376d9d640 1 -- 172.21.15.69:0/3239721118 learned_addr learned my addr 172.21.15.69:0/3239721118 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f737659c640 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bdb80 0x5647842c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f7376d9d640 1 -- 172.21.15.69:0/3239721118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bed50 msgr2=0x5647842c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f7376d9d640 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bed50 0x5647842c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f7376d9d640 1 -- 172.21.15.69:0/3239721118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bdb80 msgr2=0x5647842c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f7376d9d640 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bdb80 0x5647842c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f7376d9d640 1 -- 172.21.15.69:0/3239721118 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564783fff6b0 con 0x5647842bf710 2024-04-23T10:26:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.630+0000 7f737659c640 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bdb80 0x5647842c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f7376d9d640 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cf530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f737000e9f0 tx=0x7f737000add0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912e69aab77f2b3f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f735dffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f735dffb640 1 -- 172.21.15.69:0/3239721118 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370004210 con 0x5647842bf710 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f735dffb640 1 -- 172.21.15.69:0/3239721118 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f73700043b0 con 0x5647842bf710 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f737fbdb740 1 -- 172.21.15.69:0/3239721118 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73700035f0 con 0x5647842bf710 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f735dffb640 1 -- 172.21.15.69:0/3239721118 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73700037a0 con 0x5647842bf710 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f737fbdb740 10 client.15294 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f737fbdb740 1 -- 172.21.15.69:0/3239721118 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5647842d2880 con 0x5647842bf710 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f735dffb640 1 -- 172.21.15.69:0/3239721118 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f73700035f0 con 0x5647842bf710 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f735dffb640 1 -- 172.21.15.69:0/3239721118 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f737001c030 con 0x5647842bf710 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f737fbdb740 10 client.15294 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f737fbdb740 10 client.15294 resolve_mds: resolved name 'l' to daemon mds.l 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f737fbdb740 20 client.15294 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f737fbdb740 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5647842d4d80 0x5647842d61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f737fbdb740 4 client.15294 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.631+0000 7f737fbdb740 1 -- 172.21.15.69:0/3239721118 --> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564784230670 con 0x5647842d4d80 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.632+0000 7f737659c640 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5647842d4d80 0x5647842d61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.632+0000 7f735dffb640 10 client.15294 ms_handle_connect on v2:172.21.15.167:6832/977410598 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.632+0000 7f737659c640 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5647842d4d80 0x5647842d61f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11f2e20a79e10a99 server_cookie=cc5d78bd67d14165 in_seq=0 out_seq=0 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f735dffb640 1 -- 172.21.15.69:0/3239721118 <== mds.2 v2:172.21.15.167:6832/977410598 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564784230670 con 0x5647842d4d80 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f735dffb640 10 client.15294 handle_command_reply: tid=0 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 1 client.15294 shutdown 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 1 -- 172.21.15.69:0/3239721118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 msgr2=0x5647842cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cf530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f737000e9f0 tx=0x7f737000add0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 1 -- 172.21.15.69:0/3239721118 shutdown_connections 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5647842d4d80 0x5647842d61f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cf530 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f735dffb640 0 client.15294 ms_handle_reset on v2:172.21.15.167:6832/977410598 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bed50 0x5647842c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 1 --2- 172.21.15.69:0/3239721118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bdb80 0x5647842c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 1 -- 172.21.15.69:0/3239721118 >> 172.21.15.69:0/3239721118 conn(0x5647842b9070 msgr2=0x5647842b81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 1 -- 172.21.15.69:0/3239721118 shutdown_connections 2024-04-23T10:26:44.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 1 -- 172.21.15.69:0/3239721118 wait complete. 2024-04-23T10:26:44.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.633+0000 7f737fbdb740 20 client.15294 trim_cache size 0 max 16384 2024-04-23T10:26:44.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f737fbdb740 1 Processor -- start 2024-04-23T10:26:44.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f737fbdb740 1 -- start start 2024-04-23T10:26:44.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bdb80 0x5647842b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bed50 0x5647842cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 0x5647842c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f737fbdb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5647842d4530 con 0x5647842bed50 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f737fbdb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5647842d4c00 con 0x5647842bf710 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f737fbdb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5647842d52d0 con 0x5647842bdb80 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f7375d9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bed50 0x5647842cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f7375d9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bed50 0x5647842cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47366/0 (socket says 172.21.15.69:47366) 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f7375d9b640 1 -- 172.21.15.69:0/3780830503 learned_addr learned my addr 172.21.15.69:0/3780830503 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f7375d9b640 1 -- 172.21.15.69:0/3780830503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bdb80 msgr2=0x5647842b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f7375d9b640 1 --2- 172.21.15.69:0/3780830503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bdb80 0x5647842b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f7375d9b640 1 -- 172.21.15.69:0/3780830503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 msgr2=0x5647842c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f7376d9d640 1 --2- 172.21.15.69:0/3780830503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 0x5647842c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f7375d9b640 1 --2- 172.21.15.69:0/3780830503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 0x5647842c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f7375d9b640 1 -- 172.21.15.69:0/3780830503 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647842d6520 con 0x5647842bed50 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f7376d9d640 1 --2- 172.21.15.69:0/3780830503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 0x5647842c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:26:44.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.651+0000 7f7375d9b640 1 --2- 172.21.15.69:0/3780830503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bed50 0x5647842cf4f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f736c09c8f0 tx=0x7f736c01c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc5132427c5b5e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f735ffff640 1 -- 172.21.15.69:0/3780830503 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c0056a0 con 0x5647842bed50 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f735ffff640 1 -- 172.21.15.69:0/3780830503 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f736c087040 con 0x5647842bed50 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f735ffff640 1 -- 172.21.15.69:0/3780830503 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c016df0 con 0x5647842bed50 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f737fbdb740 1 -- 172.21.15.69:0/3780830503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bed50 msgr2=0x5647842cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f737fbdb740 1 --2- 172.21.15.69:0/3780830503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bed50 0x5647842cf4f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f736c09c8f0 tx=0x7f736c01c590 comp rx=0 tx=0).stop 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f737fbdb740 1 -- 172.21.15.69:0/3780830503 shutdown_connections 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f737fbdb740 1 --2- 172.21.15.69:0/3780830503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bed50 0x5647842cf4f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f737fbdb740 1 --2- 172.21.15.69:0/3780830503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bf710 0x5647842c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f737fbdb740 1 --2- 172.21.15.69:0/3780830503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bdb80 0x5647842b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f737fbdb740 1 -- 172.21.15.69:0/3780830503 >> 172.21.15.69:0/3780830503 conn(0x5647842b9070 msgr2=0x5647842d3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f737fbdb740 1 -- 172.21.15.69:0/3780830503 shutdown_connections 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f737fbdb740 1 -- 172.21.15.69:0/3780830503 wait complete. 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.652+0000 7f737fbdb740 1 -- start start 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f737fbdb740 1 Processor -- start 2024-04-23T10:26:44.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bdb80 0x5647842ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bed50 0x5647842cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f737fbdb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f737fbdb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5647842d6070 con 0x5647842bf710 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f737fbdb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5647842d59a0 con 0x5647842bed50 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f737fbdb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5647842d6740 con 0x5647842bdb80 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f737fbdb740 10 client.0 _ll_register_callbacks cb 0x7f73700139e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f7376d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f7376d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47372/0 (socket says 172.21.15.69:47372) 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f7376d9d640 1 -- 172.21.15.69:0/155619544 learned_addr learned my addr 172.21.15.69:0/155619544 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f737659c640 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bdb80 0x5647842ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f7375d9b640 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bed50 0x5647842cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f7376d9d640 1 -- 172.21.15.69:0/155619544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bdb80 msgr2=0x5647842ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f7376d9d640 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bdb80 0x5647842ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f7376d9d640 1 -- 172.21.15.69:0/155619544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bed50 msgr2=0x5647842cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f7376d9d640 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bed50 0x5647842cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f7376d9d640 1 -- 172.21.15.69:0/155619544 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647842ce170 con 0x5647842bf710 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f7376d9d640 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cdb80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7370010ca0 tx=0x7f7370013a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf8effda2c77a84 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f735dffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f735dffb640 1 -- 172.21.15.69:0/155619544 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370005d00 con 0x5647842bf710 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f735dffb640 1 -- 172.21.15.69:0/155619544 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f7370003940 con 0x5647842bf710 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.653+0000 7f737fbdb740 1 -- 172.21.15.69:0/155619544 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f736c087040 con 0x5647842bf710 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f735dffb640 1 -- 172.21.15.69:0/155619544 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7370005ea0 con 0x5647842bf710 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f737fbdb740 10 client.15300 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f737fbdb740 1 -- 172.21.15.69:0/155619544 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5647842cf3e0 con 0x5647842bf710 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f735dffb640 1 -- 172.21.15.69:0/155619544 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f736c087040 con 0x5647842bf710 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f735dffb640 1 -- 172.21.15.69:0/155619544 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f737001c070 con 0x5647842bf710 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f737fbdb740 10 client.15300 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:44.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f737fbdb740 10 client.15300 resolve_mds: resolved name 'l' to daemon mds.l 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f737fbdb740 20 client.15300 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f737fbdb740 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x56478433f240 0x56478433df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f737fbdb740 4 client.15300 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f737fbdb740 1 -- 172.21.15.69:0/155619544 --> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] -- command(tid 0: {"prefix": "status"}) -- 0x56478422a4e0 con 0x56478433f240 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.654+0000 7f737659c640 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x56478433f240 0x56478433df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f735dffb640 10 client.15300 ms_handle_connect on v2:172.21.15.167:6832/977410598 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737659c640 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x56478433f240 0x56478433df50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6a2dea5430306d70 server_cookie=25d2e70b5b321446 in_seq=0 out_seq=0 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f735dffb640 1 -- 172.21.15.69:0/155619544 <== mds.2 v2:172.21.15.167:6832/977410598 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56478422a4e0 con 0x56478433f240 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f735dffb640 10 client.15300 handle_command_reply: tid=0 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 1 client.15300 shutdown 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 1 -- 172.21.15.69:0/155619544 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 msgr2=0x5647842cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cdb80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7370010ca0 tx=0x7f7370013a90 comp rx=0 tx=0).stop 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 1 -- 172.21.15.69:0/155619544 shutdown_connections 2024-04-23T10:26:44.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x56478433f240 0x56478433df50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5647842bf710 0x5647842cdb80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5647842bed50 0x5647842cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f735dffb640 0 client.15300 ms_handle_reset on v2:172.21.15.167:6832/977410598 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 1 --2- 172.21.15.69:0/155619544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647842bdb80 0x5647842ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 1 -- 172.21.15.69:0/155619544 >> 172.21.15.69:0/155619544 conn(0x5647842b9070 msgr2=0x5647842b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 1 -- 172.21.15.69:0/155619544 shutdown_connections 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 1 -- 172.21.15.69:0/155619544 wait complete. 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737fbdb740 20 client.15300 trim_cache size 0 max 16384 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 2, 2024-04-23T10:26:44.661 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24421, 2024-04-23T10:26:44.662 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:26:44.662 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:26:44.662 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:26:44.662 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 108.33983724700001, 2024-04-23T10:26:44.662 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 25, 2024-04-23T10:26:44.662 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 88, 2024-04-23T10:26:44.662 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 86, 2024-04-23T10:26:44.662 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 147.712315921 2024-04-23T10:26:44.662 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:26:44.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737cde5640 1 -- 172.21.15.69:0/1859558767 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f73600a3bb0 msgr2=0x7f73600a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737cde5640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f73600a3bb0 0x7f73600a6070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f73700058c0 tx=0x7f7370015000 comp rx=0 tx=0).stop 2024-04-23T10:26:44.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737cde5640 1 -- 172.21.15.69:0/1859558767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73781053a0 msgr2=0x7f7378198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.655+0000 7f737cde5640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73781053a0 0x7f7378198830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f736c00e9f0 tx=0x7f736c00eeb0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.656+0000 7f737cde5640 1 -- 172.21.15.69:0/1859558767 shutdown_connections 2024-04-23T10:26:44.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.656+0000 7f737cde5640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f73600a3bb0 0x7f73600a6070 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.656+0000 7f737cde5640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73781053a0 0x7f7378198830 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.656+0000 7f737cde5640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7378107cd0 0x7f737819f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.656+0000 7f737cde5640 1 --2- 172.21.15.69:0/1859558767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7378102a70 0x7f73781982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.656+0000 7f737cde5640 1 -- 172.21.15.69:0/1859558767 >> 172.21.15.69:0/1859558767 conn(0x7f73780fc400 msgr2=0x7f73781033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.656+0000 7f737cde5640 1 -- 172.21.15.69:0/1859558767 shutdown_connections 2024-04-23T10:26:44.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.656+0000 7f737cde5640 1 -- 172.21.15.69:0/1859558767 wait complete. 2024-04-23T10:26:44.665 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.766+0000 7fba51835640 1 -- 172.21.15.69:0/2773407371 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba4c103180 msgr2=0x7fba4c103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.766+0000 7fba51835640 1 --2- 172.21.15.69:0/2773407371 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba4c103180 0x7fba4c103600 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fba40009900 tx=0x7fba4002a410 comp rx=0 tx=0).stop 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.766+0000 7fba51835640 1 -- 172.21.15.69:0/2773407371 shutdown_connections 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.766+0000 7fba51835640 1 --2- 172.21.15.69:0/2773407371 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba4c103180 0x7fba4c103600 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.766+0000 7fba51835640 1 --2- 172.21.15.69:0/2773407371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4c103b40 0x7fba4c10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.766+0000 7fba51835640 1 --2- 172.21.15.69:0/2773407371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba4c101f90 0x7fba4c1023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.766+0000 7fba51835640 1 -- 172.21.15.69:0/2773407371 >> 172.21.15.69:0/2773407371 conn(0x7fba4c0fd500 msgr2=0x7fba4c0ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.766+0000 7fba51835640 1 -- 172.21.15.69:0/2773407371 shutdown_connections 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.766+0000 7fba51835640 1 -- 172.21.15.69:0/2773407371 wait complete. 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.766+0000 7fba51835640 1 Processor -- start 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.766+0000 7fba51835640 1 -- start start 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba51835640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba4c101f90 0x7fba4c1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba51835640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4c103180 0x7fba4c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba51835640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba4c103b40 0x7fba4c19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba51835640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c10dbf0 con 0x7fba4c103b40 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba51835640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c10da70 con 0x7fba4c103180 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba51835640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c10dd70 con 0x7fba4c101f90 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba4c103b40 0x7fba4c19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba4c103b40 0x7fba4c19f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47400/0 (socket says 172.21.15.69:47400) 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4b7fe640 1 -- 172.21.15.69:0/2437712057 learned_addr learned my addr 172.21.15.69:0/2437712057 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4affd640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba4c101f90 0x7fba4c1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4c103180 0x7fba4c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4b7fe640 1 -- 172.21.15.69:0/2437712057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba4c101f90 msgr2=0x7fba4c1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4b7fe640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba4c101f90 0x7fba4c1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4b7fe640 1 -- 172.21.15.69:0/2437712057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4c103180 msgr2=0x7fba4c1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4b7fe640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4c103180 0x7fba4c1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4b7fe640 1 -- 172.21.15.69:0/2437712057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c19fed0 con 0x7fba4c103b40 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4affd640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba4c101f90 0x7fba4c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:44.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba4b7fe640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba4c103b40 0x7fba4c19f860 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fba4400eaa0 tx=0x7fba4400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba50833640 1 -- 172.21.15.69:0/2437712057 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4400cdb0 con 0x7fba4c103b40 2024-04-23T10:26:44.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba50833640 1 -- 172.21.15.69:0/2437712057 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba44005020 con 0x7fba4c103b40 2024-04-23T10:26:44.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba51835640 1 -- 172.21.15.69:0/2437712057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4c1a01c0 con 0x7fba4c103b40 2024-04-23T10:26:44.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba50833640 1 -- 172.21.15.69:0/2437712057 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba440116d0 con 0x7fba4c103b40 2024-04-23T10:26:44.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.767+0000 7fba51835640 1 -- 172.21.15.69:0/2437712057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4c1a0710 con 0x7fba4c103b40 2024-04-23T10:26:44.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.769+0000 7fba50833640 1 -- 172.21.15.69:0/2437712057 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fba440051d0 con 0x7fba4c103b40 2024-04-23T10:26:44.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba5462d740 1 Processor -- start 2024-04-23T10:26:44.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba5462d740 1 -- start start 2024-04-23T10:26:44.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba5462d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71066b80 0x563a71066fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba5462d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71067d50 0x563a710681d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba5462d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba5462d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x563a70fcbc50 con 0x563a71068710 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba5462d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563a70f68830 con 0x563a71067d50 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba5462d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563a70fc7c10 con 0x563a71066b80 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47404/0 (socket says 172.21.15.69:47404) 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4a7fc640 1 -- 172.21.15.69:0/4069261835 learned_addr learned my addr 172.21.15.69:0/4069261835 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba50833640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fba340a3c30 0x7fba340a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4affd640 1 --2- 172.21.15.69:0/4069261835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71067d50 0x563a710681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/4069261835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71066b80 0x563a71066fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4b7fe640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fba340a3c30 0x7fba340a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4a7fc640 1 -- 172.21.15.69:0/4069261835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71066b80 msgr2=0x563a71066fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/4069261835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71066b80 0x563a71066fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4a7fc640 1 -- 172.21.15.69:0/4069261835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71067d50 msgr2=0x563a710681d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/4069261835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71067d50 0x563a710681d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4a7fc640 1 -- 172.21.15.69:0/4069261835 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a70cde2d0 con 0x563a71068710 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba50833640 1 -- 172.21.15.69:0/2437712057 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fba440d0670 con 0x7fba4c103b40 2024-04-23T10:26:44.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.770+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/4069261835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106efa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fba40005940 tx=0x7fba400058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6d753eeea6e7ea server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba31ffb640 1 -- 172.21.15.69:0/4069261835 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40043020 con 0x563a71068710 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba31ffb640 1 -- 172.21.15.69:0/4069261835 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba40031910 con 0x563a71068710 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba4b7fe640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fba340a3c30 0x7fba340a60f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fba44009270 tx=0x7fba44087040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba31ffb640 1 -- 172.21.15.69:0/4069261835 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40035070 con 0x563a71068710 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba5462d740 1 -- 172.21.15.69:0/4069261835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 msgr2=0x563a7106efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba5462d740 1 --2- 172.21.15.69:0/4069261835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106efa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fba40005940 tx=0x7fba400058d0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba5462d740 1 -- 172.21.15.69:0/4069261835 shutdown_connections 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba5462d740 1 --2- 172.21.15.69:0/4069261835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106efa0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba5462d740 1 --2- 172.21.15.69:0/4069261835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71067d50 0x563a710681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba5462d740 1 --2- 172.21.15.69:0/4069261835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71066b80 0x563a71066fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba5462d740 1 -- 172.21.15.69:0/4069261835 >> 172.21.15.69:0/4069261835 conn(0x563a71062070 msgr2=0x563a71062470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba5462d740 1 -- 172.21.15.69:0/4069261835 shutdown_connections 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.771+0000 7fba5462d740 1 -- 172.21.15.69:0/4069261835 wait complete. 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba5462d740 1 -- start start 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba5462d740 1 Processor -- start 2024-04-23T10:26:44.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba5462d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71066b80 0x563a71070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba5462d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71067d50 0x563a710714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba5462d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71068710 0x563a71078520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba5462d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x563a7106f6c0 con 0x563a71067d50 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba5462d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563a70f66470 con 0x563a71066b80 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba5462d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563a7106f840 con 0x563a71068710 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba5462d740 10 client.0 _ll_register_callbacks cb 0x563a70f8bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71067d50 0x563a710714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71067d50 0x563a710714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47416/0 (socket says 172.21.15.69:47416) 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4affd640 1 -- 172.21.15.69:0/4050765250 learned_addr learned my addr 172.21.15.69:0/4050765250 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71068710 0x563a71078520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71066b80 0x563a71070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4affd640 1 -- 172.21.15.69:0/4050765250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71068710 msgr2=0x563a71078520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4affd640 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71068710 0x563a71078520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4affd640 1 -- 172.21.15.69:0/4050765250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71066b80 msgr2=0x563a71070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4affd640 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71066b80 0x563a71070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4affd640 1 -- 172.21.15.69:0/4050765250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a70da86b0 con 0x563a71067d50 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71068710 0x563a71078520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba4affd640 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71067d50 0x563a710714e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00bf10 tx=0x7fba3c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bf5d2daa0087d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.772+0000 7fba2affd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba2affd640 1 -- 172.21.15.69:0/4050765250 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c01f060 con 0x563a71067d50 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba2affd640 1 -- 172.21.15.69:0/4050765250 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fba3c010960 con 0x563a71067d50 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba5462d740 1 -- 172.21.15.69:0/4050765250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba40031910 con 0x563a71067d50 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba2affd640 1 -- 172.21.15.69:0/4050765250 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba3c010b60 con 0x563a71067d50 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba5462d740 10 client.15312 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba5462d740 1 -- 172.21.15.69:0/4050765250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a7107b960 con 0x563a71067d50 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba2affd640 1 -- 172.21.15.69:0/4050765250 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba40031910 con 0x563a71067d50 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba2affd640 1 -- 172.21.15.69:0/4050765250 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fba3c019030 con 0x563a71067d50 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba5462d740 10 client.15312 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba5462d740 10 client.15312 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-23T10:26:44.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba5462d740 20 client.15312 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba5462d740 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x563a7107dfe0 0x563a7107f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba5462d740 4 client.15312 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba5462d740 1 -- 172.21.15.69:0/4050765250 --> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a70fd9670 con 0x563a7107dfe0 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.773+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x563a7107dfe0 0x563a7107f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.774+0000 7fba2affd640 10 client.15312 ms_handle_connect on v2:172.21.15.167:6836/1671189160 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.774+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x563a7107dfe0 0x563a7107f450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ddb227733fb2f5c8 server_cookie=343c0419cf733665 in_seq=0 out_seq=0 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.774+0000 7fba2affd640 1 -- 172.21.15.69:0/4050765250 <== mds.1 v2:172.21.15.167:6836/1671189160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563a70fd9670 con 0x563a7107dfe0 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.774+0000 7fba2affd640 10 client.15312 handle_command_reply: tid=0 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 1 client.15312 shutdown 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 1 -- 172.21.15.69:0/4050765250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71067d50 msgr2=0x563a710714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71067d50 0x563a710714e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00bf10 tx=0x7fba3c012820 comp rx=0 tx=0).stop 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 1 -- 172.21.15.69:0/4050765250 shutdown_connections 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x563a7107dfe0 0x563a7107f450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71067d50 0x563a710714e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba2affd640 0 client.15312 ms_handle_reset on v2:172.21.15.167:6836/1671189160 2024-04-23T10:26:44.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71068710 0x563a71078520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 1 --2- 172.21.15.69:0/4050765250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71066b80 0x563a71070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 1 -- 172.21.15.69:0/4050765250 >> 172.21.15.69:0/4050765250 conn(0x563a71062070 msgr2=0x563a710611d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 1 -- 172.21.15.69:0/4050765250 shutdown_connections 2024-04-23T10:26:44.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 1 -- 172.21.15.69:0/4050765250 wait complete. 2024-04-23T10:26:44.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.775+0000 7fba5462d740 20 client.15312 trim_cache size 0 max 16384 2024-04-23T10:26:44.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba5462d740 1 Processor -- start 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba5462d740 1 -- start start 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba5462d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71066b80 0x563a7106b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba5462d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71067d50 0x563a710784e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba5462d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba5462d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x563a7107d790 con 0x563a71068710 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba5462d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563a7107de60 con 0x563a71066b80 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba5462d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563a7107e530 con 0x563a71067d50 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba4a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba4a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47420/0 (socket says 172.21.15.69:47420) 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba4a7fc640 1 -- 172.21.15.69:0/1279639024 learned_addr learned my addr 172.21.15.69:0/1279639024 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba4a7fc640 1 -- 172.21.15.69:0/1279639024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71067d50 msgr2=0x563a710784e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba4affd640 1 --2- 172.21.15.69:0/1279639024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71067d50 0x563a710784e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/1279639024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71067d50 0x563a710784e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba4a7fc640 1 -- 172.21.15.69:0/1279639024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71066b80 msgr2=0x563a7106b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/1279639024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71066b80 0x563a7106b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba4a7fc640 1 -- 172.21.15.69:0/1279639024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a71071e40 con 0x563a71068710 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.793+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/1279639024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106bd70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fba40032e10 tx=0x7fba400058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a714a9d1dee86ce server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba317fa640 1 -- 172.21.15.69:0/1279639024 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40057070 con 0x563a71068710 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba317fa640 1 -- 172.21.15.69:0/1279639024 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba40052de0 con 0x563a71068710 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba317fa640 1 -- 172.21.15.69:0/1279639024 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40043050 con 0x563a71068710 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba5462d740 1 -- 172.21.15.69:0/1279639024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 msgr2=0x563a7106bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba5462d740 1 --2- 172.21.15.69:0/1279639024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106bd70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fba40032e10 tx=0x7fba400058d0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba5462d740 1 -- 172.21.15.69:0/1279639024 shutdown_connections 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba5462d740 1 --2- 172.21.15.69:0/1279639024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71068710 0x563a7106bd70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba5462d740 1 --2- 172.21.15.69:0/1279639024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71067d50 0x563a710784e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba5462d740 1 --2- 172.21.15.69:0/1279639024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71066b80 0x563a7106b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba5462d740 1 -- 172.21.15.69:0/1279639024 >> 172.21.15.69:0/1279639024 conn(0x563a71062070 msgr2=0x563a7105d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba5462d740 1 -- 172.21.15.69:0/1279639024 shutdown_connections 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba5462d740 1 -- 172.21.15.69:0/1279639024 wait complete. 2024-04-23T10:26:44.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.794+0000 7fba5462d740 1 -- start start 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba5462d740 1 Processor -- start 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba5462d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71066b80 0x563a71073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba5462d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71067d50 0x563a71073f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba5462d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71068710 0x563a71076fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba5462d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x563a7107f2d0 con 0x563a71066b80 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba5462d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563a7107ec00 con 0x563a71068710 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba5462d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563a7107f9a0 con 0x563a71067d50 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba5462d740 10 client.0 _ll_register_callbacks cb 0x7fba3c00b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba4a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71066b80 0x563a71073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba4a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71066b80 0x563a71073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47432/0 (socket says 172.21.15.69:47432) 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba4a7fc640 1 -- 172.21.15.69:0/3198088329 learned_addr learned my addr 172.21.15.69:0/3198088329 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba4a7fc640 1 -- 172.21.15.69:0/3198088329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71067d50 msgr2=0x563a71073f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/3198088329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71067d50 0x563a71073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba4a7fc640 1 -- 172.21.15.69:0/3198088329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71068710 msgr2=0x563a71076fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/3198088329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71068710 0x563a71076fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba4a7fc640 1 -- 172.21.15.69:0/3198088329 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a71077590 con 0x563a71066b80 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba4a7fc640 1 --2- 172.21.15.69:0/3198088329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71066b80 0x563a71073a40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fba40055040 tx=0x7fba40052c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5105a36f4fb214 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba2affd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba2affd640 1 -- 172.21.15.69:0/3198088329 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40043050 con 0x563a71066b80 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba2affd640 1 -- 172.21.15.69:0/3198088329 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fba40004020 con 0x563a71066b80 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.795+0000 7fba5462d740 1 -- 172.21.15.69:0/3198088329 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba40052de0 con 0x563a71066b80 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba2affd640 1 -- 172.21.15.69:0/3198088329 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba40057040 con 0x563a71066b80 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba5462d740 10 client.15318 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba5462d740 1 -- 172.21.15.69:0/3198088329 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a71078890 con 0x563a71066b80 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba2affd640 1 -- 172.21.15.69:0/3198088329 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba40052de0 con 0x563a71066b80 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba2affd640 1 -- 172.21.15.69:0/3198088329 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fba4005a070 con 0x563a71066b80 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba5462d740 10 client.15318 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba5462d740 10 client.15318 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba5462d740 20 client.15318 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba5462d740 1 --2- 172.21.15.69:0/3198088329 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x563a710e82a0 0x563a710e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba5462d740 4 client.15318 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:26:44.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba5462d740 1 -- 172.21.15.69:0/3198088329 --> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] -- command(tid 0: {"prefix": "status"}) -- 0x563a70fd34e0 con 0x563a710e82a0 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.796+0000 7fba4affd640 1 --2- 172.21.15.69:0/3198088329 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x563a710e82a0 0x563a710e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba4affd640 1 --2- 172.21.15.69:0/3198088329 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x563a710e82a0 0x563a710e6fb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=46fce19eec8ee460 server_cookie=d06696483c91af11 in_seq=0 out_seq=0 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba2affd640 10 client.15318 ms_handle_connect on v2:172.21.15.167:6836/1671189160 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba2affd640 1 -- 172.21.15.69:0/3198088329 <== mds.1 v2:172.21.15.167:6836/1671189160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563a70fd34e0 con 0x563a710e82a0 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba2affd640 10 client.15318 handle_command_reply: tid=0 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 1 client.15318 shutdown 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 1 -- 172.21.15.69:0/3198088329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71066b80 msgr2=0x563a71073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 1 --2- 172.21.15.69:0/3198088329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71066b80 0x563a71073a40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fba40055040 tx=0x7fba40052c70 comp rx=0 tx=0).stop 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 1 -- 172.21.15.69:0/3198088329 shutdown_connections 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 1 --2- 172.21.15.69:0/3198088329 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x563a710e82a0 0x563a710e6fb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 1 --2- 172.21.15.69:0/3198088329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a71068710 0x563a71076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 1 --2- 172.21.15.69:0/3198088329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a71067d50 0x563a71073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba2affd640 0 client.15318 ms_handle_reset on v2:172.21.15.167:6836/1671189160 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 1 --2- 172.21.15.69:0/3198088329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563a71066b80 0x563a71073a40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 1 -- 172.21.15.69:0/3198088329 >> 172.21.15.69:0/3198088329 conn(0x563a71062070 msgr2=0x563a7106f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 1 -- 172.21.15.69:0/3198088329 shutdown_connections 2024-04-23T10:26:44.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 1 -- 172.21.15.69:0/3198088329 wait complete. 2024-04-23T10:26:44.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.797+0000 7fba5462d740 20 client.15318 trim_cache size 0 max 16384 2024-04-23T10:26:44.802 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:26:44.802 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:26:44.802 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 1, 2024-04-23T10:26:44.802 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24463, 2024-04-23T10:26:44.802 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:26:44.802 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:26:44.802 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:26:44.802 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 108.960813465, 2024-04-23T10:26:44.802 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 25, 2024-04-23T10:26:44.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 88, 2024-04-23T10:26:44.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 86, 2024-04-23T10:26:44.803 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 130.65641399399999 2024-04-23T10:26:44.803 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:26:44.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 -- 172.21.15.69:0/2437712057 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fba340a3c30 msgr2=0x7fba340a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fba340a3c30 0x7fba340a60f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fba44009270 tx=0x7fba44087040 comp rx=0 tx=0).stop 2024-04-23T10:26:44.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 -- 172.21.15.69:0/2437712057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba4c103b40 msgr2=0x7fba4c19f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba4c103b40 0x7fba4c19f860 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fba4400eaa0 tx=0x7fba4400ef60 comp rx=0 tx=0).stop 2024-04-23T10:26:44.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 -- 172.21.15.69:0/2437712057 shutdown_connections 2024-04-23T10:26:44.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fba340a3c30 0x7fba340a60f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba4c103b40 0x7fba4c19f860 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba4c103180 0x7fba4c1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 --2- 172.21.15.69:0/2437712057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba4c101f90 0x7fba4c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 -- 172.21.15.69:0/2437712057 >> 172.21.15.69:0/2437712057 conn(0x7fba4c0fd500 msgr2=0x7fba4c106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 -- 172.21.15.69:0/2437712057 shutdown_connections 2024-04-23T10:26:44.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.798+0000 7fba51835640 1 -- 172.21.15.69:0/2437712057 wait complete. 2024-04-23T10:26:44.808 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-23T10:26:44.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.908+0000 7f3af5d8e640 1 -- 172.21.15.69:0/727628555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3af0103180 msgr2=0x7f3af0103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.908+0000 7f3af5d8e640 1 --2- 172.21.15.69:0/727628555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3af0103180 0x7f3af0103600 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009900 tx=0x7f3ad802a410 comp rx=0 tx=0).stop 2024-04-23T10:26:44.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.908+0000 7f3af5d8e640 1 -- 172.21.15.69:0/727628555 shutdown_connections 2024-04-23T10:26:44.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.908+0000 7f3af5d8e640 1 --2- 172.21.15.69:0/727628555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3af0103180 0x7f3af0103600 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.908+0000 7f3af5d8e640 1 --2- 172.21.15.69:0/727628555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3af0103b40 0x7f3af010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.908+0000 7f3af5d8e640 1 --2- 172.21.15.69:0/727628555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af0101f90 0x7f3af01023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.908+0000 7f3af5d8e640 1 -- 172.21.15.69:0/727628555 >> 172.21.15.69:0/727628555 conn(0x7f3af00fd500 msgr2=0x7f3af00ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.908+0000 7f3af5d8e640 1 -- 172.21.15.69:0/727628555 shutdown_connections 2024-04-23T10:26:44.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.908+0000 7f3af5d8e640 1 -- 172.21.15.69:0/727628555 wait complete. 2024-04-23T10:26:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.908+0000 7f3af5d8e640 1 Processor -- start 2024-04-23T10:26:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.908+0000 7f3af5d8e640 1 -- start start 2024-04-23T10:26:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3af5d8e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3af0101f90 0x7f3af0198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3af5d8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3af0103180 0x7f3af01987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3af5d8e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af0103b40 0x7f3af019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3af5d8e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3af010dbf0 con 0x7f3af0101f90 2024-04-23T10:26:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3af5d8e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3af010da70 con 0x7f3af0103b40 2024-04-23T10:26:44.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3af5d8e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3af010dd70 con 0x7f3af0103180 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aef7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3af0101f90 0x7f3af0198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aef7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3af0101f90 0x7f3af0198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47458/0 (socket says 172.21.15.69:47458) 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aef7fe640 1 -- 172.21.15.69:0/2636832493 learned_addr learned my addr 172.21.15.69:0/2636832493 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aeffff640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af0103b40 0x7f3af019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3ae6ffd640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3af0103180 0x7f3af01987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aef7fe640 1 -- 172.21.15.69:0/2636832493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3af0103180 msgr2=0x7f3af01987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aef7fe640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3af0103180 0x7f3af01987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aef7fe640 1 -- 172.21.15.69:0/2636832493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af0103b40 msgr2=0x7f3af019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aef7fe640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af0103b40 0x7f3af019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aef7fe640 1 -- 172.21.15.69:0/2636832493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af019fe80 con 0x7f3af0101f90 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3ae6ffd640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3af0103180 0x7f3af01987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aef7fe640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3af0101f90 0x7f3af0198260 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000d770 tx=0x7f3ae000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aed7fa640 1 -- 172.21.15.69:0/2636832493 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0017070 con 0x7f3af0101f90 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aed7fa640 1 -- 172.21.15.69:0/2636832493 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ae0009c30 con 0x7f3af0101f90 2024-04-23T10:26:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3af5d8e640 1 -- 172.21.15.69:0/2636832493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af01a0170 con 0x7f3af0101f90 2024-04-23T10:26:44.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3aed7fa640 1 -- 172.21.15.69:0/2636832493 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0003d70 con 0x7f3af0101f90 2024-04-23T10:26:44.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.909+0000 7f3af5d8e640 1 -- 172.21.15.69:0/2636832493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af01a06c0 con 0x7f3af0101f90 2024-04-23T10:26:44.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aed7fa640 1 -- 172.21.15.69:0/2636832493 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f3ae0003f10 con 0x7f3af0101f90 2024-04-23T10:26:44.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3af8b7f740 1 Processor -- start 2024-04-23T10:26:44.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3af8b7f740 1 -- start start 2024-04-23T10:26:44.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f0b80 0x5564a26f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a26f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f2710 0x5564a26f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5564a2655c50 con 0x5564a26f0b80 2024-04-23T10:26:44.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5564a25f2830 con 0x5564a26f1d50 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5564a2651c10 con 0x5564a26f2710 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f0b80 0x5564a26f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f0b80 0x5564a26f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47472/0 (socket says 172.21.15.69:47472) 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aeffff640 1 -- 172.21.15.69:0/3928585375 learned_addr learned my addr 172.21.15.69:0/3928585375 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aef7fe640 1 --2- 172.21.15.69:0/3928585375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a26f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aeffff640 1 -- 172.21.15.69:0/3928585375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f2710 msgr2=0x5564a26f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aeffff640 1 --2- 172.21.15.69:0/3928585375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f2710 0x5564a26f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aeffff640 1 -- 172.21.15.69:0/3928585375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 msgr2=0x5564a26f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aed7fa640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3adc0a3bb0 0x7f3adc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aeffff640 1 --2- 172.21.15.69:0/3928585375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a26f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aeffff640 1 -- 172.21.15.69:0/3928585375 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564a23682d0 con 0x5564a26f0b80 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aed7fa640 1 -- 172.21.15.69:0/2636832493 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f3ae00cfd60 con 0x7f3af0101f90 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aeffff640 1 --2- 172.21.15.69:0/3928585375 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f0b80 0x5564a26f0fa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8010370 tx=0x7f3ae8010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e25edea9fdeec0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.912+0000 7f3aeffff640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3adc0a3bb0 0x7f3adc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3ae5ffb640 1 -- 172.21.15.69:0/3928585375 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8022070 con 0x5564a26f0b80 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3ae5ffb640 1 -- 172.21.15.69:0/3928585375 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ae80113e0 con 0x5564a26f0b80 2024-04-23T10:26:44.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3ae5ffb640 1 -- 172.21.15.69:0/3928585375 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8016070 con 0x5564a26f0b80 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3af8b7f740 1 -- 172.21.15.69:0/3928585375 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f0b80 msgr2=0x5564a26f0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3aeffff640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3adc0a3bb0 0x7f3adc0a6070 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3ae801f000 tx=0x7f3ae8022000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/3928585375 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f0b80 0x5564a26f0fa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8010370 tx=0x7f3ae8010830 comp rx=0 tx=0).stop 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3af8b7f740 1 -- 172.21.15.69:0/3928585375 shutdown_connections 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/3928585375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f2710 0x5564a26f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/3928585375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a26f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/3928585375 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f0b80 0x5564a26f0fa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3af8b7f740 1 -- 172.21.15.69:0/3928585375 >> 172.21.15.69:0/3928585375 conn(0x5564a26ec070 msgr2=0x5564a26ec470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3af8b7f740 1 -- 172.21.15.69:0/3928585375 shutdown_connections 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.913+0000 7f3af8b7f740 1 -- 172.21.15.69:0/3928585375 wait complete. 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3af8b7f740 1 -- start start 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3af8b7f740 1 Processor -- start 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a26ff3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a26ff930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a2706970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5564a26f9720 con 0x5564a26f2710 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5564a25f0470 con 0x5564a26f1d50 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5564a26f98a0 con 0x5564a26f0b80 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a2706970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3af8b7f740 10 client.0 _ll_register_callbacks cb 0x5564a2615f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a2706970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47478/0 (socket says 172.21.15.69:47478) 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3aeffff640 1 -- 172.21.15.69:0/1055525180 learned_addr learned my addr 172.21.15.69:0/1055525180 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.914+0000 7f3aef7fe640 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a26ff3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3ae6ffd640 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a26ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aeffff640 1 -- 172.21.15.69:0/1055525180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 msgr2=0x5564a26ff3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aeffff640 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a26ff3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aeffff640 1 -- 172.21.15.69:0/1055525180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 msgr2=0x5564a26ff930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aeffff640 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a26ff930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aeffff640 1 -- 172.21.15.69:0/1055525180 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564a24326b0 con 0x5564a26f2710 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aeffff640 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a2706970 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8010d30 tx=0x7f3ae8012aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc78d7e79186b54 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aceffd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aceffd640 1 -- 172.21.15.69:0/1055525180 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8016070 con 0x5564a26f2710 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aceffd640 1 -- 172.21.15.69:0/1055525180 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f3ae801ca60 con 0x5564a26f2710 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3af8b7f740 1 -- 172.21.15.69:0/1055525180 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ae80113e0 con 0x5564a26f2710 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aceffd640 1 -- 172.21.15.69:0/1055525180 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3ae8009c00 con 0x5564a26f2710 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3af8b7f740 10 client.15330 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3af8b7f740 1 -- 172.21.15.69:0/1055525180 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5564a2709ce0 con 0x5564a26f2710 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aceffd640 1 -- 172.21.15.69:0/1055525180 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ae80113e0 con 0x5564a26f2710 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3aceffd640 1 -- 172.21.15.69:0/1055525180 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3ae802e070 con 0x5564a26f2710 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3af8b7f740 10 client.15330 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3af8b7f740 10 client.15330 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3af8b7f740 20 client.15330 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5564a270c130 0x5564a270d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3af8b7f740 4 client.15330 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.915+0000 7f3af8b7f740 1 -- 172.21.15.69:0/1055525180 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564a2663670 con 0x5564a270c130 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.916+0000 7f3aef7fe640 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5564a270c130 0x5564a270d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.916+0000 7f3aef7fe640 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5564a270c130 0x5564a270d5a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb03a8b16e656b6c server_cookie=5995ed701dd89683 in_seq=0 out_seq=0 2024-04-23T10:26:44.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.916+0000 7f3aceffd640 10 client.15330 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:26:44.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3aceffd640 1 -- 172.21.15.69:0/1055525180 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5564a2663670 con 0x5564a270c130 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3aceffd640 10 client.15330 handle_command_reply: tid=0 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 1 client.15330 shutdown 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 1 -- 172.21.15.69:0/1055525180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 msgr2=0x5564a2706970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a2706970 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8010d30 tx=0x7f3ae8012aa0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 1 -- 172.21.15.69:0/1055525180 shutdown_connections 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5564a270c130 0x5564a270d5a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a2706970 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a26ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/1055525180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a26ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 1 -- 172.21.15.69:0/1055525180 >> 172.21.15.69:0/1055525180 conn(0x5564a26ec070 msgr2=0x5564a26eb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3aceffd640 0 client.15330 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 1 -- 172.21.15.69:0/1055525180 shutdown_connections 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 1 -- 172.21.15.69:0/1055525180 wait complete. 2024-04-23T10:26:44.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.917+0000 7f3af8b7f740 20 client.15330 trim_cache size 0 max 16384 2024-04-23T10:26:44.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.935+0000 7f3af8b7f740 1 Processor -- start 2024-04-23T10:26:44.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.935+0000 7f3af8b7f740 1 -- start start 2024-04-23T10:26:44.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.935+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a26fe6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.935+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a2706930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.935+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a26fec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.935+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5564a270b8e0 con 0x5564a26f2710 2024-04-23T10:26:44.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.935+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5564a270bfb0 con 0x5564a26f1d50 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.935+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5564a270c680 con 0x5564a26f0b80 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.935+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a26fec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a26fec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47488/0 (socket says 172.21.15.69:47488) 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3aeffff640 1 -- 172.21.15.69:0/3229270951 learned_addr learned my addr 172.21.15.69:0/3229270951 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3aef7fe640 1 --2- 172.21.15.69:0/3229270951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a26fe6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3ae6ffd640 1 --2- 172.21.15.69:0/3229270951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a2706930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3aeffff640 1 -- 172.21.15.69:0/3229270951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 msgr2=0x5564a26fe6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3aeffff640 1 --2- 172.21.15.69:0/3229270951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a26fe6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3aeffff640 1 -- 172.21.15.69:0/3229270951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 msgr2=0x5564a2706930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3aeffff640 1 --2- 172.21.15.69:0/3229270951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a2706930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3aeffff640 1 -- 172.21.15.69:0/3229270951 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564a26ebea0 con 0x5564a26f2710 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3aeffff640 1 --2- 172.21.15.69:0/3229270951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a26fec00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8006010 tx=0x7f3ae8012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf6ca0dd4be5f04 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3ae57fa640 1 -- 172.21.15.69:0/3229270951 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8016070 con 0x5564a26f2710 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3ae57fa640 1 -- 172.21.15.69:0/3229270951 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ae8036030 con 0x5564a26f2710 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.936+0000 7f3ae57fa640 1 -- 172.21.15.69:0/3229270951 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8003d30 con 0x5564a26f2710 2024-04-23T10:26:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 -- 172.21.15.69:0/3229270951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 msgr2=0x5564a26fec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/3229270951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a26fec00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8006010 tx=0x7f3ae8012b90 comp rx=0 tx=0).stop 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 -- 172.21.15.69:0/3229270951 shutdown_connections 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/3229270951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f2710 0x5564a26fec00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/3229270951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f1d50 0x5564a2706930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/3229270951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a26fe6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 -- 172.21.15.69:0/3229270951 >> 172.21.15.69:0/3229270951 conn(0x5564a26ec070 msgr2=0x5564a26fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 -- 172.21.15.69:0/3229270951 shutdown_connections 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 -- 172.21.15.69:0/3229270951 wait complete. 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 -- start start 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 Processor -- start 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a2701da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f1d50 0x5564a27022e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f2710 0x5564a27052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5564a270d420 con 0x5564a26f1d50 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5564a270cd50 con 0x5564a26f2710 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5564a270daf0 con 0x5564a26f0b80 2024-04-23T10:26:44.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3af8b7f740 10 client.0 _ll_register_callbacks cb 0x7f3ae8020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3ae6ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f1d50 0x5564a27022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3ae6ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f1d50 0x5564a27022e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47492/0 (socket says 172.21.15.69:47492) 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3ae6ffd640 1 -- 172.21.15.69:0/2305877355 learned_addr learned my addr 172.21.15.69:0/2305877355 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.937+0000 7f3aef7fe640 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a2701da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3aeffff640 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f2710 0x5564a27052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3ae6ffd640 1 -- 172.21.15.69:0/2305877355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 msgr2=0x5564a2701da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3ae6ffd640 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a2701da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3ae6ffd640 1 -- 172.21.15.69:0/2305877355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f2710 msgr2=0x5564a27052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3ae6ffd640 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f2710 0x5564a27052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3ae6ffd640 1 -- 172.21.15.69:0/2305877355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564a27058a0 con 0x5564a26f1d50 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3aeffff640 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f2710 0x5564a27052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3ae6ffd640 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f1d50 0x5564a27022e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8005940 tx=0x7f3ad8031eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829872a4c2bda28d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3aceffd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3aceffd640 1 -- 172.21.15.69:0/2305877355 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8035070 con 0x5564a26f1d50 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3aceffd640 1 -- 172.21.15.69:0/2305877355 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f3ad8031890 con 0x5564a26f1d50 2024-04-23T10:26:44.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3af8b7f740 1 -- 172.21.15.69:0/2305877355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ae8036030 con 0x5564a26f1d50 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3aceffd640 1 -- 172.21.15.69:0/2305877355 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3ad8004040 con 0x5564a26f1d50 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3af8b7f740 10 client.15336 fetch_fsmap learned FSMap version 25 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3af8b7f740 1 -- 172.21.15.69:0/2305877355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5564a2706c40 con 0x5564a26f1d50 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3aceffd640 1 -- 172.21.15.69:0/2305877355 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ae8036030 con 0x5564a26f1d50 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3aceffd640 1 -- 172.21.15.69:0/2305877355 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3ad8045470 con 0x5564a26f1d50 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3af8b7f740 10 client.15336 fetch_fsmap finished waiting for FSMap version 25 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3af8b7f740 10 client.15336 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.938+0000 7f3af8b7f740 20 client.15336 populate_metadata read hostname 'smithi069' 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.939+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5564a2776b50 0x5564a2775860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.939+0000 7f3af8b7f740 4 client.15336 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.939+0000 7f3af8b7f740 1 -- 172.21.15.69:0/2305877355 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "status"}) -- 0x5564a265d4e0 con 0x5564a2776b50 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.939+0000 7f3aef7fe640 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5564a2776b50 0x5564a2775860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.939+0000 7f3aceffd640 10 client.15336 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.939+0000 7f3aef7fe640 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5564a2776b50 0x5564a2775860 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8edaecf752b70f3 server_cookie=56a9468f2c0b3379 in_seq=0 out_seq=0 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.939+0000 7f3aceffd640 1 -- 172.21.15.69:0/2305877355 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x5564a265d4e0 con 0x5564a2776b50 2024-04-23T10:26:44.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.939+0000 7f3aceffd640 10 client.15336 handle_command_reply: tid=0 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.939+0000 7f3af8b7f740 1 client.15336 shutdown 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af8b7f740 1 -- 172.21.15.69:0/2305877355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f1d50 msgr2=0x5564a27022e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f1d50 0x5564a27022e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8005940 tx=0x7f3ad8031eb0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af8b7f740 1 -- 172.21.15.69:0/2305877355 shutdown_connections 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5564a2776b50 0x5564a2775860 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5564a26f1d50 0x5564a27022e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564a26f2710 0x5564a27052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3aceffd640 0 client.15336 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af8b7f740 1 --2- 172.21.15.69:0/2305877355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564a26f0b80 0x5564a2701da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af8b7f740 1 -- 172.21.15.69:0/2305877355 >> 172.21.15.69:0/2305877355 conn(0x5564a26ec070 msgr2=0x5564a26fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af8b7f740 1 -- 172.21.15.69:0/2305877355 shutdown_connections 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af8b7f740 1 -- 172.21.15.69:0/2305877355 wait complete. 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af8b7f740 20 client.15336 trim_cache size 0 max 16384 2024-04-23T10:26:44.944 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24487, 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 111.120237606, 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 25, 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 88, 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 86, 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 125.31833628 2024-04-23T10:26:44.945 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:26:44.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 -- 172.21.15.69:0/2636832493 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3adc0a3bb0 msgr2=0x7f3adc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3adc0a3bb0 0x7f3adc0a6070 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3ae801f000 tx=0x7f3ae8022000 comp rx=0 tx=0).stop 2024-04-23T10:26:44.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 -- 172.21.15.69:0/2636832493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3af0101f90 msgr2=0x7f3af0198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:44.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3af0101f90 0x7f3af0198260 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000d770 tx=0x7f3ae000dc30 comp rx=0 tx=0).stop 2024-04-23T10:26:44.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 -- 172.21.15.69:0/2636832493 shutdown_connections 2024-04-23T10:26:44.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f3adc0a3bb0 0x7f3adc0a6070 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af0103b40 0x7f3af019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3af0103180 0x7f3af01987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 --2- 172.21.15.69:0/2636832493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3af0101f90 0x7f3af0198260 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:44.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 -- 172.21.15.69:0/2636832493 >> 172.21.15.69:0/2636832493 conn(0x7f3af00fd500 msgr2=0x7f3af01064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:44.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 -- 172.21.15.69:0/2636832493 shutdown_connections 2024-04-23T10:26:44.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:44.940+0000 7f3af5d8e640 1 -- 172.21.15.69:0/2636832493 wait complete. 2024-04-23T10:26:44.950 INFO:teuthology.run_tasks:Running task sequential... 2024-04-23T10:26:44.959 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-23T10:26:44.959 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-23T10:26:44.960 INFO:teuthology.task.print:Enabling mgr modules 2024-04-23T10:26:44.960 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-23T10:26:44.960 INFO:teuthology.task.exec:Executing custom commands... 2024-04-23T10:26:44.960 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-04-23T10:26:44.960 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-23T10:26:45.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.060+0000 7f756a835640 1 -- 172.21.15.69:0/3955785868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7564103b90 msgr2=0x7f756410a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:45.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.060+0000 7f756a835640 1 --2- 172.21.15.69:0/3955785868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7564103b90 0x7f756410a420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f755c009ca0 tx=0x7f755c02a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:45.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.060+0000 7f756a835640 1 -- 172.21.15.69:0/3955785868 shutdown_connections 2024-04-23T10:26:45.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.060+0000 7f756a835640 1 --2- 172.21.15.69:0/3955785868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7564103b90 0x7f756410a420 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:45.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.060+0000 7f756a835640 1 --2- 172.21.15.69:0/3955785868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75641031d0 0x7f7564103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:45.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.060+0000 7f756a835640 1 --2- 172.21.15.69:0/3955785868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7564101fe0 0x7f7564102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:45.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.060+0000 7f756a835640 1 -- 172.21.15.69:0/3955785868 >> 172.21.15.69:0/3955785868 conn(0x7f75640fd570 msgr2=0x7f75640ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:45.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.060+0000 7f756a835640 1 -- 172.21.15.69:0/3955785868 shutdown_connections 2024-04-23T10:26:45.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.060+0000 7f756a835640 1 -- 172.21.15.69:0/3955785868 wait complete. 2024-04-23T10:26:45.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.060+0000 7f756a835640 1 Processor -- start 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.060+0000 7f756a835640 1 -- start start 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f756a835640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7564101fe0 0x7f75641980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f756a835640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75641031d0 0x7f7564198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f756a835640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7564103b90 0x7f756419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f756a835640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f756410dc40 con 0x7f7564103b90 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f756a835640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f756410dac0 con 0x7f75641031d0 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f756a835640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f756410ddc0 con 0x7f7564101fe0 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f7568dd2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7564103b90 0x7f756419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f7568dd2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7564103b90 0x7f756419f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47504/0 (socket says 172.21.15.69:47504) 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f7568dd2640 1 -- 172.21.15.69:0/2271786903 learned_addr learned my addr 172.21.15.69:0/2271786903 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f7563fff640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7564101fe0 0x7f75641980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f75637fe640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75641031d0 0x7f7564198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f7568dd2640 1 -- 172.21.15.69:0/2271786903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7564101fe0 msgr2=0x7f75641980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f7568dd2640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7564101fe0 0x7f75641980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f7568dd2640 1 -- 172.21.15.69:0/2271786903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75641031d0 msgr2=0x7f7564198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:45.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f7568dd2640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75641031d0 0x7f7564198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:45.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f7568dd2640 1 -- 172.21.15.69:0/2271786903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756419fce0 con 0x7f7564103b90 2024-04-23T10:26:45.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f7568dd2640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7564103b90 0x7f756419f670 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f755c009dc0 tx=0x7f755c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:45.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f75617fa640 1 -- 172.21.15.69:0/2271786903 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c004240 con 0x7f7564103b90 2024-04-23T10:26:45.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.061+0000 7f756a835640 1 -- 172.21.15.69:0/2271786903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756419ff70 con 0x7f7564103b90 2024-04-23T10:26:45.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.062+0000 7f75617fa640 1 -- 172.21.15.69:0/2271786903 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f755c031830 con 0x7f7564103b90 2024-04-23T10:26:45.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.062+0000 7f75617fa640 1 -- 172.21.15.69:0/2271786903 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0305c0 con 0x7f7564103b90 2024-04-23T10:26:45.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.062+0000 7f756a835640 1 -- 172.21.15.69:0/2271786903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75641a0480 con 0x7f7564103b90 2024-04-23T10:26:45.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.062+0000 7f756a835640 1 -- 172.21.15.69:0/2271786903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7564109230 con 0x7f7564103b90 2024-04-23T10:26:45.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.064+0000 7f75617fa640 1 -- 172.21.15.69:0/2271786903 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f755c02f660 con 0x7f7564103b90 2024-04-23T10:26:45.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.064+0000 7f75617fa640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f754c0a3c50 0x7f754c0a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:45.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.064+0000 7f7563fff640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f754c0a3c50 0x7f754c0a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:45.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.064+0000 7f75617fa640 1 -- 172.21.15.69:0/2271786903 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f755c0f1dd0 con 0x7f7564103b90 2024-04-23T10:26:45.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.065+0000 7f7563fff640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f754c0a3c50 0x7f754c0a6110 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7564103030 tx=0x7f755400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:45.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.068+0000 7f75617fa640 1 -- 172.21.15.69:0/2271786903 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f755c0be7c0 con 0x7f7564103b90 2024-04-23T10:26:45.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:45.294+0000 7f756a835640 1 -- 172.21.15.69:0/2271786903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f756402d5c0 con 0x7f7564103b90 2024-04-23T10:26:45.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:45 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1657942156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:45.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:45 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1657942156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:45.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:45 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1657942156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:46.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.169+0000 7f75617fa640 1 -- 172.21.15.69:0/2271786903 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f755c0be0c0 con 0x7f7564103b90 2024-04-23T10:26:46.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.172+0000 7f756a835640 1 -- 172.21.15.69:0/2271786903 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f754c0a3c50 msgr2=0x7f754c0a6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:46.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.172+0000 7f756a835640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f754c0a3c50 0x7f754c0a6110 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7564103030 tx=0x7f755400a2d0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.172+0000 7f756a835640 1 -- 172.21.15.69:0/2271786903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7564103b90 msgr2=0x7f756419f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:46.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.172+0000 7f756a835640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7564103b90 0x7f756419f670 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f755c009dc0 tx=0x7f755c003c20 comp rx=0 tx=0).stop 2024-04-23T10:26:46.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.173+0000 7f756a835640 1 -- 172.21.15.69:0/2271786903 shutdown_connections 2024-04-23T10:26:46.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.173+0000 7f756a835640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f754c0a3c50 0x7f754c0a6110 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.173+0000 7f756a835640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7564103b90 0x7f756419f670 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.173+0000 7f756a835640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75641031d0 0x7f7564198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.173+0000 7f756a835640 1 --2- 172.21.15.69:0/2271786903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7564101fe0 0x7f75641980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.173+0000 7f756a835640 1 -- 172.21.15.69:0/2271786903 >> 172.21.15.69:0/2271786903 conn(0x7f75640fd570 msgr2=0x7f7564106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:46.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.173+0000 7f756a835640 1 -- 172.21.15.69:0/2271786903 shutdown_connections 2024-04-23T10:26:46.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.173+0000 7f756a835640 1 -- 172.21.15.69:0/2271786903 wait complete. 2024-04-23T10:26:46.191 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-23T10:26:46.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.297+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/2164694130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aac102040 msgr2=0x7f6aac1024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.297+0000 7f6ab2ba1640 1 --2- 172.21.15.69:0/2164694130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aac102040 0x7f6aac1024c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009ca0 tx=0x7f6a9c02a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.297+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/2164694130 shutdown_connections 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.297+0000 7f6ab2ba1640 1 --2- 172.21.15.69:0/2164694130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aac102040 0x7f6aac1024c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.297+0000 7f6ab2ba1640 1 --2- 172.21.15.69:0/2164694130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aac102a00 0x7f6aac109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.297+0000 7f6ab2ba1640 1 --2- 172.21.15.69:0/2164694130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aac100e60 0x7f6aac101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.297+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/2164694130 >> 172.21.15.69:0/2164694130 conn(0x7f6aac0fc420 msgr2=0x7f6aac0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.297+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/2164694130 shutdown_connections 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.297+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/2164694130 wait complete. 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab2ba1640 1 Processor -- start 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab2ba1640 1 -- start start 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab2ba1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aac100e60 0x7f6aac197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab2ba1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aac102040 0x7f6aac197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:46.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab2ba1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aac102a00 0x7f6aac19e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab2ba1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac10cb40 con 0x7f6aac100e60 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab2ba1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac10c9c0 con 0x7f6aac102a00 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab2ba1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac10ccc0 con 0x7f6aac102040 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab093d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aac100e60 0x7f6aac197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab093d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aac100e60 0x7f6aac197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47518/0 (socket says 172.21.15.69:47518) 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab093d640 1 -- 172.21.15.69:0/613173539 learned_addr learned my addr 172.21.15.69:0/613173539 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6aabfff640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aac102040 0x7f6aac197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab113e640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aac102a00 0x7f6aac19e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.298+0000 7f6ab093d640 1 -- 172.21.15.69:0/613173539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aac102040 msgr2=0x7f6aac197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.299+0000 7f6ab093d640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aac102040 0x7f6aac197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.299+0000 7f6ab093d640 1 -- 172.21.15.69:0/613173539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aac102a00 msgr2=0x7f6aac19e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.299+0000 7f6ab093d640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aac102a00 0x7f6aac19e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.299+0000 7f6ab093d640 1 -- 172.21.15.69:0/613173539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aac19ed20 con 0x7f6aac100e60 2024-04-23T10:26:46.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.299+0000 7f6ab093d640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aac100e60 0x7f6aac197100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400e9c0 tx=0x7f6aa400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:46.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.299+0000 7f6aa9ffb640 1 -- 172.21.15.69:0/613173539 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa400cd80 con 0x7f6aac100e60 2024-04-23T10:26:46.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.299+0000 7f6aa9ffb640 1 -- 172.21.15.69:0/613173539 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6aa40035f0 con 0x7f6aac100e60 2024-04-23T10:26:46.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.299+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/613173539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aac19efb0 con 0x7f6aac100e60 2024-04-23T10:26:46.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.299+0000 7f6aa9ffb640 1 -- 172.21.15.69:0/613173539 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4010690 con 0x7f6aac100e60 2024-04-23T10:26:46.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.299+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/613173539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aac19f470 con 0x7f6aac100e60 2024-04-23T10:26:46.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.300+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/613173539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aac1081a0 con 0x7f6aac100e60 2024-04-23T10:26:46.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.301+0000 7f6aa9ffb640 1 -- 172.21.15.69:0/613173539 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f6aa40037a0 con 0x7f6aac100e60 2024-04-23T10:26:46.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.301+0000 7f6aa9ffb640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6a980a3ca0 0x7f6a980a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:46.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.301+0000 7f6aabfff640 1 -- 172.21.15.69:0/613173539 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6a980a3ca0 msgr2=0x7f6a980a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/847729550 2024-04-23T10:26:46.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.302+0000 7f6aa9ffb640 1 -- 172.21.15.69:0/613173539 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f6aa40d0830 con 0x7f6aac100e60 2024-04-23T10:26:46.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.302+0000 7f6aabfff640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6a980a3ca0 0x7f6a980a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:26:46.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.306+0000 7f6aa9ffb640 1 -- 172.21.15.69:0/613173539 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6aa409d220 con 0x7f6aac100e60 2024-04-23T10:26:46.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:46 smithi146 ceph-mon[32800]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-04-23T10:26:46.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:46 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2271786903' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-23T10:26:46.428 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: ignoring --setuser ceph since I am not root 2024-04-23T10:26:46.428 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: ignoring --setgroup ceph since I am not root 2024-04-23T10:26:46.428 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:46 smithi146 ceph-mgr[34181]: -- 172.21.15.146:0/1972483076 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562f2a0525a0 con 0x562f2a026800 2024-04-23T10:26:46.428 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:46.351+0000 7f44f3e56200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:26:46.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.491+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/613173539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f6aac062b50 con 0x7f6aac100e60 2024-04-23T10:26:46.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:46 smithi069 ceph-mon[29593]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-04-23T10:26:46.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:46 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2271786903' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-23T10:26:46.492 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:46 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: ignoring --setuser ceph since I am not root 2024-04-23T10:26:46.492 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:46 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: ignoring --setgroup ceph since I am not root 2024-04-23T10:26:46.492 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:46 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:46.357+0000 7f4af2842200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:26:46.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.495+0000 7f6aa9ffb640 1 -- 172.21.15.69:0/613173539 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) ==== 138+0+0 (secure 0 0 0) 0x7f6aa409cb20 con 0x7f6aac100e60 2024-04-23T10:26:46.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/613173539 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6a980a3ca0 msgr2=0x7f6a980a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:26:46.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6a980a3ca0 0x7f6a980a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/613173539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aac100e60 msgr2=0x7f6aac197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:46.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aac100e60 0x7f6aac197100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400e9c0 tx=0x7f6aa400ee80 comp rx=0 tx=0).stop 2024-04-23T10:26:46.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/613173539 shutdown_connections 2024-04-23T10:26:46.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f6a980a3ca0 0x7f6a980a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aac102a00 0x7f6aac19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aac102040 0x7f6aac197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 --2- 172.21.15.69:0/613173539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aac100e60 0x7f6aac197100 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/613173539 >> 172.21.15.69:0/613173539 conn(0x7f6aac0fc420 msgr2=0x7f6aac105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:46.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/613173539 shutdown_connections 2024-04-23T10:26:46.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.497+0000 7f6ab2ba1640 1 -- 172.21.15.69:0/613173539 wait complete. 2024-04-23T10:26:46.508 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-23T10:26:46.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:46 smithi167 ceph-mon[32940]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-04-23T10:26:46.537 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:46 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2271786903' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-23T10:26:46.537 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: ignoring --setuser ceph since I am not root 2024-04-23T10:26:46.537 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: ignoring --setgroup ceph since I am not root 2024-04-23T10:26:46.537 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:46 smithi167 ceph-mgr[34813]: -- 172.21.15.167:0/4089006660 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d218f285a0 con 0x55d218efcc00 2024-04-23T10:26:46.537 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:46.353+0000 7fb7f6152200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:26:46.537 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:46.538+0000 7fb7f6152200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:26:46.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.611+0000 7f46bf2ea640 1 -- 172.21.15.69:0/2812090657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46b8107cf0 msgr2=0x7f46b810a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:46.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.611+0000 7f46bf2ea640 1 --2- 172.21.15.69:0/2812090657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46b8107cf0 0x7f46b810a0e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009ca0 tx=0x7f46b002a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.611+0000 7f46bf2ea640 1 -- 172.21.15.69:0/2812090657 shutdown_connections 2024-04-23T10:26:46.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.611+0000 7f46bf2ea640 1 --2- 172.21.15.69:0/2812090657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46b8107cf0 0x7f46b810a0e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.611+0000 7f46bf2ea640 1 --2- 172.21.15.69:0/2812090657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b81053c0 0x7f46b81077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.611+0000 7f46bf2ea640 1 --2- 172.21.15.69:0/2812090657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8102a90 0x7f46b8104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.611+0000 7f46bf2ea640 1 -- 172.21.15.69:0/2812090657 >> 172.21.15.69:0/2812090657 conn(0x7f46b80fc420 msgr2=0x7f46b80fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:46.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.611+0000 7f46bf2ea640 1 -- 172.21.15.69:0/2812090657 shutdown_connections 2024-04-23T10:26:46.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.611+0000 7f46bf2ea640 1 -- 172.21.15.69:0/2812090657 wait complete. 2024-04-23T10:26:46.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.611+0000 7f46bf2ea640 1 Processor -- start 2024-04-23T10:26:46.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.611+0000 7f46bf2ea640 1 -- start start 2024-04-23T10:26:46.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bf2ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8102a90 0x7f46b81981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:46.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bf2ea640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46b81053c0 0x7f46b8198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:46.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bf2ea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b8107cf0 0x7f46b819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:46.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bf2ea640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f46b810dc30 con 0x7f46b81053c0 2024-04-23T10:26:46.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bf2ea640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f46b810dab0 con 0x7f46b8102a90 2024-04-23T10:26:46.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bf2ea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46b810ddb0 con 0x7f46b8107cf0 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bc885640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46b81053c0 0x7f46b8198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bc885640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46b81053c0 0x7f46b8198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47540/0 (socket says 172.21.15.69:47540) 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bc885640 1 -- 172.21.15.69:0/742284516 learned_addr learned my addr 172.21.15.69:0/742284516 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bd086640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8102a90 0x7f46b81981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bd887640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b8107cf0 0x7f46b819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bc885640 1 -- 172.21.15.69:0/742284516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b8107cf0 msgr2=0x7f46b819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bc885640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b8107cf0 0x7f46b819f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bc885640 1 -- 172.21.15.69:0/742284516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8102a90 msgr2=0x7f46b81981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bc885640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8102a90 0x7f46b81981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bc885640 1 -- 172.21.15.69:0/742284516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b819fe10 con 0x7f46b81053c0 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bd086640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8102a90 0x7f46b81981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:26:46.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bc885640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46b81053c0 0x7f46b8198730 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f46a800e9f0 tx=0x7f46a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:46.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46ae7fc640 1 -- 172.21.15.69:0/742284516 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a800ccc0 con 0x7f46b81053c0 2024-04-23T10:26:46.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bf2ea640 1 -- 172.21.15.69:0/742284516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b81a0100 con 0x7f46b81053c0 2024-04-23T10:26:46.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46ae7fc640 1 -- 172.21.15.69:0/742284516 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f46a80054f0 con 0x7f46b81053c0 2024-04-23T10:26:46.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46ae7fc640 1 -- 172.21.15.69:0/742284516 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8010690 con 0x7f46b81053c0 2024-04-23T10:26:46.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.612+0000 7f46bf2ea640 1 -- 172.21.15.69:0/742284516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b81a0650 con 0x7f46b81053c0 2024-04-23T10:26:46.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.613+0000 7f46bf2ea640 1 -- 172.21.15.69:0/742284516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b80fdf10 con 0x7f46b81053c0 2024-04-23T10:26:46.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.614+0000 7f46ae7fc640 1 -- 172.21.15.69:0/742284516 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f46a80046c0 con 0x7f46b81053c0 2024-04-23T10:26:46.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.615+0000 7f46ae7fc640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f46a40a3ca0 0x7f46a40a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:46.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.615+0000 7f46bd086640 1 -- 172.21.15.69:0/742284516 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f46a40a3ca0 msgr2=0x7f46a40a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/847729550 2024-04-23T10:26:46.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.615+0000 7f46ae7fc640 1 -- 172.21.15.69:0/742284516 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f46a80d0850 con 0x7f46b81053c0 2024-04-23T10:26:46.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.615+0000 7f46bd086640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f46a40a3ca0 0x7f46a40a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:26:46.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.620+0000 7f46ae7fc640 1 -- 172.21.15.69:0/742284516 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f46a809d240 con 0x7f46b81053c0 2024-04-23T10:26:46.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.806+0000 7f46bf2ea640 1 -- 172.21.15.69:0/742284516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f46b8062b50 con 0x7f46b81053c0 2024-04-23T10:26:46.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.809+0000 7f46ae7fc640 1 -- 172.21.15.69:0/742284516 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v29)=0 v29) ==== 133+0+0 (secure 0 0 0) 0x7f46a809cb40 con 0x7f46b81053c0 2024-04-23T10:26:46.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 -- 172.21.15.69:0/742284516 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f46a40a3ca0 msgr2=0x7f46a40a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:26:46.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f46a40a3ca0 0x7f46a40a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 -- 172.21.15.69:0/742284516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46b81053c0 msgr2=0x7f46b8198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:46.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46b81053c0 0x7f46b8198730 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f46a800e9f0 tx=0x7f46a800eeb0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 -- 172.21.15.69:0/742284516 shutdown_connections 2024-04-23T10:26:46.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f46a40a3ca0 0x7f46a40a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46b81053c0 0x7f46b8198730 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b8107cf0 0x7f46b819f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 --2- 172.21.15.69:0/742284516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8102a90 0x7f46b81981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:46.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 -- 172.21.15.69:0/742284516 >> 172.21.15.69:0/742284516 conn(0x7f46b80fc420 msgr2=0x7f46b8103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:46.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 -- 172.21.15.69:0/742284516 shutdown_connections 2024-04-23T10:26:46.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:46.812+0000 7f46bf2ea640 1 -- 172.21.15.69:0/742284516 wait complete. 2024-04-23T10:26:46.820 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:46 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:46.546+0000 7f4af2842200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:26:46.821 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:46 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:46.656+0000 7f4af2842200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:26:46.821 INFO:teuthology.run_tasks:Running task kclient... 2024-04-23T10:26:46.843 INFO:tasks.kclient:Mounting kernel clients... 2024-04-23T10:26:46.843 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-23T10:26:46.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:26:46.843 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-04-23T10:26:46.844 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:46.640+0000 7fb7f6152200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:26:46.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:26:46.859 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2024-04-23T10:26:46.924 INFO:teuthology.orchestra.run.smithi069.stderr:Cannot find device "ceph-brx" 2024-04-23T10:26:46.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:26:46.926 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-04-23T10:26:46.926 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-23T10:26:46.926 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T10:26:46.927 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-23T10:26:46.927 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:46.537+0000 7f44f3e56200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:26:46.927 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:46.638+0000 7f44f3e56200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:26:47.169 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:46 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:46.977+0000 7f4af2842200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:26:47.169 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:47 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:47.065+0000 7f4af2842200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:26:47.215 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:26:47.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:47 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2271786903' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-23T10:26:47.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:47 smithi167 ceph-mon[32940]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-04-23T10:26:47.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:47 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/613173539' entity='client.admin' 2024-04-23T10:26:47.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:47 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/742284516' entity='client.admin' 2024-04-23T10:26:47.333 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:46.947+0000 7fb7f6152200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:26:47.333 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:47 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:47.033+0000 7fb7f6152200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:26:47.427 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:46.947+0000 7f44f3e56200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:26:47.427 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:47 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:47.031+0000 7f44f3e56200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:26:47.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:47 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2271786903' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-23T10:26:47.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:47 smithi146 ceph-mon[32800]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-04-23T10:26:47.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:47 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/613173539' entity='client.admin' 2024-04-23T10:26:47.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:47 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/742284516' entity='client.admin' 2024-04-23T10:26:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:47 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2271786903' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-23T10:26:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:47 smithi069 ceph-mon[29593]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-04-23T10:26:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:47 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/613173539' entity='client.admin' 2024-04-23T10:26:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:47 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/742284516' entity='client.admin' 2024-04-23T10:26:48.555 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:48.213+0000 7fb7f6152200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:26:48.555 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:48.384+0000 7fb7f6152200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:26:48.570 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:48.215+0000 7f44f3e56200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:26:48.570 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:48.390+0000 7f44f3e56200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:26:48.631 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:48 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:48.280+0000 7f4af2842200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:26:48.631 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:48 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:48.454+0000 7f4af2842200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:26:48.631 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:48 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:48.631+0000 7f4af2842200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:26:48.832 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:48.556+0000 7fb7f6152200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:26:48.878 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:48.571+0000 7f44f3e56200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:26:49.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.072+0000 7f5587ba2700 1 -- 172.21.15.69:0/3867065280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5580101930 msgr2=0x7f5580101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:49.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.072+0000 7f5587ba2700 1 --2- 172.21.15.69:0/3867065280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5580101930 0x7f5580101db0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5570009990 tx=0x7f5570009ca0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.072+0000 7f5587ba2700 1 -- 172.21.15.69:0/3867065280 shutdown_connections 2024-04-23T10:26:49.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.072+0000 7f5587ba2700 1 --2- 172.21.15.69:0/3867065280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55801022f0 0x7f558010e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.072+0000 7f5587ba2700 1 --2- 172.21.15.69:0/3867065280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5580107980 0x7f5580107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.072+0000 7f5587ba2700 1 --2- 172.21.15.69:0/3867065280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5580101930 0x7f5580101db0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.072+0000 7f5587ba2700 1 -- 172.21.15.69:0/3867065280 >> 172.21.15.69:0/3867065280 conn(0x7f55800788b0 msgr2=0x7f5580078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:49.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.072+0000 7f5587ba2700 1 -- 172.21.15.69:0/3867065280 shutdown_connections 2024-04-23T10:26:49.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.072+0000 7f5587ba2700 1 -- 172.21.15.69:0/3867065280 wait complete. 2024-04-23T10:26:49.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f5587ba2700 1 Processor -- start 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f5587ba2700 1 -- start start 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f5587ba2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5580101930 0x7f55801034e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f5587ba2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55801022f0 0x7f5580103a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f5587ba2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5580107980 0x7f5580103f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f5587ba2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5580111c60 con 0x7f5580107980 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f5587ba2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5580111ae0 con 0x7f5580101930 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f5587ba2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5580111de0 con 0x7f55801022f0 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f558613f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5580107980 0x7f5580103f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f558613f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5580107980 0x7f5580103f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47572/0 (socket says 172.21.15.69:47572) 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f558613f700 1 -- 172.21.15.69:0/713857373 learned_addr learned my addr 172.21.15.69:0/713857373 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f558513d700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55801022f0 0x7f5580103a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.073+0000 7f558593e700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5580101930 0x7f55801034e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.074+0000 7f558613f700 1 -- 172.21.15.69:0/713857373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55801022f0 msgr2=0x7f5580103a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.074+0000 7f558613f700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55801022f0 0x7f5580103a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.074+0000 7f558613f700 1 -- 172.21.15.69:0/713857373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5580101930 msgr2=0x7f55801034e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.074+0000 7f558613f700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5580101930 0x7f55801034e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.074+0000 7f558613f700 1 -- 172.21.15.69:0/713857373 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55801a76f0 con 0x7f5580107980 2024-04-23T10:26:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.074+0000 7f558613f700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5580107980 0x7f5580103f60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5578007ee0 tx=0x7f557800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.074+0000 7f5576ffd700 1 -- 172.21.15.69:0/713857373 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557800dd20 con 0x7f5580107980 2024-04-23T10:26:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.074+0000 7f5587ba2700 1 -- 172.21.15.69:0/713857373 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55801a79e0 con 0x7f5580107980 2024-04-23T10:26:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.074+0000 7f5576ffd700 1 -- 172.21.15.69:0/713857373 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5578004020 con 0x7f5580107980 2024-04-23T10:26:49.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.074+0000 7f5576ffd700 1 -- 172.21.15.69:0/713857373 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578015660 con 0x7f5580107980 2024-04-23T10:26:49.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.074+0000 7f5587ba2700 1 -- 172.21.15.69:0/713857373 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55801a7ea0 con 0x7f5580107980 2024-04-23T10:26:49.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.075+0000 7f5587ba2700 1 -- 172.21.15.69:0/713857373 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5580069730 con 0x7f5580107980 2024-04-23T10:26:49.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.076+0000 7f5576ffd700 1 -- 172.21.15.69:0/713857373 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f55780041d0 con 0x7f5580107980 2024-04-23T10:26:49.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.077+0000 7f5576ffd700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f556c0a3c90 0x7f556c0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:49.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.077+0000 7f558593e700 1 -- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f556c0a3c90 msgr2=0x7f556c0a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/847729550 2024-04-23T10:26:49.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.077+0000 7f5576ffd700 1 -- 172.21.15.69:0/713857373 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f55780cfdf0 con 0x7f5580107980 2024-04-23T10:26:49.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.077+0000 7f558593e700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f556c0a3c90 0x7f556c0a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:26:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.081+0000 7f5576ffd700 1 -- 172.21.15.69:0/713857373 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5578010070 con 0x7f5580107980 2024-04-23T10:26:49.141 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:48.846+0000 7fb7f6152200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:26:49.141 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:48.938+0000 7fb7f6152200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:26:49.177 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:48.879+0000 7f44f3e56200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:26:49.177 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:48.977+0000 7f44f3e56200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:26:49.237 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:48 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:48.930+0000 7f4af2842200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:26:49.237 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:49 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:49.027+0000 7f4af2842200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:26:49.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.278+0000 7f558593e700 1 -- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f556c0a3c90 msgr2=0x7f556c0a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/847729550 2024-04-23T10:26:49.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.278+0000 7f558593e700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f556c0a3c90 0x7f556c0a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T10:26:49.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.335+0000 7f5587ba2700 1 -- 172.21.15.69:0/713857373 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f55801a8140 con 0x7f5580107980 2024-04-23T10:26:49.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.335+0000 7f5576ffd700 1 -- 172.21.15.69:0/713857373 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f557809c7e0 con 0x7f5580107980 2024-04-23T10:26:49.334 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 -- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f556c0a3c90 msgr2=0x7f556c0a6150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f556c0a3c90 0x7f556c0a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 -- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5580107980 msgr2=0x7f5580103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5580107980 0x7f5580103f60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5578007ee0 tx=0x7f557800d3b0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 -- 172.21.15.69:0/713857373 shutdown_connections 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f556c0a3c90 0x7f556c0a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5580107980 0x7f5580103f60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5580101930 0x7f55801034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 --2- 172.21.15.69:0/713857373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55801022f0 0x7f5580103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 -- 172.21.15.69:0/713857373 >> 172.21.15.69:0/713857373 conn(0x7f55800788b0 msgr2=0x7f5580100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 -- 172.21.15.69:0/713857373 shutdown_connections 2024-04-23T10:26:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:49.338+0000 7f5587ba2700 1 -- 172.21.15.69:0/713857373 wait complete. 2024-04-23T10:26:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:49 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/713857373' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T10:26:49.492 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:49 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:49.238+0000 7f4af2842200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:26:49.492 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:49 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:49.442+0000 7f4af2842200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:26:49.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:49 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/713857373' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T10:26:49.582 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:49 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:49.143+0000 7fb7f6152200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:26:49.582 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:49 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:49.337+0000 7fb7f6152200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:26:49.587 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:49 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/713857373' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-23T10:26:49.587 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:49 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:49.190+0000 7f44f3e56200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:26:49.587 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:49 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:49.391+0000 7f44f3e56200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:26:49.947 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-23T10:26:49.947 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-23T10:26:49.948 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2024-04-23T10:26:49.948 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-23T10:26:49.948 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T10:26:49.948 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-23T10:26:49.948 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-23T10:26:49.948 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-23T10:26:49.948 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-23T10:26:49.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:26:49.948 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2024-04-23T10:26:49.964 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-23T10:26:49.964 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-23T10:26:49.964 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2024-04-23T10:26:49.964 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:26:49.964 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2024-04-23T10:26:49.964 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:26:49.964 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 41511sec preferred_lft 41511sec 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::29da:7ec3:91cc:c1f0/64 scope link noprefixroute 2024-04-23T10:26:49.965 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:26:49.966 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-23T10:26:49.966 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:26:49.966 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-04-23T10:26:49.966 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add name ceph-brx type bridge 2024-04-23T10:26:49.966 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr flush dev ceph-brx 2024-04-23T10:26:49.966 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set ceph-brx up 2024-04-23T10:26:49.966 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-23T10:26:49.966 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-04-23T10:26:50.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:26:50.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:26:50.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:26:50.149 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-23T10:26:50.167 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:50 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:50.057+0000 7f4af2842200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T10:26:50.172 INFO:teuthology.orchestra.run.smithi069.stdout:1 2024-04-23T10:26:50.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:26:50.175 DEBUG:teuthology.orchestra.run.smithi069:> route 2024-04-23T10:26:50.239 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2024-04-23T10:26:50.239 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-23T10:26:50.239 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-23T10:26:50.239 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-23T10:26:50.239 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-23T10:26:50.240 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:26:50.240 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-04-23T10:26:50.240 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-23T10:26:50.240 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-23T10:26:50.240 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-23T10:26:50.240 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-04-23T10:26:50.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:26:50.332 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:49 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:49.941+0000 7fb7f6152200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T10:26:50.420 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:50 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:50.002+0000 7f44f3e56200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T10:26:50.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:26:50.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:26:50.541 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-04-23T10:26:50.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:26:50.556 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2024-04-23T10:26:50.612 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:26:50.612 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-04-23T10:26:50.612 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:26:50.612 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-23T10:26:50.612 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-04-23T10:26:50.664 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:50 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:50.367+0000 7fb7f6152200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:26:50.665 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:50 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:50.463+0000 7fb7f6152200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:26:50.677 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:50 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:50.421+0000 7f44f3e56200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:26:50.677 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:50 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:50.518+0000 7f44f3e56200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:26:50.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:26:50.708 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:50 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:50.516+0000 7f4af2842200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:26:50.708 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:50 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:50.622+0000 7f4af2842200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:26:50.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:26:50.729 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-23T10:26:50.729 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:26:50.729 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-04-23T10:26:50.729 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-23T10:26:50.729 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-23T10:26:50.730 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-23T10:26:50.730 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-23T10:26:50.730 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-23T10:26:50.730 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-04-23T10:26:50.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:26:50.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:26:50.849 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:26:50.849 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-04-23T10:26:50.849 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2024-04-23T10:26:50.849 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.0 master ceph-brx 2024-04-23T10:26:50.849 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-04-23T10:26:50.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:26:50.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:26:50.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T10:26:50.927 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-23T10:26:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-23T10:26:50.942 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T10:26:50.942 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-23T10:26:50.992 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:50 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:50.843+0000 7f4af2842200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T10:26:50.997 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-23T10:26:50.997 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-23T10:26:50.997 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/cec0e692-b351-4dd8-958e-abe3bc589ac9 2024-04-23T10:26:50.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:26:50.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/cec0e692-b351-4dd8-958e-abe3bc589ac9 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-23T10:26:51.082 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:50 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:50.665+0000 7fb7f6152200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T10:26:51.088 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-23T10:26:51.088 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-04-23T10:26:51.088 INFO:teuthology.orchestra.run.smithi069.stdout:invalid new device string format 2024-04-23T10:26:51.177 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:50 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:50.720+0000 7f44f3e56200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T10:26:51.186 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-04-23T10:26:51.186 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-04-23T10:26:51.186 INFO:teuthology.orchestra.run.smithi069.stdout:invalid new device string format 2024-04-23T10:26:51.186 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.146:3300,172.21.15.167:3300" 2024-04-23T10:26:51.186 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.69:3300,172.21.15.146:3300,172.21.15.167:3300:/volumes/qa/sv_1/cec0e692-b351-4dd8-958e-abe3bc589ac9 2024-04-23T10:26:51.187 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=ac4c3a2c-0159-11ef-bc93-c7b262605968" will pass to kernel 2024-04-23T10:26:51.187 INFO:teuthology.orchestra.run.smithi069.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-23T10:26:51.187 INFO:teuthology.orchestra.run.smithi069.stdout: You just mounted a file system that supports labels which does not 2024-04-23T10:26:51.187 INFO:teuthology.orchestra.run.smithi069.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-23T10:26:51.188 INFO:teuthology.orchestra.run.smithi069.stdout: applications will generate AVC messages and not be allowed access to 2024-04-23T10:26:51.188 INFO:teuthology.orchestra.run.smithi069.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-23T10:26:51.189 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-23T10:26:51.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:26:51.189 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-23T10:26:51.217 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T10:26:51.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T10:26:51.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:26:51.315 INFO:teuthology.orchestra.run.smithi069.stdout:client15381 2024-04-23T10:26:51.316 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:26:51.316 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:26:51.335 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T10:26:51.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T10:26:51.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:26:51.431 INFO:teuthology.orchestra.run.smithi069.stdout:client15381 2024-04-23T10:26:51.431 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T10:26:51.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T10:26:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:26:51.487 INFO:teuthology.orchestra.run.smithi069.stdout:client15381 2024-04-23T10:26:51.488 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968.client15381/status') 2024-04-23T10:26:51.531 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:51.191+0000 7fb7f6152200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:26:51.531 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:51.285+0000 7fb7f6152200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:26:51.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:26:51.546 INFO:teuthology.orchestra.run.smithi069.stdout:instance: client.15381 (3)192.168.0.1:0/509569479 2024-04-23T10:26:51.546 INFO:teuthology.orchestra.run.smithi069.stdout:blocklisted: false 2024-04-23T10:26:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:0+1 records in 2024-04-23T10:26:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:0+1 records out 2024-04-23T10:26:51.547 INFO:teuthology.orchestra.run.smithi069.stderr:69 bytes copied, 2.281e-05 s, 3.0 MB/s 2024-04-23T10:26:51.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:26:51.553 INFO:teuthology.run_tasks:Running task exec... 2024-04-23T10:26:51.563 INFO:teuthology.task.exec:Executing custom commands... 2024-04-23T10:26:51.563 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-04-23T10:26:51.563 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-04-23T10:26:51.586 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:51 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:51.249+0000 7f44f3e56200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:26:51.586 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:51 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:51.341+0000 7f44f3e56200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:26:51.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.667+0000 7fb148f44640 1 -- 172.21.15.69:0/4079018448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb144102a00 msgr2=0x7fb144109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:51.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.667+0000 7fb148f44640 1 --2- 172.21.15.69:0/4079018448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb144102a00 0x7fb144109320 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009ca0 tx=0x7fb13c02a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:51.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.667+0000 7fb148f44640 1 -- 172.21.15.69:0/4079018448 shutdown_connections 2024-04-23T10:26:51.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.667+0000 7fb148f44640 1 --2- 172.21.15.69:0/4079018448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb144102a00 0x7fb144109320 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:51.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.667+0000 7fb148f44640 1 --2- 172.21.15.69:0/4079018448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb144102040 0x7fb1441024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:51.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.667+0000 7fb148f44640 1 --2- 172.21.15.69:0/4079018448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100e60 0x7fb144101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:51.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.667+0000 7fb148f44640 1 -- 172.21.15.69:0/4079018448 >> 172.21.15.69:0/4079018448 conn(0x7fb1440fc420 msgr2=0x7fb1440fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:51.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.667+0000 7fb148f44640 1 -- 172.21.15.69:0/4079018448 shutdown_connections 2024-04-23T10:26:51.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.667+0000 7fb148f44640 1 -- 172.21.15.69:0/4079018448 wait complete. 2024-04-23T10:26:51.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb148f44640 1 Processor -- start 2024-04-23T10:26:51.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb148f44640 1 -- start start 2024-04-23T10:26:51.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb148f44640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100e60 0x7fb1441970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:51.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb148f44640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb144102040 0x7fb144197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:51.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb148f44640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb144102a00 0x7fb14419e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:51.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb148f44640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb14410cb50 con 0x7fb144102a00 2024-04-23T10:26:51.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb148f44640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb14410c9d0 con 0x7fb144102040 2024-04-23T10:26:51.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb148f44640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb14410ccd0 con 0x7fb144100e60 2024-04-23T10:26:51.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb142d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb144102a00 0x7fb14419e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:51.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb14259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100e60 0x7fb1441970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:51.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb142d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb144102a00 0x7fb14419e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38246/0 (socket says 172.21.15.69:38246) 2024-04-23T10:26:51.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb141d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb144102040 0x7fb144197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:51.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb142d9d640 1 -- 172.21.15.69:0/2805568323 learned_addr learned my addr 172.21.15.69:0/2805568323 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:51.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb142d9d640 1 -- 172.21.15.69:0/2805568323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100e60 msgr2=0x7fb1441970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:51.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb142d9d640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100e60 0x7fb1441970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:51.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb142d9d640 1 -- 172.21.15.69:0/2805568323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb144102040 msgr2=0x7fb144197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:51.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb142d9d640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb144102040 0x7fb144197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:51.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.668+0000 7fb142d9d640 1 -- 172.21.15.69:0/2805568323 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14419ed00 con 0x7fb144102a00 2024-04-23T10:26:51.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.669+0000 7fb142d9d640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb144102a00 0x7fb14419e690 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009dc0 tx=0x7fb13c031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:51.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.669+0000 7fb1337fe640 1 -- 172.21.15.69:0/2805568323 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c003bf0 con 0x7fb144102a00 2024-04-23T10:26:51.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.669+0000 7fb148f44640 1 -- 172.21.15.69:0/2805568323 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14419ef90 con 0x7fb144102a00 2024-04-23T10:26:51.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.669+0000 7fb1337fe640 1 -- 172.21.15.69:0/2805568323 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb13c003d90 con 0x7fb144102a00 2024-04-23T10:26:51.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.669+0000 7fb148f44640 1 -- 172.21.15.69:0/2805568323 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14419f4a0 con 0x7fb144102a00 2024-04-23T10:26:51.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.669+0000 7fb1337fe640 1 -- 172.21.15.69:0/2805568323 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c02fce0 con 0x7fb144102a00 2024-04-23T10:26:51.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.670+0000 7fb148f44640 1 -- 172.21.15.69:0/2805568323 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1441081a0 con 0x7fb144102a00 2024-04-23T10:26:51.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.671+0000 7fb1337fe640 1 -- 172.21.15.69:0/2805568323 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7fb13c004040 con 0x7fb144102a00 2024-04-23T10:26:51.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.672+0000 7fb1337fe640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb12c0a3ca0 0x7fb12c0a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:51.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.672+0000 7fb14259c640 1 -- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb12c0a3ca0 msgr2=0x7fb12c0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/847729550 2024-04-23T10:26:51.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.672+0000 7fb1337fe640 1 -- 172.21.15.69:0/2805568323 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fb13c0f1b40 con 0x7fb144102a00 2024-04-23T10:26:51.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.672+0000 7fb14259c640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb12c0a3ca0 0x7fb12c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:26:51.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.677+0000 7fb1337fe640 1 -- 172.21.15.69:0/2805568323 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb13c0be5c0 con 0x7fb144102a00 2024-04-23T10:26:51.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:51 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:51.395+0000 7f4af2842200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:26:51.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:51 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:51.495+0000 7f4af2842200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:26:51.832 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:51.532+0000 7fb7f6152200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:26:51.832 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:51.666+0000 7fb7f6152200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:26:51.833 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:51.762+0000 7fb7f6152200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:26:51.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.873+0000 7fb14259c640 1 -- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb12c0a3ca0 msgr2=0x7fb12c0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/847729550 2024-04-23T10:26:51.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.873+0000 7fb14259c640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb12c0a3ca0 0x7fb12c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T10:26:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.902+0000 7fb148f44640 1 -- 172.21.15.69:0/2805568323 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fb144062b50 con 0x7fb144102a00 2024-04-23T10:26:51.927 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:51 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:51.587+0000 7f44f3e56200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:26:51.927 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:51 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:51.721+0000 7f44f3e56200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:26:51.928 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:51 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:51.817+0000 7f44f3e56200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:26:51.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.954+0000 7fb1337fe640 1 -- 172.21.15.69:0/2805568323 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7fb13c0bdec0 con 0x7fb144102a00 2024-04-23T10:26:51.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 -- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb12c0a3ca0 msgr2=0x7fb12c0a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:26:51.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb12c0a3ca0 0x7fb12c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:51.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 -- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb144102a00 msgr2=0x7fb14419e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:51.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb144102a00 0x7fb14419e690 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009dc0 tx=0x7fb13c031840 comp rx=0 tx=0).stop 2024-04-23T10:26:51.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 -- 172.21.15.69:0/2805568323 shutdown_connections 2024-04-23T10:26:51.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7fb12c0a3ca0 0x7fb12c0a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:51.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb144102a00 0x7fb14419e690 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:51.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb144102040 0x7fb144197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:51.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 --2- 172.21.15.69:0/2805568323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100e60 0x7fb1441970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:51.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 -- 172.21.15.69:0/2805568323 >> 172.21.15.69:0/2805568323 conn(0x7fb1440fc420 msgr2=0x7fb144105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:51.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 -- 172.21.15.69:0/2805568323 shutdown_connections 2024-04-23T10:26:51.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:51.956+0000 7fb148f44640 1 -- 172.21.15.69:0/2805568323 wait complete. 2024-04-23T10:26:51.966 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-23T10:26:51.977 INFO:teuthology.run_tasks:Running task exec... 2024-04-23T10:26:52.013 INFO:teuthology.task.exec:Executing custom commands... 2024-04-23T10:26:52.013 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-04-23T10:26:52.013 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-23T10:26:52.034 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:51 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:51.753+0000 7f4af2842200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:26:52.034 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:51 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:51.892+0000 7f4af2842200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:26:52.034 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:51 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:51.991+0000 7f4af2842200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:26:52.034 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:51 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2805568323' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-23T10:26:52.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.117+0000 7f3882920640 1 -- 172.21.15.69:0/286802060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f387c103cb0 msgr2=0x7f387c10a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:52.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.117+0000 7f3882920640 1 --2- 172.21.15.69:0/286802060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f387c103cb0 0x7f387c10a540 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3874009cd0 tx=0x7f387402a8e0 comp rx=0 tx=0).stop 2024-04-23T10:26:52.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.117+0000 7f3882920640 1 -- 172.21.15.69:0/286802060 shutdown_connections 2024-04-23T10:26:52.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.117+0000 7f3882920640 1 --2- 172.21.15.69:0/286802060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f387c103cb0 0x7f387c10a540 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:52.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.117+0000 7f3882920640 1 --2- 172.21.15.69:0/286802060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f387c1032f0 0x7f387c103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:52.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.117+0000 7f3882920640 1 --2- 172.21.15.69:0/286802060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f387c100280 0x7f387c1006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:52.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.117+0000 7f3882920640 1 -- 172.21.15.69:0/286802060 >> 172.21.15.69:0/286802060 conn(0x7f387c0fbbb0 msgr2=0x7f387c0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:52.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.117+0000 7f3882920640 1 -- 172.21.15.69:0/286802060 shutdown_connections 2024-04-23T10:26:52.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.117+0000 7f3882920640 1 -- 172.21.15.69:0/286802060 wait complete. 2024-04-23T10:26:52.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.118+0000 7f3882920640 1 Processor -- start 2024-04-23T10:26:52.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.118+0000 7f3882920640 1 -- start start 2024-04-23T10:26:52.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.118+0000 7f3882920640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f387c100280 0x7f387c102c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.118+0000 7f3882920640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f387c1032f0 0x7f387c1012a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.118+0000 7f3882920640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f387c103cb0 0x7f387c1017e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.118+0000 7f3882920640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f387c10dc10 con 0x7f387c1032f0 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.118+0000 7f3882920640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f387c10da90 con 0x7f387c103cb0 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.118+0000 7f3882920640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f387c10dd90 con 0x7f387c100280 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.118+0000 7f387b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f387c1032f0 0x7f387c1012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.118+0000 7f387b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f387c1032f0 0x7f387c1012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38268/0 (socket says 172.21.15.69:38268) 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f387b7fe640 1 -- 172.21.15.69:0/2998845019 learned_addr learned my addr 172.21.15.69:0/2998845019 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f3880ebd640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f387c103cb0 0x7f387c1017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f387bfff640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f387c100280 0x7f387c102c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f387b7fe640 1 -- 172.21.15.69:0/2998845019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f387c100280 msgr2=0x7f387c102c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f387b7fe640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f387c100280 0x7f387c102c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f387b7fe640 1 -- 172.21.15.69:0/2998845019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f387c103cb0 msgr2=0x7f387c1017e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:52.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f387b7fe640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f387c103cb0 0x7f387c1017e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:52.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f387b7fe640 1 -- 172.21.15.69:0/2998845019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387c1020a0 con 0x7f387c1032f0 2024-04-23T10:26:52.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f387b7fe640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f387c1032f0 0x7f387c1012a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f386c00e9f0 tx=0x7f386c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:52.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f38797fa640 1 -- 172.21.15.69:0/2998845019 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c00cd80 con 0x7f387c1032f0 2024-04-23T10:26:52.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f38797fa640 1 -- 172.21.15.69:0/2998845019 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f386c0054f0 con 0x7f387c1032f0 2024-04-23T10:26:52.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f3882920640 1 -- 172.21.15.69:0/2998845019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387c1a23f0 con 0x7f387c1032f0 2024-04-23T10:26:52.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f38797fa640 1 -- 172.21.15.69:0/2998845019 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c010690 con 0x7f387c1032f0 2024-04-23T10:26:52.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.119+0000 7f3882920640 1 -- 172.21.15.69:0/2998845019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387c1a28c0 con 0x7f387c1032f0 2024-04-23T10:26:52.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.120+0000 7f3882920640 1 -- 172.21.15.69:0/2998845019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f387c109420 con 0x7f387c1032f0 2024-04-23T10:26:52.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.121+0000 7f38797fa640 1 -- 172.21.15.69:0/2998845019 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f386c0046c0 con 0x7f387c1032f0 2024-04-23T10:26:52.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.122+0000 7f38797fa640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f38640a3ca0 0x7f38640a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:52.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.122+0000 7f387bfff640 1 -- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f38640a3ca0 msgr2=0x7f38640a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/847729550 2024-04-23T10:26:52.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.122+0000 7f38797fa640 1 -- 172.21.15.69:0/2998845019 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f386c0d07a0 con 0x7f387c1032f0 2024-04-23T10:26:52.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.122+0000 7f387bfff640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f38640a3ca0 0x7f38640a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:26:52.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.126+0000 7f38797fa640 1 -- 172.21.15.69:0/2998845019 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f386c09d190 con 0x7f387c1032f0 2024-04-23T10:26:52.184 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:51 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2805568323' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-23T10:26:52.184 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:51.879+0000 7fb7f6152200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:26:52.236 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:51 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:51.932+0000 7f44f3e56200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:26:52.237 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:51 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2805568323' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-23T10:26:52.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.323+0000 7f387bfff640 1 -- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f38640a3ca0 msgr2=0x7f38640a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/847729550 2024-04-23T10:26:52.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.323+0000 7f387bfff640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f38640a3ca0 0x7f38640a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T10:26:52.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.333+0000 7f3882920640 1 -- 172.21.15.69:0/2998845019 --> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f387c062390 con 0x7f38640a3ca0 2024-04-23T10:26:52.427 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:52.114+0000 7f4af2842200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:26:52.582 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:52.185+0000 7fb7f6152200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:26:52.677 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:52 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:52.237+0000 7f44f3e56200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:26:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.723+0000 7f387bfff640 1 -- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f38640a3ca0 msgr2=0x7f38640a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/847729550 2024-04-23T10:26:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:52.723+0000 7f387bfff640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f38640a3ca0 0x7f38640a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T10:26:52.742 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:52.427+0000 7f4af2842200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:26:53.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:52 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2805568323' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-23T10:26:53.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:52 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:26:53.083 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:52.788+0000 7fb7f6152200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:26:53.083 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z[34809]: 2024-04-23T10:26:53.006+0000 7fb7f6152200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:26:53.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:52 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2805568323' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-23T10:26:53.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:52 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:26:53.178 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:52 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:52.846+0000 7f44f3e56200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:26:53.178 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y[34177]: 2024-04-23T10:26:53.065+0000 7f44f3e56200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:26:53.241 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.035+0000 7f4af2842200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:26:53.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:52 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2805568323' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-23T10:26:53.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:52 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:26:53.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:53.270+0000 7f38797fa640 1 -- 172.21.15.69:0/2998845019 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 20) ==== 138331+0+0 (secure 0 0 0) 0x7f386c099100 con 0x7f387c1032f0 2024-04-23T10:26:53.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:53.271+0000 7f38797fa640 1 -- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f38640a3ca0 msgr2=0x7f38640a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:26:53.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:53.271+0000 7f38797fa640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/847729550,v1:172.21.15.69:6801/847729550] conn(0x7f38640a3ca0 0x7f38640a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:53.513 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.257+0000 7f4af2842200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:26:53.514 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.501+0000 7f4a52176700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:26:53.514 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.501+0000 7f4a52176700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:26:53.514 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.501+0000 7f4a52176700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:26:53.514 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.501+0000 7f4a52176700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:26:53.514 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.501+0000 7f4a52176700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:26:53.514 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.502+0000 7f4a5517c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:26:53.514 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.502+0000 7f4a5517c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:26:53.514 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.502+0000 7f4a5517c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:26:53.514 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.502+0000 7f4a5517c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:26:53.514 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:26:53.502+0000 7f4a5517c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:26:54.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: Standby manager daemon z restarted 2024-04-23T10:26:54.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: Standby manager daemon z started 2024-04-23T10:26:54.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T10:26:54.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: Standby manager daemon y restarted 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: Standby manager daemon y started 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: Active manager daemon x restarted 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: Activating manager daemon x 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: osdmap e89: 12 total, 12 up, 12 in 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: mgrmap e20: x(active, starting, since 0.012089s), standbys: y, z 2024-04-23T10:26:54.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:26:54.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:26:54.246 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:26:54.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:26:54.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:26:54.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:26:54.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T10:26:54.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T10:26:54.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T10:26:54.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: Manager daemon x is now available 2024-04-23T10:26:54.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:26:54.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T10:26:54.247 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:53 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T10:26:54.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.283+0000 7f38797fa640 1 -- 172.21.15.69:0/2998845019 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f386c0a1fd0 con 0x7f387c1032f0 2024-04-23T10:26:54.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.284+0000 7f38797fa640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f38640528d0 0x7f3864052cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:54.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.284+0000 7f38797fa640 1 -- 172.21.15.69:0/2998845019 --> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f386c011ea0 con 0x7f38640528d0 2024-04-23T10:26:54.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.284+0000 7f387bfff640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f38640528d0 0x7f3864052cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:54.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.285+0000 7f387bfff640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f38640528d0 0x7f3864052cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f387c069340 tx=0x7f3870005f90 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: Standby manager daemon z restarted 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: Standby manager daemon z started 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: Standby manager daemon y restarted 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: Standby manager daemon y started 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T10:26:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: Active manager daemon x restarted 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: Activating manager daemon x 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: osdmap e89: 12 total, 12 up, 12 in 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: mgrmap e20: x(active, starting, since 0.012089s), standbys: y, z 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T10:26:54.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:26:54.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: Manager daemon x is now available 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T10:26:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:53 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T10:26:54.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.343+0000 7f38797fa640 1 -- 172.21.15.69:0/2998845019 <== mgr.24836 v2:172.21.15.69:6800/908508073 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f386c011ea0 con 0x7f38640528d0 2024-04-23T10:26:54.342 INFO:teuthology.orchestra.run.smithi069.stdout:Schedule set for path / 2024-04-23T10:26:54.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.345+0000 7f3882920640 1 -- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f38640528d0 msgr2=0x7f3864052cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:54.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.345+0000 7f3882920640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f38640528d0 0x7f3864052cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f387c069340 tx=0x7f3870005f90 comp rx=0 tx=0).stop 2024-04-23T10:26:54.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.345+0000 7f3882920640 1 -- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f387c1032f0 msgr2=0x7f387c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:54.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.345+0000 7f3882920640 1 --2- 172.21.15.69:0/2998845019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f387c1032f0 0x7f387c1012a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f386c00e9f0 tx=0x7f386c00edf0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.345+0000 7f3880ebd640 1 -- 172.21.15.69:0/2998845019 reap_dead start 2024-04-23T10:26:54.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.345+0000 7f3882920640 1 -- 172.21.15.69:0/2998845019 shutdown_connections 2024-04-23T10:26:54.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.345+0000 7f3882920640 1 -- 172.21.15.69:0/2998845019 >> 172.21.15.69:0/2998845019 conn(0x7f387c0fbbb0 msgr2=0x7f387c1065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:54.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.345+0000 7f3882920640 1 -- 172.21.15.69:0/2998845019 shutdown_connections 2024-04-23T10:26:54.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.345+0000 7f3882920640 1 -- 172.21.15.69:0/2998845019 wait complete. 2024-04-23T10:26:54.355 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-23T10:26:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: Standby manager daemon z restarted 2024-04-23T10:26:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: Standby manager daemon z started 2024-04-23T10:26:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-23T10:26:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:26:54.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.167:0/1641784321' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: Standby manager daemon y restarted 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: Standby manager daemon y started 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.? 172.21.15.146:0/1260048280' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: Active manager daemon x restarted 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: Activating manager daemon x 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: osdmap e89: 12 total, 12 up, 12 in 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: mgrmap e20: x(active, starting, since 0.012089s), standbys: y, z 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-23T10:26:54.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-23T10:26:54.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-23T10:26:54.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-23T10:26:54.432 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-23T10:26:54.432 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-23T10:26:54.432 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: Manager daemon x is now available 2024-04-23T10:26:54.432 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:26:54.432 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-23T10:26:54.432 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:53 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-23T10:26:54.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.500+0000 7f69357f0640 1 -- 172.21.15.69:0/1749686180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6930102040 msgr2=0x7f69301024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:54.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.500+0000 7f69357f0640 1 --2- 172.21.15.69:0/1749686180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6930102040 0x7f69301024c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6920009900 tx=0x7f692002a410 comp rx=0 tx=0).stop 2024-04-23T10:26:54.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.500+0000 7f69357f0640 1 -- 172.21.15.69:0/1749686180 shutdown_connections 2024-04-23T10:26:54.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.500+0000 7f69357f0640 1 --2- 172.21.15.69:0/1749686180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6930102040 0x7f69301024c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.500+0000 7f69357f0640 1 --2- 172.21.15.69:0/1749686180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6930102a00 0x7f6930109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.500+0000 7f69357f0640 1 --2- 172.21.15.69:0/1749686180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6930100e60 0x7f6930101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.500+0000 7f69357f0640 1 -- 172.21.15.69:0/1749686180 >> 172.21.15.69:0/1749686180 conn(0x7f69300fc420 msgr2=0x7f69300fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:54.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.500+0000 7f69357f0640 1 -- 172.21.15.69:0/1749686180 shutdown_connections 2024-04-23T10:26:54.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.500+0000 7f69357f0640 1 -- 172.21.15.69:0/1749686180 wait complete. 2024-04-23T10:26:54.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.500+0000 7f69357f0640 1 Processor -- start 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f69357f0640 1 -- start start 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f69357f0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6930100e60 0x7f693006a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f69357f0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6930102040 0x7f693019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f69357f0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6930102a00 0x7f693019f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f69357f0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f693010cb50 con 0x7f6930100e60 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f69357f0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f693010c9d0 con 0x7f6930102040 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f69357f0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f693010ccd0 con 0x7f6930102a00 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f692effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6930100e60 0x7f693006a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f692effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6930100e60 0x7f693006a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38396/0 (socket says 172.21.15.69:38396) 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f692effd640 1 -- 172.21.15.69:0/2578316967 learned_addr learned my addr 172.21.15.69:0/2578316967 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f692e7fc640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6930102040 0x7f693019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f692f7fe640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6930102a00 0x7f693019f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f692effd640 1 -- 172.21.15.69:0/2578316967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6930102a00 msgr2=0x7f693019f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f692effd640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6930102a00 0x7f693019f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f692effd640 1 -- 172.21.15.69:0/2578316967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6930102040 msgr2=0x7f693019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:54.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f692effd640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6930102040 0x7f693019cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f692effd640 1 -- 172.21.15.69:0/2578316967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693019fee0 con 0x7f6930100e60 2024-04-23T10:26:54.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f692effd640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6930100e60 0x7f693006a170 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f692400d950 tx=0x7f692400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:54.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.501+0000 7f6917fff640 1 -- 172.21.15.69:0/2578316967 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924017070 con 0x7f6930100e60 2024-04-23T10:26:54.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.502+0000 7f69357f0640 1 -- 172.21.15.69:0/2578316967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69301a0170 con 0x7f6930100e60 2024-04-23T10:26:54.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.502+0000 7f6917fff640 1 -- 172.21.15.69:0/2578316967 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6924009c30 con 0x7f6930100e60 2024-04-23T10:26:54.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.502+0000 7f6917fff640 1 -- 172.21.15.69:0/2578316967 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692400f620 con 0x7f6930100e60 2024-04-23T10:26:54.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.502+0000 7f69357f0640 1 -- 172.21.15.69:0/2578316967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69301a0690 con 0x7f6930100e60 2024-04-23T10:26:54.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.503+0000 7f69357f0640 1 -- 172.21.15.69:0/2578316967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6930108200 con 0x7f6930100e60 2024-04-23T10:26:54.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.504+0000 7f6917fff640 1 -- 172.21.15.69:0/2578316967 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f692401a070 con 0x7f6930100e60 2024-04-23T10:26:54.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.504+0000 7f6917fff640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69180a3a60 0x7f69180a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:54.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.505+0000 7f692e7fc640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69180a3a60 0x7f69180a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:54.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.505+0000 7f6917fff640 1 -- 172.21.15.69:0/2578316967 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f69240cfb00 con 0x7f6930100e60 2024-04-23T10:26:54.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.505+0000 7f692e7fc640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69180a3a60 0x7f69180a5f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6920000c00 tx=0x7f6920031510 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:54.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.512+0000 7f6917fff640 1 -- 172.21.15.69:0/2578316967 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6924009de0 con 0x7f6930100e60 2024-04-23T10:26:54.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.721+0000 7f69357f0640 1 -- 172.21.15.69:0/2578316967 --> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f69300624f0 con 0x7f69180a3a60 2024-04-23T10:26:54.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.776+0000 7f6917fff640 1 -- 172.21.15.69:0/2578316967 <== mgr.24836 v2:172.21.15.69:6800/908508073 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f69300624f0 con 0x7f69180a3a60 2024-04-23T10:26:54.776 INFO:teuthology.orchestra.run.smithi069.stdout:Retention added to path / 2024-04-23T10:26:54.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.778+0000 7f69357f0640 1 -- 172.21.15.69:0/2578316967 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69180a3a60 msgr2=0x7f69180a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:54.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.778+0000 7f69357f0640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69180a3a60 0x7f69180a5f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6920000c00 tx=0x7f6920031510 comp rx=0 tx=0).stop 2024-04-23T10:26:54.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.778+0000 7f69357f0640 1 -- 172.21.15.69:0/2578316967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6930100e60 msgr2=0x7f693006a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:54.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.778+0000 7f69357f0640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6930100e60 0x7f693006a170 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f692400d950 tx=0x7f692400de10 comp rx=0 tx=0).stop 2024-04-23T10:26:54.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.779+0000 7f69357f0640 1 -- 172.21.15.69:0/2578316967 shutdown_connections 2024-04-23T10:26:54.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.779+0000 7f69357f0640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69180a3a60 0x7f69180a5f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.779+0000 7f69357f0640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6930102a00 0x7f693019f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.779+0000 7f69357f0640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6930102040 0x7f693019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.779+0000 7f69357f0640 1 --2- 172.21.15.69:0/2578316967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6930100e60 0x7f693006a170 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.779+0000 7f69357f0640 1 -- 172.21.15.69:0/2578316967 >> 172.21.15.69:0/2578316967 conn(0x7f69300fc420 msgr2=0x7f69301053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:54.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.779+0000 7f69357f0640 1 -- 172.21.15.69:0/2578316967 shutdown_connections 2024-04-23T10:26:54.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.779+0000 7f69357f0640 1 -- 172.21.15.69:0/2578316967 wait complete. 2024-04-23T10:26:54.788 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-23T10:26:54.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.889+0000 7f0251c31640 1 -- 172.21.15.69:0/2060001883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f024c103b60 msgr2=0x7f024c10a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:54.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.889+0000 7f0251c31640 1 --2- 172.21.15.69:0/2060001883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f024c103b60 0x7f024c10a3f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0244009ca0 tx=0x7f024402a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.889+0000 7f0251c31640 1 -- 172.21.15.69:0/2060001883 shutdown_connections 2024-04-23T10:26:54.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.889+0000 7f0251c31640 1 --2- 172.21.15.69:0/2060001883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f024c103b60 0x7f024c10a3f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.889+0000 7f0251c31640 1 --2- 172.21.15.69:0/2060001883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f024c1031a0 0x7f024c103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.889+0000 7f0251c31640 1 --2- 172.21.15.69:0/2060001883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f024c101fb0 0x7f024c1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.889+0000 7f0251c31640 1 -- 172.21.15.69:0/2060001883 >> 172.21.15.69:0/2060001883 conn(0x7f024c0fd540 msgr2=0x7f024c0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:54.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.889+0000 7f0251c31640 1 -- 172.21.15.69:0/2060001883 shutdown_connections 2024-04-23T10:26:54.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.889+0000 7f0251c31640 1 -- 172.21.15.69:0/2060001883 wait complete. 2024-04-23T10:26:54.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.889+0000 7f0251c31640 1 Processor -- start 2024-04-23T10:26:54.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f0251c31640 1 -- start start 2024-04-23T10:26:54.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f0251c31640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f024c101fb0 0x7f024c198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:54.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f0251c31640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f024c1031a0 0x7f024c1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:54.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f0251c31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f024c103b60 0x7f024c19f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:54.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f0251c31640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f024c10dc10 con 0x7f024c101fb0 2024-04-23T10:26:54.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f0251c31640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f024c10da90 con 0x7f024c1031a0 2024-04-23T10:26:54.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f0251c31640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f024c10dd90 con 0x7f024c103b60 2024-04-23T10:26:54.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f024b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f024c101fb0 0x7f024c198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:54.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f024b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f024c101fb0 0x7f024c198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38410/0 (socket says 172.21.15.69:38410) 2024-04-23T10:26:54.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f024b7fe640 1 -- 172.21.15.69:0/3307996666 learned_addr learned my addr 172.21.15.69:0/3307996666 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:54.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f024bfff640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f024c103b60 0x7f024c19f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f024affd640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f024c1031a0 0x7f024c1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f024b7fe640 1 -- 172.21.15.69:0/3307996666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f024c103b60 msgr2=0x7f024c19f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f024b7fe640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f024c103b60 0x7f024c19f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f024b7fe640 1 -- 172.21.15.69:0/3307996666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f024c1031a0 msgr2=0x7f024c1986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f024b7fe640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f024c1031a0 0x7f024c1986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f024b7fe640 1 -- 172.21.15.69:0/3307996666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c19fdb0 con 0x7f024c101fb0 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.890+0000 7f024b7fe640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f024c101fb0 0x7f024c198190 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f024000e9c0 tx=0x7f024000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.891+0000 7f0248ff9640 1 -- 172.21.15.69:0/3307996666 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024000cd80 con 0x7f024c101fb0 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.891+0000 7f0251c31640 1 -- 172.21.15.69:0/3307996666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024c1a00a0 con 0x7f024c101fb0 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.891+0000 7f0248ff9640 1 -- 172.21.15.69:0/3307996666 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f02400035f0 con 0x7f024c101fb0 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.891+0000 7f0248ff9640 1 -- 172.21.15.69:0/3307996666 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240010690 con 0x7f024c101fb0 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.891+0000 7f0251c31640 1 -- 172.21.15.69:0/3307996666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024c1a05f0 con 0x7f024c101fb0 2024-04-23T10:26:54.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.892+0000 7f0251c31640 1 -- 172.21.15.69:0/3307996666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f024c109270 con 0x7f024c101fb0 2024-04-23T10:26:54.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.893+0000 7f0248ff9640 1 -- 172.21.15.69:0/3307996666 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f0240003b30 con 0x7f024c101fb0 2024-04-23T10:26:54.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.893+0000 7f0248ff9640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02340a3a60 0x7f02340a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:54.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.894+0000 7f024affd640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02340a3a60 0x7f02340a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:54.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.894+0000 7f0248ff9640 1 -- 172.21.15.69:0/3307996666 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f02400d0520 con 0x7f024c101fb0 2024-04-23T10:26:54.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.894+0000 7f024affd640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02340a3a60 0x7f02340a5f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f024c1996a0 tx=0x7f023c00b390 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:54.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:54.897+0000 7f0248ff9640 1 -- 172.21.15.69:0/3307996666 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f024009d100 con 0x7f024c101fb0 2024-04-23T10:26:55.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.133+0000 7f0251c31640 1 -- 172.21.15.69:0/3307996666 --> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f024c062390 con 0x7f02340a3a60 2024-04-23T10:26:55.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.142+0000 7f0248ff9640 1 -- 172.21.15.69:0/3307996666 <== mgr.24836 v2:172.21.15.69:6800/908508073 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f024c062390 con 0x7f02340a3a60 2024-04-23T10:26:55.141 INFO:teuthology.orchestra.run.smithi069.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-23T00:00:00", "created": "2024-04-23T10:26:54", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.144+0000 7f0251c31640 1 -- 172.21.15.69:0/3307996666 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02340a3a60 msgr2=0x7f02340a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.144+0000 7f0251c31640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02340a3a60 0x7f02340a5f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f024c1996a0 tx=0x7f023c00b390 comp rx=0 tx=0).stop 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.144+0000 7f0251c31640 1 -- 172.21.15.69:0/3307996666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f024c101fb0 msgr2=0x7f024c198190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.144+0000 7f0251c31640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f024c101fb0 0x7f024c198190 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f024000e9c0 tx=0x7f024000ee80 comp rx=0 tx=0).stop 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.145+0000 7f0251c31640 1 -- 172.21.15.69:0/3307996666 shutdown_connections 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.145+0000 7f0251c31640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02340a3a60 0x7f02340a5f20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.145+0000 7f0251c31640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f024c103b60 0x7f024c19f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.145+0000 7f0251c31640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f024c1031a0 0x7f024c1986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.145+0000 7f0251c31640 1 --2- 172.21.15.69:0/3307996666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f024c101fb0 0x7f024c198190 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.145+0000 7f0251c31640 1 -- 172.21.15.69:0/3307996666 >> 172.21.15.69:0/3307996666 conn(0x7f024c0fd540 msgr2=0x7f024c106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.145+0000 7f0251c31640 1 -- 172.21.15.69:0/3307996666 shutdown_connections 2024-04-23T10:26:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.145+0000 7f0251c31640 1 -- 172.21.15.69:0/3307996666 wait complete. 2024-04-23T10:26:55.155 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-23T10:26:55.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:54 smithi069 ceph-mon[29593]: [23/Apr/2024:10:26:53] ENGINE Bus STARTING 2024-04-23T10:26:55.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:54 smithi069 ceph-mon[29593]: [23/Apr/2024:10:26:53] ENGINE Serving on https://172.21.15.69:7150 2024-04-23T10:26:55.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:54 smithi069 ceph-mon[29593]: [23/Apr/2024:10:26:54] ENGINE Serving on http://172.21.15.69:8765 2024-04-23T10:26:55.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:54 smithi069 ceph-mon[29593]: [23/Apr/2024:10:26:54] ENGINE Bus STARTED 2024-04-23T10:26:55.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:54 smithi069 ceph-mon[29593]: mgrmap e21: x(active, since 1.01968s), standbys: y, z 2024-04-23T10:26:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.264+0000 7f02a5707640 1 -- 172.21.15.69:0/1493049150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02a0102a30 msgr2=0x7f02a0104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.264+0000 7f02a5707640 1 --2- 172.21.15.69:0/1493049150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02a0102a30 0x7f02a0104e20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0290009900 tx=0x7f029002a410 comp rx=0 tx=0).stop 2024-04-23T10:26:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.264+0000 7f02a5707640 1 -- 172.21.15.69:0/1493049150 shutdown_connections 2024-04-23T10:26:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.264+0000 7f02a5707640 1 --2- 172.21.15.69:0/1493049150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02a0107c90 0x7f02a010a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.264+0000 7f02a5707640 1 --2- 172.21.15.69:0/1493049150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02a0105360 0x7f02a0107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.264+0000 7f02a5707640 1 --2- 172.21.15.69:0/1493049150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02a0102a30 0x7f02a0104e20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.264+0000 7f02a5707640 1 -- 172.21.15.69:0/1493049150 >> 172.21.15.69:0/1493049150 conn(0x7f02a00fc420 msgr2=0x7f02a00fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:55.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.264+0000 7f02a5707640 1 -- 172.21.15.69:0/1493049150 shutdown_connections 2024-04-23T10:26:55.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.264+0000 7f02a5707640 1 -- 172.21.15.69:0/1493049150 wait complete. 2024-04-23T10:26:55.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f02a5707640 1 Processor -- start 2024-04-23T10:26:55.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f02a5707640 1 -- start start 2024-04-23T10:26:55.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f02a5707640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02a0102a30 0x7f02a0198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:55.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f02a5707640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02a0105360 0x7f02a01987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:55.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f02a5707640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02a0107c90 0x7f02a019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:55.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f02a5707640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f02a010dc10 con 0x7f02a0102a30 2024-04-23T10:26:55.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f02a5707640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f02a010da90 con 0x7f02a0107c90 2024-04-23T10:26:55.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f02a5707640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f02a010dd90 con 0x7f02a0105360 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f029effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02a0102a30 0x7f02a0198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f029effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02a0102a30 0x7f02a0198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38418/0 (socket says 172.21.15.69:38418) 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f029effd640 1 -- 172.21.15.69:0/3232260458 learned_addr learned my addr 172.21.15.69:0/3232260458 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.265+0000 7f029e7fc640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02a0105360 0x7f02a01987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f029f7fe640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02a0107c90 0x7f02a019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f029effd640 1 -- 172.21.15.69:0/3232260458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02a0105360 msgr2=0x7f02a01987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f029effd640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02a0105360 0x7f02a01987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f029effd640 1 -- 172.21.15.69:0/3232260458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02a0107c90 msgr2=0x7f02a019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f029effd640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02a0107c90 0x7f02a019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f029effd640 1 -- 172.21.15.69:0/3232260458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a019fe80 con 0x7f02a0102a30 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f029effd640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02a0102a30 0x7f02a0198260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0290005940 tx=0x7f02900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f0297fff640 1 -- 172.21.15.69:0/3232260458 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029003f030 con 0x7f02a0102a30 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f0297fff640 1 -- 172.21.15.69:0/3232260458 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0290003cd0 con 0x7f02a0102a30 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f02a5707640 1 -- 172.21.15.69:0/3232260458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a01a0110 con 0x7f02a0102a30 2024-04-23T10:26:55.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f0297fff640 1 -- 172.21.15.69:0/3232260458 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290035070 con 0x7f02a0102a30 2024-04-23T10:26:55.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.266+0000 7f02a5707640 1 -- 172.21.15.69:0/3232260458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a01a0600 con 0x7f02a0102a30 2024-04-23T10:26:55.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.268+0000 7f02a5707640 1 -- 172.21.15.69:0/3232260458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a00fdf10 con 0x7f02a0102a30 2024-04-23T10:26:55.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.268+0000 7f0297fff640 1 -- 172.21.15.69:0/3232260458 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f0290042030 con 0x7f02a0102a30 2024-04-23T10:26:55.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.269+0000 7f0297fff640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f028c0a3a60 0x7f028c0a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:55.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.269+0000 7f0297fff640 1 -- 172.21.15.69:0/3232260458 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f02900f0530 con 0x7f02a0102a30 2024-04-23T10:26:55.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.269+0000 7f029e7fc640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f028c0a3a60 0x7f028c0a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:55.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.270+0000 7f029e7fc640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f028c0a3a60 0x7f028c0a5f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f02a0199770 tx=0x7f0288005f90 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:55.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.274+0000 7f0297fff640 1 -- 172.21.15.69:0/3232260458 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f02900bcac0 con 0x7f02a0102a30 2024-04-23T10:26:55.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:54 smithi167 ceph-mon[32940]: [23/Apr/2024:10:26:53] ENGINE Bus STARTING 2024-04-23T10:26:55.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:54 smithi167 ceph-mon[32940]: [23/Apr/2024:10:26:53] ENGINE Serving on https://172.21.15.69:7150 2024-04-23T10:26:55.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:54 smithi167 ceph-mon[32940]: [23/Apr/2024:10:26:54] ENGINE Serving on http://172.21.15.69:8765 2024-04-23T10:26:55.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:54 smithi167 ceph-mon[32940]: [23/Apr/2024:10:26:54] ENGINE Bus STARTED 2024-04-23T10:26:55.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:54 smithi167 ceph-mon[32940]: mgrmap e21: x(active, since 1.01968s), standbys: y, z 2024-04-23T10:26:55.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:54 smithi146 ceph-mon[32800]: [23/Apr/2024:10:26:53] ENGINE Bus STARTING 2024-04-23T10:26:55.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:54 smithi146 ceph-mon[32800]: [23/Apr/2024:10:26:53] ENGINE Serving on https://172.21.15.69:7150 2024-04-23T10:26:55.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:54 smithi146 ceph-mon[32800]: [23/Apr/2024:10:26:54] ENGINE Serving on http://172.21.15.69:8765 2024-04-23T10:26:55.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:54 smithi146 ceph-mon[32800]: [23/Apr/2024:10:26:54] ENGINE Bus STARTED 2024-04-23T10:26:55.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:54 smithi146 ceph-mon[32800]: mgrmap e21: x(active, since 1.01968s), standbys: y, z 2024-04-23T10:26:55.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.516+0000 7f02a5707640 1 -- 172.21.15.69:0/3232260458 --> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f02a0062390 con 0x7f028c0a3a60 2024-04-23T10:26:55.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.523+0000 7f0297fff640 1 -- 172.21.15.69:0/3232260458 <== mgr.24836 v2:172.21.15.69:6800/908508073 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f02a0062390 con 0x7f028c0a3a60 2024-04-23T10:26:55.522 INFO:teuthology.orchestra.run.smithi069.stdout:/ 1m 6m3h 2024-04-23T10:26:55.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.525+0000 7f02a5707640 1 -- 172.21.15.69:0/3232260458 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f028c0a3a60 msgr2=0x7f028c0a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:55.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.525+0000 7f02a5707640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f028c0a3a60 0x7f028c0a5f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f02a0199770 tx=0x7f0288005f90 comp rx=0 tx=0).stop 2024-04-23T10:26:55.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.525+0000 7f02a5707640 1 -- 172.21.15.69:0/3232260458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02a0102a30 msgr2=0x7f02a0198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:55.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.525+0000 7f02a5707640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02a0102a30 0x7f02a0198260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0290005940 tx=0x7f02900042f0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.525+0000 7f02a5707640 1 -- 172.21.15.69:0/3232260458 shutdown_connections 2024-04-23T10:26:55.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.526+0000 7f02a5707640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f028c0a3a60 0x7f028c0a5f20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.526+0000 7f02a5707640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02a0107c90 0x7f02a019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.526+0000 7f02a5707640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02a0105360 0x7f02a01987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.526+0000 7f02a5707640 1 --2- 172.21.15.69:0/3232260458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02a0102a30 0x7f02a0198260 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.526+0000 7f02a5707640 1 -- 172.21.15.69:0/3232260458 >> 172.21.15.69:0/3232260458 conn(0x7f02a00fc420 msgr2=0x7f02a0103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:55.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.526+0000 7f02a5707640 1 -- 172.21.15.69:0/3232260458 shutdown_connections 2024-04-23T10:26:55.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.526+0000 7f02a5707640 1 -- 172.21.15.69:0/3232260458 wait complete. 2024-04-23T10:26:55.535 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-23T10:26:55.560 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-23T10:26:55.569 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-23T10:26:55.652 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-04-23T10:26:55.652 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-23T10:26:55.654 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-23T10:26:55.710 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:26:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.812+0000 7f2c8acd0640 1 -- 172.21.15.69:0/3870110004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c841029a0 msgr2=0x7f2c841092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.812+0000 7f2c8acd0640 1 --2- 172.21.15.69:0/3870110004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c841029a0 0x7f2c841092c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009ca0 tx=0x7f2c7c02a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.812+0000 7f2c8acd0640 1 -- 172.21.15.69:0/3870110004 shutdown_connections 2024-04-23T10:26:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.812+0000 7f2c8acd0640 1 --2- 172.21.15.69:0/3870110004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c841029a0 0x7f2c841092c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.812+0000 7f2c8acd0640 1 --2- 172.21.15.69:0/3870110004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c84101fe0 0x7f2c84102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.812+0000 7f2c8acd0640 1 --2- 172.21.15.69:0/3870110004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c84100e90 0x7f2c841012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.812+0000 7f2c8acd0640 1 -- 172.21.15.69:0/3870110004 >> 172.21.15.69:0/3870110004 conn(0x7f2c840fc400 msgr2=0x7f2c840fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.812+0000 7f2c8acd0640 1 -- 172.21.15.69:0/3870110004 shutdown_connections 2024-04-23T10:26:55.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.812+0000 7f2c8acd0640 1 -- 172.21.15.69:0/3870110004 wait complete. 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c8acd0640 1 Processor -- start 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c8acd0640 1 -- start start 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c8acd0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c84100e90 0x7f2c84197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c8acd0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c84101fe0 0x7f2c84197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c8acd0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c841029a0 0x7f2c8419e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c8acd0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8410cb20 con 0x7f2c84100e90 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c8acd0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8410c9a0 con 0x7f2c84101fe0 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c8acd0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8410cca0 con 0x7f2c841029a0 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c88a6c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c84100e90 0x7f2c84197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c88a6c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c84100e90 0x7f2c84197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38460/0 (socket says 172.21.15.69:38460) 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c88a6c640 1 -- 172.21.15.69:0/2032782500 learned_addr learned my addr 172.21.15.69:0/2032782500 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c8926d640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c841029a0 0x7f2c8419e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c83fff640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c84101fe0 0x7f2c84197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c88a6c640 1 -- 172.21.15.69:0/2032782500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c841029a0 msgr2=0x7f2c8419e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c88a6c640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c841029a0 0x7f2c8419e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c88a6c640 1 -- 172.21.15.69:0/2032782500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c84101fe0 msgr2=0x7f2c84197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c88a6c640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c84101fe0 0x7f2c84197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c88a6c640 1 -- 172.21.15.69:0/2032782500 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8419ed20 con 0x7f2c84100e90 2024-04-23T10:26:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.813+0000 7f2c88a6c640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c84100e90 0x7f2c84197100 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800d950 tx=0x7f2c7800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.814+0000 7f2c81ffb640 1 -- 172.21.15.69:0/2032782500 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78017030 con 0x7f2c84100e90 2024-04-23T10:26:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.814+0000 7f2c81ffb640 1 -- 172.21.15.69:0/2032782500 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c78004020 con 0x7f2c84100e90 2024-04-23T10:26:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.814+0000 7f2c8acd0640 1 -- 172.21.15.69:0/2032782500 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8419efb0 con 0x7f2c84100e90 2024-04-23T10:26:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.814+0000 7f2c81ffb640 1 -- 172.21.15.69:0/2032782500 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c780047a0 con 0x7f2c84100e90 2024-04-23T10:26:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.814+0000 7f2c8acd0640 1 -- 172.21.15.69:0/2032782500 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8419f470 con 0x7f2c84100e90 2024-04-23T10:26:55.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.815+0000 7f2c8acd0640 1 -- 172.21.15.69:0/2032782500 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c84108140 con 0x7f2c84100e90 2024-04-23T10:26:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.816+0000 7f2c81ffb640 1 -- 172.21.15.69:0/2032782500 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f2c780041d0 con 0x7f2c84100e90 2024-04-23T10:26:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.816+0000 7f2c81ffb640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2c740a39b0 0x7f2c740a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.817+0000 7f2c83fff640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2c740a39b0 0x7f2c740a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.817+0000 7f2c81ffb640 1 -- 172.21.15.69:0/2032782500 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f2c780cfb00 con 0x7f2c84100e90 2024-04-23T10:26:55.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.817+0000 7f2c83fff640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2c740a39b0 0x7f2c740a5e70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c84198610 tx=0x7f2c70005f90 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:55.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.821+0000 7f2c81ffb640 1 -- 172.21.15.69:0/2032782500 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2c7809c6e0 con 0x7f2c84100e90 2024-04-23T10:26:55.962 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:55 smithi069 ceph-mon[29593]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:55.962 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:55 smithi069 ceph-mon[29593]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:26:55.963 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:55 smithi069 ceph-mon[29593]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:55.963 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:55 smithi069 ceph-mon[29593]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:55.963 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:55 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:55.963 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:55 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:55.963 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:55 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:55.963 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:55 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:55.963 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:55 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:55.963 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:55 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:55.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:55.987+0000 7f2c81ffb640 1 -- 172.21.15.69:0/2032782500 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 22) ==== 138766+0+0 (secure 0 0 0) 0x7f2c78098650 con 0x7f2c84100e90 2024-04-23T10:26:56.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.018+0000 7f2c8acd0640 1 -- 172.21.15.69:0/2032782500 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c84062b50 con 0x7f2c84100e90 2024-04-23T10:26:56.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.019+0000 7f2c81ffb640 1 -- 172.21.15.69:0/2032782500 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22971 (secure 0 0 0) 0x7f2c780578d0 con 0x7f2c84100e90 2024-04-23T10:26:56.018 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:56.018 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":89,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:26:53.261556+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/2621408239":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1024244898":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1462548780":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6800/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3272003821":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:26:56.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 -- 172.21.15.69:0/2032782500 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2c740a39b0 msgr2=0x7f2c740a5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2c740a39b0 0x7f2c740a5e70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c84198610 tx=0x7f2c70005f90 comp rx=0 tx=0).stop 2024-04-23T10:26:56.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 -- 172.21.15.69:0/2032782500 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c84100e90 msgr2=0x7f2c84197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c84100e90 0x7f2c84197100 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800d950 tx=0x7f2c7800de10 comp rx=0 tx=0).stop 2024-04-23T10:26:56.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 -- 172.21.15.69:0/2032782500 shutdown_connections 2024-04-23T10:26:56.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2c740a39b0 0x7f2c740a5e70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c841029a0 0x7f2c8419e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c84101fe0 0x7f2c84197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 --2- 172.21.15.69:0/2032782500 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c84100e90 0x7f2c84197100 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 -- 172.21.15.69:0/2032782500 >> 172.21.15.69:0/2032782500 conn(0x7f2c840fc400 msgr2=0x7f2c84105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:56.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 -- 172.21.15.69:0/2032782500 shutdown_connections 2024-04-23T10:26:56.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.021+0000 7f2c8acd0640 1 -- 172.21.15.69:0/2032782500 wait complete. 2024-04-23T10:26:56.031 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:24:50.484063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:24:51.816315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:26:56.032 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:26:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.137+0000 7f6697efa640 1 -- 172.21.15.69:0/2904762004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690103b50 msgr2=0x7f669010a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.137+0000 7f6697efa640 1 --2- 172.21.15.69:0/2904762004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690103b50 0x7f669010a3e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6688009ca0 tx=0x7f668802a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.137+0000 7f6697efa640 1 -- 172.21.15.69:0/2904762004 shutdown_connections 2024-04-23T10:26:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.137+0000 7f6697efa640 1 --2- 172.21.15.69:0/2904762004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690103b50 0x7f669010a3e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.137+0000 7f6697efa640 1 --2- 172.21.15.69:0/2904762004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690103190 0x7f6690103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.137+0000 7f6697efa640 1 --2- 172.21.15.69:0/2904762004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6690101fa0 0x7f66901023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.137+0000 7f6697efa640 1 -- 172.21.15.69:0/2904762004 >> 172.21.15.69:0/2904762004 conn(0x7f66900fd530 msgr2=0x7f66900ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.137+0000 7f6697efa640 1 -- 172.21.15.69:0/2904762004 shutdown_connections 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.137+0000 7f6697efa640 1 -- 172.21.15.69:0/2904762004 wait complete. 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.137+0000 7f6697efa640 1 Processor -- start 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6697efa640 1 -- start start 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6697efa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6690101fa0 0x7f6690198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6697efa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690103190 0x7f66901987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6697efa640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690103b50 0x7f669019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6697efa640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f669010dc00 con 0x7f6690103b50 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6697efa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f669010da80 con 0x7f6690103190 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6697efa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f669010dd80 con 0x7f6690101fa0 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6696497640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690103b50 0x7f669019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6696497640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690103b50 0x7f669019f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38476/0 (socket says 172.21.15.69:38476) 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6695c96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6690101fa0 0x7f6690198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6696497640 1 -- 172.21.15.69:0/3051788484 learned_addr learned my addr 172.21.15.69:0/3051788484 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:56.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6695495640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690103190 0x7f66901987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6696497640 1 -- 172.21.15.69:0/3051788484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6690101fa0 msgr2=0x7f6690198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6696497640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6690101fa0 0x7f6690198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6696497640 1 -- 172.21.15.69:0/3051788484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690103190 msgr2=0x7f66901987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6696497640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690103190 0x7f66901987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6696497640 1 -- 172.21.15.69:0/3051788484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669019fe90 con 0x7f6690103b50 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6695c96640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6690101fa0 0x7f6690198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.138+0000 7f6696497640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690103b50 0x7f669019f820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6688009dc0 tx=0x7f6688031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.139+0000 7f6686ffd640 1 -- 172.21.15.69:0/3051788484 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688003bf0 con 0x7f6690103b50 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.139+0000 7f6686ffd640 1 -- 172.21.15.69:0/3051788484 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6688003d90 con 0x7f6690103b50 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.139+0000 7f6697efa640 1 -- 172.21.15.69:0/3051788484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6690074180 con 0x7f6690103b50 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.139+0000 7f6686ffd640 1 -- 172.21.15.69:0/3051788484 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668802fce0 con 0x7f6690103b50 2024-04-23T10:26:56.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.139+0000 7f6697efa640 1 -- 172.21.15.69:0/3051788484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66900746d0 con 0x7f6690103b50 2024-04-23T10:26:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.140+0000 7f6697efa640 1 -- 172.21.15.69:0/3051788484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6690109340 con 0x7f6690103b50 2024-04-23T10:26:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.141+0000 7f6686ffd640 1 -- 172.21.15.69:0/3051788484 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 22) ==== 138766+0+0 (secure 0 0 0) 0x7f6688004040 con 0x7f6690103b50 2024-04-23T10:26:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.141+0000 7f6686ffd640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f667c0a3d20 0x7f667c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.141+0000 7f6695c96640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f667c0a3d20 0x7f667c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.142+0000 7f6686ffd640 1 -- 172.21.15.69:0/3051788484 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f66880f1c70 con 0x7f6690103b50 2024-04-23T10:26:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.142+0000 7f6695c96640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f667c0a3d20 0x7f667c0a61e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6690102ff0 tx=0x7f6680012040 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.147+0000 7f6686ffd640 1 -- 172.21.15.69:0/3051788484 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f66880be480 con 0x7f6690103b50 2024-04-23T10:26:56.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:55 smithi167 ceph-mon[32940]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:56.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:55 smithi167 ceph-mon[32940]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:26:56.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:55 smithi167 ceph-mon[32940]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:55 smithi167 ceph-mon[32940]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:55 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:55 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:55 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:55 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:55 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:55 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.334+0000 7f6697efa640 1 -- 172.21.15.69:0/3051788484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6690075ab0 con 0x7f6690103b50 2024-04-23T10:26:56.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.335+0000 7f6686ffd640 1 -- 172.21.15.69:0/3051788484 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f66880bdd80 con 0x7f6690103b50 2024-04-23T10:26:56.334 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:26:56.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 -- 172.21.15.69:0/3051788484 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f667c0a3d20 msgr2=0x7f667c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f667c0a3d20 0x7f667c0a61e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6690102ff0 tx=0x7f6680012040 comp rx=0 tx=0).stop 2024-04-23T10:26:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 -- 172.21.15.69:0/3051788484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690103b50 msgr2=0x7f669019f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690103b50 0x7f669019f820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6688009dc0 tx=0x7f6688031840 comp rx=0 tx=0).stop 2024-04-23T10:26:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 -- 172.21.15.69:0/3051788484 shutdown_connections 2024-04-23T10:26:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f667c0a3d20 0x7f667c0a61e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690103b50 0x7f669019f820 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690103190 0x7f66901987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 --2- 172.21.15.69:0/3051788484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6690101fa0 0x7f6690198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 -- 172.21.15.69:0/3051788484 >> 172.21.15.69:0/3051788484 conn(0x7f66900fd530 msgr2=0x7f6690106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 -- 172.21.15.69:0/3051788484 shutdown_connections 2024-04-23T10:26:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.337+0000 7f6697efa640 1 -- 172.21.15.69:0/3051788484 wait complete. 2024-04-23T10:26:56.348 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:26:56.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:55 smithi146 ceph-mon[32800]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:56.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:55 smithi146 ceph-mon[32800]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:26:56.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:55 smithi146 ceph-mon[32800]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:56.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:55 smithi146 ceph-mon[32800]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:56.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:55 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:55 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:55 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:55 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:55 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:55 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.452+0000 7f1aead76640 1 -- 172.21.15.69:0/962608277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ae4100e70 msgr2=0x7f1ae4101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.452+0000 7f1aead76640 1 --2- 172.21.15.69:0/962608277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ae4100e70 0x7f1ae4101290 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009900 tx=0x7f1ad802a410 comp rx=0 tx=0).stop 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.452+0000 7f1aead76640 1 -- 172.21.15.69:0/962608277 shutdown_connections 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.452+0000 7f1aead76640 1 --2- 172.21.15.69:0/962608277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ae4102980 0x7f1ae41092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.452+0000 7f1aead76640 1 --2- 172.21.15.69:0/962608277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4101fc0 0x7f1ae4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.452+0000 7f1aead76640 1 --2- 172.21.15.69:0/962608277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ae4100e70 0x7f1ae4101290 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.452+0000 7f1aead76640 1 -- 172.21.15.69:0/962608277 >> 172.21.15.69:0/962608277 conn(0x7f1ae40fc3e0 msgr2=0x7f1ae40fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.452+0000 7f1aead76640 1 -- 172.21.15.69:0/962608277 shutdown_connections 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.452+0000 7f1aead76640 1 -- 172.21.15.69:0/962608277 wait complete. 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1aead76640 1 Processor -- start 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1aead76640 1 -- start start 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1aead76640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4100e70 0x7f1ae4069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1aead76640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ae4101fc0 0x7f1ae419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1aead76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ae4102980 0x7f1ae41a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1aead76640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae410cb10 con 0x7f1ae4101fc0 2024-04-23T10:26:56.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1aead76640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae410c990 con 0x7f1ae4100e70 2024-04-23T10:26:56.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1aead76640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae410cc90 con 0x7f1ae4102980 2024-04-23T10:26:56.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae3fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ae4101fc0 0x7f1ae419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae3fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ae4101fc0 0x7f1ae419f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38496/0 (socket says 172.21.15.69:38496) 2024-04-23T10:26:56.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae3fff640 1 -- 172.21.15.69:0/1119706719 learned_addr learned my addr 172.21.15.69:0/1119706719 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:56.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae8b12640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4100e70 0x7f1ae4069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae9313640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ae4102980 0x7f1ae41a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae3fff640 1 -- 172.21.15.69:0/1119706719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ae4102980 msgr2=0x7f1ae41a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae3fff640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ae4102980 0x7f1ae41a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae3fff640 1 -- 172.21.15.69:0/1119706719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4100e70 msgr2=0x7f1ae4069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae3fff640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4100e70 0x7f1ae4069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae3fff640 1 -- 172.21.15.69:0/1119706719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae41a2110 con 0x7f1ae4101fc0 2024-04-23T10:26:56.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae3fff640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ae4101fc0 0x7f1ae419f3d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000e9c0 tx=0x7f1ad000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:56.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.453+0000 7f1ae1ffb640 1 -- 172.21.15.69:0/1119706719 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000cd80 con 0x7f1ae4101fc0 2024-04-23T10:26:56.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.454+0000 7f1ae1ffb640 1 -- 172.21.15.69:0/1119706719 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1ad00035f0 con 0x7f1ae4101fc0 2024-04-23T10:26:56.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.454+0000 7f1aead76640 1 -- 172.21.15.69:0/1119706719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae41a23a0 con 0x7f1ae4101fc0 2024-04-23T10:26:56.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.454+0000 7f1ae1ffb640 1 -- 172.21.15.69:0/1119706719 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0010690 con 0x7f1ae4101fc0 2024-04-23T10:26:56.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.454+0000 7f1aead76640 1 -- 172.21.15.69:0/1119706719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae41a28f0 con 0x7f1ae4101fc0 2024-04-23T10:26:56.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.455+0000 7f1aead76640 1 -- 172.21.15.69:0/1119706719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae4108180 con 0x7f1ae4101fc0 2024-04-23T10:26:56.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.456+0000 7f1ae1ffb640 1 -- 172.21.15.69:0/1119706719 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 22) ==== 138766+0+0 (secure 0 0 0) 0x7f1ad00037a0 con 0x7f1ae4101fc0 2024-04-23T10:26:56.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.456+0000 7f1ae1ffb640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1ad40a3d50 0x7f1ad40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.457+0000 7f1ae8b12640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1ad40a3d50 0x7f1ad40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.457+0000 7f1ae1ffb640 1 -- 172.21.15.69:0/1119706719 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f1ad00d0b80 con 0x7f1ae4101fc0 2024-04-23T10:26:56.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.457+0000 7f1ae8b12640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1ad40a3d50 0x7f1ad40a6210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8000c00 tx=0x7f1ad8031510 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:56.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.461+0000 7f1ae1ffb640 1 -- 172.21.15.69:0/1119706719 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1ad009d250 con 0x7f1ae4101fc0 2024-04-23T10:26:56.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.658+0000 7f1aead76640 1 -- 172.21.15.69:0/1119706719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1ae402d810 con 0x7f1ae4101fc0 2024-04-23T10:26:56.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.658+0000 7f1ae1ffb640 1 -- 172.21.15.69:0/1119706719 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f1ad009cb50 con 0x7f1ae4101fc0 2024-04-23T10:26:56.658 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-04-23T10:26:56.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 -- 172.21.15.69:0/1119706719 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1ad40a3d50 msgr2=0x7f1ad40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1ad40a3d50 0x7f1ad40a6210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8000c00 tx=0x7f1ad8031510 comp rx=0 tx=0).stop 2024-04-23T10:26:56.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 -- 172.21.15.69:0/1119706719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ae4101fc0 msgr2=0x7f1ae419f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ae4101fc0 0x7f1ae419f3d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000e9c0 tx=0x7f1ad000ee80 comp rx=0 tx=0).stop 2024-04-23T10:26:56.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 -- 172.21.15.69:0/1119706719 shutdown_connections 2024-04-23T10:26:56.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1ad40a3d50 0x7f1ad40a6210 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ae4101fc0 0x7f1ae419f3d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ae4102980 0x7f1ae41a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 --2- 172.21.15.69:0/1119706719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae4100e70 0x7f1ae4069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 -- 172.21.15.69:0/1119706719 >> 172.21.15.69:0/1119706719 conn(0x7f1ae40fc3e0 msgr2=0x7f1ae4105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:56.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 -- 172.21.15.69:0/1119706719 shutdown_connections 2024-04-23T10:26:56.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.661+0000 7f1aead76640 1 -- 172.21.15.69:0/1119706719 wait complete. 2024-04-23T10:26:56.675 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:26:56.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.780+0000 7f99ac835640 1 -- 172.21.15.69:0/2391356192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99a8102a10 msgr2=0x7f99a8104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.780+0000 7f99ac835640 1 --2- 172.21.15.69:0/2391356192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99a8102a10 0x7f99a8104e00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9998009900 tx=0x7f999802a410 comp rx=0 tx=0).stop 2024-04-23T10:26:56.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.780+0000 7f99ac835640 1 -- 172.21.15.69:0/2391356192 shutdown_connections 2024-04-23T10:26:56.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.780+0000 7f99ac835640 1 --2- 172.21.15.69:0/2391356192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99a8107c70 0x7f99a810a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.780+0000 7f99ac835640 1 --2- 172.21.15.69:0/2391356192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99a8105340 0x7f99a8107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.780+0000 7f99ac835640 1 --2- 172.21.15.69:0/2391356192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99a8102a10 0x7f99a8104e00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.780+0000 7f99ac835640 1 -- 172.21.15.69:0/2391356192 >> 172.21.15.69:0/2391356192 conn(0x7f99a80fc400 msgr2=0x7f99a80fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:56.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.780+0000 7f99ac835640 1 -- 172.21.15.69:0/2391356192 shutdown_connections 2024-04-23T10:26:56.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.780+0000 7f99ac835640 1 -- 172.21.15.69:0/2391356192 wait complete. 2024-04-23T10:26:56.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99ac835640 1 Processor -- start 2024-04-23T10:26:56.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99ac835640 1 -- start start 2024-04-23T10:26:56.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99ac835640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99a8102a10 0x7f99a8102380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99ac835640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99a8105340 0x7f99a81009c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99ac835640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99a8107c70 0x7f99a8100f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99ac835640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f99a810dc50 con 0x7f99a8107c70 2024-04-23T10:26:56.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99ac835640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f99a810dad0 con 0x7f99a8102a10 2024-04-23T10:26:56.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99ac835640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f99a810ddd0 con 0x7f99a8105340 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99a6d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99a8107c70 0x7f99a8100f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99a6d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99a8107c70 0x7f99a8100f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38526/0 (socket says 172.21.15.69:38526) 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99a6d9d640 1 -- 172.21.15.69:0/1347737540 learned_addr learned my addr 172.21.15.69:0/1347737540 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99a5d9b640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99a8105340 0x7f99a81009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99a659c640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99a8102a10 0x7f99a8102380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99a6d9d640 1 -- 172.21.15.69:0/1347737540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99a8105340 msgr2=0x7f99a81009c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99a6d9d640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99a8105340 0x7f99a81009c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99a6d9d640 1 -- 172.21.15.69:0/1347737540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99a8102a10 msgr2=0x7f99a8102380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99a6d9d640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99a8102a10 0x7f99a8102380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99a6d9d640 1 -- 172.21.15.69:0/1347737540 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a8101790 con 0x7f99a8107c70 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.781+0000 7f99a659c640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99a8102a10 0x7f99a8102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.782+0000 7f99a6d9d640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99a8107c70 0x7f99a8100f00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009fd0 tx=0x7f99a000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.782+0000 7f99977fe640 1 -- 172.21.15.69:0/1347737540 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0017070 con 0x7f99a8107c70 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.782+0000 7f99ac835640 1 -- 172.21.15.69:0/1347737540 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a81a2450 con 0x7f99a8107c70 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.782+0000 7f99977fe640 1 -- 172.21.15.69:0/1347737540 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f99a0003e40 con 0x7f99a8107c70 2024-04-23T10:26:56.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.782+0000 7f99977fe640 1 -- 172.21.15.69:0/1347737540 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a00106c0 con 0x7f99a8107c70 2024-04-23T10:26:56.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.782+0000 7f99ac835640 1 -- 172.21.15.69:0/1347737540 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a81a29a0 con 0x7f99a8107c70 2024-04-23T10:26:56.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.783+0000 7f99ac835640 1 -- 172.21.15.69:0/1347737540 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a80fdef0 con 0x7f99a8107c70 2024-04-23T10:26:56.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.784+0000 7f99977fe640 1 -- 172.21.15.69:0/1347737540 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 22) ==== 138766+0+0 (secure 0 0 0) 0x7f99a0003970 con 0x7f99a8107c70 2024-04-23T10:26:56.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.784+0000 7f99977fe640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f99900a3d20 0x7f99900a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:56.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.785+0000 7f99a659c640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f99900a3d20 0x7f99900a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:56.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.785+0000 7f99977fe640 1 -- 172.21.15.69:0/1347737540 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f99a00d04c0 con 0x7f99a8107c70 2024-04-23T10:26:56.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.785+0000 7f99a659c640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f99900a3d20 0x7f99900a61e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9998000c00 tx=0x7f9998031530 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:56.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.789+0000 7f99977fe640 1 -- 172.21.15.69:0/1347737540 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f99a0003c60 con 0x7f99a8107c70 2024-04-23T10:26:56.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.994+0000 7f99ac835640 1 -- 172.21.15.69:0/1347737540 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f99a8062b50 con 0x7f99a8107c70 2024-04-23T10:26:56.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.995+0000 7f99977fe640 1 -- 172.21.15.69:0/1347737540 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f99a009cb90 con 0x7f99a8107c70 2024-04-23T10:26:56.994 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 -- 172.21.15.69:0/1347737540 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f99900a3d20 msgr2=0x7f99900a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f99900a3d20 0x7f99900a61e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9998000c00 tx=0x7f9998031530 comp rx=0 tx=0).stop 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 -- 172.21.15.69:0/1347737540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99a8107c70 msgr2=0x7f99a8100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99a8107c70 0x7f99a8100f00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009fd0 tx=0x7f99a000b260 comp rx=0 tx=0).stop 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 -- 172.21.15.69:0/1347737540 shutdown_connections 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f99900a3d20 0x7f99900a61e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99a8107c70 0x7f99a8100f00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99a8105340 0x7f99a81009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 --2- 172.21.15.69:0/1347737540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99a8102a10 0x7f99a8102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 -- 172.21.15.69:0/1347737540 >> 172.21.15.69:0/1347737540 conn(0x7f99a80fc400 msgr2=0x7f99a8103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 -- 172.21.15.69:0/1347737540 shutdown_connections 2024-04-23T10:26:56.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:56.997+0000 7f99ac835640 1 -- 172.21.15.69:0/1347737540 wait complete. 2024-04-23T10:26:57.007 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:26:57.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.109+0000 7fd51324e640 1 -- 172.21.15.69:0/2396471878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd50c105340 msgr2=0x7fd50c107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.109+0000 7fd51324e640 1 --2- 172.21.15.69:0/2396471878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd50c105340 0x7fd50c107730 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009900 tx=0x7fd4f802a410 comp rx=0 tx=0).stop 2024-04-23T10:26:57.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.109+0000 7fd51324e640 1 -- 172.21.15.69:0/2396471878 shutdown_connections 2024-04-23T10:26:57.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.109+0000 7fd51324e640 1 --2- 172.21.15.69:0/2396471878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd50c105340 0x7fd50c107730 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.109+0000 7fd51324e640 1 --2- 172.21.15.69:0/2396471878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd50c107c70 0x7fd50c10a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.109+0000 7fd51324e640 1 --2- 172.21.15.69:0/2396471878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c102a10 0x7fd50c104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.109+0000 7fd51324e640 1 -- 172.21.15.69:0/2396471878 >> 172.21.15.69:0/2396471878 conn(0x7fd50c0fc400 msgr2=0x7fd50c0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.109+0000 7fd51324e640 1 -- 172.21.15.69:0/2396471878 shutdown_connections 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.109+0000 7fd51324e640 1 -- 172.21.15.69:0/2396471878 wait complete. 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd51324e640 1 Processor -- start 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd51324e640 1 -- start start 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd51324e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd50c102a10 0x7fd50c1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd51324e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c105340 0x7fd50c198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd51324e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd50c107c70 0x7fd50c19f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd51324e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c10dc40 con 0x7fd50c102a10 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd51324e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c10dac0 con 0x7fd50c105340 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd51324e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c10ddc0 con 0x7fd50c107c70 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd510fea640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd50c102a10 0x7fd50c1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd50bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c105340 0x7fd50c198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd510fea640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd50c102a10 0x7fd50c1982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38536/0 (socket says 172.21.15.69:38536) 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd50bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c105340 0x7fd50c198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.69:40772/0 (socket says 172.21.15.69:40772) 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd510fea640 1 -- 172.21.15.69:0/2091422362 learned_addr learned my addr 172.21.15.69:0/2091422362 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd5117eb640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd50c107c70 0x7fd50c19f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd510fea640 1 -- 172.21.15.69:0/2091422362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd50c107c70 msgr2=0x7fd50c19f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd510fea640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd50c107c70 0x7fd50c19f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd510fea640 1 -- 172.21.15.69:0/2091422362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c105340 msgr2=0x7fd50c198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd510fea640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c105340 0x7fd50c198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd510fea640 1 -- 172.21.15.69:0/2091422362 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c19fee0 con 0x7fd50c102a10 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd50bfff640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c105340 0x7fd50c198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.110+0000 7fd510fea640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd50c102a10 0x7fd50c1982c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd50000ea60 tx=0x7fd50000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.111+0000 7fd509ffb640 1 -- 172.21.15.69:0/2091422362 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50000cde0 con 0x7fd50c102a10 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.111+0000 7fd51324e640 1 -- 172.21.15.69:0/2091422362 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50c1a01d0 con 0x7fd50c102a10 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.111+0000 7fd509ffb640 1 -- 172.21.15.69:0/2091422362 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd5000035f0 con 0x7fd50c102a10 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.111+0000 7fd509ffb640 1 -- 172.21.15.69:0/2091422362 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500010690 con 0x7fd50c102a10 2024-04-23T10:26:57.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.111+0000 7fd51324e640 1 -- 172.21.15.69:0/2091422362 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50c1a06f0 con 0x7fd50c102a10 2024-04-23T10:26:57.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.112+0000 7fd51324e640 1 -- 172.21.15.69:0/2091422362 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50c0fdef0 con 0x7fd50c102a10 2024-04-23T10:26:57.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.113+0000 7fd509ffb640 1 -- 172.21.15.69:0/2091422362 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 22) ==== 138766+0+0 (secure 0 0 0) 0x7fd5000037a0 con 0x7fd50c102a10 2024-04-23T10:26:57.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.114+0000 7fd509ffb640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd4fc0a3d20 0x7fd4fc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.114+0000 7fd50bfff640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd4fc0a3d20 0x7fd4fc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.114+0000 7fd509ffb640 1 -- 172.21.15.69:0/2091422362 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fd5000d0a60 con 0x7fd50c102a10 2024-04-23T10:26:57.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.114+0000 7fd50bfff640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd4fc0a3d20 0x7fd4fc0a61e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8005ab0 tx=0x7fd4f8005a20 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.119+0000 7fd509ffb640 1 -- 172.21.15.69:0/2091422362 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd50009d130 con 0x7fd50c102a10 2024-04-23T10:26:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:26:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-04-23T10:26:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2032782500' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3051788484' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:26:57.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:26:57.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:56 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1119706719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:57.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.316+0000 7fd51324e640 1 -- 172.21.15.69:0/2091422362 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd50c02d5c0 con 0x7fd50c102a10 2024-04-23T10:26:57.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.317+0000 7fd509ffb640 1 -- 172.21.15.69:0/2091422362 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22971 (secure 0 0 0) 0x7fd50009ca30 con 0x7fd50c102a10 2024-04-23T10:26:57.317 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:57.317 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":89,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:26:53.261556+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/2621408239":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1024244898":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1462548780":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6800/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3272003821":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 -- 172.21.15.69:0/2091422362 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd4fc0a3d20 msgr2=0x7fd4fc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd4fc0a3d20 0x7fd4fc0a61e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8005ab0 tx=0x7fd4f8005a20 comp rx=0 tx=0).stop 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 -- 172.21.15.69:0/2091422362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd50c102a10 msgr2=0x7fd50c1982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd50c102a10 0x7fd50c1982c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd50000ea60 tx=0x7fd50000ef20 comp rx=0 tx=0).stop 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 -- 172.21.15.69:0/2091422362 shutdown_connections 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd4fc0a3d20 0x7fd4fc0a61e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd50c107c70 0x7fd50c19f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c105340 0x7fd50c198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 --2- 172.21.15.69:0/2091422362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd50c102a10 0x7fd50c1982c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 -- 172.21.15.69:0/2091422362 >> 172.21.15.69:0/2091422362 conn(0x7fd50c0fc400 msgr2=0x7fd50c103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 -- 172.21.15.69:0/2091422362 shutdown_connections 2024-04-23T10:26:57.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.320+0000 7fd51324e640 1 -- 172.21.15.69:0/2091422362 wait complete. 2024-04-23T10:26:57.331 INFO:tasks.quiescer.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:24:50.484063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:24:51.816315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:26:57.331 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:26:57.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:26:57.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:57.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2032782500' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3051788484' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:26:57.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:26:57.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:56 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1119706719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2032782500' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3051788484' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:26:57.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:56 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1119706719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:57.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.437+0000 7f19b8664640 1 -- 172.21.15.69:0/3587614128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0101a40 msgr2=0x7f19b0105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.437+0000 7f19b8664640 1 --2- 172.21.15.69:0/3587614128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0101a40 0x7f19b0105a80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009900 tx=0x7f19a002a410 comp rx=0 tx=0).stop 2024-04-23T10:26:57.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.437+0000 7f19b8664640 1 -- 172.21.15.69:0/3587614128 shutdown_connections 2024-04-23T10:26:57.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.437+0000 7f19b8664640 1 --2- 172.21.15.69:0/3587614128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b0106160 0x7f19b010dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.437+0000 7f19b8664640 1 --2- 172.21.15.69:0/3587614128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0101a40 0x7f19b0105a80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.437+0000 7f19b8664640 1 --2- 172.21.15.69:0/3587614128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0101090 0x7f19b0101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.437+0000 7f19b8664640 1 -- 172.21.15.69:0/3587614128 >> 172.21.15.69:0/3587614128 conn(0x7f19b0077f50 msgr2=0x7f19b0078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:57.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.437+0000 7f19b8664640 1 -- 172.21.15.69:0/3587614128 shutdown_connections 2024-04-23T10:26:57.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.437+0000 7f19b8664640 1 -- 172.21.15.69:0/3587614128 wait complete. 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b8664640 1 Processor -- start 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b8664640 1 -- start start 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b8664640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0101090 0x7f19b019e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b8664640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b0106160 0x7f19b019eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b8664640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0198640 0x7f19b0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b8664640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0112300 con 0x7f19b0106160 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b8664640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0112180 con 0x7f19b0101090 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b8664640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0112480 con 0x7f19b0198640 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b5bff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b0106160 0x7f19b019eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b6400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0101090 0x7f19b019e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b6400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0101090 0x7f19b019e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.69:40786/0 (socket says 172.21.15.69:40786) 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b5bff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b0106160 0x7f19b019eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38540/0 (socket says 172.21.15.69:38540) 2024-04-23T10:26:57.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b6400640 1 -- 172.21.15.69:0/1738722859 learned_addr learned my addr 172.21.15.69:0/1738722859 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.438+0000 7f19b6c01640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0198640 0x7f19b0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19b6400640 1 -- 172.21.15.69:0/1738722859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0198640 msgr2=0x7f19b0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19b6400640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0198640 0x7f19b0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19b6400640 1 -- 172.21.15.69:0/1738722859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b0106160 msgr2=0x7f19b019eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19b6400640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b0106160 0x7f19b019eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19b6400640 1 -- 172.21.15.69:0/1738722859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b0199240 con 0x7f19b0101090 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19b6c01640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0198640 0x7f19b0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19b6400640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0101090 0x7f19b019e580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e9f0 tx=0x7f19ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19a77fe640 1 -- 172.21.15.69:0/1738722859 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac00cd80 con 0x7f19b0101090 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19b8664640 1 -- 172.21.15.69:0/1738722859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b01a5320 con 0x7f19b0101090 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19a77fe640 1 -- 172.21.15.69:0/1738722859 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f19ac010900 con 0x7f19b0101090 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19a77fe640 1 -- 172.21.15.69:0/1738722859 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0188d0 con 0x7f19b0101090 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.439+0000 7f19b8664640 1 -- 172.21.15.69:0/1738722859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b01a56d0 con 0x7f19b0101090 2024-04-23T10:26:57.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.440+0000 7f19b8664640 1 -- 172.21.15.69:0/1738722859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b0102560 con 0x7f19b0101090 2024-04-23T10:26:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.441+0000 7f19a77fe640 1 -- 172.21.15.69:0/1738722859 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 22) ==== 138766+0+0 (secure 0 0 0) 0x7f19ac010ab0 con 0x7f19b0101090 2024-04-23T10:26:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.442+0000 7f19a77fe640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f199c0a3d20 0x7f199c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.442+0000 7f19b5bff640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f199c0a3d20 0x7f199c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.442+0000 7f19a77fe640 1 -- 172.21.15.69:0/1738722859 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f19ac0d0bd0 con 0x7f19b0101090 2024-04-23T10:26:57.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.442+0000 7f19b5bff640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f199c0a3d20 0x7f199c0a61e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f19a00314b0 tx=0x7f19a00058d0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.446+0000 7f19a77fe640 1 -- 172.21.15.69:0/1738722859 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f19ac09cbf0 con 0x7f19b0101090 2024-04-23T10:26:57.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.636+0000 7f19b8664640 1 -- 172.21.15.69:0/1738722859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f19b01093f0 con 0x7f19b0101090 2024-04-23T10:26:57.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.636+0000 7f19a77fe640 1 -- 172.21.15.69:0/1738722859 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f19ac0a0ef0 con 0x7f19b0101090 2024-04-23T10:26:57.635 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:26:57.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.638+0000 7f19b8664640 1 -- 172.21.15.69:0/1738722859 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f199c0a3d20 msgr2=0x7f199c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.638+0000 7f19b8664640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f199c0a3d20 0x7f199c0a61e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f19a00314b0 tx=0x7f19a00058d0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.638+0000 7f19b8664640 1 -- 172.21.15.69:0/1738722859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0101090 msgr2=0x7f19b019e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.638+0000 7f19b8664640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0101090 0x7f19b019e580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e9f0 tx=0x7f19ac00eeb0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.638+0000 7f19b8664640 1 -- 172.21.15.69:0/1738722859 shutdown_connections 2024-04-23T10:26:57.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.638+0000 7f19b8664640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f199c0a3d20 0x7f199c0a61e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.638+0000 7f19b8664640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b0106160 0x7f19b019eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.638+0000 7f19b8664640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0198640 0x7f19b0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.638+0000 7f19b8664640 1 --2- 172.21.15.69:0/1738722859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b0101090 0x7f19b019e580 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.638+0000 7f19b8664640 1 -- 172.21.15.69:0/1738722859 >> 172.21.15.69:0/1738722859 conn(0x7f19b0077f50 msgr2=0x7f19b00feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:57.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.638+0000 7f19b8664640 1 -- 172.21.15.69:0/1738722859 shutdown_connections 2024-04-23T10:26:57.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.639+0000 7f19b8664640 1 -- 172.21.15.69:0/1738722859 wait complete. 2024-04-23T10:26:57.649 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:26:57.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.764+0000 7faf31b37640 1 -- 172.21.15.69:0/650190958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf2c106150 msgr2=0x7faf2c10dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.764+0000 7faf31b37640 1 --2- 172.21.15.69:0/650190958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf2c106150 0x7faf2c10dd20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7faf24009ca0 tx=0x7faf2402a8c0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.764+0000 7faf31b37640 1 -- 172.21.15.69:0/650190958 shutdown_connections 2024-04-23T10:26:57.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.764+0000 7faf31b37640 1 --2- 172.21.15.69:0/650190958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf2c106150 0x7faf2c10dd20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.764+0000 7faf31b37640 1 --2- 172.21.15.69:0/650190958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf2c101a30 0x7faf2c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.764+0000 7faf31b37640 1 --2- 172.21.15.69:0/650190958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c101080 0x7faf2c101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.764+0000 7faf31b37640 1 -- 172.21.15.69:0/650190958 >> 172.21.15.69:0/650190958 conn(0x7faf2c078000 msgr2=0x7faf2c078410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:57.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.764+0000 7faf31b37640 1 -- 172.21.15.69:0/650190958 shutdown_connections 2024-04-23T10:26:57.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.764+0000 7faf31b37640 1 -- 172.21.15.69:0/650190958 wait complete. 2024-04-23T10:26:57.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf31b37640 1 Processor -- start 2024-04-23T10:26:57.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf31b37640 1 -- start start 2024-04-23T10:26:57.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf31b37640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf2c101080 0x7faf2c1995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf31b37640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf2c106150 0x7faf2c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf31b37640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c19a0a0 0x7faf2c1a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf31b37640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1111d0 con 0x7faf2c106150 2024-04-23T10:26:57.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf31b37640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c111050 con 0x7faf2c19a0a0 2024-04-23T10:26:57.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf31b37640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c111350 con 0x7faf2c101080 2024-04-23T10:26:57.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf2affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf2c106150 0x7faf2c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf2affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf2c106150 0x7faf2c199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38568/0 (socket says 172.21.15.69:38568) 2024-04-23T10:26:57.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf2affd640 1 -- 172.21.15.69:0/3871851549 learned_addr learned my addr 172.21.15.69:0/3871851549 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf2bfff640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c19a0a0 0x7faf2c1a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.765+0000 7faf2b7fe640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf2c101080 0x7faf2c1995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.766+0000 7faf2affd640 1 -- 172.21.15.69:0/3871851549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf2c101080 msgr2=0x7faf2c1995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.766+0000 7faf2affd640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf2c101080 0x7faf2c1995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.766+0000 7faf2affd640 1 -- 172.21.15.69:0/3871851549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c19a0a0 msgr2=0x7faf2c1a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.766+0000 7faf2affd640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c19a0a0 0x7faf2c1a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.766+0000 7faf2affd640 1 -- 172.21.15.69:0/3871851549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c1a4e20 con 0x7faf2c106150 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.766+0000 7faf2affd640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf2c106150 0x7faf2c199b10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faf2000d770 tx=0x7faf2000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.766+0000 7faf28ff9640 1 -- 172.21.15.69:0/3871851549 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20017070 con 0x7faf2c106150 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.766+0000 7faf28ff9640 1 -- 172.21.15.69:0/3871851549 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf20009c30 con 0x7faf2c106150 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.766+0000 7faf31b37640 1 -- 172.21.15.69:0/3871851549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2c1a5110 con 0x7faf2c106150 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.766+0000 7faf28ff9640 1 -- 172.21.15.69:0/3871851549 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2000f620 con 0x7faf2c106150 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.766+0000 7faf31b37640 1 -- 172.21.15.69:0/3871851549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2c1a56b0 con 0x7faf2c106150 2024-04-23T10:26:57.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.767+0000 7faf31b37640 1 -- 172.21.15.69:0/3871851549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2c068d70 con 0x7faf2c106150 2024-04-23T10:26:57.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.768+0000 7faf28ff9640 1 -- 172.21.15.69:0/3871851549 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 22) ==== 138766+0+0 (secure 0 0 0) 0x7faf2001a070 con 0x7faf2c106150 2024-04-23T10:26:57.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.768+0000 7faf28ff9640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7faf140a3da0 0x7faf140a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:57.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.769+0000 7faf2b7fe640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7faf140a3da0 0x7faf140a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:57.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.769+0000 7faf28ff9640 1 -- 172.21.15.69:0/3871851549 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7faf200d00a0 con 0x7faf2c106150 2024-04-23T10:26:57.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.769+0000 7faf2b7fe640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7faf140a3da0 0x7faf140a6260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf1c005d00 tx=0x7faf1c00b410 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:57.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.773+0000 7faf28ff9640 1 -- 172.21.15.69:0/3871851549 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faf20009de0 con 0x7faf2c106150 2024-04-23T10:26:57.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.972+0000 7faf31b37640 1 -- 172.21.15.69:0/3871851549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faf2c1093e0 con 0x7faf2c106150 2024-04-23T10:26:57.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.973+0000 7faf28ff9640 1 -- 172.21.15.69:0/3871851549 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7faf2009c1c0 con 0x7faf2c106150 2024-04-23T10:26:57.972 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.974+0000 7faf31b37640 1 -- 172.21.15.69:0/3871851549 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7faf140a3da0 msgr2=0x7faf140a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.974+0000 7faf31b37640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7faf140a3da0 0x7faf140a6260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf1c005d00 tx=0x7faf1c00b410 comp rx=0 tx=0).stop 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.974+0000 7faf31b37640 1 -- 172.21.15.69:0/3871851549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf2c106150 msgr2=0x7faf2c199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.974+0000 7faf31b37640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf2c106150 0x7faf2c199b10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faf2000d770 tx=0x7faf2000dc30 comp rx=0 tx=0).stop 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.975+0000 7faf31b37640 1 -- 172.21.15.69:0/3871851549 shutdown_connections 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.975+0000 7faf31b37640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7faf140a3da0 0x7faf140a6260 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.975+0000 7faf31b37640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf2c106150 0x7faf2c199b10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.975+0000 7faf31b37640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf2c19a0a0 0x7faf2c1a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.975+0000 7faf31b37640 1 --2- 172.21.15.69:0/3871851549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf2c101080 0x7faf2c1995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.975+0000 7faf31b37640 1 -- 172.21.15.69:0/3871851549 >> 172.21.15.69:0/3871851549 conn(0x7faf2c078000 msgr2=0x7faf2c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.975+0000 7faf31b37640 1 -- 172.21.15.69:0/3871851549 shutdown_connections 2024-04-23T10:26:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:57.975+0000 7faf31b37640 1 -- 172.21.15.69:0/3871851549 wait complete. 2024-04-23T10:26:57.986 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:26:58.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.091+0000 7f81c15ad640 1 -- 172.21.15.69:0/794783482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81bc107310 msgr2=0x7f81bc10ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.091+0000 7f81c15ad640 1 --2- 172.21.15.69:0/794783482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81bc107310 0x7f81bc10ee70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009930 tx=0x7f81ac02a420 comp rx=0 tx=0).stop 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 -- 172.21.15.69:0/794783482 shutdown_connections 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 --2- 172.21.15.69:0/794783482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81bc107310 0x7f81bc10ee70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 --2- 172.21.15.69:0/794783482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81bc1010b0 0x7f81bc106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 --2- 172.21.15.69:0/794783482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81bc100700 0x7f81bc100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 -- 172.21.15.69:0/794783482 >> 172.21.15.69:0/794783482 conn(0x7f81bc0773e0 msgr2=0x7f81bc0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 -- 172.21.15.69:0/794783482 shutdown_connections 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 -- 172.21.15.69:0/794783482 wait complete. 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 Processor -- start 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 -- start start 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81bc100700 0x7f81bc19e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81bc107310 0x7f81bc19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81bc198610 0x7f81bc198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc112310 con 0x7f81bc198610 2024-04-23T10:26:58.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc112190 con 0x7f81bc107310 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.092+0000 7f81c15ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc112490 con 0x7f81bc100700 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81bb7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81bc198610 0x7f81bc198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81bb7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81bc198610 0x7f81bc198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38580/0 (socket says 172.21.15.69:38580) 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81ba7fc640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81bc107310 0x7f81bc19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81bb7fe640 1 -- 172.21.15.69:0/935974678 learned_addr learned my addr 172.21.15.69:0/935974678 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81baffd640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81bc100700 0x7f81bc19e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81bb7fe640 1 -- 172.21.15.69:0/935974678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81bc100700 msgr2=0x7f81bc19e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81bb7fe640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81bc100700 0x7f81bc19e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81bb7fe640 1 -- 172.21.15.69:0/935974678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81bc107310 msgr2=0x7f81bc19e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81bb7fe640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81bc107310 0x7f81bc19e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81bb7fe640 1 -- 172.21.15.69:0/935974678 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc199130 con 0x7f81bc198610 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81bb7fe640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81bc198610 0x7f81bc198ac0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f81ac005ab0 tx=0x7f81ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81a3fff640 1 -- 172.21.15.69:0/935974678 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac03f030 con 0x7f81bc198610 2024-04-23T10:26:58.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81a3fff640 1 -- 172.21.15.69:0/935974678 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81ac0318f0 con 0x7f81bc198610 2024-04-23T10:26:58.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81c15ad640 1 -- 172.21.15.69:0/935974678 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc1993c0 con 0x7f81bc198610 2024-04-23T10:26:58.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81a3fff640 1 -- 172.21.15.69:0/935974678 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac035070 con 0x7f81bc198610 2024-04-23T10:26:58.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.093+0000 7f81c15ad640 1 -- 172.21.15.69:0/935974678 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc1a55b0 con 0x7f81bc198610 2024-04-23T10:26:58.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.094+0000 7f81c15ad640 1 -- 172.21.15.69:0/935974678 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81bc0691c0 con 0x7f81bc198610 2024-04-23T10:26:58.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.095+0000 7f81a3fff640 1 -- 172.21.15.69:0/935974678 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f81ac042030 con 0x7f81bc198610 2024-04-23T10:26:58.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.096+0000 7f81a3fff640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81a40a3db0 0x7f81a40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.096+0000 7f81baffd640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81a40a3db0 0x7f81a40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.096+0000 7f81a3fff640 1 -- 172.21.15.69:0/935974678 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f81ac0f0d90 con 0x7f81bc198610 2024-04-23T10:26:58.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.096+0000 7f81baffd640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81a40a3db0 0x7f81a40a6270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81b4005fd0 tx=0x7f81b4009680 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:58.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.101+0000 7f81a3fff640 1 -- 172.21.15.69:0/935974678 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f81ac0bcca0 con 0x7f81bc198610 2024-04-23T10:26:58.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi146 to 176.2M 2024-04-23T10:26:58.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Unable to set osd_memory_target on smithi146 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-23T10:26:58.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi167 to 176.2M 2024-04-23T10:26:58.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Unable to set osd_memory_target on smithi167 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-23T10:26:58.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi069 to 176.1M 2024-04-23T10:26:58.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Unable to set osd_memory_target on smithi069 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-04-23T10:26:58.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-23T10:26:58.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Updating smithi146:/etc/ceph/ceph.conf 2024-04-23T10:26:58.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Updating smithi167:/etc/ceph/ceph.conf 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Updating smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1347737540' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Updating smithi146:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2091422362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1738722859' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:26:58.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:26:58.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:26:58.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:57 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3871851549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:58.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.278+0000 7f81c15ad640 1 -- 172.21.15.69:0/935974678 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f81bc1010b0 con 0x7f81bc198610 2024-04-23T10:26:58.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.279+0000 7f81a3fff640 1 -- 172.21.15.69:0/935974678 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f81ac0c0fa0 con 0x7f81bc198610 2024-04-23T10:26:58.279 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-04-23T10:26:58.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 -- 172.21.15.69:0/935974678 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81a40a3db0 msgr2=0x7f81a40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81a40a3db0 0x7f81a40a6270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81b4005fd0 tx=0x7f81b4009680 comp rx=0 tx=0).stop 2024-04-23T10:26:58.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 -- 172.21.15.69:0/935974678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81bc198610 msgr2=0x7f81bc198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81bc198610 0x7f81bc198ac0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f81ac005ab0 tx=0x7f81ac0042f0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 -- 172.21.15.69:0/935974678 shutdown_connections 2024-04-23T10:26:58.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81a40a3db0 0x7f81a40a6270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81bc198610 0x7f81bc198ac0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81bc107310 0x7f81bc19e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 --2- 172.21.15.69:0/935974678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81bc100700 0x7f81bc19e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 -- 172.21.15.69:0/935974678 >> 172.21.15.69:0/935974678 conn(0x7f81bc0773e0 msgr2=0x7f81bc1054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:58.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 -- 172.21.15.69:0/935974678 shutdown_connections 2024-04-23T10:26:58.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.281+0000 7f81c15ad640 1 -- 172.21.15.69:0/935974678 wait complete. 2024-04-23T10:26:58.291 INFO:tasks.quiescer.ceph_manager:waiting for clean 2024-04-23T10:26:58.291 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi146 to 176.2M 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Unable to set osd_memory_target on smithi146 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi167 to 176.2M 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Unable to set osd_memory_target on smithi167 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi069 to 176.1M 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Unable to set osd_memory_target on smithi069 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Updating smithi146:/etc/ceph/ceph.conf 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Updating smithi167:/etc/ceph/ceph.conf 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Updating smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:26:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1347737540' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Updating smithi146:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2091422362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1738722859' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:26:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:26:58.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:26:58.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:57 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3871851549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.391+0000 7f4ea4c05640 1 -- 172.21.15.69:0/599165263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ea0074c20 msgr2=0x7f4ea010e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.391+0000 7f4ea4c05640 1 --2- 172.21.15.69:0/599165263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ea0074c20 0x7f4ea010e2b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009900 tx=0x7f4e9402a480 comp rx=0 tx=0).stop 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.391+0000 7f4ea4c05640 1 -- 172.21.15.69:0/599165263 shutdown_connections 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.391+0000 7f4ea4c05640 1 --2- 172.21.15.69:0/599165263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ea0074c20 0x7f4ea010e2b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.391+0000 7f4ea4c05640 1 --2- 172.21.15.69:0/599165263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea010e7f0 0x7f4ea0110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.391+0000 7f4ea4c05640 1 --2- 172.21.15.69:0/599165263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea0074300 0x7f4ea00746e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.391+0000 7f4ea4c05640 1 -- 172.21.15.69:0/599165263 >> 172.21.15.69:0/599165263 conn(0x7f4ea00fd9e0 msgr2=0x7f4ea00ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.392+0000 7f4ea4c05640 1 -- 172.21.15.69:0/599165263 shutdown_connections 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.392+0000 7f4ea4c05640 1 -- 172.21.15.69:0/599165263 wait complete. 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.392+0000 7f4ea4c05640 1 Processor -- start 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.392+0000 7f4ea4c05640 1 -- start start 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.392+0000 7f4ea4c05640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea0074300 0x7f4ea01a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.392+0000 7f4ea4c05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea0074c20 0x7f4ea01a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.392+0000 7f4ea4c05640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ea010e7f0 0x7f4ea019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.392+0000 7f4ea4c05640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea01144e0 con 0x7f4ea010e7f0 2024-04-23T10:26:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.392+0000 7f4ea4c05640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea0114360 con 0x7f4ea0074300 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.392+0000 7f4ea4c05640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea0114660 con 0x7f4ea0074c20 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ea010e7f0 0x7f4ea019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ea010e7f0 0x7f4ea019a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38600/0 (socket says 172.21.15.69:38600) 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9ed9d640 1 -- 172.21.15.69:0/2808800318 learned_addr learned my addr 172.21.15.69:0/2808800318 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9e59c640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea0074300 0x7f4ea01a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9dd9b640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea0074c20 0x7f4ea01a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9ed9d640 1 -- 172.21.15.69:0/2808800318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea0074c20 msgr2=0x7f4ea01a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9ed9d640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea0074c20 0x7f4ea01a0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9ed9d640 1 -- 172.21.15.69:0/2808800318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea0074300 msgr2=0x7f4ea01a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9ed9d640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea0074300 0x7f4ea01a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9ed9d640 1 -- 172.21.15.69:0/2808800318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea019b000 con 0x7f4ea010e7f0 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9e59c640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea0074300 0x7f4ea01a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e9ed9d640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ea010e7f0 0x7f4ea019a880 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800d950 tx=0x7f4e9800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:58.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e8f7fe640 1 -- 172.21.15.69:0/2808800318 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98017030 con 0x7f4ea010e7f0 2024-04-23T10:26:58.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e8f7fe640 1 -- 172.21.15.69:0/2808800318 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e98004020 con 0x7f4ea010e7f0 2024-04-23T10:26:58.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4e8f7fe640 1 -- 172.21.15.69:0/2808800318 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98003b90 con 0x7f4ea010e7f0 2024-04-23T10:26:58.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4ea4c05640 1 -- 172.21.15.69:0/2808800318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea019b2f0 con 0x7f4ea010e7f0 2024-04-23T10:26:58.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.393+0000 7f4ea4c05640 1 -- 172.21.15.69:0/2808800318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea01a7590 con 0x7f4ea010e7f0 2024-04-23T10:26:58.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.394+0000 7f4ea4c05640 1 -- 172.21.15.69:0/2808800318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea0068d70 con 0x7f4ea010e7f0 2024-04-23T10:26:58.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.395+0000 7f4e8f7fe640 1 -- 172.21.15.69:0/2808800318 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f4e9801a070 con 0x7f4ea010e7f0 2024-04-23T10:26:58.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.396+0000 7f4e8f7fe640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4e880a3e30 0x7f4e880a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.396+0000 7f4e9e59c640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4e880a3e30 0x7f4e880a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.396+0000 7f4e8f7fe640 1 -- 172.21.15.69:0/2808800318 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f4e980d0610 con 0x7f4ea010e7f0 2024-04-23T10:26:58.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.396+0000 7f4e9e59c640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4e880a3e30 0x7f4e880a62f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ea019b9c0 tx=0x7f4e90009500 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:58.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.400+0000 7f4e8f7fe640 1 -- 172.21.15.69:0/2808800318 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4e9809cbf0 con 0x7f4ea010e7f0 2024-04-23T10:26:58.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi146 to 176.2M 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Unable to set osd_memory_target on smithi146 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi167 to 176.2M 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Unable to set osd_memory_target on smithi167 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi069 to 176.1M 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Unable to set osd_memory_target on smithi069 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Updating smithi146:/etc/ceph/ceph.conf 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Updating smithi167:/etc/ceph/ceph.conf 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Updating smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1347737540' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Updating smithi146:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:26:58.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-04-23T10:26:58.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2091422362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:26:58.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1738722859' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:26:58.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:26:58.429 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:26:58.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:26:58.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:26:58.430 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:57 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3871851549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:26:58.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.573+0000 7f4ea4c05640 1 -- 172.21.15.69:0/2808800318 --> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ea0062390 con 0x7f4e880a3e30 2024-04-23T10:26:58.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.581+0000 7f4e8f7fe640 1 -- 172.21.15.69:0/2808800318 <== mgr.24836 v2:172.21.15.69:6800/908508073 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258081 (secure 0 0 0) 0x7f4ea0062390 con 0x7f4e880a3e30 2024-04-23T10:26:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:58.584 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 -- 172.21.15.69:0/2808800318 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4e880a3e30 msgr2=0x7f4e880a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4e880a3e30 0x7f4e880a62f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ea019b9c0 tx=0x7f4e90009500 comp rx=0 tx=0).stop 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 -- 172.21.15.69:0/2808800318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ea010e7f0 msgr2=0x7f4ea019a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ea010e7f0 0x7f4ea019a880 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800d950 tx=0x7f4e9800dd50 comp rx=0 tx=0).stop 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 -- 172.21.15.69:0/2808800318 shutdown_connections 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4e880a3e30 0x7f4e880a62f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ea010e7f0 0x7f4ea019a880 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ea0074c20 0x7f4ea01a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 --2- 172.21.15.69:0/2808800318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea0074300 0x7f4ea01a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 -- 172.21.15.69:0/2808800318 >> 172.21.15.69:0/2808800318 conn(0x7f4ea00fd9e0 msgr2=0x7f4ea00ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 -- 172.21.15.69:0/2808800318 shutdown_connections 2024-04-23T10:26:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.584+0000 7f4ea4c05640 1 -- 172.21.15.69:0/2808800318 wait complete. 2024-04-23T10:26:58.594 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-23T10:26:57.280910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188064,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1433,"num_read_kb":873,"num_write":553,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180853,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":939,"ondisk_log_size":939,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365432,"kb_used_data":12084,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576392,"statfs":{"total":1151940427776,"available":1151566225408,"internally_reserved":0,"allocated":12374016,"data_stored":9182448,"data_compressed":223383,"data_compressed_allocated":294912,"data_compressed_original":3440640,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.990717"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360811+0000","last_change":"2024-04-23T10:24:53.504514+0000","last_active":"2024-04-23T10:26:53.360811+0000","last_peered":"2024-04-23T10:26:53.360811+0000","last_clean":"2024-04-23T10:26:53.360811+0000","last_became_active":"2024-04-23T10:24:53.504105+0000","last_became_peered":"2024-04-23T10:24:53.504105+0000","last_unstale":"2024-04-23T10:26:53.360811+0000","last_undegraded":"2024-04-23T10:26:53.360811+0000","last_fullsized":"2024-04-23T10:26:53.360811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:49.730698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513756+0000","last_change":"2024-04-23T10:24:53.504534+0000","last_active":"2024-04-23T10:26:53.513756+0000","last_peered":"2024-04-23T10:26:53.513756+0000","last_clean":"2024-04-23T10:26:53.513756+0000","last_became_active":"2024-04-23T10:24:53.504244+0000","last_became_peered":"2024-04-23T10:24:53.504244+0000","last_unstale":"2024-04-23T10:26:53.513756+0000","last_undegraded":"2024-04-23T10:26:53.513756+0000","last_fullsized":"2024-04-23T10:26:53.513756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:12:57.447009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513390+0000","last_change":"2024-04-23T10:24:53.502922+0000","last_active":"2024-04-23T10:26:53.513390+0000","last_peered":"2024-04-23T10:26:53.513390+0000","last_clean":"2024-04-23T10:26:53.513390+0000","last_became_active":"2024-04-23T10:24:53.502519+0000","last_became_peered":"2024-04-23T10:24:53.502519+0000","last_unstale":"2024-04-23T10:26:53.513390+0000","last_undegraded":"2024-04-23T10:26:53.513390+0000","last_fullsized":"2024-04-23T10:26:53.513390+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:58:35.871081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486193+0000","last_change":"2024-04-23T10:24:53.500049+0000","last_active":"2024-04-23T10:26:53.486193+0000","last_peered":"2024-04-23T10:26:53.486193+0000","last_clean":"2024-04-23T10:26:53.486193+0000","last_became_active":"2024-04-23T10:24:53.499607+0000","last_became_peered":"2024-04-23T10:24:53.499607+0000","last_unstale":"2024-04-23T10:26:53.486193+0000","last_undegraded":"2024-04-23T10:26:53.486193+0000","last_fullsized":"2024-04-23T10:26:53.486193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:10:27.104622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269934+0000","last_change":"2024-04-23T10:24:53.493739+0000","last_active":"2024-04-23T10:26:53.269934+0000","last_peered":"2024-04-23T10:26:53.269934+0000","last_clean":"2024-04-23T10:26:53.269934+0000","last_became_active":"2024-04-23T10:24:53.492471+0000","last_became_peered":"2024-04-23T10:24:53.492471+0000","last_unstale":"2024-04-23T10:26:53.269934+0000","last_undegraded":"2024-04-23T10:26:53.269934+0000","last_fullsized":"2024-04-23T10:26:53.269934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:43.267366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369215+0000","last_change":"2024-04-23T10:24:53.500426+0000","last_active":"2024-04-23T10:26:53.369215+0000","last_peered":"2024-04-23T10:26:53.369215+0000","last_clean":"2024-04-23T10:26:53.369215+0000","last_became_active":"2024-04-23T10:24:53.500052+0000","last_became_peered":"2024-04-23T10:24:53.500052+0000","last_unstale":"2024-04-23T10:26:53.369215+0000","last_undegraded":"2024-04-23T10:26:53.369215+0000","last_fullsized":"2024-04-23T10:26:53.369215+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:21:36.361816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267875+0000","last_change":"2024-04-23T10:24:53.501672+0000","last_active":"2024-04-23T10:26:53.267875+0000","last_peered":"2024-04-23T10:26:53.267875+0000","last_clean":"2024-04-23T10:26:53.267875+0000","last_became_active":"2024-04-23T10:24:53.501345+0000","last_became_peered":"2024-04-23T10:24:53.501345+0000","last_unstale":"2024-04-23T10:26:53.267875+0000","last_undegraded":"2024-04-23T10:26:53.267875+0000","last_fullsized":"2024-04-23T10:26:53.267875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:31:41.488482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360520+0000","last_change":"2024-04-23T10:24:53.499442+0000","last_active":"2024-04-23T10:26:53.360520+0000","last_peered":"2024-04-23T10:26:53.360520+0000","last_clean":"2024-04-23T10:26:53.360520+0000","last_became_active":"2024-04-23T10:24:53.499131+0000","last_became_peered":"2024-04-23T10:24:53.499131+0000","last_unstale":"2024-04-23T10:26:53.360520+0000","last_undegraded":"2024-04-23T10:26:53.360520+0000","last_fullsized":"2024-04-23T10:26:53.360520+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:17:21.815851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509244+0000","last_change":"2024-04-23T10:24:53.501235+0000","last_active":"2024-04-23T10:26:53.509244+0000","last_peered":"2024-04-23T10:26:53.509244+0000","last_clean":"2024-04-23T10:26:53.509244+0000","last_became_active":"2024-04-23T10:24:53.500392+0000","last_became_peered":"2024-04-23T10:24:53.500392+0000","last_unstale":"2024-04-23T10:26:53.509244+0000","last_undegraded":"2024-04-23T10:26:53.509244+0000","last_fullsized":"2024-04-23T10:26:53.509244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:58:20.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369317+0000","last_change":"2024-04-23T10:24:53.504235+0000","last_active":"2024-04-23T10:26:53.369317+0000","last_peered":"2024-04-23T10:26:53.369317+0000","last_clean":"2024-04-23T10:26:53.369317+0000","last_became_active":"2024-04-23T10:24:53.503743+0000","last_became_peered":"2024-04-23T10:24:53.503743+0000","last_unstale":"2024-04-23T10:26:53.369317+0000","last_undegraded":"2024-04-23T10:26:53.369317+0000","last_fullsized":"2024-04-23T10:26:53.369317+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:25:53.881433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268044+0000","last_change":"2024-04-23T10:24:53.497355+0000","last_active":"2024-04-23T10:26:53.268044+0000","last_peered":"2024-04-23T10:26:53.268044+0000","last_clean":"2024-04-23T10:26:53.268044+0000","last_became_active":"2024-04-23T10:24:53.494195+0000","last_became_peered":"2024-04-23T10:24:53.494195+0000","last_unstale":"2024-04-23T10:26:53.268044+0000","last_undegraded":"2024-04-23T10:26:53.268044+0000","last_fullsized":"2024-04-23T10:26:53.268044+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:19:48.638789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486102+0000","last_change":"2024-04-23T10:24:53.504513+0000","last_active":"2024-04-23T10:26:53.486102+0000","last_peered":"2024-04-23T10:26:53.486102+0000","last_clean":"2024-04-23T10:26:53.486102+0000","last_became_active":"2024-04-23T10:24:53.504058+0000","last_became_peered":"2024-04-23T10:24:53.504058+0000","last_unstale":"2024-04-23T10:26:53.486102+0000","last_undegraded":"2024-04-23T10:26:53.486102+0000","last_fullsized":"2024-04-23T10:26:53.486102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:16:34.302848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483342+0000","last_change":"2024-04-23T10:24:53.495277+0000","last_active":"2024-04-23T10:26:53.483342+0000","last_peered":"2024-04-23T10:26:53.483342+0000","last_clean":"2024-04-23T10:26:53.483342+0000","last_became_active":"2024-04-23T10:24:53.494925+0000","last_became_peered":"2024-04-23T10:24:53.494925+0000","last_unstale":"2024-04-23T10:26:53.483342+0000","last_undegraded":"2024-04-23T10:26:53.483342+0000","last_fullsized":"2024-04-23T10:26:53.483342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:33.647408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513294+0000","last_change":"2024-04-23T10:24:53.504082+0000","last_active":"2024-04-23T10:26:53.513294+0000","last_peered":"2024-04-23T10:26:53.513294+0000","last_clean":"2024-04-23T10:26:53.513294+0000","last_became_active":"2024-04-23T10:24:53.503753+0000","last_became_peered":"2024-04-23T10:24:53.503753+0000","last_unstale":"2024-04-23T10:26:53.513294+0000","last_undegraded":"2024-04-23T10:26:53.513294+0000","last_fullsized":"2024-04-23T10:26:53.513294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:59.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513636+0000","last_change":"2024-04-23T10:26:00.091416+0000","last_active":"2024-04-23T10:26:53.513636+0000","last_peered":"2024-04-23T10:26:53.513636+0000","last_clean":"2024-04-23T10:26:53.513636+0000","last_became_active":"2024-04-23T10:26:00.091030+0000","last_became_peered":"2024-04-23T10:26:00.091030+0000","last_unstale":"2024-04-23T10:26:53.513636+0000","last_undegraded":"2024-04-23T10:26:53.513636+0000","last_fullsized":"2024-04-23T10:26:53.513636+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:28.835870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509148+0000","last_change":"2024-04-23T10:24:53.498916+0000","last_active":"2024-04-23T10:26:53.509148+0000","last_peered":"2024-04-23T10:26:53.509148+0000","last_clean":"2024-04-23T10:26:53.509148+0000","last_became_active":"2024-04-23T10:24:53.498560+0000","last_became_peered":"2024-04-23T10:24:53.498560+0000","last_unstale":"2024-04-23T10:26:53.509148+0000","last_undegraded":"2024-04-23T10:26:53.509148+0000","last_fullsized":"2024-04-23T10:26:53.509148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:24:07.965091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360836+0000","last_change":"2024-04-23T10:24:53.505167+0000","last_active":"2024-04-23T10:26:53.360836+0000","last_peered":"2024-04-23T10:26:53.360836+0000","last_clean":"2024-04-23T10:26:53.360836+0000","last_became_active":"2024-04-23T10:24:53.504832+0000","last_became_peered":"2024-04-23T10:24:53.504832+0000","last_unstale":"2024-04-23T10:26:53.360836+0000","last_undegraded":"2024-04-23T10:26:53.360836+0000","last_fullsized":"2024-04-23T10:26:53.360836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:58:20.867496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.266311+0000","last_change":"2024-04-23T10:24:53.505363+0000","last_active":"2024-04-23T10:26:53.266311+0000","last_peered":"2024-04-23T10:26:53.266311+0000","last_clean":"2024-04-23T10:26:53.266311+0000","last_became_active":"2024-04-23T10:24:53.505029+0000","last_became_peered":"2024-04-23T10:24:53.505029+0000","last_unstale":"2024-04-23T10:26:53.266311+0000","last_undegraded":"2024-04-23T10:26:53.266311+0000","last_fullsized":"2024-04-23T10:26:53.266311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:22.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513220+0000","last_change":"2024-04-23T10:24:53.497666+0000","last_active":"2024-04-23T10:26:53.513220+0000","last_peered":"2024-04-23T10:26:53.513220+0000","last_clean":"2024-04-23T10:26:53.513220+0000","last_became_active":"2024-04-23T10:24:53.495144+0000","last_became_peered":"2024-04-23T10:24:53.495144+0000","last_unstale":"2024-04-23T10:26:53.513220+0000","last_undegraded":"2024-04-23T10:26:53.513220+0000","last_fullsized":"2024-04-23T10:26:53.513220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:23:27.148289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'14","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.481791+0000","last_change":"2024-04-23T10:24:52.496907+0000","last_active":"2024-04-23T10:26:53.481791+0000","last_peered":"2024-04-23T10:26:53.481791+0000","last_clean":"2024-04-23T10:26:53.481791+0000","last_became_active":"2024-04-23T10:24:52.496567+0000","last_became_peered":"2024-04-23T10:24:52.496567+0000","last_unstale":"2024-04-23T10:26:53.481791+0000","last_undegraded":"2024-04-23T10:26:53.481791+0000","last_fullsized":"2024-04-23T10:26:53.481791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:33.195504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.361042+0000","last_change":"2024-04-23T10:24:53.501140+0000","last_active":"2024-04-23T10:26:53.361042+0000","last_peered":"2024-04-23T10:26:53.361042+0000","last_clean":"2024-04-23T10:26:53.361042+0000","last_became_active":"2024-04-23T10:24:53.500826+0000","last_became_peered":"2024-04-23T10:24:53.500826+0000","last_unstale":"2024-04-23T10:26:53.361042+0000","last_undegraded":"2024-04-23T10:26:53.361042+0000","last_fullsized":"2024-04-23T10:26:53.361042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:39.178784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.361229+0000","last_change":"2024-04-23T10:24:52.494413+0000","last_active":"2024-04-23T10:26:53.361229+0000","last_peered":"2024-04-23T10:26:53.361229+0000","last_clean":"2024-04-23T10:26:53.361229+0000","last_became_active":"2024-04-23T10:24:52.494092+0000","last_became_peered":"2024-04-23T10:24:52.494092+0000","last_unstale":"2024-04-23T10:26:53.361229+0000","last_undegraded":"2024-04-23T10:26:53.361229+0000","last_fullsized":"2024-04-23T10:26:53.361229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:42:09.407787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513214+0000","last_change":"2024-04-23T10:24:53.495285+0000","last_active":"2024-04-23T10:26:53.513214+0000","last_peered":"2024-04-23T10:26:53.513214+0000","last_clean":"2024-04-23T10:26:53.513214+0000","last_became_active":"2024-04-23T10:24:53.494959+0000","last_became_peered":"2024-04-23T10:24:53.494959+0000","last_unstale":"2024-04-23T10:26:53.513214+0000","last_undegraded":"2024-04-23T10:26:53.513214+0000","last_fullsized":"2024-04-23T10:26:53.513214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:59.209505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270433+0000","last_change":"2024-04-23T10:24:52.496310+0000","last_active":"2024-04-23T10:26:53.270433+0000","last_peered":"2024-04-23T10:26:53.270433+0000","last_clean":"2024-04-23T10:26:53.270433+0000","last_became_active":"2024-04-23T10:24:52.496009+0000","last_became_peered":"2024-04-23T10:24:52.496009+0000","last_unstale":"2024-04-23T10:26:53.270433+0000","last_undegraded":"2024-04-23T10:26:53.270433+0000","last_fullsized":"2024-04-23T10:26:53.270433+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:05:46.911691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509924+0000","last_change":"2024-04-23T10:24:53.498204+0000","last_active":"2024-04-23T10:26:53.509924+0000","last_peered":"2024-04-23T10:26:53.509924+0000","last_clean":"2024-04-23T10:26:53.509924+0000","last_became_active":"2024-04-23T10:24:53.496535+0000","last_became_peered":"2024-04-23T10:24:53.496535+0000","last_unstale":"2024-04-23T10:26:53.509924+0000","last_undegraded":"2024-04-23T10:26:53.509924+0000","last_fullsized":"2024-04-23T10:26:53.509924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:32.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270193+0000","last_change":"2024-04-23T10:24:52.493485+0000","last_active":"2024-04-23T10:26:53.270193+0000","last_peered":"2024-04-23T10:26:53.270193+0000","last_clean":"2024-04-23T10:26:53.270193+0000","last_became_active":"2024-04-23T10:24:52.493164+0000","last_became_peered":"2024-04-23T10:24:52.493164+0000","last_unstale":"2024-04-23T10:26:53.270193+0000","last_undegraded":"2024-04-23T10:26:53.270193+0000","last_fullsized":"2024-04-23T10:26:53.270193+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:42:33.701248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366725+0000","last_change":"2024-04-23T10:24:53.507145+0000","last_active":"2024-04-23T10:26:53.366725+0000","last_peered":"2024-04-23T10:26:53.366725+0000","last_clean":"2024-04-23T10:26:53.366725+0000","last_became_active":"2024-04-23T10:24:53.506824+0000","last_became_peered":"2024-04-23T10:24:53.506824+0000","last_unstale":"2024-04-23T10:26:53.366725+0000","last_undegraded":"2024-04-23T10:26:53.366725+0000","last_fullsized":"2024-04-23T10:26:53.366725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:37:54.870303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.482159+0000","last_change":"2024-04-23T10:24:52.498646+0000","last_active":"2024-04-23T10:26:53.482159+0000","last_peered":"2024-04-23T10:26:53.482159+0000","last_clean":"2024-04-23T10:26:53.482159+0000","last_became_active":"2024-04-23T10:24:52.498328+0000","last_became_peered":"2024-04-23T10:24:52.498328+0000","last_unstale":"2024-04-23T10:26:53.482159+0000","last_undegraded":"2024-04-23T10:26:53.482159+0000","last_fullsized":"2024-04-23T10:26:53.482159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:26:33.646144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269856+0000","last_change":"2024-04-23T10:26:00.216570+0000","last_active":"2024-04-23T10:26:53.269856+0000","last_peered":"2024-04-23T10:26:53.269856+0000","last_clean":"2024-04-23T10:26:53.269856+0000","last_became_active":"2024-04-23T10:26:00.216228+0000","last_became_peered":"2024-04-23T10:26:00.216228+0000","last_unstale":"2024-04-23T10:26:53.269856+0000","last_undegraded":"2024-04-23T10:26:53.269856+0000","last_fullsized":"2024-04-23T10:26:53.269856+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:57:54.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369044+0000","last_change":"2024-04-23T10:24:52.495242+0000","last_active":"2024-04-23T10:26:53.369044+0000","last_peered":"2024-04-23T10:26:53.369044+0000","last_clean":"2024-04-23T10:26:53.369044+0000","last_became_active":"2024-04-23T10:24:52.493255+0000","last_became_peered":"2024-04-23T10:24:52.493255+0000","last_unstale":"2024-04-23T10:26:53.369044+0000","last_undegraded":"2024-04-23T10:26:53.369044+0000","last_fullsized":"2024-04-23T10:26:53.369044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:33.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366744+0000","last_change":"2024-04-23T10:24:53.499843+0000","last_active":"2024-04-23T10:26:53.366744+0000","last_peered":"2024-04-23T10:26:53.366744+0000","last_clean":"2024-04-23T10:26:53.366744+0000","last_became_active":"2024-04-23T10:24:53.499512+0000","last_became_peered":"2024-04-23T10:24:53.499512+0000","last_unstale":"2024-04-23T10:26:53.366744+0000","last_undegraded":"2024-04-23T10:26:53.366744+0000","last_fullsized":"2024-04-23T10:26:53.366744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:20.333479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.484060+0000","last_change":"2024-04-23T10:24:52.495915+0000","last_active":"2024-04-23T10:26:53.484060+0000","last_peered":"2024-04-23T10:26:53.484060+0000","last_clean":"2024-04-23T10:26:53.484060+0000","last_became_active":"2024-04-23T10:24:52.495558+0000","last_became_peered":"2024-04-23T10:24:52.495558+0000","last_unstale":"2024-04-23T10:26:53.484060+0000","last_undegraded":"2024-04-23T10:26:53.484060+0000","last_fullsized":"2024-04-23T10:26:53.484060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:41:09.080880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360587+0000","last_change":"2024-04-23T10:24:53.496376+0000","last_active":"2024-04-23T10:26:53.360587+0000","last_peered":"2024-04-23T10:26:53.360587+0000","last_clean":"2024-04-23T10:26:53.360587+0000","last_became_active":"2024-04-23T10:24:53.496067+0000","last_became_peered":"2024-04-23T10:24:53.496067+0000","last_unstale":"2024-04-23T10:26:53.360587+0000","last_undegraded":"2024-04-23T10:26:53.360587+0000","last_fullsized":"2024-04-23T10:26:53.360587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:02:51.252365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366356+0000","last_change":"2024-04-23T10:24:52.499566+0000","last_active":"2024-04-23T10:26:53.366356+0000","last_peered":"2024-04-23T10:26:53.366356+0000","last_clean":"2024-04-23T10:26:53.366356+0000","last_became_active":"2024-04-23T10:24:52.499277+0000","last_became_peered":"2024-04-23T10:24:52.499277+0000","last_unstale":"2024-04-23T10:26:53.366356+0000","last_undegraded":"2024-04-23T10:26:53.366356+0000","last_fullsized":"2024-04-23T10:26:53.366356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:38.716187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.266066+0000","last_change":"2024-04-23T10:24:53.499617+0000","last_active":"2024-04-23T10:26:53.266066+0000","last_peered":"2024-04-23T10:26:53.266066+0000","last_clean":"2024-04-23T10:26:53.266066+0000","last_became_active":"2024-04-23T10:24:53.499283+0000","last_became_peered":"2024-04-23T10:24:53.499283+0000","last_unstale":"2024-04-23T10:26:53.266066+0000","last_undegraded":"2024-04-23T10:26:53.266066+0000","last_fullsized":"2024-04-23T10:26:53.266066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:36.931697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'7","reported_seq":261,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.516687+0000","last_change":"2024-04-23T10:24:52.492276+0000","last_active":"2024-04-23T10:26:53.516687+0000","last_peered":"2024-04-23T10:26:53.516687+0000","last_clean":"2024-04-23T10:26:53.516687+0000","last_became_active":"2024-04-23T10:24:52.491979+0000","last_became_peered":"2024-04-23T10:24:52.491979+0000","last_unstale":"2024-04-23T10:26:53.516687+0000","last_undegraded":"2024-04-23T10:26:53.516687+0000","last_fullsized":"2024-04-23T10:26:53.516687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:15:40.847446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":233,"num_read_kb":233,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509422+0000","last_change":"2024-04-23T10:24:53.500964+0000","last_active":"2024-04-23T10:26:53.509422+0000","last_peered":"2024-04-23T10:26:53.509422+0000","last_clean":"2024-04-23T10:26:53.509422+0000","last_became_active":"2024-04-23T10:24:53.499209+0000","last_became_peered":"2024-04-23T10:24:53.499209+0000","last_unstale":"2024-04-23T10:26:53.509422+0000","last_undegraded":"2024-04-23T10:26:53.509422+0000","last_fullsized":"2024-04-23T10:26:53.509422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:27:29.539994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268207+0000","last_change":"2024-04-23T10:24:52.496016+0000","last_active":"2024-04-23T10:26:53.268207+0000","last_peered":"2024-04-23T10:26:53.268207+0000","last_clean":"2024-04-23T10:26:53.268207+0000","last_became_active":"2024-04-23T10:24:52.495711+0000","last_became_peered":"2024-04-23T10:24:52.495711+0000","last_unstale":"2024-04-23T10:26:53.268207+0000","last_undegraded":"2024-04-23T10:26:53.268207+0000","last_fullsized":"2024-04-23T10:26:53.268207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:31:30.970731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513895+0000","last_change":"2024-04-23T10:26:00.091494+0000","last_active":"2024-04-23T10:26:53.513895+0000","last_peered":"2024-04-23T10:26:53.513895+0000","last_clean":"2024-04-23T10:26:53.513895+0000","last_became_active":"2024-04-23T10:26:00.091122+0000","last_became_peered":"2024-04-23T10:26:00.091122+0000","last_unstale":"2024-04-23T10:26:53.513895+0000","last_undegraded":"2024-04-23T10:26:53.513895+0000","last_fullsized":"2024-04-23T10:26:53.513895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:32.833741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366824+0000","last_change":"2024-04-23T10:24:52.497200+0000","last_active":"2024-04-23T10:26:53.366824+0000","last_peered":"2024-04-23T10:26:53.366824+0000","last_clean":"2024-04-23T10:26:53.366824+0000","last_became_active":"2024-04-23T10:24:52.496864+0000","last_became_peered":"2024-04-23T10:24:52.496864+0000","last_unstale":"2024-04-23T10:26:53.366824+0000","last_undegraded":"2024-04-23T10:26:53.366824+0000","last_fullsized":"2024-04-23T10:26:53.366824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:16.514060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509302+0000","last_change":"2024-04-23T10:24:53.498438+0000","last_active":"2024-04-23T10:26:53.509302+0000","last_peered":"2024-04-23T10:26:53.509302+0000","last_clean":"2024-04-23T10:26:53.509302+0000","last_became_active":"2024-04-23T10:24:53.496569+0000","last_became_peered":"2024-04-23T10:24:53.496569+0000","last_unstale":"2024-04-23T10:26:53.509302+0000","last_undegraded":"2024-04-23T10:26:53.509302+0000","last_fullsized":"2024-04-23T10:26:53.509302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:06:45.964699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'34","reported_seq":300,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.519323+0000","last_change":"2024-04-23T10:24:52.490058+0000","last_active":"2024-04-23T10:26:53.519323+0000","last_peered":"2024-04-23T10:26:53.519323+0000","last_clean":"2024-04-23T10:26:53.519323+0000","last_became_active":"2024-04-23T10:24:52.489720+0000","last_became_peered":"2024-04-23T10:24:52.489720+0000","last_unstale":"2024-04-23T10:26:53.519323+0000","last_undegraded":"2024-04-23T10:26:53.519323+0000","last_fullsized":"2024-04-23T10:26:53.519323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:41.049778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62506,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":245,"num_read_kb":178,"num_write":36,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270171+0000","last_change":"2024-04-23T10:24:53.507122+0000","last_active":"2024-04-23T10:26:53.270171+0000","last_peered":"2024-04-23T10:26:53.270171+0000","last_clean":"2024-04-23T10:26:53.270171+0000","last_became_active":"2024-04-23T10:24:53.506838+0000","last_became_peered":"2024-04-23T10:24:53.506838+0000","last_unstale":"2024-04-23T10:26:53.270171+0000","last_undegraded":"2024-04-23T10:26:53.270171+0000","last_fullsized":"2024-04-23T10:26:53.270171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:59:51.289630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513981+0000","last_change":"2024-04-23T10:24:52.499787+0000","last_active":"2024-04-23T10:26:53.513981+0000","last_peered":"2024-04-23T10:26:53.513981+0000","last_clean":"2024-04-23T10:26:53.513981+0000","last_became_active":"2024-04-23T10:24:52.499400+0000","last_became_peered":"2024-04-23T10:24:52.499400+0000","last_unstale":"2024-04-23T10:26:53.513981+0000","last_undegraded":"2024-04-23T10:26:53.513981+0000","last_fullsized":"2024-04-23T10:26:53.513981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:15:17.638984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483399+0000","last_change":"2024-04-23T10:24:53.495773+0000","last_active":"2024-04-23T10:26:53.483399+0000","last_peered":"2024-04-23T10:26:53.483399+0000","last_clean":"2024-04-23T10:26:53.483399+0000","last_became_active":"2024-04-23T10:24:53.495456+0000","last_became_peered":"2024-04-23T10:24:53.495456+0000","last_unstale":"2024-04-23T10:26:53.483399+0000","last_undegraded":"2024-04-23T10:26:53.483399+0000","last_fullsized":"2024-04-23T10:26:53.483399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:12:06.638141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366448+0000","last_change":"2024-04-23T10:24:52.498660+0000","last_active":"2024-04-23T10:26:53.366448+0000","last_peered":"2024-04-23T10:26:53.366448+0000","last_clean":"2024-04-23T10:26:53.366448+0000","last_became_active":"2024-04-23T10:24:52.498302+0000","last_became_peered":"2024-04-23T10:24:52.498302+0000","last_unstale":"2024-04-23T10:26:53.366448+0000","last_undegraded":"2024-04-23T10:26:53.366448+0000","last_fullsized":"2024-04-23T10:26:53.366448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:49:23.826748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268154+0000","last_change":"2024-04-23T10:24:53.501718+0000","last_active":"2024-04-23T10:26:53.268154+0000","last_peered":"2024-04-23T10:26:53.268154+0000","last_clean":"2024-04-23T10:26:53.268154+0000","last_became_active":"2024-04-23T10:24:53.501359+0000","last_became_peered":"2024-04-23T10:24:53.501359+0000","last_unstale":"2024-04-23T10:26:53.268154+0000","last_undegraded":"2024-04-23T10:26:53.268154+0000","last_fullsized":"2024-04-23T10:26:53.268154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:51:42.474899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'9","reported_seq":148,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513026+0000","last_change":"2024-04-23T10:24:52.493910+0000","last_active":"2024-04-23T10:26:53.513026+0000","last_peered":"2024-04-23T10:26:53.513026+0000","last_clean":"2024-04-23T10:26:53.513026+0000","last_became_active":"2024-04-23T10:24:52.493536+0000","last_became_peered":"2024-04-23T10:24:52.493536+0000","last_unstale":"2024-04-23T10:26:53.513026+0000","last_undegraded":"2024-04-23T10:26:53.513026+0000","last_fullsized":"2024-04-23T10:26:53.513026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:23.806993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267746+0000","last_change":"2024-04-23T10:24:53.498221+0000","last_active":"2024-04-23T10:26:53.267746+0000","last_peered":"2024-04-23T10:26:53.267746+0000","last_clean":"2024-04-23T10:26:53.267746+0000","last_became_active":"2024-04-23T10:24:53.497887+0000","last_became_peered":"2024-04-23T10:24:53.497887+0000","last_unstale":"2024-04-23T10:26:53.267746+0000","last_undegraded":"2024-04-23T10:26:53.267746+0000","last_fullsized":"2024-04-23T10:26:53.267746+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:49:02.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269915+0000","last_change":"2024-04-23T10:24:52.498883+0000","last_active":"2024-04-23T10:26:53.269915+0000","last_peered":"2024-04-23T10:26:53.269915+0000","last_clean":"2024-04-23T10:26:53.269915+0000","last_became_active":"2024-04-23T10:24:52.498562+0000","last_became_peered":"2024-04-23T10:24:52.498562+0000","last_unstale":"2024-04-23T10:26:53.269915+0000","last_undegraded":"2024-04-23T10:26:53.269915+0000","last_fullsized":"2024-04-23T10:26:53.269915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:33.914481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366468+0000","last_change":"2024-04-23T10:24:53.506303+0000","last_active":"2024-04-23T10:26:53.366468+0000","last_peered":"2024-04-23T10:26:53.366468+0000","last_clean":"2024-04-23T10:26:53.366468+0000","last_became_active":"2024-04-23T10:24:53.505850+0000","last_became_peered":"2024-04-23T10:24:53.505850+0000","last_unstale":"2024-04-23T10:26:53.366468+0000","last_undegraded":"2024-04-23T10:26:53.366468+0000","last_fullsized":"2024-04-23T10:26:53.366468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:18.498188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270324+0000","last_change":"2024-04-23T10:24:52.493853+0000","last_active":"2024-04-23T10:26:53.270324+0000","last_peered":"2024-04-23T10:26:53.270324+0000","last_clean":"2024-04-23T10:26:53.270324+0000","last_became_active":"2024-04-23T10:24:52.492932+0000","last_became_peered":"2024-04-23T10:24:52.492932+0000","last_unstale":"2024-04-23T10:26:53.270324+0000","last_undegraded":"2024-04-23T10:26:53.270324+0000","last_fullsized":"2024-04-23T10:26:53.270324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:12:33.327611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360638+0000","last_change":"2024-04-23T10:26:00.284417+0000","last_active":"2024-04-23T10:26:53.360638+0000","last_peered":"2024-04-23T10:26:53.360638+0000","last_clean":"2024-04-23T10:26:53.360638+0000","last_became_active":"2024-04-23T10:26:00.284097+0000","last_became_peered":"2024-04-23T10:26:00.284097+0000","last_unstale":"2024-04-23T10:26:53.360638+0000","last_undegraded":"2024-04-23T10:26:53.360638+0000","last_fullsized":"2024-04-23T10:26:53.360638+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:53.114887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.266231+0000","last_change":"2024-04-23T10:24:52.494032+0000","last_active":"2024-04-23T10:26:53.266231+0000","last_peered":"2024-04-23T10:26:53.266231+0000","last_clean":"2024-04-23T10:26:53.266231+0000","last_became_active":"2024-04-23T10:24:52.493699+0000","last_became_peered":"2024-04-23T10:24:52.493699+0000","last_unstale":"2024-04-23T10:26:53.266231+0000","last_undegraded":"2024-04-23T10:26:53.266231+0000","last_fullsized":"2024-04-23T10:26:53.266231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:54.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369228+0000","last_change":"2024-04-23T10:24:53.494846+0000","last_active":"2024-04-23T10:26:53.369228+0000","last_peered":"2024-04-23T10:26:53.369228+0000","last_clean":"2024-04-23T10:26:53.369228+0000","last_became_active":"2024-04-23T10:24:53.494541+0000","last_became_peered":"2024-04-23T10:24:53.494541+0000","last_unstale":"2024-04-23T10:26:53.369228+0000","last_undegraded":"2024-04-23T10:26:53.369228+0000","last_fullsized":"2024-04-23T10:26:53.369228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:33:24.263803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'7","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509421+0000","last_change":"2024-04-23T10:24:52.499078+0000","last_active":"2024-04-23T10:26:53.509421+0000","last_peered":"2024-04-23T10:26:53.509421+0000","last_clean":"2024-04-23T10:26:53.509421+0000","last_became_active":"2024-04-23T10:24:52.498764+0000","last_became_peered":"2024-04-23T10:24:52.498764+0000","last_unstale":"2024-04-23T10:26:53.509421+0000","last_undegraded":"2024-04-23T10:26:53.509421+0000","last_fullsized":"2024-04-23T10:26:53.509421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:10:51.634437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1370,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369333+0000","last_change":"2024-04-23T10:26:00.087050+0000","last_active":"2024-04-23T10:26:53.369333+0000","last_peered":"2024-04-23T10:26:53.369333+0000","last_clean":"2024-04-23T10:26:53.369333+0000","last_became_active":"2024-04-23T10:26:00.086634+0000","last_became_peered":"2024-04-23T10:26:00.086634+0000","last_unstale":"2024-04-23T10:26:53.369333+0000","last_undegraded":"2024-04-23T10:26:53.369333+0000","last_fullsized":"2024-04-23T10:26:53.369333+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:40:38.242963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366503+0000","last_change":"2024-04-23T10:24:53.504787+0000","last_active":"2024-04-23T10:26:53.366503+0000","last_peered":"2024-04-23T10:26:53.366503+0000","last_clean":"2024-04-23T10:26:53.366503+0000","last_became_active":"2024-04-23T10:24:53.504423+0000","last_became_peered":"2024-04-23T10:24:53.504423+0000","last_unstale":"2024-04-23T10:26:53.366503+0000","last_undegraded":"2024-04-23T10:26:53.366503+0000","last_fullsized":"2024-04-23T10:26:53.366503+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:00.171449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'7","reported_seq":145,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513248+0000","last_change":"2024-04-23T10:24:52.493600+0000","last_active":"2024-04-23T10:26:53.513248+0000","last_peered":"2024-04-23T10:26:53.513248+0000","last_clean":"2024-04-23T10:26:53.513248+0000","last_became_active":"2024-04-23T10:24:52.493310+0000","last_became_peered":"2024-04-23T10:24:52.493310+0000","last_unstale":"2024-04-23T10:26:53.513248+0000","last_undegraded":"2024-04-23T10:26:53.513248+0000","last_fullsized":"2024-04-23T10:26:53.513248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:07.144860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360960+0000","last_change":"2024-04-23T10:24:53.506311+0000","last_active":"2024-04-23T10:26:53.360960+0000","last_peered":"2024-04-23T10:26:53.360960+0000","last_clean":"2024-04-23T10:26:53.360960+0000","last_became_active":"2024-04-23T10:24:53.503910+0000","last_became_peered":"2024-04-23T10:24:53.503910+0000","last_unstale":"2024-04-23T10:26:53.360960+0000","last_undegraded":"2024-04-23T10:26:53.360960+0000","last_fullsized":"2024-04-23T10:26:53.360960+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:01:32.620891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486002+0000","last_change":"2024-04-23T10:24:52.485060+0000","last_active":"2024-04-23T10:26:53.486002+0000","last_peered":"2024-04-23T10:26:53.486002+0000","last_clean":"2024-04-23T10:26:53.486002+0000","last_became_active":"2024-04-23T10:24:52.484636+0000","last_became_peered":"2024-04-23T10:24:52.484636+0000","last_unstale":"2024-04-23T10:26:53.486002+0000","last_undegraded":"2024-04-23T10:26:53.486002+0000","last_fullsized":"2024-04-23T10:26:53.486002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:26:01.737147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":356,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267872+0000","last_change":"2024-04-23T10:23:43.804102+0000","last_active":"2024-04-23T10:26:53.267872+0000","last_peered":"2024-04-23T10:26:53.267872+0000","last_clean":"2024-04-23T10:26:53.267872+0000","last_became_active":"2024-04-23T10:23:43.803657+0000","last_became_peered":"2024-04-23T10:23:43.803657+0000","last_unstale":"2024-04-23T10:26:53.267872+0000","last_undegraded":"2024-04-23T10:26:53.267872+0000","last_fullsized":"2024-04-23T10:26:53.267872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_clean_scrub_stamp":"2024-04-23T10:20:19.875078+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:50.160735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483865+0000","last_change":"2024-04-23T10:24:53.499334+0000","last_active":"2024-04-23T10:26:53.483865+0000","last_peered":"2024-04-23T10:26:53.483865+0000","last_clean":"2024-04-23T10:26:53.483865+0000","last_became_active":"2024-04-23T10:24:53.499008+0000","last_became_peered":"2024-04-23T10:24:53.499008+0000","last_unstale":"2024-04-23T10:26:53.483865+0000","last_undegraded":"2024-04-23T10:26:53.483865+0000","last_fullsized":"2024-04-23T10:26:53.483865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:13.504789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268032+0000","last_change":"2024-04-23T10:24:52.493601+0000","last_active":"2024-04-23T10:26:53.268032+0000","last_peered":"2024-04-23T10:26:53.268032+0000","last_clean":"2024-04-23T10:26:53.268032+0000","last_became_active":"2024-04-23T10:24:52.493278+0000","last_became_peered":"2024-04-23T10:24:52.493278+0000","last_unstale":"2024-04-23T10:26:53.268032+0000","last_undegraded":"2024-04-23T10:26:53.268032+0000","last_fullsized":"2024-04-23T10:26:53.268032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:36:21.375233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270337+0000","last_change":"2024-04-23T10:24:52.495637+0000","last_active":"2024-04-23T10:26:53.270337+0000","last_peered":"2024-04-23T10:26:53.270337+0000","last_clean":"2024-04-23T10:26:53.270337+0000","last_became_active":"2024-04-23T10:24:52.495329+0000","last_became_peered":"2024-04-23T10:24:52.495329+0000","last_unstale":"2024-04-23T10:26:53.270337+0000","last_undegraded":"2024-04-23T10:26:53.270337+0000","last_fullsized":"2024-04-23T10:26:53.270337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:14.187803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483641+0000","last_change":"2024-04-23T10:24:53.500353+0000","last_active":"2024-04-23T10:26:53.483641+0000","last_peered":"2024-04-23T10:26:53.483641+0000","last_clean":"2024-04-23T10:26:53.483641+0000","last_became_active":"2024-04-23T10:24:53.499995+0000","last_became_peered":"2024-04-23T10:24:53.499995+0000","last_unstale":"2024-04-23T10:26:53.483641+0000","last_undegraded":"2024-04-23T10:26:53.483641+0000","last_fullsized":"2024-04-23T10:26:53.483641+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:55:52.695375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'47","reported_seq":107,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.464904+0000","last_change":"2024-04-23T10:26:00.099289+0000","last_active":"2024-04-23T10:26:53.464904+0000","last_peered":"2024-04-23T10:26:53.464904+0000","last_clean":"2024-04-23T10:26:53.464904+0000","last_became_active":"2024-04-23T10:26:00.088425+0000","last_became_peered":"2024-04-23T10:26:00.088425+0000","last_unstale":"2024-04-23T10:26:53.464904+0000","last_undegraded":"2024-04-23T10:26:53.464904+0000","last_fullsized":"2024-04-23T10:26:53.464904+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:54:11.848553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360844+0000","last_change":"2024-04-23T10:24:53.498140+0000","last_active":"2024-04-23T10:26:53.360844+0000","last_peered":"2024-04-23T10:26:53.360844+0000","last_clean":"2024-04-23T10:26:53.360844+0000","last_became_active":"2024-04-23T10:24:53.496683+0000","last_became_peered":"2024-04-23T10:24:53.496683+0000","last_unstale":"2024-04-23T10:26:53.360844+0000","last_undegraded":"2024-04-23T10:26:53.360844+0000","last_fullsized":"2024-04-23T10:26:53.360844+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:49:18.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486140+0000","last_change":"2024-04-23T10:24:52.486505+0000","last_active":"2024-04-23T10:26:53.486140+0000","last_peered":"2024-04-23T10:26:53.486140+0000","last_clean":"2024-04-23T10:26:53.486140+0000","last_became_active":"2024-04-23T10:24:52.486185+0000","last_became_peered":"2024-04-23T10:24:52.486185+0000","last_unstale":"2024-04-23T10:26:53.486140+0000","last_undegraded":"2024-04-23T10:26:53.486140+0000","last_fullsized":"2024-04-23T10:26:53.486140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:46:27.052935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513586+0000","last_change":"2024-04-23T10:24:53.496234+0000","last_active":"2024-04-23T10:26:53.513586+0000","last_peered":"2024-04-23T10:26:53.513586+0000","last_clean":"2024-04-23T10:26:53.513586+0000","last_became_active":"2024-04-23T10:24:53.495892+0000","last_became_peered":"2024-04-23T10:24:53.495892+0000","last_unstale":"2024-04-23T10:26:53.513586+0000","last_undegraded":"2024-04-23T10:26:53.513586+0000","last_fullsized":"2024-04-23T10:26:53.513586+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:11.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509445+0000","last_change":"2024-04-23T10:26:00.094344+0000","last_active":"2024-04-23T10:26:53.509445+0000","last_peered":"2024-04-23T10:26:53.509445+0000","last_clean":"2024-04-23T10:26:53.509445+0000","last_became_active":"2024-04-23T10:26:00.090692+0000","last_became_peered":"2024-04-23T10:26:00.090692+0000","last_unstale":"2024-04-23T10:26:53.509445+0000","last_undegraded":"2024-04-23T10:26:53.509445+0000","last_fullsized":"2024-04-23T10:26:53.509445+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269829+0000","last_change":"2024-04-23T10:24:53.497985+0000","last_active":"2024-04-23T10:26:53.269829+0000","last_peered":"2024-04-23T10:26:53.269829+0000","last_clean":"2024-04-23T10:26:53.269829+0000","last_became_active":"2024-04-23T10:24:53.497661+0000","last_became_peered":"2024-04-23T10:24:53.497661+0000","last_unstale":"2024-04-23T10:26:53.269829+0000","last_undegraded":"2024-04-23T10:26:53.269829+0000","last_fullsized":"2024-04-23T10:26:53.269829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:48.923714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360768+0000","last_change":"2024-04-23T10:24:52.490572+0000","last_active":"2024-04-23T10:26:53.360768+0000","last_peered":"2024-04-23T10:26:53.360768+0000","last_clean":"2024-04-23T10:26:53.360768+0000","last_became_active":"2024-04-23T10:24:52.490274+0000","last_became_peered":"2024-04-23T10:24:52.490274+0000","last_unstale":"2024-04-23T10:26:53.360768+0000","last_undegraded":"2024-04-23T10:26:53.360768+0000","last_fullsized":"2024-04-23T10:26:53.360768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:22.447399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360448+0000","last_change":"2024-04-23T10:24:53.509189+0000","last_active":"2024-04-23T10:26:53.360448+0000","last_peered":"2024-04-23T10:26:53.360448+0000","last_clean":"2024-04-23T10:26:53.360448+0000","last_became_active":"2024-04-23T10:24:53.508850+0000","last_became_peered":"2024-04-23T10:24:53.508850+0000","last_unstale":"2024-04-23T10:26:53.360448+0000","last_undegraded":"2024-04-23T10:26:53.360448+0000","last_fullsized":"2024-04-23T10:26:53.360448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:23.242999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'5","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513953+0000","last_change":"2024-04-23T10:24:52.497616+0000","last_active":"2024-04-23T10:26:53.513953+0000","last_peered":"2024-04-23T10:26:53.513953+0000","last_clean":"2024-04-23T10:26:53.513953+0000","last_became_active":"2024-04-23T10:24:52.497028+0000","last_became_peered":"2024-04-23T10:24:52.497028+0000","last_unstale":"2024-04-23T10:26:53.513953+0000","last_undegraded":"2024-04-23T10:26:53.513953+0000","last_fullsized":"2024-04-23T10:26:53.513953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:51:26.836718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360841+0000","last_change":"2024-04-23T10:24:53.498086+0000","last_active":"2024-04-23T10:26:53.360841+0000","last_peered":"2024-04-23T10:26:53.360841+0000","last_clean":"2024-04-23T10:26:53.360841+0000","last_became_active":"2024-04-23T10:24:53.497734+0000","last_became_peered":"2024-04-23T10:24:53.497734+0000","last_unstale":"2024-04-23T10:26:53.360841+0000","last_undegraded":"2024-04-23T10:26:53.360841+0000","last_fullsized":"2024-04-23T10:26:53.360841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:57.602301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269954+0000","last_change":"2024-04-23T10:24:52.496609+0000","last_active":"2024-04-23T10:26:53.269954+0000","last_peered":"2024-04-23T10:26:53.269954+0000","last_clean":"2024-04-23T10:26:53.269954+0000","last_became_active":"2024-04-23T10:24:52.495981+0000","last_became_peered":"2024-04-23T10:24:52.495981+0000","last_unstale":"2024-04-23T10:26:53.269954+0000","last_undegraded":"2024-04-23T10:26:53.269954+0000","last_fullsized":"2024-04-23T10:26:53.269954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:28.111644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268115+0000","last_change":"2024-04-23T10:24:53.503840+0000","last_active":"2024-04-23T10:26:53.268115+0000","last_peered":"2024-04-23T10:26:53.268115+0000","last_clean":"2024-04-23T10:26:53.268115+0000","last_became_active":"2024-04-23T10:24:53.503448+0000","last_became_peered":"2024-04-23T10:24:53.503448+0000","last_unstale":"2024-04-23T10:26:53.268115+0000","last_undegraded":"2024-04-23T10:26:53.268115+0000","last_fullsized":"2024-04-23T10:26:53.268115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:03.295985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'9","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.521877+0000","last_change":"2024-04-23T10:24:52.501792+0000","last_active":"2024-04-23T10:26:53.521877+0000","last_peered":"2024-04-23T10:26:53.521877+0000","last_clean":"2024-04-23T10:26:53.521877+0000","last_became_active":"2024-04-23T10:24:52.501404+0000","last_became_peered":"2024-04-23T10:24:52.501404+0000","last_unstale":"2024-04-23T10:26:53.521877+0000","last_undegraded":"2024-04-23T10:26:53.521877+0000","last_fullsized":"2024-04-23T10:26:53.521877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:03.529410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2401,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268107+0000","last_change":"2024-04-23T10:24:53.501649+0000","last_active":"2024-04-23T10:26:53.268107+0000","last_peered":"2024-04-23T10:26:53.268107+0000","last_clean":"2024-04-23T10:26:53.268107+0000","last_became_active":"2024-04-23T10:24:53.501307+0000","last_became_peered":"2024-04-23T10:24:53.501307+0000","last_unstale":"2024-04-23T10:26:53.268107+0000","last_undegraded":"2024-04-23T10:26:53.268107+0000","last_fullsized":"2024-04-23T10:26:53.268107+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:37.863832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'41","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.462917+0000","last_change":"2024-04-23T10:24:52.495737+0000","last_active":"2024-04-23T10:26:53.462917+0000","last_peered":"2024-04-23T10:26:53.462917+0000","last_clean":"2024-04-23T10:26:53.462917+0000","last_became_active":"2024-04-23T10:24:52.495395+0000","last_became_peered":"2024-04-23T10:24:52.495395+0000","last_unstale":"2024-04-23T10:26:53.462917+0000","last_undegraded":"2024-04-23T10:26:53.462917+0000","last_fullsized":"2024-04-23T10:26:53.462917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:14:45.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267964+0000","last_change":"2024-04-23T10:26:00.095511+0000","last_active":"2024-04-23T10:26:53.267964+0000","last_peered":"2024-04-23T10:26:53.267964+0000","last_clean":"2024-04-23T10:26:53.267964+0000","last_became_active":"2024-04-23T10:26:00.092403+0000","last_became_peered":"2024-04-23T10:26:00.092403+0000","last_unstale":"2024-04-23T10:26:53.267964+0000","last_undegraded":"2024-04-23T10:26:53.267964+0000","last_fullsized":"2024-04-23T10:26:53.267964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:16:45.782094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483944+0000","last_change":"2024-04-23T10:24:52.494322+0000","last_active":"2024-04-23T10:26:53.483944+0000","last_peered":"2024-04-23T10:26:53.483944+0000","last_clean":"2024-04-23T10:26:53.483944+0000","last_became_active":"2024-04-23T10:24:52.494019+0000","last_became_peered":"2024-04-23T10:24:52.494019+0000","last_unstale":"2024-04-23T10:26:53.483944+0000","last_undegraded":"2024-04-23T10:26:53.483944+0000","last_fullsized":"2024-04-23T10:26:53.483944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:16.099197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268354+0000","last_change":"2024-04-23T10:24:53.507160+0000","last_active":"2024-04-23T10:26:53.268354+0000","last_peered":"2024-04-23T10:26:53.268354+0000","last_clean":"2024-04-23T10:26:53.268354+0000","last_became_active":"2024-04-23T10:24:53.506815+0000","last_became_peered":"2024-04-23T10:24:53.506815+0000","last_unstale":"2024-04-23T10:26:53.268354+0000","last_undegraded":"2024-04-23T10:26:53.268354+0000","last_fullsized":"2024-04-23T10:26:53.268354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:24.657153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360475+0000","last_change":"2024-04-23T10:24:53.510511+0000","last_active":"2024-04-23T10:26:53.360475+0000","last_peered":"2024-04-23T10:26:53.360475+0000","last_clean":"2024-04-23T10:26:53.360475+0000","last_became_active":"2024-04-23T10:24:53.510174+0000","last_became_peered":"2024-04-23T10:24:53.510174+0000","last_unstale":"2024-04-23T10:26:53.360475+0000","last_undegraded":"2024-04-23T10:26:53.360475+0000","last_fullsized":"2024-04-23T10:26:53.360475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:35.048697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513132+0000","last_change":"2024-04-23T10:24:53.497365+0000","last_active":"2024-04-23T10:26:53.513132+0000","last_peered":"2024-04-23T10:26:53.513132+0000","last_clean":"2024-04-23T10:26:53.513132+0000","last_became_active":"2024-04-23T10:24:53.496427+0000","last_became_peered":"2024-04-23T10:24:53.496427+0000","last_unstale":"2024-04-23T10:26:53.513132+0000","last_undegraded":"2024-04-23T10:26:53.513132+0000","last_fullsized":"2024-04-23T10:26:53.513132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:22:35.867252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513193+0000","last_change":"2024-04-23T10:24:53.495913+0000","last_active":"2024-04-23T10:26:53.513193+0000","last_peered":"2024-04-23T10:26:53.513193+0000","last_clean":"2024-04-23T10:26:53.513193+0000","last_became_active":"2024-04-23T10:24:53.495543+0000","last_became_peered":"2024-04-23T10:24:53.495543+0000","last_unstale":"2024-04-23T10:26:53.513193+0000","last_undegraded":"2024-04-23T10:26:53.513193+0000","last_fullsized":"2024-04-23T10:26:53.513193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:03:29.327759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513412+0000","last_change":"2024-04-23T10:24:53.492305+0000","last_active":"2024-04-23T10:26:53.513412+0000","last_peered":"2024-04-23T10:26:53.513412+0000","last_clean":"2024-04-23T10:26:53.513412+0000","last_became_active":"2024-04-23T10:24:53.491980+0000","last_became_peered":"2024-04-23T10:24:53.491980+0000","last_unstale":"2024-04-23T10:26:53.513412+0000","last_undegraded":"2024-04-23T10:26:53.513412+0000","last_fullsized":"2024-04-23T10:26:53.513412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:34.987447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483808+0000","last_change":"2024-04-23T10:24:53.492464+0000","last_active":"2024-04-23T10:26:53.483808+0000","last_peered":"2024-04-23T10:26:53.483808+0000","last_clean":"2024-04-23T10:26:53.483808+0000","last_became_active":"2024-04-23T10:24:53.492156+0000","last_became_peered":"2024-04-23T10:24:53.492156+0000","last_unstale":"2024-04-23T10:26:53.483808+0000","last_undegraded":"2024-04-23T10:26:53.483808+0000","last_fullsized":"2024-04-23T10:26:53.483808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:07:15.414598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360552+0000","last_change":"2024-04-23T10:24:53.502208+0000","last_active":"2024-04-23T10:26:53.360552+0000","last_peered":"2024-04-23T10:26:53.360552+0000","last_clean":"2024-04-23T10:26:53.360552+0000","last_became_active":"2024-04-23T10:24:53.501921+0000","last_became_peered":"2024-04-23T10:24:53.501921+0000","last_unstale":"2024-04-23T10:26:53.360552+0000","last_undegraded":"2024-04-23T10:26:53.360552+0000","last_fullsized":"2024-04-23T10:26:53.360552+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:29:21.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513417+0000","last_change":"2024-04-23T10:24:53.495446+0000","last_active":"2024-04-23T10:26:53.513417+0000","last_peered":"2024-04-23T10:26:53.513417+0000","last_clean":"2024-04-23T10:26:53.513417+0000","last_became_active":"2024-04-23T10:24:53.495090+0000","last_became_peered":"2024-04-23T10:24:53.495090+0000","last_unstale":"2024-04-23T10:26:53.513417+0000","last_undegraded":"2024-04-23T10:26:53.513417+0000","last_fullsized":"2024-04-23T10:26:53.513417+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:44:00.007468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360726+0000","last_change":"2024-04-23T10:24:53.503390+0000","last_active":"2024-04-23T10:26:53.360726+0000","last_peered":"2024-04-23T10:26:53.360726+0000","last_clean":"2024-04-23T10:26:53.360726+0000","last_became_active":"2024-04-23T10:24:53.503057+0000","last_became_peered":"2024-04-23T10:24:53.503057+0000","last_unstale":"2024-04-23T10:26:53.360726+0000","last_undegraded":"2024-04-23T10:26:53.360726+0000","last_fullsized":"2024-04-23T10:26:53.360726+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:19:39.950651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366412+0000","last_change":"2024-04-23T10:24:53.498188+0000","last_active":"2024-04-23T10:26:53.366412+0000","last_peered":"2024-04-23T10:26:53.366412+0000","last_clean":"2024-04-23T10:26:53.366412+0000","last_became_active":"2024-04-23T10:24:53.497873+0000","last_became_peered":"2024-04-23T10:24:53.497873+0000","last_unstale":"2024-04-23T10:26:53.366412+0000","last_undegraded":"2024-04-23T10:26:53.366412+0000","last_fullsized":"2024-04-23T10:26:53.366412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:48:05.001361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360615+0000","last_change":"2024-04-23T10:24:53.502260+0000","last_active":"2024-04-23T10:26:53.360615+0000","last_peered":"2024-04-23T10:26:53.360615+0000","last_clean":"2024-04-23T10:26:53.360615+0000","last_became_active":"2024-04-23T10:24:53.501525+0000","last_became_peered":"2024-04-23T10:24:53.501525+0000","last_unstale":"2024-04-23T10:26:53.360615+0000","last_undegraded":"2024-04-23T10:26:53.360615+0000","last_fullsized":"2024-04-23T10:26:53.360615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:04.379055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509274+0000","last_change":"2024-04-23T10:24:53.499306+0000","last_active":"2024-04-23T10:26:53.509274+0000","last_peered":"2024-04-23T10:26:53.509274+0000","last_clean":"2024-04-23T10:26:53.509274+0000","last_became_active":"2024-04-23T10:24:53.496717+0000","last_became_peered":"2024-04-23T10:24:53.496717+0000","last_unstale":"2024-04-23T10:26:53.509274+0000","last_undegraded":"2024-04-23T10:26:53.509274+0000","last_fullsized":"2024-04-23T10:26:53.509274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:03:17.907117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483514+0000","last_change":"2024-04-23T10:24:53.496330+0000","last_active":"2024-04-23T10:26:53.483514+0000","last_peered":"2024-04-23T10:26:53.483514+0000","last_clean":"2024-04-23T10:26:53.483514+0000","last_became_active":"2024-04-23T10:24:53.496021+0000","last_became_peered":"2024-04-23T10:24:53.496021+0000","last_unstale":"2024-04-23T10:26:53.483514+0000","last_undegraded":"2024-04-23T10:26:53.483514+0000","last_fullsized":"2024-04-23T10:26:53.483514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:10:59.340265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360493+0000","last_change":"2024-04-23T10:24:53.501025+0000","last_active":"2024-04-23T10:26:53.360493+0000","last_peered":"2024-04-23T10:26:53.360493+0000","last_clean":"2024-04-23T10:26:53.360493+0000","last_became_active":"2024-04-23T10:24:53.500673+0000","last_became_peered":"2024-04-23T10:24:53.500673+0000","last_unstale":"2024-04-23T10:26:53.360493+0000","last_undegraded":"2024-04-23T10:26:53.360493+0000","last_fullsized":"2024-04-23T10:26:53.360493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:07.728645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107040,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597462,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1297,"num_read_kb":754,"num_write":370,"num_write_kb":1461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":700416,"data_stored":1792386,"data_compressed":81483,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":863827,"data_compressed":22051,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612649,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1146880,"data_stored":1255829,"data_compressed":46600,"data_compressed_allocated":61440,"data_compressed_original":729088,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776175,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1024000,"data_stored":862643,"data_compressed":22051,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037812,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":991232,"data_stored":469688,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":1064302,"data_compressed":38585,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":469809,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":533228,"data_compressed":4764,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":999424,"data_stored":471597,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1060864,"data_stored":534288,"data_compressed":4764,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":993551,"data_compressed":28207,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888135,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":470202,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724611,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":1193484,"data_compressed":44741,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65040,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66100,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":134811,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":197156,"data_compressed":8015,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":395639,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:26:58.598 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.733+0000 7fec2b3d8640 1 -- 172.21.15.69:0/4126628159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec24101a50 msgr2=0x7fec24105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.733+0000 7fec2b3d8640 1 --2- 172.21.15.69:0/4126628159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec24101a50 0x7fec24105a90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fec18009900 tx=0x7fec1802a410 comp rx=0 tx=0).stop 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 -- 172.21.15.69:0/4126628159 shutdown_connections 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 --2- 172.21.15.69:0/4126628159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec24101a50 0x7fec24105a90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 --2- 172.21.15.69:0/4126628159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec24106170 0x7fec2410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 --2- 172.21.15.69:0/4126628159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec241010a0 0x7fec24101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 -- 172.21.15.69:0/4126628159 >> 172.21.15.69:0/4126628159 conn(0x7fec24077f50 msgr2=0x7fec24078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 -- 172.21.15.69:0/4126628159 shutdown_connections 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 -- 172.21.15.69:0/4126628159 wait complete. 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 Processor -- start 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 -- start start 2024-04-23T10:26:58.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec241010a0 0x7fec240feb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec24106170 0x7fec240ff090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec240ff5d0 0x7fec241a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fec241111d0 con 0x7fec240ff5d0 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fec24111050 con 0x7fec241010a0 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.734+0000 7fec2b3d8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fec24111350 con 0x7fec24106170 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec29975640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec240ff5d0 0x7fec241a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec29975640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec240ff5d0 0x7fec241a67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38616/0 (socket says 172.21.15.69:38616) 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec29975640 1 -- 172.21.15.69:0/1273517803 learned_addr learned my addr 172.21.15.69:0/1273517803 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec28973640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec24106170 0x7fec240ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec29174640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec241010a0 0x7fec240feb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec29975640 1 -- 172.21.15.69:0/1273517803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec24106170 msgr2=0x7fec240ff090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec29975640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec24106170 0x7fec240ff090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec29975640 1 -- 172.21.15.69:0/1273517803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec241010a0 msgr2=0x7fec240feb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec29975640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec241010a0 0x7fec240feb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec29975640 1 -- 172.21.15.69:0/1273517803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec241a6ed0 con 0x7fec240ff5d0 2024-04-23T10:26:58.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec29975640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec240ff5d0 0x7fec241a67d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00cad0 tx=0x7fec1c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:58.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec167fc640 1 -- 172.21.15.69:0/1273517803 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00ad60 con 0x7fec240ff5d0 2024-04-23T10:26:58.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec167fc640 1 -- 172.21.15.69:0/1273517803 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fec1c005020 con 0x7fec240ff5d0 2024-04-23T10:26:58.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec2b3d8640 1 -- 172.21.15.69:0/1273517803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec241a71c0 con 0x7fec240ff5d0 2024-04-23T10:26:58.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec167fc640 1 -- 172.21.15.69:0/1273517803 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00f690 con 0x7fec240ff5d0 2024-04-23T10:26:58.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.735+0000 7fec2b3d8640 1 -- 172.21.15.69:0/1273517803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec241a7710 con 0x7fec240ff5d0 2024-04-23T10:26:58.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.736+0000 7fec2b3d8640 1 -- 172.21.15.69:0/1273517803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec24068d70 con 0x7fec240ff5d0 2024-04-23T10:26:58.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.737+0000 7fec167fc640 1 -- 172.21.15.69:0/1273517803 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7fec1c0051d0 con 0x7fec240ff5d0 2024-04-23T10:26:58.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.738+0000 7fec167fc640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fec100a3e60 0x7fec100a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:58.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.738+0000 7fec29174640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fec100a3e60 0x7fec100a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:58.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.738+0000 7fec167fc640 1 -- 172.21.15.69:0/1273517803 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fec1c0d0810 con 0x7fec240ff5d0 2024-04-23T10:26:58.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.738+0000 7fec29174640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fec100a3e60 0x7fec100a6320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fec2000abe0 tx=0x7fec2000a2d0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:58.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.742+0000 7fec167fc640 1 -- 172.21.15.69:0/1273517803 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fec1c014030 con 0x7fec240ff5d0 2024-04-23T10:26:58.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.914+0000 7fec2b3d8640 1 -- 172.21.15.69:0/1273517803 --> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec24101ac0 con 0x7fec100a3e60 2024-04-23T10:26:58.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.921+0000 7fec167fc640 1 -- 172.21.15.69:0/1273517803 <== mgr.24836 v2:172.21.15.69:6800/908508073 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258081 (secure 0 0 0) 0x7fec24101ac0 con 0x7fec100a3e60 2024-04-23T10:26:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:58.924 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-23T10:26:58.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 -- 172.21.15.69:0/1273517803 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fec100a3e60 msgr2=0x7fec100a6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fec100a3e60 0x7fec100a6320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fec2000abe0 tx=0x7fec2000a2d0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 -- 172.21.15.69:0/1273517803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec240ff5d0 msgr2=0x7fec241a67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:58.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec240ff5d0 0x7fec241a67d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00cad0 tx=0x7fec1c00ced0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 -- 172.21.15.69:0/1273517803 shutdown_connections 2024-04-23T10:26:58.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fec100a3e60 0x7fec100a6320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec240ff5d0 0x7fec241a67d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec24106170 0x7fec240ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 --2- 172.21.15.69:0/1273517803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec241010a0 0x7fec240feb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:58.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 -- 172.21.15.69:0/1273517803 >> 172.21.15.69:0/1273517803 conn(0x7fec24077f50 msgr2=0x7fec240691a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:58.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 -- 172.21.15.69:0/1273517803 shutdown_connections 2024-04-23T10:26:58.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:58.924+0000 7fec2b3d8640 1 -- 172.21.15.69:0/1273517803 wait complete. 2024-04-23T10:26:58.934 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-23T10:26:57.280910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188064,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1433,"num_read_kb":873,"num_write":553,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180853,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":939,"ondisk_log_size":939,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365432,"kb_used_data":12084,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576392,"statfs":{"total":1151940427776,"available":1151566225408,"internally_reserved":0,"allocated":12374016,"data_stored":9182448,"data_compressed":223383,"data_compressed_allocated":294912,"data_compressed_original":3440640,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.990717"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360811+0000","last_change":"2024-04-23T10:24:53.504514+0000","last_active":"2024-04-23T10:26:53.360811+0000","last_peered":"2024-04-23T10:26:53.360811+0000","last_clean":"2024-04-23T10:26:53.360811+0000","last_became_active":"2024-04-23T10:24:53.504105+0000","last_became_peered":"2024-04-23T10:24:53.504105+0000","last_unstale":"2024-04-23T10:26:53.360811+0000","last_undegraded":"2024-04-23T10:26:53.360811+0000","last_fullsized":"2024-04-23T10:26:53.360811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:49.730698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513756+0000","last_change":"2024-04-23T10:24:53.504534+0000","last_active":"2024-04-23T10:26:53.513756+0000","last_peered":"2024-04-23T10:26:53.513756+0000","last_clean":"2024-04-23T10:26:53.513756+0000","last_became_active":"2024-04-23T10:24:53.504244+0000","last_became_peered":"2024-04-23T10:24:53.504244+0000","last_unstale":"2024-04-23T10:26:53.513756+0000","last_undegraded":"2024-04-23T10:26:53.513756+0000","last_fullsized":"2024-04-23T10:26:53.513756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:12:57.447009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513390+0000","last_change":"2024-04-23T10:24:53.502922+0000","last_active":"2024-04-23T10:26:53.513390+0000","last_peered":"2024-04-23T10:26:53.513390+0000","last_clean":"2024-04-23T10:26:53.513390+0000","last_became_active":"2024-04-23T10:24:53.502519+0000","last_became_peered":"2024-04-23T10:24:53.502519+0000","last_unstale":"2024-04-23T10:26:53.513390+0000","last_undegraded":"2024-04-23T10:26:53.513390+0000","last_fullsized":"2024-04-23T10:26:53.513390+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:58:35.871081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486193+0000","last_change":"2024-04-23T10:24:53.500049+0000","last_active":"2024-04-23T10:26:53.486193+0000","last_peered":"2024-04-23T10:26:53.486193+0000","last_clean":"2024-04-23T10:26:53.486193+0000","last_became_active":"2024-04-23T10:24:53.499607+0000","last_became_peered":"2024-04-23T10:24:53.499607+0000","last_unstale":"2024-04-23T10:26:53.486193+0000","last_undegraded":"2024-04-23T10:26:53.486193+0000","last_fullsized":"2024-04-23T10:26:53.486193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:10:27.104622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269934+0000","last_change":"2024-04-23T10:24:53.493739+0000","last_active":"2024-04-23T10:26:53.269934+0000","last_peered":"2024-04-23T10:26:53.269934+0000","last_clean":"2024-04-23T10:26:53.269934+0000","last_became_active":"2024-04-23T10:24:53.492471+0000","last_became_peered":"2024-04-23T10:24:53.492471+0000","last_unstale":"2024-04-23T10:26:53.269934+0000","last_undegraded":"2024-04-23T10:26:53.269934+0000","last_fullsized":"2024-04-23T10:26:53.269934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:43.267366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369215+0000","last_change":"2024-04-23T10:24:53.500426+0000","last_active":"2024-04-23T10:26:53.369215+0000","last_peered":"2024-04-23T10:26:53.369215+0000","last_clean":"2024-04-23T10:26:53.369215+0000","last_became_active":"2024-04-23T10:24:53.500052+0000","last_became_peered":"2024-04-23T10:24:53.500052+0000","last_unstale":"2024-04-23T10:26:53.369215+0000","last_undegraded":"2024-04-23T10:26:53.369215+0000","last_fullsized":"2024-04-23T10:26:53.369215+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:21:36.361816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267875+0000","last_change":"2024-04-23T10:24:53.501672+0000","last_active":"2024-04-23T10:26:53.267875+0000","last_peered":"2024-04-23T10:26:53.267875+0000","last_clean":"2024-04-23T10:26:53.267875+0000","last_became_active":"2024-04-23T10:24:53.501345+0000","last_became_peered":"2024-04-23T10:24:53.501345+0000","last_unstale":"2024-04-23T10:26:53.267875+0000","last_undegraded":"2024-04-23T10:26:53.267875+0000","last_fullsized":"2024-04-23T10:26:53.267875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:31:41.488482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360520+0000","last_change":"2024-04-23T10:24:53.499442+0000","last_active":"2024-04-23T10:26:53.360520+0000","last_peered":"2024-04-23T10:26:53.360520+0000","last_clean":"2024-04-23T10:26:53.360520+0000","last_became_active":"2024-04-23T10:24:53.499131+0000","last_became_peered":"2024-04-23T10:24:53.499131+0000","last_unstale":"2024-04-23T10:26:53.360520+0000","last_undegraded":"2024-04-23T10:26:53.360520+0000","last_fullsized":"2024-04-23T10:26:53.360520+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:17:21.815851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509244+0000","last_change":"2024-04-23T10:24:53.501235+0000","last_active":"2024-04-23T10:26:53.509244+0000","last_peered":"2024-04-23T10:26:53.509244+0000","last_clean":"2024-04-23T10:26:53.509244+0000","last_became_active":"2024-04-23T10:24:53.500392+0000","last_became_peered":"2024-04-23T10:24:53.500392+0000","last_unstale":"2024-04-23T10:26:53.509244+0000","last_undegraded":"2024-04-23T10:26:53.509244+0000","last_fullsized":"2024-04-23T10:26:53.509244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:58:20.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369317+0000","last_change":"2024-04-23T10:24:53.504235+0000","last_active":"2024-04-23T10:26:53.369317+0000","last_peered":"2024-04-23T10:26:53.369317+0000","last_clean":"2024-04-23T10:26:53.369317+0000","last_became_active":"2024-04-23T10:24:53.503743+0000","last_became_peered":"2024-04-23T10:24:53.503743+0000","last_unstale":"2024-04-23T10:26:53.369317+0000","last_undegraded":"2024-04-23T10:26:53.369317+0000","last_fullsized":"2024-04-23T10:26:53.369317+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:25:53.881433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268044+0000","last_change":"2024-04-23T10:24:53.497355+0000","last_active":"2024-04-23T10:26:53.268044+0000","last_peered":"2024-04-23T10:26:53.268044+0000","last_clean":"2024-04-23T10:26:53.268044+0000","last_became_active":"2024-04-23T10:24:53.494195+0000","last_became_peered":"2024-04-23T10:24:53.494195+0000","last_unstale":"2024-04-23T10:26:53.268044+0000","last_undegraded":"2024-04-23T10:26:53.268044+0000","last_fullsized":"2024-04-23T10:26:53.268044+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:19:48.638789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486102+0000","last_change":"2024-04-23T10:24:53.504513+0000","last_active":"2024-04-23T10:26:53.486102+0000","last_peered":"2024-04-23T10:26:53.486102+0000","last_clean":"2024-04-23T10:26:53.486102+0000","last_became_active":"2024-04-23T10:24:53.504058+0000","last_became_peered":"2024-04-23T10:24:53.504058+0000","last_unstale":"2024-04-23T10:26:53.486102+0000","last_undegraded":"2024-04-23T10:26:53.486102+0000","last_fullsized":"2024-04-23T10:26:53.486102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:16:34.302848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483342+0000","last_change":"2024-04-23T10:24:53.495277+0000","last_active":"2024-04-23T10:26:53.483342+0000","last_peered":"2024-04-23T10:26:53.483342+0000","last_clean":"2024-04-23T10:26:53.483342+0000","last_became_active":"2024-04-23T10:24:53.494925+0000","last_became_peered":"2024-04-23T10:24:53.494925+0000","last_unstale":"2024-04-23T10:26:53.483342+0000","last_undegraded":"2024-04-23T10:26:53.483342+0000","last_fullsized":"2024-04-23T10:26:53.483342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:33.647408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513294+0000","last_change":"2024-04-23T10:24:53.504082+0000","last_active":"2024-04-23T10:26:53.513294+0000","last_peered":"2024-04-23T10:26:53.513294+0000","last_clean":"2024-04-23T10:26:53.513294+0000","last_became_active":"2024-04-23T10:24:53.503753+0000","last_became_peered":"2024-04-23T10:24:53.503753+0000","last_unstale":"2024-04-23T10:26:53.513294+0000","last_undegraded":"2024-04-23T10:26:53.513294+0000","last_fullsized":"2024-04-23T10:26:53.513294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:59.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513636+0000","last_change":"2024-04-23T10:26:00.091416+0000","last_active":"2024-04-23T10:26:53.513636+0000","last_peered":"2024-04-23T10:26:53.513636+0000","last_clean":"2024-04-23T10:26:53.513636+0000","last_became_active":"2024-04-23T10:26:00.091030+0000","last_became_peered":"2024-04-23T10:26:00.091030+0000","last_unstale":"2024-04-23T10:26:53.513636+0000","last_undegraded":"2024-04-23T10:26:53.513636+0000","last_fullsized":"2024-04-23T10:26:53.513636+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:28.835870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509148+0000","last_change":"2024-04-23T10:24:53.498916+0000","last_active":"2024-04-23T10:26:53.509148+0000","last_peered":"2024-04-23T10:26:53.509148+0000","last_clean":"2024-04-23T10:26:53.509148+0000","last_became_active":"2024-04-23T10:24:53.498560+0000","last_became_peered":"2024-04-23T10:24:53.498560+0000","last_unstale":"2024-04-23T10:26:53.509148+0000","last_undegraded":"2024-04-23T10:26:53.509148+0000","last_fullsized":"2024-04-23T10:26:53.509148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:24:07.965091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360836+0000","last_change":"2024-04-23T10:24:53.505167+0000","last_active":"2024-04-23T10:26:53.360836+0000","last_peered":"2024-04-23T10:26:53.360836+0000","last_clean":"2024-04-23T10:26:53.360836+0000","last_became_active":"2024-04-23T10:24:53.504832+0000","last_became_peered":"2024-04-23T10:24:53.504832+0000","last_unstale":"2024-04-23T10:26:53.360836+0000","last_undegraded":"2024-04-23T10:26:53.360836+0000","last_fullsized":"2024-04-23T10:26:53.360836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:58:20.867496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.266311+0000","last_change":"2024-04-23T10:24:53.505363+0000","last_active":"2024-04-23T10:26:53.266311+0000","last_peered":"2024-04-23T10:26:53.266311+0000","last_clean":"2024-04-23T10:26:53.266311+0000","last_became_active":"2024-04-23T10:24:53.505029+0000","last_became_peered":"2024-04-23T10:24:53.505029+0000","last_unstale":"2024-04-23T10:26:53.266311+0000","last_undegraded":"2024-04-23T10:26:53.266311+0000","last_fullsized":"2024-04-23T10:26:53.266311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:22.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513220+0000","last_change":"2024-04-23T10:24:53.497666+0000","last_active":"2024-04-23T10:26:53.513220+0000","last_peered":"2024-04-23T10:26:53.513220+0000","last_clean":"2024-04-23T10:26:53.513220+0000","last_became_active":"2024-04-23T10:24:53.495144+0000","last_became_peered":"2024-04-23T10:24:53.495144+0000","last_unstale":"2024-04-23T10:26:53.513220+0000","last_undegraded":"2024-04-23T10:26:53.513220+0000","last_fullsized":"2024-04-23T10:26:53.513220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:23:27.148289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'14","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.481791+0000","last_change":"2024-04-23T10:24:52.496907+0000","last_active":"2024-04-23T10:26:53.481791+0000","last_peered":"2024-04-23T10:26:53.481791+0000","last_clean":"2024-04-23T10:26:53.481791+0000","last_became_active":"2024-04-23T10:24:52.496567+0000","last_became_peered":"2024-04-23T10:24:52.496567+0000","last_unstale":"2024-04-23T10:26:53.481791+0000","last_undegraded":"2024-04-23T10:26:53.481791+0000","last_fullsized":"2024-04-23T10:26:53.481791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:33.195504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.361042+0000","last_change":"2024-04-23T10:24:53.501140+0000","last_active":"2024-04-23T10:26:53.361042+0000","last_peered":"2024-04-23T10:26:53.361042+0000","last_clean":"2024-04-23T10:26:53.361042+0000","last_became_active":"2024-04-23T10:24:53.500826+0000","last_became_peered":"2024-04-23T10:24:53.500826+0000","last_unstale":"2024-04-23T10:26:53.361042+0000","last_undegraded":"2024-04-23T10:26:53.361042+0000","last_fullsized":"2024-04-23T10:26:53.361042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:39.178784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.361229+0000","last_change":"2024-04-23T10:24:52.494413+0000","last_active":"2024-04-23T10:26:53.361229+0000","last_peered":"2024-04-23T10:26:53.361229+0000","last_clean":"2024-04-23T10:26:53.361229+0000","last_became_active":"2024-04-23T10:24:52.494092+0000","last_became_peered":"2024-04-23T10:24:52.494092+0000","last_unstale":"2024-04-23T10:26:53.361229+0000","last_undegraded":"2024-04-23T10:26:53.361229+0000","last_fullsized":"2024-04-23T10:26:53.361229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:42:09.407787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513214+0000","last_change":"2024-04-23T10:24:53.495285+0000","last_active":"2024-04-23T10:26:53.513214+0000","last_peered":"2024-04-23T10:26:53.513214+0000","last_clean":"2024-04-23T10:26:53.513214+0000","last_became_active":"2024-04-23T10:24:53.494959+0000","last_became_peered":"2024-04-23T10:24:53.494959+0000","last_unstale":"2024-04-23T10:26:53.513214+0000","last_undegraded":"2024-04-23T10:26:53.513214+0000","last_fullsized":"2024-04-23T10:26:53.513214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:59.209505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270433+0000","last_change":"2024-04-23T10:24:52.496310+0000","last_active":"2024-04-23T10:26:53.270433+0000","last_peered":"2024-04-23T10:26:53.270433+0000","last_clean":"2024-04-23T10:26:53.270433+0000","last_became_active":"2024-04-23T10:24:52.496009+0000","last_became_peered":"2024-04-23T10:24:52.496009+0000","last_unstale":"2024-04-23T10:26:53.270433+0000","last_undegraded":"2024-04-23T10:26:53.270433+0000","last_fullsized":"2024-04-23T10:26:53.270433+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:05:46.911691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509924+0000","last_change":"2024-04-23T10:24:53.498204+0000","last_active":"2024-04-23T10:26:53.509924+0000","last_peered":"2024-04-23T10:26:53.509924+0000","last_clean":"2024-04-23T10:26:53.509924+0000","last_became_active":"2024-04-23T10:24:53.496535+0000","last_became_peered":"2024-04-23T10:24:53.496535+0000","last_unstale":"2024-04-23T10:26:53.509924+0000","last_undegraded":"2024-04-23T10:26:53.509924+0000","last_fullsized":"2024-04-23T10:26:53.509924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:32.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270193+0000","last_change":"2024-04-23T10:24:52.493485+0000","last_active":"2024-04-23T10:26:53.270193+0000","last_peered":"2024-04-23T10:26:53.270193+0000","last_clean":"2024-04-23T10:26:53.270193+0000","last_became_active":"2024-04-23T10:24:52.493164+0000","last_became_peered":"2024-04-23T10:24:52.493164+0000","last_unstale":"2024-04-23T10:26:53.270193+0000","last_undegraded":"2024-04-23T10:26:53.270193+0000","last_fullsized":"2024-04-23T10:26:53.270193+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:42:33.701248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366725+0000","last_change":"2024-04-23T10:24:53.507145+0000","last_active":"2024-04-23T10:26:53.366725+0000","last_peered":"2024-04-23T10:26:53.366725+0000","last_clean":"2024-04-23T10:26:53.366725+0000","last_became_active":"2024-04-23T10:24:53.506824+0000","last_became_peered":"2024-04-23T10:24:53.506824+0000","last_unstale":"2024-04-23T10:26:53.366725+0000","last_undegraded":"2024-04-23T10:26:53.366725+0000","last_fullsized":"2024-04-23T10:26:53.366725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:37:54.870303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.482159+0000","last_change":"2024-04-23T10:24:52.498646+0000","last_active":"2024-04-23T10:26:53.482159+0000","last_peered":"2024-04-23T10:26:53.482159+0000","last_clean":"2024-04-23T10:26:53.482159+0000","last_became_active":"2024-04-23T10:24:52.498328+0000","last_became_peered":"2024-04-23T10:24:52.498328+0000","last_unstale":"2024-04-23T10:26:53.482159+0000","last_undegraded":"2024-04-23T10:26:53.482159+0000","last_fullsized":"2024-04-23T10:26:53.482159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:26:33.646144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269856+0000","last_change":"2024-04-23T10:26:00.216570+0000","last_active":"2024-04-23T10:26:53.269856+0000","last_peered":"2024-04-23T10:26:53.269856+0000","last_clean":"2024-04-23T10:26:53.269856+0000","last_became_active":"2024-04-23T10:26:00.216228+0000","last_became_peered":"2024-04-23T10:26:00.216228+0000","last_unstale":"2024-04-23T10:26:53.269856+0000","last_undegraded":"2024-04-23T10:26:53.269856+0000","last_fullsized":"2024-04-23T10:26:53.269856+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:57:54.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369044+0000","last_change":"2024-04-23T10:24:52.495242+0000","last_active":"2024-04-23T10:26:53.369044+0000","last_peered":"2024-04-23T10:26:53.369044+0000","last_clean":"2024-04-23T10:26:53.369044+0000","last_became_active":"2024-04-23T10:24:52.493255+0000","last_became_peered":"2024-04-23T10:24:52.493255+0000","last_unstale":"2024-04-23T10:26:53.369044+0000","last_undegraded":"2024-04-23T10:26:53.369044+0000","last_fullsized":"2024-04-23T10:26:53.369044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:33.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366744+0000","last_change":"2024-04-23T10:24:53.499843+0000","last_active":"2024-04-23T10:26:53.366744+0000","last_peered":"2024-04-23T10:26:53.366744+0000","last_clean":"2024-04-23T10:26:53.366744+0000","last_became_active":"2024-04-23T10:24:53.499512+0000","last_became_peered":"2024-04-23T10:24:53.499512+0000","last_unstale":"2024-04-23T10:26:53.366744+0000","last_undegraded":"2024-04-23T10:26:53.366744+0000","last_fullsized":"2024-04-23T10:26:53.366744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:20.333479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.484060+0000","last_change":"2024-04-23T10:24:52.495915+0000","last_active":"2024-04-23T10:26:53.484060+0000","last_peered":"2024-04-23T10:26:53.484060+0000","last_clean":"2024-04-23T10:26:53.484060+0000","last_became_active":"2024-04-23T10:24:52.495558+0000","last_became_peered":"2024-04-23T10:24:52.495558+0000","last_unstale":"2024-04-23T10:26:53.484060+0000","last_undegraded":"2024-04-23T10:26:53.484060+0000","last_fullsized":"2024-04-23T10:26:53.484060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:41:09.080880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360587+0000","last_change":"2024-04-23T10:24:53.496376+0000","last_active":"2024-04-23T10:26:53.360587+0000","last_peered":"2024-04-23T10:26:53.360587+0000","last_clean":"2024-04-23T10:26:53.360587+0000","last_became_active":"2024-04-23T10:24:53.496067+0000","last_became_peered":"2024-04-23T10:24:53.496067+0000","last_unstale":"2024-04-23T10:26:53.360587+0000","last_undegraded":"2024-04-23T10:26:53.360587+0000","last_fullsized":"2024-04-23T10:26:53.360587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:02:51.252365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366356+0000","last_change":"2024-04-23T10:24:52.499566+0000","last_active":"2024-04-23T10:26:53.366356+0000","last_peered":"2024-04-23T10:26:53.366356+0000","last_clean":"2024-04-23T10:26:53.366356+0000","last_became_active":"2024-04-23T10:24:52.499277+0000","last_became_peered":"2024-04-23T10:24:52.499277+0000","last_unstale":"2024-04-23T10:26:53.366356+0000","last_undegraded":"2024-04-23T10:26:53.366356+0000","last_fullsized":"2024-04-23T10:26:53.366356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:38.716187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.266066+0000","last_change":"2024-04-23T10:24:53.499617+0000","last_active":"2024-04-23T10:26:53.266066+0000","last_peered":"2024-04-23T10:26:53.266066+0000","last_clean":"2024-04-23T10:26:53.266066+0000","last_became_active":"2024-04-23T10:24:53.499283+0000","last_became_peered":"2024-04-23T10:24:53.499283+0000","last_unstale":"2024-04-23T10:26:53.266066+0000","last_undegraded":"2024-04-23T10:26:53.266066+0000","last_fullsized":"2024-04-23T10:26:53.266066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:36.931697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'7","reported_seq":261,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.516687+0000","last_change":"2024-04-23T10:24:52.492276+0000","last_active":"2024-04-23T10:26:53.516687+0000","last_peered":"2024-04-23T10:26:53.516687+0000","last_clean":"2024-04-23T10:26:53.516687+0000","last_became_active":"2024-04-23T10:24:52.491979+0000","last_became_peered":"2024-04-23T10:24:52.491979+0000","last_unstale":"2024-04-23T10:26:53.516687+0000","last_undegraded":"2024-04-23T10:26:53.516687+0000","last_fullsized":"2024-04-23T10:26:53.516687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:15:40.847446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":233,"num_read_kb":233,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509422+0000","last_change":"2024-04-23T10:24:53.500964+0000","last_active":"2024-04-23T10:26:53.509422+0000","last_peered":"2024-04-23T10:26:53.509422+0000","last_clean":"2024-04-23T10:26:53.509422+0000","last_became_active":"2024-04-23T10:24:53.499209+0000","last_became_peered":"2024-04-23T10:24:53.499209+0000","last_unstale":"2024-04-23T10:26:53.509422+0000","last_undegraded":"2024-04-23T10:26:53.509422+0000","last_fullsized":"2024-04-23T10:26:53.509422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:27:29.539994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268207+0000","last_change":"2024-04-23T10:24:52.496016+0000","last_active":"2024-04-23T10:26:53.268207+0000","last_peered":"2024-04-23T10:26:53.268207+0000","last_clean":"2024-04-23T10:26:53.268207+0000","last_became_active":"2024-04-23T10:24:52.495711+0000","last_became_peered":"2024-04-23T10:24:52.495711+0000","last_unstale":"2024-04-23T10:26:53.268207+0000","last_undegraded":"2024-04-23T10:26:53.268207+0000","last_fullsized":"2024-04-23T10:26:53.268207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:31:30.970731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513895+0000","last_change":"2024-04-23T10:26:00.091494+0000","last_active":"2024-04-23T10:26:53.513895+0000","last_peered":"2024-04-23T10:26:53.513895+0000","last_clean":"2024-04-23T10:26:53.513895+0000","last_became_active":"2024-04-23T10:26:00.091122+0000","last_became_peered":"2024-04-23T10:26:00.091122+0000","last_unstale":"2024-04-23T10:26:53.513895+0000","last_undegraded":"2024-04-23T10:26:53.513895+0000","last_fullsized":"2024-04-23T10:26:53.513895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:32.833741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366824+0000","last_change":"2024-04-23T10:24:52.497200+0000","last_active":"2024-04-23T10:26:53.366824+0000","last_peered":"2024-04-23T10:26:53.366824+0000","last_clean":"2024-04-23T10:26:53.366824+0000","last_became_active":"2024-04-23T10:24:52.496864+0000","last_became_peered":"2024-04-23T10:24:52.496864+0000","last_unstale":"2024-04-23T10:26:53.366824+0000","last_undegraded":"2024-04-23T10:26:53.366824+0000","last_fullsized":"2024-04-23T10:26:53.366824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:16.514060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509302+0000","last_change":"2024-04-23T10:24:53.498438+0000","last_active":"2024-04-23T10:26:53.509302+0000","last_peered":"2024-04-23T10:26:53.509302+0000","last_clean":"2024-04-23T10:26:53.509302+0000","last_became_active":"2024-04-23T10:24:53.496569+0000","last_became_peered":"2024-04-23T10:24:53.496569+0000","last_unstale":"2024-04-23T10:26:53.509302+0000","last_undegraded":"2024-04-23T10:26:53.509302+0000","last_fullsized":"2024-04-23T10:26:53.509302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:06:45.964699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'34","reported_seq":300,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.519323+0000","last_change":"2024-04-23T10:24:52.490058+0000","last_active":"2024-04-23T10:26:53.519323+0000","last_peered":"2024-04-23T10:26:53.519323+0000","last_clean":"2024-04-23T10:26:53.519323+0000","last_became_active":"2024-04-23T10:24:52.489720+0000","last_became_peered":"2024-04-23T10:24:52.489720+0000","last_unstale":"2024-04-23T10:26:53.519323+0000","last_undegraded":"2024-04-23T10:26:53.519323+0000","last_fullsized":"2024-04-23T10:26:53.519323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:41.049778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62506,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":245,"num_read_kb":178,"num_write":36,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270171+0000","last_change":"2024-04-23T10:24:53.507122+0000","last_active":"2024-04-23T10:26:53.270171+0000","last_peered":"2024-04-23T10:26:53.270171+0000","last_clean":"2024-04-23T10:26:53.270171+0000","last_became_active":"2024-04-23T10:24:53.506838+0000","last_became_peered":"2024-04-23T10:24:53.506838+0000","last_unstale":"2024-04-23T10:26:53.270171+0000","last_undegraded":"2024-04-23T10:26:53.270171+0000","last_fullsized":"2024-04-23T10:26:53.270171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:59:51.289630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513981+0000","last_change":"2024-04-23T10:24:52.499787+0000","last_active":"2024-04-23T10:26:53.513981+0000","last_peered":"2024-04-23T10:26:53.513981+0000","last_clean":"2024-04-23T10:26:53.513981+0000","last_became_active":"2024-04-23T10:24:52.499400+0000","last_became_peered":"2024-04-23T10:24:52.499400+0000","last_unstale":"2024-04-23T10:26:53.513981+0000","last_undegraded":"2024-04-23T10:26:53.513981+0000","last_fullsized":"2024-04-23T10:26:53.513981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:15:17.638984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483399+0000","last_change":"2024-04-23T10:24:53.495773+0000","last_active":"2024-04-23T10:26:53.483399+0000","last_peered":"2024-04-23T10:26:53.483399+0000","last_clean":"2024-04-23T10:26:53.483399+0000","last_became_active":"2024-04-23T10:24:53.495456+0000","last_became_peered":"2024-04-23T10:24:53.495456+0000","last_unstale":"2024-04-23T10:26:53.483399+0000","last_undegraded":"2024-04-23T10:26:53.483399+0000","last_fullsized":"2024-04-23T10:26:53.483399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:12:06.638141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366448+0000","last_change":"2024-04-23T10:24:52.498660+0000","last_active":"2024-04-23T10:26:53.366448+0000","last_peered":"2024-04-23T10:26:53.366448+0000","last_clean":"2024-04-23T10:26:53.366448+0000","last_became_active":"2024-04-23T10:24:52.498302+0000","last_became_peered":"2024-04-23T10:24:52.498302+0000","last_unstale":"2024-04-23T10:26:53.366448+0000","last_undegraded":"2024-04-23T10:26:53.366448+0000","last_fullsized":"2024-04-23T10:26:53.366448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:49:23.826748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268154+0000","last_change":"2024-04-23T10:24:53.501718+0000","last_active":"2024-04-23T10:26:53.268154+0000","last_peered":"2024-04-23T10:26:53.268154+0000","last_clean":"2024-04-23T10:26:53.268154+0000","last_became_active":"2024-04-23T10:24:53.501359+0000","last_became_peered":"2024-04-23T10:24:53.501359+0000","last_unstale":"2024-04-23T10:26:53.268154+0000","last_undegraded":"2024-04-23T10:26:53.268154+0000","last_fullsized":"2024-04-23T10:26:53.268154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:51:42.474899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'9","reported_seq":148,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513026+0000","last_change":"2024-04-23T10:24:52.493910+0000","last_active":"2024-04-23T10:26:53.513026+0000","last_peered":"2024-04-23T10:26:53.513026+0000","last_clean":"2024-04-23T10:26:53.513026+0000","last_became_active":"2024-04-23T10:24:52.493536+0000","last_became_peered":"2024-04-23T10:24:52.493536+0000","last_unstale":"2024-04-23T10:26:53.513026+0000","last_undegraded":"2024-04-23T10:26:53.513026+0000","last_fullsized":"2024-04-23T10:26:53.513026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:23.806993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267746+0000","last_change":"2024-04-23T10:24:53.498221+0000","last_active":"2024-04-23T10:26:53.267746+0000","last_peered":"2024-04-23T10:26:53.267746+0000","last_clean":"2024-04-23T10:26:53.267746+0000","last_became_active":"2024-04-23T10:24:53.497887+0000","last_became_peered":"2024-04-23T10:24:53.497887+0000","last_unstale":"2024-04-23T10:26:53.267746+0000","last_undegraded":"2024-04-23T10:26:53.267746+0000","last_fullsized":"2024-04-23T10:26:53.267746+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:49:02.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269915+0000","last_change":"2024-04-23T10:24:52.498883+0000","last_active":"2024-04-23T10:26:53.269915+0000","last_peered":"2024-04-23T10:26:53.269915+0000","last_clean":"2024-04-23T10:26:53.269915+0000","last_became_active":"2024-04-23T10:24:52.498562+0000","last_became_peered":"2024-04-23T10:24:52.498562+0000","last_unstale":"2024-04-23T10:26:53.269915+0000","last_undegraded":"2024-04-23T10:26:53.269915+0000","last_fullsized":"2024-04-23T10:26:53.269915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:33.914481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366468+0000","last_change":"2024-04-23T10:24:53.506303+0000","last_active":"2024-04-23T10:26:53.366468+0000","last_peered":"2024-04-23T10:26:53.366468+0000","last_clean":"2024-04-23T10:26:53.366468+0000","last_became_active":"2024-04-23T10:24:53.505850+0000","last_became_peered":"2024-04-23T10:24:53.505850+0000","last_unstale":"2024-04-23T10:26:53.366468+0000","last_undegraded":"2024-04-23T10:26:53.366468+0000","last_fullsized":"2024-04-23T10:26:53.366468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:18.498188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270324+0000","last_change":"2024-04-23T10:24:52.493853+0000","last_active":"2024-04-23T10:26:53.270324+0000","last_peered":"2024-04-23T10:26:53.270324+0000","last_clean":"2024-04-23T10:26:53.270324+0000","last_became_active":"2024-04-23T10:24:52.492932+0000","last_became_peered":"2024-04-23T10:24:52.492932+0000","last_unstale":"2024-04-23T10:26:53.270324+0000","last_undegraded":"2024-04-23T10:26:53.270324+0000","last_fullsized":"2024-04-23T10:26:53.270324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:12:33.327611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360638+0000","last_change":"2024-04-23T10:26:00.284417+0000","last_active":"2024-04-23T10:26:53.360638+0000","last_peered":"2024-04-23T10:26:53.360638+0000","last_clean":"2024-04-23T10:26:53.360638+0000","last_became_active":"2024-04-23T10:26:00.284097+0000","last_became_peered":"2024-04-23T10:26:00.284097+0000","last_unstale":"2024-04-23T10:26:53.360638+0000","last_undegraded":"2024-04-23T10:26:53.360638+0000","last_fullsized":"2024-04-23T10:26:53.360638+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:53.114887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.266231+0000","last_change":"2024-04-23T10:24:52.494032+0000","last_active":"2024-04-23T10:26:53.266231+0000","last_peered":"2024-04-23T10:26:53.266231+0000","last_clean":"2024-04-23T10:26:53.266231+0000","last_became_active":"2024-04-23T10:24:52.493699+0000","last_became_peered":"2024-04-23T10:24:52.493699+0000","last_unstale":"2024-04-23T10:26:53.266231+0000","last_undegraded":"2024-04-23T10:26:53.266231+0000","last_fullsized":"2024-04-23T10:26:53.266231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:54.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369228+0000","last_change":"2024-04-23T10:24:53.494846+0000","last_active":"2024-04-23T10:26:53.369228+0000","last_peered":"2024-04-23T10:26:53.369228+0000","last_clean":"2024-04-23T10:26:53.369228+0000","last_became_active":"2024-04-23T10:24:53.494541+0000","last_became_peered":"2024-04-23T10:24:53.494541+0000","last_unstale":"2024-04-23T10:26:53.369228+0000","last_undegraded":"2024-04-23T10:26:53.369228+0000","last_fullsized":"2024-04-23T10:26:53.369228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:33:24.263803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'7","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509421+0000","last_change":"2024-04-23T10:24:52.499078+0000","last_active":"2024-04-23T10:26:53.509421+0000","last_peered":"2024-04-23T10:26:53.509421+0000","last_clean":"2024-04-23T10:26:53.509421+0000","last_became_active":"2024-04-23T10:24:52.498764+0000","last_became_peered":"2024-04-23T10:24:52.498764+0000","last_unstale":"2024-04-23T10:26:53.509421+0000","last_undegraded":"2024-04-23T10:26:53.509421+0000","last_fullsized":"2024-04-23T10:26:53.509421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:10:51.634437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1370,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369333+0000","last_change":"2024-04-23T10:26:00.087050+0000","last_active":"2024-04-23T10:26:53.369333+0000","last_peered":"2024-04-23T10:26:53.369333+0000","last_clean":"2024-04-23T10:26:53.369333+0000","last_became_active":"2024-04-23T10:26:00.086634+0000","last_became_peered":"2024-04-23T10:26:00.086634+0000","last_unstale":"2024-04-23T10:26:53.369333+0000","last_undegraded":"2024-04-23T10:26:53.369333+0000","last_fullsized":"2024-04-23T10:26:53.369333+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:40:38.242963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366503+0000","last_change":"2024-04-23T10:24:53.504787+0000","last_active":"2024-04-23T10:26:53.366503+0000","last_peered":"2024-04-23T10:26:53.366503+0000","last_clean":"2024-04-23T10:26:53.366503+0000","last_became_active":"2024-04-23T10:24:53.504423+0000","last_became_peered":"2024-04-23T10:24:53.504423+0000","last_unstale":"2024-04-23T10:26:53.366503+0000","last_undegraded":"2024-04-23T10:26:53.366503+0000","last_fullsized":"2024-04-23T10:26:53.366503+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:00.171449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'7","reported_seq":145,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513248+0000","last_change":"2024-04-23T10:24:52.493600+0000","last_active":"2024-04-23T10:26:53.513248+0000","last_peered":"2024-04-23T10:26:53.513248+0000","last_clean":"2024-04-23T10:26:53.513248+0000","last_became_active":"2024-04-23T10:24:52.493310+0000","last_became_peered":"2024-04-23T10:24:52.493310+0000","last_unstale":"2024-04-23T10:26:53.513248+0000","last_undegraded":"2024-04-23T10:26:53.513248+0000","last_fullsized":"2024-04-23T10:26:53.513248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:07.144860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360960+0000","last_change":"2024-04-23T10:24:53.506311+0000","last_active":"2024-04-23T10:26:53.360960+0000","last_peered":"2024-04-23T10:26:53.360960+0000","last_clean":"2024-04-23T10:26:53.360960+0000","last_became_active":"2024-04-23T10:24:53.503910+0000","last_became_peered":"2024-04-23T10:24:53.503910+0000","last_unstale":"2024-04-23T10:26:53.360960+0000","last_undegraded":"2024-04-23T10:26:53.360960+0000","last_fullsized":"2024-04-23T10:26:53.360960+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:01:32.620891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486002+0000","last_change":"2024-04-23T10:24:52.485060+0000","last_active":"2024-04-23T10:26:53.486002+0000","last_peered":"2024-04-23T10:26:53.486002+0000","last_clean":"2024-04-23T10:26:53.486002+0000","last_became_active":"2024-04-23T10:24:52.484636+0000","last_became_peered":"2024-04-23T10:24:52.484636+0000","last_unstale":"2024-04-23T10:26:53.486002+0000","last_undegraded":"2024-04-23T10:26:53.486002+0000","last_fullsized":"2024-04-23T10:26:53.486002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:26:01.737147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":356,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267872+0000","last_change":"2024-04-23T10:23:43.804102+0000","last_active":"2024-04-23T10:26:53.267872+0000","last_peered":"2024-04-23T10:26:53.267872+0000","last_clean":"2024-04-23T10:26:53.267872+0000","last_became_active":"2024-04-23T10:23:43.803657+0000","last_became_peered":"2024-04-23T10:23:43.803657+0000","last_unstale":"2024-04-23T10:26:53.267872+0000","last_undegraded":"2024-04-23T10:26:53.267872+0000","last_fullsized":"2024-04-23T10:26:53.267872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_clean_scrub_stamp":"2024-04-23T10:20:19.875078+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:50.160735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483865+0000","last_change":"2024-04-23T10:24:53.499334+0000","last_active":"2024-04-23T10:26:53.483865+0000","last_peered":"2024-04-23T10:26:53.483865+0000","last_clean":"2024-04-23T10:26:53.483865+0000","last_became_active":"2024-04-23T10:24:53.499008+0000","last_became_peered":"2024-04-23T10:24:53.499008+0000","last_unstale":"2024-04-23T10:26:53.483865+0000","last_undegraded":"2024-04-23T10:26:53.483865+0000","last_fullsized":"2024-04-23T10:26:53.483865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:13.504789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268032+0000","last_change":"2024-04-23T10:24:52.493601+0000","last_active":"2024-04-23T10:26:53.268032+0000","last_peered":"2024-04-23T10:26:53.268032+0000","last_clean":"2024-04-23T10:26:53.268032+0000","last_became_active":"2024-04-23T10:24:52.493278+0000","last_became_peered":"2024-04-23T10:24:52.493278+0000","last_unstale":"2024-04-23T10:26:53.268032+0000","last_undegraded":"2024-04-23T10:26:53.268032+0000","last_fullsized":"2024-04-23T10:26:53.268032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:36:21.375233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270337+0000","last_change":"2024-04-23T10:24:52.495637+0000","last_active":"2024-04-23T10:26:53.270337+0000","last_peered":"2024-04-23T10:26:53.270337+0000","last_clean":"2024-04-23T10:26:53.270337+0000","last_became_active":"2024-04-23T10:24:52.495329+0000","last_became_peered":"2024-04-23T10:24:52.495329+0000","last_unstale":"2024-04-23T10:26:53.270337+0000","last_undegraded":"2024-04-23T10:26:53.270337+0000","last_fullsized":"2024-04-23T10:26:53.270337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:14.187803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483641+0000","last_change":"2024-04-23T10:24:53.500353+0000","last_active":"2024-04-23T10:26:53.483641+0000","last_peered":"2024-04-23T10:26:53.483641+0000","last_clean":"2024-04-23T10:26:53.483641+0000","last_became_active":"2024-04-23T10:24:53.499995+0000","last_became_peered":"2024-04-23T10:24:53.499995+0000","last_unstale":"2024-04-23T10:26:53.483641+0000","last_undegraded":"2024-04-23T10:26:53.483641+0000","last_fullsized":"2024-04-23T10:26:53.483641+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:55:52.695375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'47","reported_seq":107,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.464904+0000","last_change":"2024-04-23T10:26:00.099289+0000","last_active":"2024-04-23T10:26:53.464904+0000","last_peered":"2024-04-23T10:26:53.464904+0000","last_clean":"2024-04-23T10:26:53.464904+0000","last_became_active":"2024-04-23T10:26:00.088425+0000","last_became_peered":"2024-04-23T10:26:00.088425+0000","last_unstale":"2024-04-23T10:26:53.464904+0000","last_undegraded":"2024-04-23T10:26:53.464904+0000","last_fullsized":"2024-04-23T10:26:53.464904+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:54:11.848553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360844+0000","last_change":"2024-04-23T10:24:53.498140+0000","last_active":"2024-04-23T10:26:53.360844+0000","last_peered":"2024-04-23T10:26:53.360844+0000","last_clean":"2024-04-23T10:26:53.360844+0000","last_became_active":"2024-04-23T10:24:53.496683+0000","last_became_peered":"2024-04-23T10:24:53.496683+0000","last_unstale":"2024-04-23T10:26:53.360844+0000","last_undegraded":"2024-04-23T10:26:53.360844+0000","last_fullsized":"2024-04-23T10:26:53.360844+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:49:18.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486140+0000","last_change":"2024-04-23T10:24:52.486505+0000","last_active":"2024-04-23T10:26:53.486140+0000","last_peered":"2024-04-23T10:26:53.486140+0000","last_clean":"2024-04-23T10:26:53.486140+0000","last_became_active":"2024-04-23T10:24:52.486185+0000","last_became_peered":"2024-04-23T10:24:52.486185+0000","last_unstale":"2024-04-23T10:26:53.486140+0000","last_undegraded":"2024-04-23T10:26:53.486140+0000","last_fullsized":"2024-04-23T10:26:53.486140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:46:27.052935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513586+0000","last_change":"2024-04-23T10:24:53.496234+0000","last_active":"2024-04-23T10:26:53.513586+0000","last_peered":"2024-04-23T10:26:53.513586+0000","last_clean":"2024-04-23T10:26:53.513586+0000","last_became_active":"2024-04-23T10:24:53.495892+0000","last_became_peered":"2024-04-23T10:24:53.495892+0000","last_unstale":"2024-04-23T10:26:53.513586+0000","last_undegraded":"2024-04-23T10:26:53.513586+0000","last_fullsized":"2024-04-23T10:26:53.513586+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:11.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509445+0000","last_change":"2024-04-23T10:26:00.094344+0000","last_active":"2024-04-23T10:26:53.509445+0000","last_peered":"2024-04-23T10:26:53.509445+0000","last_clean":"2024-04-23T10:26:53.509445+0000","last_became_active":"2024-04-23T10:26:00.090692+0000","last_became_peered":"2024-04-23T10:26:00.090692+0000","last_unstale":"2024-04-23T10:26:53.509445+0000","last_undegraded":"2024-04-23T10:26:53.509445+0000","last_fullsized":"2024-04-23T10:26:53.509445+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269829+0000","last_change":"2024-04-23T10:24:53.497985+0000","last_active":"2024-04-23T10:26:53.269829+0000","last_peered":"2024-04-23T10:26:53.269829+0000","last_clean":"2024-04-23T10:26:53.269829+0000","last_became_active":"2024-04-23T10:24:53.497661+0000","last_became_peered":"2024-04-23T10:24:53.497661+0000","last_unstale":"2024-04-23T10:26:53.269829+0000","last_undegraded":"2024-04-23T10:26:53.269829+0000","last_fullsized":"2024-04-23T10:26:53.269829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:48.923714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360768+0000","last_change":"2024-04-23T10:24:52.490572+0000","last_active":"2024-04-23T10:26:53.360768+0000","last_peered":"2024-04-23T10:26:53.360768+0000","last_clean":"2024-04-23T10:26:53.360768+0000","last_became_active":"2024-04-23T10:24:52.490274+0000","last_became_peered":"2024-04-23T10:24:52.490274+0000","last_unstale":"2024-04-23T10:26:53.360768+0000","last_undegraded":"2024-04-23T10:26:53.360768+0000","last_fullsized":"2024-04-23T10:26:53.360768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:22.447399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360448+0000","last_change":"2024-04-23T10:24:53.509189+0000","last_active":"2024-04-23T10:26:53.360448+0000","last_peered":"2024-04-23T10:26:53.360448+0000","last_clean":"2024-04-23T10:26:53.360448+0000","last_became_active":"2024-04-23T10:24:53.508850+0000","last_became_peered":"2024-04-23T10:24:53.508850+0000","last_unstale":"2024-04-23T10:26:53.360448+0000","last_undegraded":"2024-04-23T10:26:53.360448+0000","last_fullsized":"2024-04-23T10:26:53.360448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:23.242999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'5","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513953+0000","last_change":"2024-04-23T10:24:52.497616+0000","last_active":"2024-04-23T10:26:53.513953+0000","last_peered":"2024-04-23T10:26:53.513953+0000","last_clean":"2024-04-23T10:26:53.513953+0000","last_became_active":"2024-04-23T10:24:52.497028+0000","last_became_peered":"2024-04-23T10:24:52.497028+0000","last_unstale":"2024-04-23T10:26:53.513953+0000","last_undegraded":"2024-04-23T10:26:53.513953+0000","last_fullsized":"2024-04-23T10:26:53.513953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:51:26.836718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360841+0000","last_change":"2024-04-23T10:24:53.498086+0000","last_active":"2024-04-23T10:26:53.360841+0000","last_peered":"2024-04-23T10:26:53.360841+0000","last_clean":"2024-04-23T10:26:53.360841+0000","last_became_active":"2024-04-23T10:24:53.497734+0000","last_became_peered":"2024-04-23T10:24:53.497734+0000","last_unstale":"2024-04-23T10:26:53.360841+0000","last_undegraded":"2024-04-23T10:26:53.360841+0000","last_fullsized":"2024-04-23T10:26:53.360841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:57.602301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269954+0000","last_change":"2024-04-23T10:24:52.496609+0000","last_active":"2024-04-23T10:26:53.269954+0000","last_peered":"2024-04-23T10:26:53.269954+0000","last_clean":"2024-04-23T10:26:53.269954+0000","last_became_active":"2024-04-23T10:24:52.495981+0000","last_became_peered":"2024-04-23T10:24:52.495981+0000","last_unstale":"2024-04-23T10:26:53.269954+0000","last_undegraded":"2024-04-23T10:26:53.269954+0000","last_fullsized":"2024-04-23T10:26:53.269954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:28.111644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268115+0000","last_change":"2024-04-23T10:24:53.503840+0000","last_active":"2024-04-23T10:26:53.268115+0000","last_peered":"2024-04-23T10:26:53.268115+0000","last_clean":"2024-04-23T10:26:53.268115+0000","last_became_active":"2024-04-23T10:24:53.503448+0000","last_became_peered":"2024-04-23T10:24:53.503448+0000","last_unstale":"2024-04-23T10:26:53.268115+0000","last_undegraded":"2024-04-23T10:26:53.268115+0000","last_fullsized":"2024-04-23T10:26:53.268115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:03.295985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'9","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.521877+0000","last_change":"2024-04-23T10:24:52.501792+0000","last_active":"2024-04-23T10:26:53.521877+0000","last_peered":"2024-04-23T10:26:53.521877+0000","last_clean":"2024-04-23T10:26:53.521877+0000","last_became_active":"2024-04-23T10:24:52.501404+0000","last_became_peered":"2024-04-23T10:24:52.501404+0000","last_unstale":"2024-04-23T10:26:53.521877+0000","last_undegraded":"2024-04-23T10:26:53.521877+0000","last_fullsized":"2024-04-23T10:26:53.521877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:03.529410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2401,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268107+0000","last_change":"2024-04-23T10:24:53.501649+0000","last_active":"2024-04-23T10:26:53.268107+0000","last_peered":"2024-04-23T10:26:53.268107+0000","last_clean":"2024-04-23T10:26:53.268107+0000","last_became_active":"2024-04-23T10:24:53.501307+0000","last_became_peered":"2024-04-23T10:24:53.501307+0000","last_unstale":"2024-04-23T10:26:53.268107+0000","last_undegraded":"2024-04-23T10:26:53.268107+0000","last_fullsized":"2024-04-23T10:26:53.268107+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:37.863832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'41","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.462917+0000","last_change":"2024-04-23T10:24:52.495737+0000","last_active":"2024-04-23T10:26:53.462917+0000","last_peered":"2024-04-23T10:26:53.462917+0000","last_clean":"2024-04-23T10:26:53.462917+0000","last_became_active":"2024-04-23T10:24:52.495395+0000","last_became_peered":"2024-04-23T10:24:52.495395+0000","last_unstale":"2024-04-23T10:26:53.462917+0000","last_undegraded":"2024-04-23T10:26:53.462917+0000","last_fullsized":"2024-04-23T10:26:53.462917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:14:45.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267964+0000","last_change":"2024-04-23T10:26:00.095511+0000","last_active":"2024-04-23T10:26:53.267964+0000","last_peered":"2024-04-23T10:26:53.267964+0000","last_clean":"2024-04-23T10:26:53.267964+0000","last_became_active":"2024-04-23T10:26:00.092403+0000","last_became_peered":"2024-04-23T10:26:00.092403+0000","last_unstale":"2024-04-23T10:26:53.267964+0000","last_undegraded":"2024-04-23T10:26:53.267964+0000","last_fullsized":"2024-04-23T10:26:53.267964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:16:45.782094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483944+0000","last_change":"2024-04-23T10:24:52.494322+0000","last_active":"2024-04-23T10:26:53.483944+0000","last_peered":"2024-04-23T10:26:53.483944+0000","last_clean":"2024-04-23T10:26:53.483944+0000","last_became_active":"2024-04-23T10:24:52.494019+0000","last_became_peered":"2024-04-23T10:24:52.494019+0000","last_unstale":"2024-04-23T10:26:53.483944+0000","last_undegraded":"2024-04-23T10:26:53.483944+0000","last_fullsized":"2024-04-23T10:26:53.483944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:16.099197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268354+0000","last_change":"2024-04-23T10:24:53.507160+0000","last_active":"2024-04-23T10:26:53.268354+0000","last_peered":"2024-04-23T10:26:53.268354+0000","last_clean":"2024-04-23T10:26:53.268354+0000","last_became_active":"2024-04-23T10:24:53.506815+0000","last_became_peered":"2024-04-23T10:24:53.506815+0000","last_unstale":"2024-04-23T10:26:53.268354+0000","last_undegraded":"2024-04-23T10:26:53.268354+0000","last_fullsized":"2024-04-23T10:26:53.268354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:24.657153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360475+0000","last_change":"2024-04-23T10:24:53.510511+0000","last_active":"2024-04-23T10:26:53.360475+0000","last_peered":"2024-04-23T10:26:53.360475+0000","last_clean":"2024-04-23T10:26:53.360475+0000","last_became_active":"2024-04-23T10:24:53.510174+0000","last_became_peered":"2024-04-23T10:24:53.510174+0000","last_unstale":"2024-04-23T10:26:53.360475+0000","last_undegraded":"2024-04-23T10:26:53.360475+0000","last_fullsized":"2024-04-23T10:26:53.360475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:35.048697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513132+0000","last_change":"2024-04-23T10:24:53.497365+0000","last_active":"2024-04-23T10:26:53.513132+0000","last_peered":"2024-04-23T10:26:53.513132+0000","last_clean":"2024-04-23T10:26:53.513132+0000","last_became_active":"2024-04-23T10:24:53.496427+0000","last_became_peered":"2024-04-23T10:24:53.496427+0000","last_unstale":"2024-04-23T10:26:53.513132+0000","last_undegraded":"2024-04-23T10:26:53.513132+0000","last_fullsized":"2024-04-23T10:26:53.513132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:22:35.867252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513193+0000","last_change":"2024-04-23T10:24:53.495913+0000","last_active":"2024-04-23T10:26:53.513193+0000","last_peered":"2024-04-23T10:26:53.513193+0000","last_clean":"2024-04-23T10:26:53.513193+0000","last_became_active":"2024-04-23T10:24:53.495543+0000","last_became_peered":"2024-04-23T10:24:53.495543+0000","last_unstale":"2024-04-23T10:26:53.513193+0000","last_undegraded":"2024-04-23T10:26:53.513193+0000","last_fullsized":"2024-04-23T10:26:53.513193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:03:29.327759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513412+0000","last_change":"2024-04-23T10:24:53.492305+0000","last_active":"2024-04-23T10:26:53.513412+0000","last_peered":"2024-04-23T10:26:53.513412+0000","last_clean":"2024-04-23T10:26:53.513412+0000","last_became_active":"2024-04-23T10:24:53.491980+0000","last_became_peered":"2024-04-23T10:24:53.491980+0000","last_unstale":"2024-04-23T10:26:53.513412+0000","last_undegraded":"2024-04-23T10:26:53.513412+0000","last_fullsized":"2024-04-23T10:26:53.513412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:34.987447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483808+0000","last_change":"2024-04-23T10:24:53.492464+0000","last_active":"2024-04-23T10:26:53.483808+0000","last_peered":"2024-04-23T10:26:53.483808+0000","last_clean":"2024-04-23T10:26:53.483808+0000","last_became_active":"2024-04-23T10:24:53.492156+0000","last_became_peered":"2024-04-23T10:24:53.492156+0000","last_unstale":"2024-04-23T10:26:53.483808+0000","last_undegraded":"2024-04-23T10:26:53.483808+0000","last_fullsized":"2024-04-23T10:26:53.483808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:07:15.414598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360552+0000","last_change":"2024-04-23T10:24:53.502208+0000","last_active":"2024-04-23T10:26:53.360552+0000","last_peered":"2024-04-23T10:26:53.360552+0000","last_clean":"2024-04-23T10:26:53.360552+0000","last_became_active":"2024-04-23T10:24:53.501921+0000","last_became_peered":"2024-04-23T10:24:53.501921+0000","last_unstale":"2024-04-23T10:26:53.360552+0000","last_undegraded":"2024-04-23T10:26:53.360552+0000","last_fullsized":"2024-04-23T10:26:53.360552+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:29:21.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513417+0000","last_change":"2024-04-23T10:24:53.495446+0000","last_active":"2024-04-23T10:26:53.513417+0000","last_peered":"2024-04-23T10:26:53.513417+0000","last_clean":"2024-04-23T10:26:53.513417+0000","last_became_active":"2024-04-23T10:24:53.495090+0000","last_became_peered":"2024-04-23T10:24:53.495090+0000","last_unstale":"2024-04-23T10:26:53.513417+0000","last_undegraded":"2024-04-23T10:26:53.513417+0000","last_fullsized":"2024-04-23T10:26:53.513417+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:44:00.007468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360726+0000","last_change":"2024-04-23T10:24:53.503390+0000","last_active":"2024-04-23T10:26:53.360726+0000","last_peered":"2024-04-23T10:26:53.360726+0000","last_clean":"2024-04-23T10:26:53.360726+0000","last_became_active":"2024-04-23T10:24:53.503057+0000","last_became_peered":"2024-04-23T10:24:53.503057+0000","last_unstale":"2024-04-23T10:26:53.360726+0000","last_undegraded":"2024-04-23T10:26:53.360726+0000","last_fullsized":"2024-04-23T10:26:53.360726+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:19:39.950651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366412+0000","last_change":"2024-04-23T10:24:53.498188+0000","last_active":"2024-04-23T10:26:53.366412+0000","last_peered":"2024-04-23T10:26:53.366412+0000","last_clean":"2024-04-23T10:26:53.366412+0000","last_became_active":"2024-04-23T10:24:53.497873+0000","last_became_peered":"2024-04-23T10:24:53.497873+0000","last_unstale":"2024-04-23T10:26:53.366412+0000","last_undegraded":"2024-04-23T10:26:53.366412+0000","last_fullsized":"2024-04-23T10:26:53.366412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:48:05.001361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360615+0000","last_change":"2024-04-23T10:24:53.502260+0000","last_active":"2024-04-23T10:26:53.360615+0000","last_peered":"2024-04-23T10:26:53.360615+0000","last_clean":"2024-04-23T10:26:53.360615+0000","last_became_active":"2024-04-23T10:24:53.501525+0000","last_became_peered":"2024-04-23T10:24:53.501525+0000","last_unstale":"2024-04-23T10:26:53.360615+0000","last_undegraded":"2024-04-23T10:26:53.360615+0000","last_fullsized":"2024-04-23T10:26:53.360615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:04.379055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509274+0000","last_change":"2024-04-23T10:24:53.499306+0000","last_active":"2024-04-23T10:26:53.509274+0000","last_peered":"2024-04-23T10:26:53.509274+0000","last_clean":"2024-04-23T10:26:53.509274+0000","last_became_active":"2024-04-23T10:24:53.496717+0000","last_became_peered":"2024-04-23T10:24:53.496717+0000","last_unstale":"2024-04-23T10:26:53.509274+0000","last_undegraded":"2024-04-23T10:26:53.509274+0000","last_fullsized":"2024-04-23T10:26:53.509274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:03:17.907117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483514+0000","last_change":"2024-04-23T10:24:53.496330+0000","last_active":"2024-04-23T10:26:53.483514+0000","last_peered":"2024-04-23T10:26:53.483514+0000","last_clean":"2024-04-23T10:26:53.483514+0000","last_became_active":"2024-04-23T10:24:53.496021+0000","last_became_peered":"2024-04-23T10:24:53.496021+0000","last_unstale":"2024-04-23T10:26:53.483514+0000","last_undegraded":"2024-04-23T10:26:53.483514+0000","last_fullsized":"2024-04-23T10:26:53.483514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:10:59.340265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360493+0000","last_change":"2024-04-23T10:24:53.501025+0000","last_active":"2024-04-23T10:26:53.360493+0000","last_peered":"2024-04-23T10:26:53.360493+0000","last_clean":"2024-04-23T10:26:53.360493+0000","last_became_active":"2024-04-23T10:24:53.500673+0000","last_became_peered":"2024-04-23T10:24:53.500673+0000","last_unstale":"2024-04-23T10:26:53.360493+0000","last_undegraded":"2024-04-23T10:26:53.360493+0000","last_fullsized":"2024-04-23T10:26:53.360493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:07.728645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107040,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597462,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1297,"num_read_kb":754,"num_write":370,"num_write_kb":1461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":700416,"data_stored":1792386,"data_compressed":81483,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":863827,"data_compressed":22051,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612649,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1146880,"data_stored":1255829,"data_compressed":46600,"data_compressed_allocated":61440,"data_compressed_original":729088,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776175,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1024000,"data_stored":862643,"data_compressed":22051,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037812,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":991232,"data_stored":469688,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":1064302,"data_compressed":38585,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":469809,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":533228,"data_compressed":4764,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":999424,"data_stored":471597,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1060864,"data_stored":534288,"data_compressed":4764,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":993551,"data_compressed":28207,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888135,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":470202,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724611,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":1193484,"data_compressed":44741,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65040,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66100,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":134811,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":197156,"data_compressed":8015,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":395639,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:26:58.938 INFO:tasks.quiescer.ceph_manager:clean! 2024-04-23T10:26:58.938 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.072+0000 7f68acfe8640 1 -- 172.21.15.69:0/2967948101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68a8103230 msgr2=0x7f68a8103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.072+0000 7f68acfe8640 1 --2- 172.21.15.69:0/2967948101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68a8103230 0x7f68a8103610 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6898009900 tx=0x7f689802a480 comp rx=0 tx=0).stop 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.072+0000 7f68acfe8640 1 -- 172.21.15.69:0/2967948101 shutdown_connections 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.072+0000 7f68acfe8640 1 --2- 172.21.15.69:0/2967948101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a810c570 0x7f68a810e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.072+0000 7f68acfe8640 1 --2- 172.21.15.69:0/2967948101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a8103b50 0x7f68a810c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.072+0000 7f68acfe8640 1 --2- 172.21.15.69:0/2967948101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68a8103230 0x7f68a8103610 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.072+0000 7f68acfe8640 1 -- 172.21.15.69:0/2967948101 >> 172.21.15.69:0/2967948101 conn(0x7f68a8077fb0 msgr2=0x7f68a80783c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.072+0000 7f68acfe8640 1 -- 172.21.15.69:0/2967948101 shutdown_connections 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.072+0000 7f68acfe8640 1 -- 172.21.15.69:0/2967948101 wait complete. 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.073+0000 7f68acfe8640 1 Processor -- start 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.073+0000 7f68acfe8640 1 -- start start 2024-04-23T10:26:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.073+0000 7f68acfe8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a8103230 0x7f68a8198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.073+0000 7f68acfe8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a8103b50 0x7f68a8198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.073+0000 7f68acfe8640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68a810c570 0x7f68a819cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.073+0000 7f68acfe8640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f68a8112310 con 0x7f68a810c570 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.073+0000 7f68acfe8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f68a8112190 con 0x7f68a8103230 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.073+0000 7f68acfe8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68a8112490 con 0x7f68a8103b50 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68a6d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68a810c570 0x7f68a819cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68a6d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68a810c570 0x7f68a819cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38640/0 (socket says 172.21.15.69:38640) 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68a6d9d640 1 -- 172.21.15.69:0/3967317243 learned_addr learned my addr 172.21.15.69:0/3967317243 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f689ffff640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a8103b50 0x7f68a8198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68a659c640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a8103230 0x7f68a8198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68a6d9d640 1 -- 172.21.15.69:0/3967317243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a8103b50 msgr2=0x7f68a8198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68a6d9d640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a8103b50 0x7f68a8198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68a6d9d640 1 -- 172.21.15.69:0/3967317243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a8103230 msgr2=0x7f68a8198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68a6d9d640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a8103230 0x7f68a8198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68a6d9d640 1 -- 172.21.15.69:0/3967317243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a819d700 con 0x7f68a810c570 2024-04-23T10:26:59.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f689ffff640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a8103b50 0x7f68a8198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68a659c640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a8103230 0x7f68a8198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:26:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68a6d9d640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68a810c570 0x7f68a819cfd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f68a000cab0 tx=0x7f68a000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f689f7fe640 1 -- 172.21.15.69:0/3967317243 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a000ae20 con 0x7f68a810c570 2024-04-23T10:26:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f689f7fe640 1 -- 172.21.15.69:0/3967317243 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68a000f920 con 0x7f68a810c570 2024-04-23T10:26:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68acfe8640 1 -- 172.21.15.69:0/3967317243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a819d9f0 con 0x7f68a810c570 2024-04-23T10:26:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f689f7fe640 1 -- 172.21.15.69:0/3967317243 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0018ad0 con 0x7f68a810c570 2024-04-23T10:26:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.074+0000 7f68acfe8640 1 -- 172.21.15.69:0/3967317243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a81a5280 con 0x7f68a810c570 2024-04-23T10:26:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.075+0000 7f68acfe8640 1 -- 172.21.15.69:0/3967317243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a80691c0 con 0x7f68a810c570 2024-04-23T10:26:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.076+0000 7f689f7fe640 1 -- 172.21.15.69:0/3967317243 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f68a0018d10 con 0x7f68a810c570 2024-04-23T10:26:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.077+0000 7f689f7fe640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f68940a3e30 0x7f68940a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.077+0000 7f68a659c640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f68940a3e30 0x7f68940a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.077+0000 7f689f7fe640 1 -- 172.21.15.69:0/3967317243 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f68a00d0cc0 con 0x7f68a810c570 2024-04-23T10:26:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.077+0000 7f68a659c640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f68940a3e30 0x7f68940a62f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6898005ab0 tx=0x7f6898005a20 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:59.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.082+0000 7f689f7fe640 1 -- 172.21.15.69:0/3967317243 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f68a0014030 con 0x7f68a810c570 2024-04-23T10:26:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:58 smithi069 ceph-mon[29593]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:26:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:58 smithi069 ceph-mon[29593]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:26:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:58 smithi069 ceph-mon[29593]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:26:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:58 smithi069 ceph-mon[29593]: Updating smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:26:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:58 smithi069 ceph-mon[29593]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-04-23T10:26:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:58 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/935974678' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:59.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.258+0000 7f68acfe8640 1 -- 172.21.15.69:0/3967317243 --> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68a80fe640 con 0x7f68940a3e30 2024-04-23T10:26:59.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.265+0000 7f689f7fe640 1 -- 172.21.15.69:0/3967317243 <== mgr.24836 v2:172.21.15.69:6800/908508073 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258081 (secure 0 0 0) 0x7f68a80fe640 con 0x7f68940a3e30 2024-04-23T10:26:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:59.267 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 -- 172.21.15.69:0/3967317243 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f68940a3e30 msgr2=0x7f68940a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f68940a3e30 0x7f68940a62f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6898005ab0 tx=0x7f6898005a20 comp rx=0 tx=0).stop 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 -- 172.21.15.69:0/3967317243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68a810c570 msgr2=0x7f68a819cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68a810c570 0x7f68a819cfd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f68a000cab0 tx=0x7f68a000cf70 comp rx=0 tx=0).stop 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 -- 172.21.15.69:0/3967317243 shutdown_connections 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f68940a3e30 0x7f68940a62f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68a810c570 0x7f68a819cfd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a8103b50 0x7f68a8198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 --2- 172.21.15.69:0/3967317243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a8103230 0x7f68a8198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 -- 172.21.15.69:0/3967317243 >> 172.21.15.69:0/3967317243 conn(0x7f68a8077fb0 msgr2=0x7f68a80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 -- 172.21.15.69:0/3967317243 shutdown_connections 2024-04-23T10:26:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.268+0000 7f68acfe8640 1 -- 172.21.15.69:0/3967317243 wait complete. 2024-04-23T10:26:59.278 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-23T10:26:57.280910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188064,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1433,"num_read_kb":873,"num_write":553,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180853,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":939,"ondisk_log_size":939,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365432,"kb_used_data":12084,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576392,"statfs":{"total":1151940427776,"available":1151566225408,"internally_reserved":0,"allocated":12374016,"data_stored":9182448,"data_compressed":223383,"data_compressed_allocated":294912,"data_compressed_original":3440640,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.990717"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360811+0000","last_change":"2024-04-23T10:24:53.504514+0000","last_active":"2024-04-23T10:26:53.360811+0000","last_peered":"2024-04-23T10:26:53.360811+0000","last_clean":"2024-04-23T10:26:53.360811+0000","last_became_active":"2024-04-23T10:24:53.504105+0000","last_became_peered":"2024-04-23T10:24:53.504105+0000","last_unstale":"2024-04-23T10:26:53.360811+0000","last_undegraded":"2024-04-23T10:26:53.360811+0000","last_fullsized":"2024-04-23T10:26:53.360811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:50:49.730698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513756+0000","last_change":"2024-04-23T10:24:53.504534+0000","last_active":"2024-04-23T10:26:53.513756+0000","last_peered":"2024-04-23T10:26:53.513756+0000","last_clean":"2024-04-23T10:26:53.513756+0000","last_became_active":"2024-04-23T10:24:53.504244+0000","last_became_peered":"2024-04-23T10:24:53.504244+0000","last_unstale":"2024-04-23T10:26:53.513756+0000","last_undegraded":"2024-04-23T10:26:53.513756+0000","last_fullsized":"2024-04-23T10:26:53.513756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:12:57.447009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513390+0000","last_change":"2024-04-23T10:24:53.502922+0000","last_active":"2024-04-23T10:26:53.513390+0000","last_peered":"2024-04-23T10:26:53.513390+0000","last_clean":"2024-04-23T10:26:53.513390+0000","last_became_active":"2024-04-23T10:24:53.502519+0000","last_became_peered":"2024-04-23T10:24:53.502519+0000","last_unstale":"2024-04-23T10:26:53.513390+0000","last_undegraded":"2024-04-23T10:26:53.513390+0000","last_fullsized":"2024-04-23T10:26:53.513390+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:58:35.871081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486193+0000","last_change":"2024-04-23T10:24:53.500049+0000","last_active":"2024-04-23T10:26:53.486193+0000","last_peered":"2024-04-23T10:26:53.486193+0000","last_clean":"2024-04-23T10:26:53.486193+0000","last_became_active":"2024-04-23T10:24:53.499607+0000","last_became_peered":"2024-04-23T10:24:53.499607+0000","last_unstale":"2024-04-23T10:26:53.486193+0000","last_undegraded":"2024-04-23T10:26:53.486193+0000","last_fullsized":"2024-04-23T10:26:53.486193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:10:27.104622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269934+0000","last_change":"2024-04-23T10:24:53.493739+0000","last_active":"2024-04-23T10:26:53.269934+0000","last_peered":"2024-04-23T10:26:53.269934+0000","last_clean":"2024-04-23T10:26:53.269934+0000","last_became_active":"2024-04-23T10:24:53.492471+0000","last_became_peered":"2024-04-23T10:24:53.492471+0000","last_unstale":"2024-04-23T10:26:53.269934+0000","last_undegraded":"2024-04-23T10:26:53.269934+0000","last_fullsized":"2024-04-23T10:26:53.269934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:40:43.267366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369215+0000","last_change":"2024-04-23T10:24:53.500426+0000","last_active":"2024-04-23T10:26:53.369215+0000","last_peered":"2024-04-23T10:26:53.369215+0000","last_clean":"2024-04-23T10:26:53.369215+0000","last_became_active":"2024-04-23T10:24:53.500052+0000","last_became_peered":"2024-04-23T10:24:53.500052+0000","last_unstale":"2024-04-23T10:26:53.369215+0000","last_undegraded":"2024-04-23T10:26:53.369215+0000","last_fullsized":"2024-04-23T10:26:53.369215+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:21:36.361816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267875+0000","last_change":"2024-04-23T10:24:53.501672+0000","last_active":"2024-04-23T10:26:53.267875+0000","last_peered":"2024-04-23T10:26:53.267875+0000","last_clean":"2024-04-23T10:26:53.267875+0000","last_became_active":"2024-04-23T10:24:53.501345+0000","last_became_peered":"2024-04-23T10:24:53.501345+0000","last_unstale":"2024-04-23T10:26:53.267875+0000","last_undegraded":"2024-04-23T10:26:53.267875+0000","last_fullsized":"2024-04-23T10:26:53.267875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:31:41.488482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360520+0000","last_change":"2024-04-23T10:24:53.499442+0000","last_active":"2024-04-23T10:26:53.360520+0000","last_peered":"2024-04-23T10:26:53.360520+0000","last_clean":"2024-04-23T10:26:53.360520+0000","last_became_active":"2024-04-23T10:24:53.499131+0000","last_became_peered":"2024-04-23T10:24:53.499131+0000","last_unstale":"2024-04-23T10:26:53.360520+0000","last_undegraded":"2024-04-23T10:26:53.360520+0000","last_fullsized":"2024-04-23T10:26:53.360520+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:17:21.815851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509244+0000","last_change":"2024-04-23T10:24:53.501235+0000","last_active":"2024-04-23T10:26:53.509244+0000","last_peered":"2024-04-23T10:26:53.509244+0000","last_clean":"2024-04-23T10:26:53.509244+0000","last_became_active":"2024-04-23T10:24:53.500392+0000","last_became_peered":"2024-04-23T10:24:53.500392+0000","last_unstale":"2024-04-23T10:26:53.509244+0000","last_undegraded":"2024-04-23T10:26:53.509244+0000","last_fullsized":"2024-04-23T10:26:53.509244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:58:20.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369317+0000","last_change":"2024-04-23T10:24:53.504235+0000","last_active":"2024-04-23T10:26:53.369317+0000","last_peered":"2024-04-23T10:26:53.369317+0000","last_clean":"2024-04-23T10:26:53.369317+0000","last_became_active":"2024-04-23T10:24:53.503743+0000","last_became_peered":"2024-04-23T10:24:53.503743+0000","last_unstale":"2024-04-23T10:26:53.369317+0000","last_undegraded":"2024-04-23T10:26:53.369317+0000","last_fullsized":"2024-04-23T10:26:53.369317+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:25:53.881433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268044+0000","last_change":"2024-04-23T10:24:53.497355+0000","last_active":"2024-04-23T10:26:53.268044+0000","last_peered":"2024-04-23T10:26:53.268044+0000","last_clean":"2024-04-23T10:26:53.268044+0000","last_became_active":"2024-04-23T10:24:53.494195+0000","last_became_peered":"2024-04-23T10:24:53.494195+0000","last_unstale":"2024-04-23T10:26:53.268044+0000","last_undegraded":"2024-04-23T10:26:53.268044+0000","last_fullsized":"2024-04-23T10:26:53.268044+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:19:48.638789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486102+0000","last_change":"2024-04-23T10:24:53.504513+0000","last_active":"2024-04-23T10:26:53.486102+0000","last_peered":"2024-04-23T10:26:53.486102+0000","last_clean":"2024-04-23T10:26:53.486102+0000","last_became_active":"2024-04-23T10:24:53.504058+0000","last_became_peered":"2024-04-23T10:24:53.504058+0000","last_unstale":"2024-04-23T10:26:53.486102+0000","last_undegraded":"2024-04-23T10:26:53.486102+0000","last_fullsized":"2024-04-23T10:26:53.486102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:16:34.302848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483342+0000","last_change":"2024-04-23T10:24:53.495277+0000","last_active":"2024-04-23T10:26:53.483342+0000","last_peered":"2024-04-23T10:26:53.483342+0000","last_clean":"2024-04-23T10:26:53.483342+0000","last_became_active":"2024-04-23T10:24:53.494925+0000","last_became_peered":"2024-04-23T10:24:53.494925+0000","last_unstale":"2024-04-23T10:26:53.483342+0000","last_undegraded":"2024-04-23T10:26:53.483342+0000","last_fullsized":"2024-04-23T10:26:53.483342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:33.647408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513294+0000","last_change":"2024-04-23T10:24:53.504082+0000","last_active":"2024-04-23T10:26:53.513294+0000","last_peered":"2024-04-23T10:26:53.513294+0000","last_clean":"2024-04-23T10:26:53.513294+0000","last_became_active":"2024-04-23T10:24:53.503753+0000","last_became_peered":"2024-04-23T10:24:53.503753+0000","last_unstale":"2024-04-23T10:26:53.513294+0000","last_undegraded":"2024-04-23T10:26:53.513294+0000","last_fullsized":"2024-04-23T10:26:53.513294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:52:59.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513636+0000","last_change":"2024-04-23T10:26:00.091416+0000","last_active":"2024-04-23T10:26:53.513636+0000","last_peered":"2024-04-23T10:26:53.513636+0000","last_clean":"2024-04-23T10:26:53.513636+0000","last_became_active":"2024-04-23T10:26:00.091030+0000","last_became_peered":"2024-04-23T10:26:00.091030+0000","last_unstale":"2024-04-23T10:26:53.513636+0000","last_undegraded":"2024-04-23T10:26:53.513636+0000","last_fullsized":"2024-04-23T10:26:53.513636+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:39:28.835870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509148+0000","last_change":"2024-04-23T10:24:53.498916+0000","last_active":"2024-04-23T10:26:53.509148+0000","last_peered":"2024-04-23T10:26:53.509148+0000","last_clean":"2024-04-23T10:26:53.509148+0000","last_became_active":"2024-04-23T10:24:53.498560+0000","last_became_peered":"2024-04-23T10:24:53.498560+0000","last_unstale":"2024-04-23T10:26:53.509148+0000","last_undegraded":"2024-04-23T10:26:53.509148+0000","last_fullsized":"2024-04-23T10:26:53.509148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:24:07.965091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360836+0000","last_change":"2024-04-23T10:24:53.505167+0000","last_active":"2024-04-23T10:26:53.360836+0000","last_peered":"2024-04-23T10:26:53.360836+0000","last_clean":"2024-04-23T10:26:53.360836+0000","last_became_active":"2024-04-23T10:24:53.504832+0000","last_became_peered":"2024-04-23T10:24:53.504832+0000","last_unstale":"2024-04-23T10:26:53.360836+0000","last_undegraded":"2024-04-23T10:26:53.360836+0000","last_fullsized":"2024-04-23T10:26:53.360836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:58:20.867496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.266311+0000","last_change":"2024-04-23T10:24:53.505363+0000","last_active":"2024-04-23T10:26:53.266311+0000","last_peered":"2024-04-23T10:26:53.266311+0000","last_clean":"2024-04-23T10:26:53.266311+0000","last_became_active":"2024-04-23T10:24:53.505029+0000","last_became_peered":"2024-04-23T10:24:53.505029+0000","last_unstale":"2024-04-23T10:26:53.266311+0000","last_undegraded":"2024-04-23T10:26:53.266311+0000","last_fullsized":"2024-04-23T10:26:53.266311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:22.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513220+0000","last_change":"2024-04-23T10:24:53.497666+0000","last_active":"2024-04-23T10:26:53.513220+0000","last_peered":"2024-04-23T10:26:53.513220+0000","last_clean":"2024-04-23T10:26:53.513220+0000","last_became_active":"2024-04-23T10:24:53.495144+0000","last_became_peered":"2024-04-23T10:24:53.495144+0000","last_unstale":"2024-04-23T10:26:53.513220+0000","last_undegraded":"2024-04-23T10:26:53.513220+0000","last_fullsized":"2024-04-23T10:26:53.513220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:23:27.148289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'14","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.481791+0000","last_change":"2024-04-23T10:24:52.496907+0000","last_active":"2024-04-23T10:26:53.481791+0000","last_peered":"2024-04-23T10:26:53.481791+0000","last_clean":"2024-04-23T10:26:53.481791+0000","last_became_active":"2024-04-23T10:24:52.496567+0000","last_became_peered":"2024-04-23T10:24:52.496567+0000","last_unstale":"2024-04-23T10:26:53.481791+0000","last_undegraded":"2024-04-23T10:26:53.481791+0000","last_fullsized":"2024-04-23T10:26:53.481791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:33.195504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.361042+0000","last_change":"2024-04-23T10:24:53.501140+0000","last_active":"2024-04-23T10:26:53.361042+0000","last_peered":"2024-04-23T10:26:53.361042+0000","last_clean":"2024-04-23T10:26:53.361042+0000","last_became_active":"2024-04-23T10:24:53.500826+0000","last_became_peered":"2024-04-23T10:24:53.500826+0000","last_unstale":"2024-04-23T10:26:53.361042+0000","last_undegraded":"2024-04-23T10:26:53.361042+0000","last_fullsized":"2024-04-23T10:26:53.361042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:39.178784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.361229+0000","last_change":"2024-04-23T10:24:52.494413+0000","last_active":"2024-04-23T10:26:53.361229+0000","last_peered":"2024-04-23T10:26:53.361229+0000","last_clean":"2024-04-23T10:26:53.361229+0000","last_became_active":"2024-04-23T10:24:52.494092+0000","last_became_peered":"2024-04-23T10:24:52.494092+0000","last_unstale":"2024-04-23T10:26:53.361229+0000","last_undegraded":"2024-04-23T10:26:53.361229+0000","last_fullsized":"2024-04-23T10:26:53.361229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:42:09.407787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513214+0000","last_change":"2024-04-23T10:24:53.495285+0000","last_active":"2024-04-23T10:26:53.513214+0000","last_peered":"2024-04-23T10:26:53.513214+0000","last_clean":"2024-04-23T10:26:53.513214+0000","last_became_active":"2024-04-23T10:24:53.494959+0000","last_became_peered":"2024-04-23T10:24:53.494959+0000","last_unstale":"2024-04-23T10:26:53.513214+0000","last_undegraded":"2024-04-23T10:26:53.513214+0000","last_fullsized":"2024-04-23T10:26:53.513214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:59.209505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270433+0000","last_change":"2024-04-23T10:24:52.496310+0000","last_active":"2024-04-23T10:26:53.270433+0000","last_peered":"2024-04-23T10:26:53.270433+0000","last_clean":"2024-04-23T10:26:53.270433+0000","last_became_active":"2024-04-23T10:24:52.496009+0000","last_became_peered":"2024-04-23T10:24:52.496009+0000","last_unstale":"2024-04-23T10:26:53.270433+0000","last_undegraded":"2024-04-23T10:26:53.270433+0000","last_fullsized":"2024-04-23T10:26:53.270433+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:05:46.911691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509924+0000","last_change":"2024-04-23T10:24:53.498204+0000","last_active":"2024-04-23T10:26:53.509924+0000","last_peered":"2024-04-23T10:26:53.509924+0000","last_clean":"2024-04-23T10:26:53.509924+0000","last_became_active":"2024-04-23T10:24:53.496535+0000","last_became_peered":"2024-04-23T10:24:53.496535+0000","last_unstale":"2024-04-23T10:26:53.509924+0000","last_undegraded":"2024-04-23T10:26:53.509924+0000","last_fullsized":"2024-04-23T10:26:53.509924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:35:32.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270193+0000","last_change":"2024-04-23T10:24:52.493485+0000","last_active":"2024-04-23T10:26:53.270193+0000","last_peered":"2024-04-23T10:26:53.270193+0000","last_clean":"2024-04-23T10:26:53.270193+0000","last_became_active":"2024-04-23T10:24:52.493164+0000","last_became_peered":"2024-04-23T10:24:52.493164+0000","last_unstale":"2024-04-23T10:26:53.270193+0000","last_undegraded":"2024-04-23T10:26:53.270193+0000","last_fullsized":"2024-04-23T10:26:53.270193+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:42:33.701248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366725+0000","last_change":"2024-04-23T10:24:53.507145+0000","last_active":"2024-04-23T10:26:53.366725+0000","last_peered":"2024-04-23T10:26:53.366725+0000","last_clean":"2024-04-23T10:26:53.366725+0000","last_became_active":"2024-04-23T10:24:53.506824+0000","last_became_peered":"2024-04-23T10:24:53.506824+0000","last_unstale":"2024-04-23T10:26:53.366725+0000","last_undegraded":"2024-04-23T10:26:53.366725+0000","last_fullsized":"2024-04-23T10:26:53.366725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:37:54.870303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.482159+0000","last_change":"2024-04-23T10:24:52.498646+0000","last_active":"2024-04-23T10:26:53.482159+0000","last_peered":"2024-04-23T10:26:53.482159+0000","last_clean":"2024-04-23T10:26:53.482159+0000","last_became_active":"2024-04-23T10:24:52.498328+0000","last_became_peered":"2024-04-23T10:24:52.498328+0000","last_unstale":"2024-04-23T10:26:53.482159+0000","last_undegraded":"2024-04-23T10:26:53.482159+0000","last_fullsized":"2024-04-23T10:26:53.482159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:26:33.646144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269856+0000","last_change":"2024-04-23T10:26:00.216570+0000","last_active":"2024-04-23T10:26:53.269856+0000","last_peered":"2024-04-23T10:26:53.269856+0000","last_clean":"2024-04-23T10:26:53.269856+0000","last_became_active":"2024-04-23T10:26:00.216228+0000","last_became_peered":"2024-04-23T10:26:00.216228+0000","last_unstale":"2024-04-23T10:26:53.269856+0000","last_undegraded":"2024-04-23T10:26:53.269856+0000","last_fullsized":"2024-04-23T10:26:53.269856+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:57:54.527816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369044+0000","last_change":"2024-04-23T10:24:52.495242+0000","last_active":"2024-04-23T10:26:53.369044+0000","last_peered":"2024-04-23T10:26:53.369044+0000","last_clean":"2024-04-23T10:26:53.369044+0000","last_became_active":"2024-04-23T10:24:52.493255+0000","last_became_peered":"2024-04-23T10:24:52.493255+0000","last_unstale":"2024-04-23T10:26:53.369044+0000","last_undegraded":"2024-04-23T10:26:53.369044+0000","last_fullsized":"2024-04-23T10:26:53.369044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:50:33.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366744+0000","last_change":"2024-04-23T10:24:53.499843+0000","last_active":"2024-04-23T10:26:53.366744+0000","last_peered":"2024-04-23T10:26:53.366744+0000","last_clean":"2024-04-23T10:26:53.366744+0000","last_became_active":"2024-04-23T10:24:53.499512+0000","last_became_peered":"2024-04-23T10:24:53.499512+0000","last_unstale":"2024-04-23T10:26:53.366744+0000","last_undegraded":"2024-04-23T10:26:53.366744+0000","last_fullsized":"2024-04-23T10:26:53.366744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:27:20.333479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.484060+0000","last_change":"2024-04-23T10:24:52.495915+0000","last_active":"2024-04-23T10:26:53.484060+0000","last_peered":"2024-04-23T10:26:53.484060+0000","last_clean":"2024-04-23T10:26:53.484060+0000","last_became_active":"2024-04-23T10:24:52.495558+0000","last_became_peered":"2024-04-23T10:24:52.495558+0000","last_unstale":"2024-04-23T10:26:53.484060+0000","last_undegraded":"2024-04-23T10:26:53.484060+0000","last_fullsized":"2024-04-23T10:26:53.484060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:41:09.080880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360587+0000","last_change":"2024-04-23T10:24:53.496376+0000","last_active":"2024-04-23T10:26:53.360587+0000","last_peered":"2024-04-23T10:26:53.360587+0000","last_clean":"2024-04-23T10:26:53.360587+0000","last_became_active":"2024-04-23T10:24:53.496067+0000","last_became_peered":"2024-04-23T10:24:53.496067+0000","last_unstale":"2024-04-23T10:26:53.360587+0000","last_undegraded":"2024-04-23T10:26:53.360587+0000","last_fullsized":"2024-04-23T10:26:53.360587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:02:51.252365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366356+0000","last_change":"2024-04-23T10:24:52.499566+0000","last_active":"2024-04-23T10:26:53.366356+0000","last_peered":"2024-04-23T10:26:53.366356+0000","last_clean":"2024-04-23T10:26:53.366356+0000","last_became_active":"2024-04-23T10:24:52.499277+0000","last_became_peered":"2024-04-23T10:24:52.499277+0000","last_unstale":"2024-04-23T10:26:53.366356+0000","last_undegraded":"2024-04-23T10:26:53.366356+0000","last_fullsized":"2024-04-23T10:26:53.366356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:38.716187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.266066+0000","last_change":"2024-04-23T10:24:53.499617+0000","last_active":"2024-04-23T10:26:53.266066+0000","last_peered":"2024-04-23T10:26:53.266066+0000","last_clean":"2024-04-23T10:26:53.266066+0000","last_became_active":"2024-04-23T10:24:53.499283+0000","last_became_peered":"2024-04-23T10:24:53.499283+0000","last_unstale":"2024-04-23T10:26:53.266066+0000","last_undegraded":"2024-04-23T10:26:53.266066+0000","last_fullsized":"2024-04-23T10:26:53.266066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:36.931697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'7","reported_seq":261,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.516687+0000","last_change":"2024-04-23T10:24:52.492276+0000","last_active":"2024-04-23T10:26:53.516687+0000","last_peered":"2024-04-23T10:26:53.516687+0000","last_clean":"2024-04-23T10:26:53.516687+0000","last_became_active":"2024-04-23T10:24:52.491979+0000","last_became_peered":"2024-04-23T10:24:52.491979+0000","last_unstale":"2024-04-23T10:26:53.516687+0000","last_undegraded":"2024-04-23T10:26:53.516687+0000","last_fullsized":"2024-04-23T10:26:53.516687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:15:40.847446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":233,"num_read_kb":233,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509422+0000","last_change":"2024-04-23T10:24:53.500964+0000","last_active":"2024-04-23T10:26:53.509422+0000","last_peered":"2024-04-23T10:26:53.509422+0000","last_clean":"2024-04-23T10:26:53.509422+0000","last_became_active":"2024-04-23T10:24:53.499209+0000","last_became_peered":"2024-04-23T10:24:53.499209+0000","last_unstale":"2024-04-23T10:26:53.509422+0000","last_undegraded":"2024-04-23T10:26:53.509422+0000","last_fullsized":"2024-04-23T10:26:53.509422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:27:29.539994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268207+0000","last_change":"2024-04-23T10:24:52.496016+0000","last_active":"2024-04-23T10:26:53.268207+0000","last_peered":"2024-04-23T10:26:53.268207+0000","last_clean":"2024-04-23T10:26:53.268207+0000","last_became_active":"2024-04-23T10:24:52.495711+0000","last_became_peered":"2024-04-23T10:24:52.495711+0000","last_unstale":"2024-04-23T10:26:53.268207+0000","last_undegraded":"2024-04-23T10:26:53.268207+0000","last_fullsized":"2024-04-23T10:26:53.268207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:31:30.970731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513895+0000","last_change":"2024-04-23T10:26:00.091494+0000","last_active":"2024-04-23T10:26:53.513895+0000","last_peered":"2024-04-23T10:26:53.513895+0000","last_clean":"2024-04-23T10:26:53.513895+0000","last_became_active":"2024-04-23T10:26:00.091122+0000","last_became_peered":"2024-04-23T10:26:00.091122+0000","last_unstale":"2024-04-23T10:26:53.513895+0000","last_undegraded":"2024-04-23T10:26:53.513895+0000","last_fullsized":"2024-04-23T10:26:53.513895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:32.833741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366824+0000","last_change":"2024-04-23T10:24:52.497200+0000","last_active":"2024-04-23T10:26:53.366824+0000","last_peered":"2024-04-23T10:26:53.366824+0000","last_clean":"2024-04-23T10:26:53.366824+0000","last_became_active":"2024-04-23T10:24:52.496864+0000","last_became_peered":"2024-04-23T10:24:52.496864+0000","last_unstale":"2024-04-23T10:26:53.366824+0000","last_undegraded":"2024-04-23T10:26:53.366824+0000","last_fullsized":"2024-04-23T10:26:53.366824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:16.514060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509302+0000","last_change":"2024-04-23T10:24:53.498438+0000","last_active":"2024-04-23T10:26:53.509302+0000","last_peered":"2024-04-23T10:26:53.509302+0000","last_clean":"2024-04-23T10:26:53.509302+0000","last_became_active":"2024-04-23T10:24:53.496569+0000","last_became_peered":"2024-04-23T10:24:53.496569+0000","last_unstale":"2024-04-23T10:26:53.509302+0000","last_undegraded":"2024-04-23T10:26:53.509302+0000","last_fullsized":"2024-04-23T10:26:53.509302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:06:45.964699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'34","reported_seq":300,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.519323+0000","last_change":"2024-04-23T10:24:52.490058+0000","last_active":"2024-04-23T10:26:53.519323+0000","last_peered":"2024-04-23T10:26:53.519323+0000","last_clean":"2024-04-23T10:26:53.519323+0000","last_became_active":"2024-04-23T10:24:52.489720+0000","last_became_peered":"2024-04-23T10:24:52.489720+0000","last_unstale":"2024-04-23T10:26:53.519323+0000","last_undegraded":"2024-04-23T10:26:53.519323+0000","last_fullsized":"2024-04-23T10:26:53.519323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:41.049778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62506,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":245,"num_read_kb":178,"num_write":36,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270171+0000","last_change":"2024-04-23T10:24:53.507122+0000","last_active":"2024-04-23T10:26:53.270171+0000","last_peered":"2024-04-23T10:26:53.270171+0000","last_clean":"2024-04-23T10:26:53.270171+0000","last_became_active":"2024-04-23T10:24:53.506838+0000","last_became_peered":"2024-04-23T10:24:53.506838+0000","last_unstale":"2024-04-23T10:26:53.270171+0000","last_undegraded":"2024-04-23T10:26:53.270171+0000","last_fullsized":"2024-04-23T10:26:53.270171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:59:51.289630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513981+0000","last_change":"2024-04-23T10:24:52.499787+0000","last_active":"2024-04-23T10:26:53.513981+0000","last_peered":"2024-04-23T10:26:53.513981+0000","last_clean":"2024-04-23T10:26:53.513981+0000","last_became_active":"2024-04-23T10:24:52.499400+0000","last_became_peered":"2024-04-23T10:24:52.499400+0000","last_unstale":"2024-04-23T10:26:53.513981+0000","last_undegraded":"2024-04-23T10:26:53.513981+0000","last_fullsized":"2024-04-23T10:26:53.513981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:15:17.638984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483399+0000","last_change":"2024-04-23T10:24:53.495773+0000","last_active":"2024-04-23T10:26:53.483399+0000","last_peered":"2024-04-23T10:26:53.483399+0000","last_clean":"2024-04-23T10:26:53.483399+0000","last_became_active":"2024-04-23T10:24:53.495456+0000","last_became_peered":"2024-04-23T10:24:53.495456+0000","last_unstale":"2024-04-23T10:26:53.483399+0000","last_undegraded":"2024-04-23T10:26:53.483399+0000","last_fullsized":"2024-04-23T10:26:53.483399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:12:06.638141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366448+0000","last_change":"2024-04-23T10:24:52.498660+0000","last_active":"2024-04-23T10:26:53.366448+0000","last_peered":"2024-04-23T10:26:53.366448+0000","last_clean":"2024-04-23T10:26:53.366448+0000","last_became_active":"2024-04-23T10:24:52.498302+0000","last_became_peered":"2024-04-23T10:24:52.498302+0000","last_unstale":"2024-04-23T10:26:53.366448+0000","last_undegraded":"2024-04-23T10:26:53.366448+0000","last_fullsized":"2024-04-23T10:26:53.366448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:49:23.826748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268154+0000","last_change":"2024-04-23T10:24:53.501718+0000","last_active":"2024-04-23T10:26:53.268154+0000","last_peered":"2024-04-23T10:26:53.268154+0000","last_clean":"2024-04-23T10:26:53.268154+0000","last_became_active":"2024-04-23T10:24:53.501359+0000","last_became_peered":"2024-04-23T10:24:53.501359+0000","last_unstale":"2024-04-23T10:26:53.268154+0000","last_undegraded":"2024-04-23T10:26:53.268154+0000","last_fullsized":"2024-04-23T10:26:53.268154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:51:42.474899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'9","reported_seq":148,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513026+0000","last_change":"2024-04-23T10:24:52.493910+0000","last_active":"2024-04-23T10:26:53.513026+0000","last_peered":"2024-04-23T10:26:53.513026+0000","last_clean":"2024-04-23T10:26:53.513026+0000","last_became_active":"2024-04-23T10:24:52.493536+0000","last_became_peered":"2024-04-23T10:24:52.493536+0000","last_unstale":"2024-04-23T10:26:53.513026+0000","last_undegraded":"2024-04-23T10:26:53.513026+0000","last_fullsized":"2024-04-23T10:26:53.513026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:23.806993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267746+0000","last_change":"2024-04-23T10:24:53.498221+0000","last_active":"2024-04-23T10:26:53.267746+0000","last_peered":"2024-04-23T10:26:53.267746+0000","last_clean":"2024-04-23T10:26:53.267746+0000","last_became_active":"2024-04-23T10:24:53.497887+0000","last_became_peered":"2024-04-23T10:24:53.497887+0000","last_unstale":"2024-04-23T10:26:53.267746+0000","last_undegraded":"2024-04-23T10:26:53.267746+0000","last_fullsized":"2024-04-23T10:26:53.267746+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:49:02.739927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269915+0000","last_change":"2024-04-23T10:24:52.498883+0000","last_active":"2024-04-23T10:26:53.269915+0000","last_peered":"2024-04-23T10:26:53.269915+0000","last_clean":"2024-04-23T10:26:53.269915+0000","last_became_active":"2024-04-23T10:24:52.498562+0000","last_became_peered":"2024-04-23T10:24:52.498562+0000","last_unstale":"2024-04-23T10:26:53.269915+0000","last_undegraded":"2024-04-23T10:26:53.269915+0000","last_fullsized":"2024-04-23T10:26:53.269915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:20:33.914481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366468+0000","last_change":"2024-04-23T10:24:53.506303+0000","last_active":"2024-04-23T10:26:53.366468+0000","last_peered":"2024-04-23T10:26:53.366468+0000","last_clean":"2024-04-23T10:26:53.366468+0000","last_became_active":"2024-04-23T10:24:53.505850+0000","last_became_peered":"2024-04-23T10:24:53.505850+0000","last_unstale":"2024-04-23T10:26:53.366468+0000","last_undegraded":"2024-04-23T10:26:53.366468+0000","last_fullsized":"2024-04-23T10:26:53.366468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:18.498188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270324+0000","last_change":"2024-04-23T10:24:52.493853+0000","last_active":"2024-04-23T10:26:53.270324+0000","last_peered":"2024-04-23T10:26:53.270324+0000","last_clean":"2024-04-23T10:26:53.270324+0000","last_became_active":"2024-04-23T10:24:52.492932+0000","last_became_peered":"2024-04-23T10:24:52.492932+0000","last_unstale":"2024-04-23T10:26:53.270324+0000","last_undegraded":"2024-04-23T10:26:53.270324+0000","last_fullsized":"2024-04-23T10:26:53.270324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:12:33.327611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360638+0000","last_change":"2024-04-23T10:26:00.284417+0000","last_active":"2024-04-23T10:26:53.360638+0000","last_peered":"2024-04-23T10:26:53.360638+0000","last_clean":"2024-04-23T10:26:53.360638+0000","last_became_active":"2024-04-23T10:26:00.284097+0000","last_became_peered":"2024-04-23T10:26:00.284097+0000","last_unstale":"2024-04-23T10:26:53.360638+0000","last_undegraded":"2024-04-23T10:26:53.360638+0000","last_fullsized":"2024-04-23T10:26:53.360638+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:53.114887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.266231+0000","last_change":"2024-04-23T10:24:52.494032+0000","last_active":"2024-04-23T10:26:53.266231+0000","last_peered":"2024-04-23T10:26:53.266231+0000","last_clean":"2024-04-23T10:26:53.266231+0000","last_became_active":"2024-04-23T10:24:52.493699+0000","last_became_peered":"2024-04-23T10:24:52.493699+0000","last_unstale":"2024-04-23T10:26:53.266231+0000","last_undegraded":"2024-04-23T10:26:53.266231+0000","last_fullsized":"2024-04-23T10:26:53.266231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:54.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369228+0000","last_change":"2024-04-23T10:24:53.494846+0000","last_active":"2024-04-23T10:26:53.369228+0000","last_peered":"2024-04-23T10:26:53.369228+0000","last_clean":"2024-04-23T10:26:53.369228+0000","last_became_active":"2024-04-23T10:24:53.494541+0000","last_became_peered":"2024-04-23T10:24:53.494541+0000","last_unstale":"2024-04-23T10:26:53.369228+0000","last_undegraded":"2024-04-23T10:26:53.369228+0000","last_fullsized":"2024-04-23T10:26:53.369228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:33:24.263803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'7","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509421+0000","last_change":"2024-04-23T10:24:52.499078+0000","last_active":"2024-04-23T10:26:53.509421+0000","last_peered":"2024-04-23T10:26:53.509421+0000","last_clean":"2024-04-23T10:26:53.509421+0000","last_became_active":"2024-04-23T10:24:52.498764+0000","last_became_peered":"2024-04-23T10:24:52.498764+0000","last_unstale":"2024-04-23T10:26:53.509421+0000","last_undegraded":"2024-04-23T10:26:53.509421+0000","last_fullsized":"2024-04-23T10:26:53.509421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:10:51.634437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1370,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.369333+0000","last_change":"2024-04-23T10:26:00.087050+0000","last_active":"2024-04-23T10:26:53.369333+0000","last_peered":"2024-04-23T10:26:53.369333+0000","last_clean":"2024-04-23T10:26:53.369333+0000","last_became_active":"2024-04-23T10:26:00.086634+0000","last_became_peered":"2024-04-23T10:26:00.086634+0000","last_unstale":"2024-04-23T10:26:53.369333+0000","last_undegraded":"2024-04-23T10:26:53.369333+0000","last_fullsized":"2024-04-23T10:26:53.369333+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:40:38.242963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366503+0000","last_change":"2024-04-23T10:24:53.504787+0000","last_active":"2024-04-23T10:26:53.366503+0000","last_peered":"2024-04-23T10:26:53.366503+0000","last_clean":"2024-04-23T10:26:53.366503+0000","last_became_active":"2024-04-23T10:24:53.504423+0000","last_became_peered":"2024-04-23T10:24:53.504423+0000","last_unstale":"2024-04-23T10:26:53.366503+0000","last_undegraded":"2024-04-23T10:26:53.366503+0000","last_fullsized":"2024-04-23T10:26:53.366503+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:00.171449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'7","reported_seq":145,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513248+0000","last_change":"2024-04-23T10:24:52.493600+0000","last_active":"2024-04-23T10:26:53.513248+0000","last_peered":"2024-04-23T10:26:53.513248+0000","last_clean":"2024-04-23T10:26:53.513248+0000","last_became_active":"2024-04-23T10:24:52.493310+0000","last_became_peered":"2024-04-23T10:24:52.493310+0000","last_unstale":"2024-04-23T10:26:53.513248+0000","last_undegraded":"2024-04-23T10:26:53.513248+0000","last_fullsized":"2024-04-23T10:26:53.513248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:07.144860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360960+0000","last_change":"2024-04-23T10:24:53.506311+0000","last_active":"2024-04-23T10:26:53.360960+0000","last_peered":"2024-04-23T10:26:53.360960+0000","last_clean":"2024-04-23T10:26:53.360960+0000","last_became_active":"2024-04-23T10:24:53.503910+0000","last_became_peered":"2024-04-23T10:24:53.503910+0000","last_unstale":"2024-04-23T10:26:53.360960+0000","last_undegraded":"2024-04-23T10:26:53.360960+0000","last_fullsized":"2024-04-23T10:26:53.360960+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:01:32.620891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486002+0000","last_change":"2024-04-23T10:24:52.485060+0000","last_active":"2024-04-23T10:26:53.486002+0000","last_peered":"2024-04-23T10:26:53.486002+0000","last_clean":"2024-04-23T10:26:53.486002+0000","last_became_active":"2024-04-23T10:24:52.484636+0000","last_became_peered":"2024-04-23T10:24:52.484636+0000","last_unstale":"2024-04-23T10:26:53.486002+0000","last_undegraded":"2024-04-23T10:26:53.486002+0000","last_fullsized":"2024-04-23T10:26:53.486002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:26:01.737147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":356,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267872+0000","last_change":"2024-04-23T10:23:43.804102+0000","last_active":"2024-04-23T10:26:53.267872+0000","last_peered":"2024-04-23T10:26:53.267872+0000","last_clean":"2024-04-23T10:26:53.267872+0000","last_became_active":"2024-04-23T10:23:43.803657+0000","last_became_peered":"2024-04-23T10:23:43.803657+0000","last_unstale":"2024-04-23T10:26:53.267872+0000","last_undegraded":"2024-04-23T10:26:53.267872+0000","last_fullsized":"2024-04-23T10:26:53.267872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:20:19.875078+0000","last_clean_scrub_stamp":"2024-04-23T10:20:19.875078+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:50.160735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483865+0000","last_change":"2024-04-23T10:24:53.499334+0000","last_active":"2024-04-23T10:26:53.483865+0000","last_peered":"2024-04-23T10:26:53.483865+0000","last_clean":"2024-04-23T10:26:53.483865+0000","last_became_active":"2024-04-23T10:24:53.499008+0000","last_became_peered":"2024-04-23T10:24:53.499008+0000","last_unstale":"2024-04-23T10:26:53.483865+0000","last_undegraded":"2024-04-23T10:26:53.483865+0000","last_fullsized":"2024-04-23T10:26:53.483865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:03:13.504789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268032+0000","last_change":"2024-04-23T10:24:52.493601+0000","last_active":"2024-04-23T10:26:53.268032+0000","last_peered":"2024-04-23T10:26:53.268032+0000","last_clean":"2024-04-23T10:26:53.268032+0000","last_became_active":"2024-04-23T10:24:52.493278+0000","last_became_peered":"2024-04-23T10:24:52.493278+0000","last_unstale":"2024-04-23T10:26:53.268032+0000","last_undegraded":"2024-04-23T10:26:53.268032+0000","last_fullsized":"2024-04-23T10:26:53.268032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:36:21.375233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.270337+0000","last_change":"2024-04-23T10:24:52.495637+0000","last_active":"2024-04-23T10:26:53.270337+0000","last_peered":"2024-04-23T10:26:53.270337+0000","last_clean":"2024-04-23T10:26:53.270337+0000","last_became_active":"2024-04-23T10:24:52.495329+0000","last_became_peered":"2024-04-23T10:24:52.495329+0000","last_unstale":"2024-04-23T10:26:53.270337+0000","last_undegraded":"2024-04-23T10:26:53.270337+0000","last_fullsized":"2024-04-23T10:26:53.270337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:14.187803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483641+0000","last_change":"2024-04-23T10:24:53.500353+0000","last_active":"2024-04-23T10:26:53.483641+0000","last_peered":"2024-04-23T10:26:53.483641+0000","last_clean":"2024-04-23T10:26:53.483641+0000","last_became_active":"2024-04-23T10:24:53.499995+0000","last_became_peered":"2024-04-23T10:24:53.499995+0000","last_unstale":"2024-04-23T10:26:53.483641+0000","last_undegraded":"2024-04-23T10:26:53.483641+0000","last_fullsized":"2024-04-23T10:26:53.483641+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:55:52.695375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'47","reported_seq":107,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.464904+0000","last_change":"2024-04-23T10:26:00.099289+0000","last_active":"2024-04-23T10:26:53.464904+0000","last_peered":"2024-04-23T10:26:53.464904+0000","last_clean":"2024-04-23T10:26:53.464904+0000","last_became_active":"2024-04-23T10:26:00.088425+0000","last_became_peered":"2024-04-23T10:26:00.088425+0000","last_unstale":"2024-04-23T10:26:53.464904+0000","last_undegraded":"2024-04-23T10:26:53.464904+0000","last_fullsized":"2024-04-23T10:26:53.464904+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:54:11.848553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360844+0000","last_change":"2024-04-23T10:24:53.498140+0000","last_active":"2024-04-23T10:26:53.360844+0000","last_peered":"2024-04-23T10:26:53.360844+0000","last_clean":"2024-04-23T10:26:53.360844+0000","last_became_active":"2024-04-23T10:24:53.496683+0000","last_became_peered":"2024-04-23T10:24:53.496683+0000","last_unstale":"2024-04-23T10:26:53.360844+0000","last_undegraded":"2024-04-23T10:26:53.360844+0000","last_fullsized":"2024-04-23T10:26:53.360844+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:49:18.761033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.486140+0000","last_change":"2024-04-23T10:24:52.486505+0000","last_active":"2024-04-23T10:26:53.486140+0000","last_peered":"2024-04-23T10:26:53.486140+0000","last_clean":"2024-04-23T10:26:53.486140+0000","last_became_active":"2024-04-23T10:24:52.486185+0000","last_became_peered":"2024-04-23T10:24:52.486185+0000","last_unstale":"2024-04-23T10:26:53.486140+0000","last_undegraded":"2024-04-23T10:26:53.486140+0000","last_fullsized":"2024-04-23T10:26:53.486140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:46:27.052935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513586+0000","last_change":"2024-04-23T10:24:53.496234+0000","last_active":"2024-04-23T10:26:53.513586+0000","last_peered":"2024-04-23T10:26:53.513586+0000","last_clean":"2024-04-23T10:26:53.513586+0000","last_became_active":"2024-04-23T10:24:53.495892+0000","last_became_peered":"2024-04-23T10:24:53.495892+0000","last_unstale":"2024-04-23T10:26:53.513586+0000","last_undegraded":"2024-04-23T10:26:53.513586+0000","last_fullsized":"2024-04-23T10:26:53.513586+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:44:11.290892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509445+0000","last_change":"2024-04-23T10:26:00.094344+0000","last_active":"2024-04-23T10:26:53.509445+0000","last_peered":"2024-04-23T10:26:53.509445+0000","last_clean":"2024-04-23T10:26:53.509445+0000","last_became_active":"2024-04-23T10:26:00.090692+0000","last_became_peered":"2024-04-23T10:26:00.090692+0000","last_unstale":"2024-04-23T10:26:53.509445+0000","last_undegraded":"2024-04-23T10:26:53.509445+0000","last_fullsized":"2024-04-23T10:26:53.509445+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:34:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269829+0000","last_change":"2024-04-23T10:24:53.497985+0000","last_active":"2024-04-23T10:26:53.269829+0000","last_peered":"2024-04-23T10:26:53.269829+0000","last_clean":"2024-04-23T10:26:53.269829+0000","last_became_active":"2024-04-23T10:24:53.497661+0000","last_became_peered":"2024-04-23T10:24:53.497661+0000","last_unstale":"2024-04-23T10:26:53.269829+0000","last_undegraded":"2024-04-23T10:26:53.269829+0000","last_fullsized":"2024-04-23T10:26:53.269829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:48.923714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360768+0000","last_change":"2024-04-23T10:24:52.490572+0000","last_active":"2024-04-23T10:26:53.360768+0000","last_peered":"2024-04-23T10:26:53.360768+0000","last_clean":"2024-04-23T10:26:53.360768+0000","last_became_active":"2024-04-23T10:24:52.490274+0000","last_became_peered":"2024-04-23T10:24:52.490274+0000","last_unstale":"2024-04-23T10:26:53.360768+0000","last_undegraded":"2024-04-23T10:26:53.360768+0000","last_fullsized":"2024-04-23T10:26:53.360768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:22.447399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360448+0000","last_change":"2024-04-23T10:24:53.509189+0000","last_active":"2024-04-23T10:26:53.360448+0000","last_peered":"2024-04-23T10:26:53.360448+0000","last_clean":"2024-04-23T10:26:53.360448+0000","last_became_active":"2024-04-23T10:24:53.508850+0000","last_became_peered":"2024-04-23T10:24:53.508850+0000","last_unstale":"2024-04-23T10:26:53.360448+0000","last_undegraded":"2024-04-23T10:26:53.360448+0000","last_fullsized":"2024-04-23T10:26:53.360448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:50:23.242999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'5","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513953+0000","last_change":"2024-04-23T10:24:52.497616+0000","last_active":"2024-04-23T10:26:53.513953+0000","last_peered":"2024-04-23T10:26:53.513953+0000","last_clean":"2024-04-23T10:26:53.513953+0000","last_became_active":"2024-04-23T10:24:52.497028+0000","last_became_peered":"2024-04-23T10:24:52.497028+0000","last_unstale":"2024-04-23T10:26:53.513953+0000","last_undegraded":"2024-04-23T10:26:53.513953+0000","last_fullsized":"2024-04-23T10:26:53.513953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:51:26.836718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360841+0000","last_change":"2024-04-23T10:24:53.498086+0000","last_active":"2024-04-23T10:26:53.360841+0000","last_peered":"2024-04-23T10:26:53.360841+0000","last_clean":"2024-04-23T10:26:53.360841+0000","last_became_active":"2024-04-23T10:24:53.497734+0000","last_became_peered":"2024-04-23T10:24:53.497734+0000","last_unstale":"2024-04-23T10:26:53.360841+0000","last_undegraded":"2024-04-23T10:26:53.360841+0000","last_fullsized":"2024-04-23T10:26:53.360841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:57.602301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.269954+0000","last_change":"2024-04-23T10:24:52.496609+0000","last_active":"2024-04-23T10:26:53.269954+0000","last_peered":"2024-04-23T10:26:53.269954+0000","last_clean":"2024-04-23T10:26:53.269954+0000","last_became_active":"2024-04-23T10:24:52.495981+0000","last_became_peered":"2024-04-23T10:24:52.495981+0000","last_unstale":"2024-04-23T10:26:53.269954+0000","last_undegraded":"2024-04-23T10:26:53.269954+0000","last_fullsized":"2024-04-23T10:26:53.269954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:28.111644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268115+0000","last_change":"2024-04-23T10:24:53.503840+0000","last_active":"2024-04-23T10:26:53.268115+0000","last_peered":"2024-04-23T10:26:53.268115+0000","last_clean":"2024-04-23T10:26:53.268115+0000","last_became_active":"2024-04-23T10:24:53.503448+0000","last_became_peered":"2024-04-23T10:24:53.503448+0000","last_unstale":"2024-04-23T10:26:53.268115+0000","last_undegraded":"2024-04-23T10:26:53.268115+0000","last_fullsized":"2024-04-23T10:26:53.268115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:03.295985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'9","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.521877+0000","last_change":"2024-04-23T10:24:52.501792+0000","last_active":"2024-04-23T10:26:53.521877+0000","last_peered":"2024-04-23T10:26:53.521877+0000","last_clean":"2024-04-23T10:26:53.521877+0000","last_became_active":"2024-04-23T10:24:52.501404+0000","last_became_peered":"2024-04-23T10:24:52.501404+0000","last_unstale":"2024-04-23T10:26:53.521877+0000","last_undegraded":"2024-04-23T10:26:53.521877+0000","last_fullsized":"2024-04-23T10:26:53.521877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:03.529410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2401,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268107+0000","last_change":"2024-04-23T10:24:53.501649+0000","last_active":"2024-04-23T10:26:53.268107+0000","last_peered":"2024-04-23T10:26:53.268107+0000","last_clean":"2024-04-23T10:26:53.268107+0000","last_became_active":"2024-04-23T10:24:53.501307+0000","last_became_peered":"2024-04-23T10:24:53.501307+0000","last_unstale":"2024-04-23T10:26:53.268107+0000","last_undegraded":"2024-04-23T10:26:53.268107+0000","last_fullsized":"2024-04-23T10:26:53.268107+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:37.863832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'41","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.462917+0000","last_change":"2024-04-23T10:24:52.495737+0000","last_active":"2024-04-23T10:26:53.462917+0000","last_peered":"2024-04-23T10:26:53.462917+0000","last_clean":"2024-04-23T10:26:53.462917+0000","last_became_active":"2024-04-23T10:24:52.495395+0000","last_became_peered":"2024-04-23T10:24:52.495395+0000","last_unstale":"2024-04-23T10:26:53.462917+0000","last_undegraded":"2024-04-23T10:26:53.462917+0000","last_fullsized":"2024-04-23T10:26:53.462917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:14:45.322831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.267964+0000","last_change":"2024-04-23T10:26:00.095511+0000","last_active":"2024-04-23T10:26:53.267964+0000","last_peered":"2024-04-23T10:26:53.267964+0000","last_clean":"2024-04-23T10:26:53.267964+0000","last_became_active":"2024-04-23T10:26:00.092403+0000","last_became_peered":"2024-04-23T10:26:00.092403+0000","last_unstale":"2024-04-23T10:26:53.267964+0000","last_undegraded":"2024-04-23T10:26:53.267964+0000","last_fullsized":"2024-04-23T10:26:53.267964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:16:45.782094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483944+0000","last_change":"2024-04-23T10:24:52.494322+0000","last_active":"2024-04-23T10:26:53.483944+0000","last_peered":"2024-04-23T10:26:53.483944+0000","last_clean":"2024-04-23T10:26:53.483944+0000","last_became_active":"2024-04-23T10:24:52.494019+0000","last_became_peered":"2024-04-23T10:24:52.494019+0000","last_unstale":"2024-04-23T10:26:53.483944+0000","last_undegraded":"2024-04-23T10:26:53.483944+0000","last_fullsized":"2024-04-23T10:26:53.483944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:51.464226+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.464226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:16.099197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.268354+0000","last_change":"2024-04-23T10:24:53.507160+0000","last_active":"2024-04-23T10:26:53.268354+0000","last_peered":"2024-04-23T10:26:53.268354+0000","last_clean":"2024-04-23T10:26:53.268354+0000","last_became_active":"2024-04-23T10:24:53.506815+0000","last_became_peered":"2024-04-23T10:24:53.506815+0000","last_unstale":"2024-04-23T10:26:53.268354+0000","last_undegraded":"2024-04-23T10:26:53.268354+0000","last_fullsized":"2024-04-23T10:26:53.268354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:53:24.657153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360475+0000","last_change":"2024-04-23T10:24:53.510511+0000","last_active":"2024-04-23T10:26:53.360475+0000","last_peered":"2024-04-23T10:26:53.360475+0000","last_clean":"2024-04-23T10:26:53.360475+0000","last_became_active":"2024-04-23T10:24:53.510174+0000","last_became_peered":"2024-04-23T10:24:53.510174+0000","last_unstale":"2024-04-23T10:26:53.360475+0000","last_undegraded":"2024-04-23T10:26:53.360475+0000","last_fullsized":"2024-04-23T10:26:53.360475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:35.048697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513132+0000","last_change":"2024-04-23T10:24:53.497365+0000","last_active":"2024-04-23T10:26:53.513132+0000","last_peered":"2024-04-23T10:26:53.513132+0000","last_clean":"2024-04-23T10:26:53.513132+0000","last_became_active":"2024-04-23T10:24:53.496427+0000","last_became_peered":"2024-04-23T10:24:53.496427+0000","last_unstale":"2024-04-23T10:26:53.513132+0000","last_undegraded":"2024-04-23T10:26:53.513132+0000","last_fullsized":"2024-04-23T10:26:53.513132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:22:35.867252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513193+0000","last_change":"2024-04-23T10:24:53.495913+0000","last_active":"2024-04-23T10:26:53.513193+0000","last_peered":"2024-04-23T10:26:53.513193+0000","last_clean":"2024-04-23T10:26:53.513193+0000","last_became_active":"2024-04-23T10:24:53.495543+0000","last_became_peered":"2024-04-23T10:24:53.495543+0000","last_unstale":"2024-04-23T10:26:53.513193+0000","last_undegraded":"2024-04-23T10:26:53.513193+0000","last_fullsized":"2024-04-23T10:26:53.513193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:03:29.327759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513412+0000","last_change":"2024-04-23T10:24:53.492305+0000","last_active":"2024-04-23T10:26:53.513412+0000","last_peered":"2024-04-23T10:26:53.513412+0000","last_clean":"2024-04-23T10:26:53.513412+0000","last_became_active":"2024-04-23T10:24:53.491980+0000","last_became_peered":"2024-04-23T10:24:53.491980+0000","last_unstale":"2024-04-23T10:26:53.513412+0000","last_undegraded":"2024-04-23T10:26:53.513412+0000","last_fullsized":"2024-04-23T10:26:53.513412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:34.987447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483808+0000","last_change":"2024-04-23T10:24:53.492464+0000","last_active":"2024-04-23T10:26:53.483808+0000","last_peered":"2024-04-23T10:26:53.483808+0000","last_clean":"2024-04-23T10:26:53.483808+0000","last_became_active":"2024-04-23T10:24:53.492156+0000","last_became_peered":"2024-04-23T10:24:53.492156+0000","last_unstale":"2024-04-23T10:26:53.483808+0000","last_undegraded":"2024-04-23T10:26:53.483808+0000","last_fullsized":"2024-04-23T10:26:53.483808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:07:15.414598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360552+0000","last_change":"2024-04-23T10:24:53.502208+0000","last_active":"2024-04-23T10:26:53.360552+0000","last_peered":"2024-04-23T10:26:53.360552+0000","last_clean":"2024-04-23T10:26:53.360552+0000","last_became_active":"2024-04-23T10:24:53.501921+0000","last_became_peered":"2024-04-23T10:24:53.501921+0000","last_unstale":"2024-04-23T10:26:53.360552+0000","last_undegraded":"2024-04-23T10:26:53.360552+0000","last_fullsized":"2024-04-23T10:26:53.360552+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:29:21.790594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.513417+0000","last_change":"2024-04-23T10:24:53.495446+0000","last_active":"2024-04-23T10:26:53.513417+0000","last_peered":"2024-04-23T10:26:53.513417+0000","last_clean":"2024-04-23T10:26:53.513417+0000","last_became_active":"2024-04-23T10:24:53.495090+0000","last_became_peered":"2024-04-23T10:24:53.495090+0000","last_unstale":"2024-04-23T10:26:53.513417+0000","last_undegraded":"2024-04-23T10:26:53.513417+0000","last_fullsized":"2024-04-23T10:26:53.513417+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:44:00.007468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360726+0000","last_change":"2024-04-23T10:24:53.503390+0000","last_active":"2024-04-23T10:26:53.360726+0000","last_peered":"2024-04-23T10:26:53.360726+0000","last_clean":"2024-04-23T10:26:53.360726+0000","last_became_active":"2024-04-23T10:24:53.503057+0000","last_became_peered":"2024-04-23T10:24:53.503057+0000","last_unstale":"2024-04-23T10:26:53.360726+0000","last_undegraded":"2024-04-23T10:26:53.360726+0000","last_fullsized":"2024-04-23T10:26:53.360726+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:19:39.950651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.366412+0000","last_change":"2024-04-23T10:24:53.498188+0000","last_active":"2024-04-23T10:26:53.366412+0000","last_peered":"2024-04-23T10:26:53.366412+0000","last_clean":"2024-04-23T10:26:53.366412+0000","last_became_active":"2024-04-23T10:24:53.497873+0000","last_became_peered":"2024-04-23T10:24:53.497873+0000","last_unstale":"2024-04-23T10:26:53.366412+0000","last_undegraded":"2024-04-23T10:26:53.366412+0000","last_fullsized":"2024-04-23T10:26:53.366412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:48:05.001361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360615+0000","last_change":"2024-04-23T10:24:53.502260+0000","last_active":"2024-04-23T10:26:53.360615+0000","last_peered":"2024-04-23T10:26:53.360615+0000","last_clean":"2024-04-23T10:26:53.360615+0000","last_became_active":"2024-04-23T10:24:53.501525+0000","last_became_peered":"2024-04-23T10:24:53.501525+0000","last_unstale":"2024-04-23T10:26:53.360615+0000","last_undegraded":"2024-04-23T10:26:53.360615+0000","last_fullsized":"2024-04-23T10:26:53.360615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:04.379055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.509274+0000","last_change":"2024-04-23T10:24:53.499306+0000","last_active":"2024-04-23T10:26:53.509274+0000","last_peered":"2024-04-23T10:26:53.509274+0000","last_clean":"2024-04-23T10:26:53.509274+0000","last_became_active":"2024-04-23T10:24:53.496717+0000","last_became_peered":"2024-04-23T10:24:53.496717+0000","last_unstale":"2024-04-23T10:26:53.509274+0000","last_undegraded":"2024-04-23T10:26:53.509274+0000","last_fullsized":"2024-04-23T10:26:53.509274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:03:17.907117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.483514+0000","last_change":"2024-04-23T10:24:53.496330+0000","last_active":"2024-04-23T10:26:53.483514+0000","last_peered":"2024-04-23T10:26:53.483514+0000","last_clean":"2024-04-23T10:26:53.483514+0000","last_became_active":"2024-04-23T10:24:53.496021+0000","last_became_peered":"2024-04-23T10:24:53.496021+0000","last_unstale":"2024-04-23T10:26:53.483514+0000","last_undegraded":"2024-04-23T10:26:53.483514+0000","last_fullsized":"2024-04-23T10:26:53.483514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:10:59.340265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-23T10:26:53.360493+0000","last_change":"2024-04-23T10:24:53.501025+0000","last_active":"2024-04-23T10:26:53.360493+0000","last_peered":"2024-04-23T10:26:53.360493+0000","last_clean":"2024-04-23T10:26:53.360493+0000","last_became_active":"2024-04-23T10:24:53.500673+0000","last_became_peered":"2024-04-23T10:24:53.500673+0000","last_unstale":"2024-04-23T10:26:53.360493+0000","last_undegraded":"2024-04-23T10:26:53.360493+0000","last_fullsized":"2024-04-23T10:26:53.360493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:24:52.468070+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.468070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:07.728645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107040,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597462,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1297,"num_read_kb":754,"num_write":370,"num_write_kb":1461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":700416,"data_stored":1792386,"data_compressed":81483,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":863827,"data_compressed":22051,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612649,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1146880,"data_stored":1255829,"data_compressed":46600,"data_compressed_allocated":61440,"data_compressed_original":729088,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776175,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1024000,"data_stored":862643,"data_compressed":22051,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037812,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":991232,"data_stored":469688,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":1064302,"data_compressed":38585,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":469809,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":533228,"data_compressed":4764,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":999424,"data_stored":471597,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1060864,"data_stored":534288,"data_compressed":4764,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":993551,"data_compressed":28207,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888135,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":470202,"data_compressed":2905,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724611,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":1193484,"data_compressed":44741,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35680,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65040,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66100,"data_compressed":1859,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":134811,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":197156,"data_compressed":8015,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":395639,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:26:59.282 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:26:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:58 smithi167 ceph-mon[32940]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:26:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:58 smithi167 ceph-mon[32940]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:26:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:58 smithi167 ceph-mon[32940]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:26:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:58 smithi167 ceph-mon[32940]: Updating smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:26:59.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:58 smithi167 ceph-mon[32940]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-04-23T10:26:59.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:58 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/935974678' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.418+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/1234651114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ecc10c520 msgr2=0x7f7ecc10e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.418+0000 7f7ed1ae8640 1 --2- 172.21.15.69:0/1234651114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ecc10c520 0x7f7ecc10e9c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009ca0 tx=0x7f7ec402a9e0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/1234651114 shutdown_connections 2024-04-23T10:26:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 --2- 172.21.15.69:0/1234651114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ecc10c520 0x7f7ecc10e9c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 --2- 172.21.15.69:0/1234651114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ecc103b00 0x7f7ecc10bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 --2- 172.21.15.69:0/1234651114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc1031e0 0x7f7ecc1035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/1234651114 >> 172.21.15.69:0/1234651114 conn(0x7f7ecc077f50 msgr2=0x7f7ecc078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/1234651114 shutdown_connections 2024-04-23T10:26:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/1234651114 wait complete. 2024-04-23T10:26:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 Processor -- start 2024-04-23T10:26:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 -- start start 2024-04-23T10:26:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc1031e0 0x7f7ecc19e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ecc103b00 0x7f7ecc19eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ecc10c520 0x7f7ecc198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc1122f0 con 0x7f7ecc103b00 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc112170 con 0x7f7ecc10c520 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.419+0000 7f7ed1ae8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc112470 con 0x7f7ecc1031e0 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec2ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ecc103b00 0x7f7ecc19eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec2ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ecc103b00 0x7f7ecc19eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38644/0 (socket says 172.21.15.69:38644) 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec2ffd640 1 -- 172.21.15.69:0/555757541 learned_addr learned my addr 172.21.15.69:0/555757541 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ecb7fe640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc1031e0 0x7f7ecc19e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ecbfff640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ecc10c520 0x7f7ecc198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec2ffd640 1 -- 172.21.15.69:0/555757541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc1031e0 msgr2=0x7f7ecc19e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec2ffd640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc1031e0 0x7f7ecc19e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec2ffd640 1 -- 172.21.15.69:0/555757541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ecc10c520 msgr2=0x7f7ecc198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec2ffd640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ecc10c520 0x7f7ecc198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec2ffd640 1 -- 172.21.15.69:0/555757541 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc198f50 con 0x7f7ecc103b00 2024-04-23T10:26:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec2ffd640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ecc103b00 0x7f7ecc19eac0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400d950 tx=0x7f7eb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec97fa640 1 -- 172.21.15.69:0/555757541 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4017030 con 0x7f7ecc103b00 2024-04-23T10:26:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec97fa640 1 -- 172.21.15.69:0/555757541 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7eb4004020 con 0x7f7ecc103b00 2024-04-23T10:26:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/555757541 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ecc199240 con 0x7f7ecc103b00 2024-04-23T10:26:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ec97fa640 1 -- 172.21.15.69:0/555757541 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40047a0 con 0x7f7ecc103b00 2024-04-23T10:26:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.420+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/555757541 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ecc1a5500 con 0x7f7ecc103b00 2024-04-23T10:26:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.421+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/555757541 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ecc0698e0 con 0x7f7ecc103b00 2024-04-23T10:26:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.422+0000 7f7ec97fa640 1 -- 172.21.15.69:0/555757541 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f7eb40041d0 con 0x7f7ecc103b00 2024-04-23T10:26:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.423+0000 7f7ec97fa640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7eb80a3e30 0x7f7eb80a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.423+0000 7f7ecb7fe640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7eb80a3e30 0x7f7eb80a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.423+0000 7f7ec97fa640 1 -- 172.21.15.69:0/555757541 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f7eb40d02f0 con 0x7f7ecc103b00 2024-04-23T10:26:59.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.424+0000 7f7ecb7fe640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7eb80a3e30 0x7f7eb80a62f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc005fd0 tx=0x7f7ebc005850 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:59.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.428+0000 7f7ec97fa640 1 -- 172.21.15.69:0/555757541 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7eb409c850 con 0x7f7ecc103b00 2024-04-23T10:26:59.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:58 smithi146 ceph-mon[32800]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-23T10:26:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:58 smithi146 ceph-mon[32800]: Updating smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:26:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:58 smithi146 ceph-mon[32800]: Updating smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:26:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:58 smithi146 ceph-mon[32800]: Updating smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-23T10:26:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:58 smithi146 ceph-mon[32800]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-04-23T10:26:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:58 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/935974678' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:26:59.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.642+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/555757541 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ecc1a56d0 con 0x7f7ecc103b00 2024-04-23T10:26:59.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.643+0000 7f7ec97fa640 1 -- 172.21.15.69:0/555757541 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11930 (secure 0 0 0) 0x7f7eb409c150 con 0x7f7ecc103b00 2024-04-23T10:26:59.642 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:59.642 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:26:51.903461+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24392,24416,24487,24463,24421]},"id":1}]} 2024-04-23T10:26:59.642 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 26 2024-04-23T10:26:59.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/555757541 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7eb80a3e30 msgr2=0x7f7eb80a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7eb80a3e30 0x7f7eb80a62f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc005fd0 tx=0x7f7ebc005850 comp rx=0 tx=0).stop 2024-04-23T10:26:59.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/555757541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ecc103b00 msgr2=0x7f7ecc19eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ecc103b00 0x7f7ecc19eac0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400d950 tx=0x7f7eb400de10 comp rx=0 tx=0).stop 2024-04-23T10:26:59.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/555757541 shutdown_connections 2024-04-23T10:26:59.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7eb80a3e30 0x7f7eb80a62f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ecc103b00 0x7f7ecc19eac0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ecc10c520 0x7f7ecc198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 --2- 172.21.15.69:0/555757541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc1031e0 0x7f7ecc19e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/555757541 >> 172.21.15.69:0/555757541 conn(0x7f7ecc077f50 msgr2=0x7f7ecc0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:59.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/555757541 shutdown_connections 2024-04-23T10:26:59.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.645+0000 7f7ed1ae8640 1 -- 172.21.15.69:0/555757541 wait complete. 2024-04-23T10:26:59.655 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:26:59.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.754+0000 7f3c87f20640 1 -- 172.21.15.69:0/3566845911 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c8010c570 msgr2=0x7f3c8010e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.754+0000 7f3c87f20640 1 --2- 172.21.15.69:0/3566845911 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c8010c570 0x7f3c8010e9e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009ca0 tx=0x7f3c7802a950 comp rx=0 tx=0).stop 2024-04-23T10:26:59.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.754+0000 7f3c87f20640 1 -- 172.21.15.69:0/3566845911 shutdown_connections 2024-04-23T10:26:59.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.754+0000 7f3c87f20640 1 --2- 172.21.15.69:0/3566845911 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c8010c570 0x7f3c8010e9e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.754+0000 7f3c87f20640 1 --2- 172.21.15.69:0/3566845911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c80103b50 0x7f3c8010c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.754+0000 7f3c87f20640 1 --2- 172.21.15.69:0/3566845911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80103230 0x7f3c80103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.754+0000 7f3c87f20640 1 -- 172.21.15.69:0/3566845911 >> 172.21.15.69:0/3566845911 conn(0x7f3c80077fb0 msgr2=0x7f3c800783c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:59.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.754+0000 7f3c87f20640 1 -- 172.21.15.69:0/3566845911 shutdown_connections 2024-04-23T10:26:59.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.754+0000 7f3c87f20640 1 -- 172.21.15.69:0/3566845911 wait complete. 2024-04-23T10:26:59.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c87f20640 1 Processor -- start 2024-04-23T10:26:59.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c87f20640 1 -- start start 2024-04-23T10:26:59.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c87f20640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c80103230 0x7f3c80198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c87f20640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80103b50 0x7f3c80198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c87f20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c8010c570 0x7f3c8019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c87f20640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3c80112310 con 0x7f3c80103230 2024-04-23T10:26:59.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c87f20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3c80112190 con 0x7f3c8010c570 2024-04-23T10:26:59.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c87f20640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3c80112490 con 0x7f3c80103b50 2024-04-23T10:26:59.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c85cbc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c80103230 0x7f3c80198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c85cbc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c80103230 0x7f3c80198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48960/0 (socket says 172.21.15.69:48960) 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c85cbc640 1 -- 172.21.15.69:0/3198748343 learned_addr learned my addr 172.21.15.69:0/3198748343 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c854bb640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80103b50 0x7f3c80198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c85cbc640 1 -- 172.21.15.69:0/3198748343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80103b50 msgr2=0x7f3c80198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c85cbc640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80103b50 0x7f3c80198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c85cbc640 1 -- 172.21.15.69:0/3198748343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c8010c570 msgr2=0x7f3c8019d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c85cbc640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c8010c570 0x7f3c8019d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.755+0000 7f3c85cbc640 1 -- 172.21.15.69:0/3198748343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8019d740 con 0x7f3c80103230 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.756+0000 7f3c85cbc640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c80103230 0x7f3c80198750 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00d770 tx=0x7f3c7c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.756+0000 7f3c76ffd640 1 -- 172.21.15.69:0/3198748343 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c017070 con 0x7f3c80103230 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.756+0000 7f3c76ffd640 1 -- 172.21.15.69:0/3198748343 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3c7c0054f0 con 0x7f3c80103230 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.756+0000 7f3c76ffd640 1 -- 172.21.15.69:0/3198748343 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c004de0 con 0x7f3c80103230 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.756+0000 7f3c87f20640 1 -- 172.21.15.69:0/3198748343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8019da30 con 0x7f3c80103230 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.756+0000 7f3c87f20640 1 -- 172.21.15.69:0/3198748343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c801a52c0 con 0x7f3c80103230 2024-04-23T10:26:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.757+0000 7f3c87f20640 1 -- 172.21.15.69:0/3198748343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c800691c0 con 0x7f3c80103230 2024-04-23T10:26:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.758+0000 7f3c76ffd640 1 -- 172.21.15.69:0/3198748343 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f3c7c004f80 con 0x7f3c80103230 2024-04-23T10:26:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.758+0000 7f3c76ffd640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3c6c0a3db0 0x7f3c6c0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:26:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.758+0000 7f3c854bb640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3c6c0a3db0 0x7f3c6c0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:26:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.758+0000 7f3c76ffd640 1 -- 172.21.15.69:0/3198748343 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f3c7c0d0920 con 0x7f3c80103230 2024-04-23T10:26:59.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.759+0000 7f3c854bb640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3c6c0a3db0 0x7f3c6c0a6270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3c8010e0c0 tx=0x7f3c7000c4a0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:26:59.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.762+0000 7f3c76ffd640 1 -- 172.21.15.69:0/3198748343 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3c7c09ce80 con 0x7f3c80103230 2024-04-23T10:26:59.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.939+0000 7f3c87f20640 1 -- 172.21.15.69:0/3198748343 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c801a55a0 con 0x7f3c80103230 2024-04-23T10:26:59.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.941+0000 7f3c76ffd640 1 -- 172.21.15.69:0/3198748343 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22971 (secure 0 0 0) 0x7f3c7c09c780 con 0x7f3c80103230 2024-04-23T10:26:59.940 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:26:59.940 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":89,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:26:53.261556+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/2621408239":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1024244898":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1462548780":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6800/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3272003821":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:26:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 -- 172.21.15.69:0/3198748343 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3c6c0a3db0 msgr2=0x7f3c6c0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3c6c0a3db0 0x7f3c6c0a6270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3c8010e0c0 tx=0x7f3c7000c4a0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 -- 172.21.15.69:0/3198748343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c80103230 msgr2=0x7f3c80198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:26:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c80103230 0x7f3c80198750 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00d770 tx=0x7f3c7c00dc30 comp rx=0 tx=0).stop 2024-04-23T10:26:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 -- 172.21.15.69:0/3198748343 shutdown_connections 2024-04-23T10:26:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3c6c0a3db0 0x7f3c6c0a6270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c8010c570 0x7f3c8019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80103b50 0x7f3c80198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 --2- 172.21.15.69:0/3198748343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c80103230 0x7f3c80198750 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:26:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 -- 172.21.15.69:0/3198748343 >> 172.21.15.69:0/3198748343 conn(0x7f3c80077fb0 msgr2=0x7f3c800fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:26:59.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 -- 172.21.15.69:0/3198748343 shutdown_connections 2024-04-23T10:26:59.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:26:59.943+0000 7f3c87f20640 1 -- 172.21.15.69:0/3198748343 wait complete. 2024-04-23T10:26:59.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:24:50.484063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:24:51.816315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:26:59.953 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:27:00.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.057+0000 7efcff623640 1 -- 172.21.15.69:0/3226102362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf8101ad0 msgr2=0x7efcf810dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.057+0000 7efcff623640 1 --2- 172.21.15.69:0/3226102362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf8101ad0 0x7efcf810dcf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009ca0 tx=0x7efcf002a8b0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.057+0000 7efcff623640 1 -- 172.21.15.69:0/3226102362 shutdown_connections 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.057+0000 7efcff623640 1 --2- 172.21.15.69:0/3226102362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf8101ad0 0x7efcf810dcf0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.057+0000 7efcff623640 1 --2- 172.21.15.69:0/3226102362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8101130 0x7efcf8101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.057+0000 7efcff623640 1 --2- 172.21.15.69:0/3226102362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8105ea0 0x7efcf8106280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.057+0000 7efcff623640 1 -- 172.21.15.69:0/3226102362 >> 172.21.15.69:0/3226102362 conn(0x7efcf8077e30 msgr2=0x7efcf8078240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.057+0000 7efcff623640 1 -- 172.21.15.69:0/3226102362 shutdown_connections 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.057+0000 7efcff623640 1 -- 172.21.15.69:0/3226102362 wait complete. 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcff623640 1 Processor -- start 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcff623640 1 -- start start 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcff623640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8101130 0x7efcf81997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcff623640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf8101ad0 0x7efcf8199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcff623640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8105ea0 0x7efcf81a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcff623640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7efcf81113e0 con 0x7efcf8101ad0 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcff623640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8111260 con 0x7efcf8101130 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcff623640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8111560 con 0x7efcf8105ea0 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcfcbbe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf8101ad0 0x7efcf8199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcfcbbe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf8101ad0 0x7efcf8199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48978/0 (socket says 172.21.15.69:48978) 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcfcbbe640 1 -- 172.21.15.69:0/3475502662 learned_addr learned my addr 172.21.15.69:0/3475502662 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcfdbc0640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8105ea0 0x7efcf81a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcfd3bf640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8101130 0x7efcf81997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcfcbbe640 1 -- 172.21.15.69:0/3475502662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8105ea0 msgr2=0x7efcf81a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcfcbbe640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8105ea0 0x7efcf81a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcfcbbe640 1 -- 172.21.15.69:0/3475502662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8101130 msgr2=0x7efcf81997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcfcbbe640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8101130 0x7efcf81997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcfcbbe640 1 -- 172.21.15.69:0/3475502662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf81a4d80 con 0x7efcf8101ad0 2024-04-23T10:27:00.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcfcbbe640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf8101ad0 0x7efcf8199d00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7efcec00b4a0 tx=0x7efcec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:00.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.058+0000 7efcea7fc640 1 -- 172.21.15.69:0/3475502662 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec014070 con 0x7efcf8101ad0 2024-04-23T10:27:00.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.059+0000 7efcea7fc640 1 -- 172.21.15.69:0/3475502662 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efcec010ae0 con 0x7efcf8101ad0 2024-04-23T10:27:00.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.059+0000 7efcff623640 1 -- 172.21.15.69:0/3475502662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf81a4fb0 con 0x7efcf8101ad0 2024-04-23T10:27:00.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.059+0000 7efcea7fc640 1 -- 172.21.15.69:0/3475502662 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec017ce0 con 0x7efcf8101ad0 2024-04-23T10:27:00.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.059+0000 7efcff623640 1 -- 172.21.15.69:0/3475502662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf81a5420 con 0x7efcf8101ad0 2024-04-23T10:27:00.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.059+0000 7efcff623640 1 -- 172.21.15.69:0/3475502662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf80691c0 con 0x7efcf8101ad0 2024-04-23T10:27:00.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.061+0000 7efcea7fc640 1 -- 172.21.15.69:0/3475502662 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7efcec017070 con 0x7efcf8101ad0 2024-04-23T10:27:00.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.061+0000 7efcea7fc640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efce40a3db0 0x7efce40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.061+0000 7efcfd3bf640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efce40a3db0 0x7efce40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.061+0000 7efcea7fc640 1 -- 172.21.15.69:0/3475502662 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7efcec0d00a0 con 0x7efcf8101ad0 2024-04-23T10:27:00.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.062+0000 7efcfd3bf640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efce40a3db0 0x7efce40a6270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efcf40058c0 tx=0x7efcf400a4c0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:00.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.065+0000 7efcea7fc640 1 -- 172.21.15.69:0/3475502662 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efcec09c710 con 0x7efcf8101ad0 2024-04-23T10:27:00.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:59 smithi069 ceph-mon[29593]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:27:00.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:59 smithi069 ceph-mon[29593]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:27:00.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:59 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/555757541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:00.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:26:59 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3198748343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:27:00.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.245+0000 7efcff623640 1 -- 172.21.15.69:0/3475502662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efcf81093b0 con 0x7efcf8101ad0 2024-04-23T10:27:00.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.245+0000 7efcea7fc640 1 -- 172.21.15.69:0/3475502662 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7efcec09c010 con 0x7efcf8101ad0 2024-04-23T10:27:00.244 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:27:00.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 -- 172.21.15.69:0/3475502662 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efce40a3db0 msgr2=0x7efce40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efce40a3db0 0x7efce40a6270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efcf40058c0 tx=0x7efcf400a4c0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 -- 172.21.15.69:0/3475502662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf8101ad0 msgr2=0x7efcf8199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf8101ad0 0x7efcf8199d00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7efcec00b4a0 tx=0x7efcec00b960 comp rx=0 tx=0).stop 2024-04-23T10:27:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 -- 172.21.15.69:0/3475502662 shutdown_connections 2024-04-23T10:27:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efce40a3db0 0x7efce40a6270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf8101ad0 0x7efcf8199d00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8105ea0 0x7efcf81a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 --2- 172.21.15.69:0/3475502662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8101130 0x7efcf81997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 -- 172.21.15.69:0/3475502662 >> 172.21.15.69:0/3475502662 conn(0x7efcf8077e30 msgr2=0x7efcf80fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 -- 172.21.15.69:0/3475502662 shutdown_connections 2024-04-23T10:27:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.247+0000 7efcff623640 1 -- 172.21.15.69:0/3475502662 wait complete. 2024-04-23T10:27:00.257 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:27:00.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:59 smithi167 ceph-mon[32940]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:27:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:59 smithi167 ceph-mon[32940]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:27:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:59 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/555757541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:26:59 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3198748343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:27:00.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.364+0000 7efd1ca6b640 1 -- 172.21.15.69:0/1272502705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd18101a30 msgr2=0x7efd18105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.364+0000 7efd1ca6b640 1 --2- 172.21.15.69:0/1272502705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd18101a30 0x7efd18105a70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009900 tx=0x7efd0c02a410 comp rx=0 tx=0).stop 2024-04-23T10:27:00.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.364+0000 7efd1ca6b640 1 -- 172.21.15.69:0/1272502705 shutdown_connections 2024-04-23T10:27:00.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.364+0000 7efd1ca6b640 1 --2- 172.21.15.69:0/1272502705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd18101a30 0x7efd18105a70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.364+0000 7efd1ca6b640 1 --2- 172.21.15.69:0/1272502705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd18106150 0x7efd1810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.364+0000 7efd1ca6b640 1 --2- 172.21.15.69:0/1272502705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd18101080 0x7efd18101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.364+0000 7efd1ca6b640 1 -- 172.21.15.69:0/1272502705 >> 172.21.15.69:0/1272502705 conn(0x7efd18078000 msgr2=0x7efd18078410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:00.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.364+0000 7efd1ca6b640 1 -- 172.21.15.69:0/1272502705 shutdown_connections 2024-04-23T10:27:00.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.364+0000 7efd1ca6b640 1 -- 172.21.15.69:0/1272502705 wait complete. 2024-04-23T10:27:00.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.365+0000 7efd1ca6b640 1 Processor -- start 2024-04-23T10:27:00.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.365+0000 7efd1ca6b640 1 -- start start 2024-04-23T10:27:00.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.365+0000 7efd1ca6b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd18101080 0x7efd1819e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.365+0000 7efd1ca6b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd18106150 0x7efd1819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.365+0000 7efd1ca6b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd181985d0 0x7efd18198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.365+0000 7efd1ca6b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7efd181122b0 con 0x7efd18106150 2024-04-23T10:27:00.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.365+0000 7efd1ca6b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efd18112130 con 0x7efd181985d0 2024-04-23T10:27:00.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.365+0000 7efd1ca6b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efd18112430 con 0x7efd18101080 2024-04-23T10:27:00.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.365+0000 7efd15d9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd18106150 0x7efd1819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.365+0000 7efd15d9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd18106150 0x7efd1819e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48992/0 (socket says 172.21.15.69:48992) 2024-04-23T10:27:00.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.365+0000 7efd15d9b640 1 -- 172.21.15.69:0/2349170535 learned_addr learned my addr 172.21.15.69:0/2349170535 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:00.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd1659c640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd18101080 0x7efd1819e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd16d9d640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd181985d0 0x7efd18198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd15d9b640 1 -- 172.21.15.69:0/2349170535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd18101080 msgr2=0x7efd1819e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd15d9b640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd18101080 0x7efd1819e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd15d9b640 1 -- 172.21.15.69:0/2349170535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd181985d0 msgr2=0x7efd18198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd15d9b640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd181985d0 0x7efd18198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd15d9b640 1 -- 172.21.15.69:0/2349170535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd181990f0 con 0x7efd18106150 2024-04-23T10:27:00.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd16d9d640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd181985d0 0x7efd18198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:00.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd15d9b640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd18106150 0x7efd1819e960 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efd0c005940 tx=0x7efd0c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:00.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd077fe640 1 -- 172.21.15.69:0/2349170535 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c03f030 con 0x7efd18106150 2024-04-23T10:27:00.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd077fe640 1 -- 172.21.15.69:0/2349170535 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efd0c0318f0 con 0x7efd18106150 2024-04-23T10:27:00.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd1ca6b640 1 -- 172.21.15.69:0/2349170535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd18199380 con 0x7efd18106150 2024-04-23T10:27:00.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd077fe640 1 -- 172.21.15.69:0/2349170535 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c035070 con 0x7efd18106150 2024-04-23T10:27:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.366+0000 7efd1ca6b640 1 -- 172.21.15.69:0/2349170535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd181a5570 con 0x7efd18106150 2024-04-23T10:27:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.368+0000 7efd1ca6b640 1 -- 172.21.15.69:0/2349170535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd18068d70 con 0x7efd18106150 2024-04-23T10:27:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.368+0000 7efd077fe640 1 -- 172.21.15.69:0/2349170535 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7efd0c042030 con 0x7efd18106150 2024-04-23T10:27:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.369+0000 7efd077fe640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efd000a3db0 0x7efd000a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.369+0000 7efd1659c640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efd000a3db0 0x7efd000a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.369+0000 7efd077fe640 1 -- 172.21.15.69:0/2349170535 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7efd0c0f0d90 con 0x7efd18106150 2024-04-23T10:27:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.369+0000 7efd1659c640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efd000a3db0 0x7efd000a6270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd08005d00 tx=0x7efd0800b410 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.373+0000 7efd077fe640 1 -- 172.21.15.69:0/2349170535 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efd0c0bd2f0 con 0x7efd18106150 2024-04-23T10:27:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:59 smithi146 ceph-mon[32800]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:27:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:59 smithi146 ceph-mon[32800]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:27:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:59 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/555757541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:26:59 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3198748343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:27:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.606+0000 7efd1ca6b640 1 -- 172.21.15.69:0/2349170535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efd181093e0 con 0x7efd18106150 2024-04-23T10:27:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.606+0000 7efd077fe640 1 -- 172.21.15.69:0/2349170535 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7efd0c0bcbf0 con 0x7efd18106150 2024-04-23T10:27:00.605 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-04-23T10:27:00.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 -- 172.21.15.69:0/2349170535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efd000a3db0 msgr2=0x7efd000a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efd000a3db0 0x7efd000a6270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd08005d00 tx=0x7efd0800b410 comp rx=0 tx=0).stop 2024-04-23T10:27:00.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 -- 172.21.15.69:0/2349170535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd18106150 msgr2=0x7efd1819e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd18106150 0x7efd1819e960 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efd0c005940 tx=0x7efd0c0042f0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 -- 172.21.15.69:0/2349170535 shutdown_connections 2024-04-23T10:27:00.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efd000a3db0 0x7efd000a6270 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd18106150 0x7efd1819e960 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd181985d0 0x7efd18198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 --2- 172.21.15.69:0/2349170535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd18101080 0x7efd1819e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 -- 172.21.15.69:0/2349170535 >> 172.21.15.69:0/2349170535 conn(0x7efd18078000 msgr2=0x7efd180feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 -- 172.21.15.69:0/2349170535 shutdown_connections 2024-04-23T10:27:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.608+0000 7efd1ca6b640 1 -- 172.21.15.69:0/2349170535 wait complete. 2024-04-23T10:27:00.619 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:27:00.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.726+0000 7ff96348a640 1 -- 172.21.15.69:0/4015619084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff95c100af0 msgr2=0x7ff95c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.726+0000 7ff96348a640 1 --2- 172.21.15.69:0/4015619084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff95c100af0 0x7ff95c100ed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff958009900 tx=0x7ff95802a410 comp rx=0 tx=0).stop 2024-04-23T10:27:00.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.726+0000 7ff96348a640 1 -- 172.21.15.69:0/4015619084 shutdown_connections 2024-04-23T10:27:00.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.726+0000 7ff96348a640 1 --2- 172.21.15.69:0/4015619084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff95c1072b0 0x7ff95c10eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.726+0000 7ff96348a640 1 --2- 172.21.15.69:0/4015619084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c1014a0 0x7ff95c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.726+0000 7ff96348a640 1 --2- 172.21.15.69:0/4015619084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff95c100af0 0x7ff95c100ed0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.726+0000 7ff96348a640 1 -- 172.21.15.69:0/4015619084 >> 172.21.15.69:0/4015619084 conn(0x7ff95c0760e0 msgr2=0x7ff95c0764f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.726+0000 7ff96348a640 1 -- 172.21.15.69:0/4015619084 shutdown_connections 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.726+0000 7ff96348a640 1 -- 172.21.15.69:0/4015619084 wait complete. 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.726+0000 7ff96348a640 1 Processor -- start 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.726+0000 7ff96348a640 1 -- start start 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff96348a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff95c100af0 0x7ff95c19e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff96348a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff95c1072b0 0x7ff95c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff96348a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c198790 0x7ff95c198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff96348a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c112390 con 0x7ff95c1072b0 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff96348a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c112210 con 0x7ff95c100af0 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff96348a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c112510 con 0x7ff95c198790 2024-04-23T10:27:00.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff960a25640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff95c1072b0 0x7ff95c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff960a25640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff95c1072b0 0x7ff95c19eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49012/0 (socket says 172.21.15.69:49012) 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff960a25640 1 -- 172.21.15.69:0/2475822810 learned_addr learned my addr 172.21.15.69:0/2475822810 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff961226640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff95c100af0 0x7ff95c19e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff961a27640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c198790 0x7ff95c198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff960a25640 1 -- 172.21.15.69:0/2475822810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c198790 msgr2=0x7ff95c198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff960a25640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c198790 0x7ff95c198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff960a25640 1 -- 172.21.15.69:0/2475822810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff95c100af0 msgr2=0x7ff95c19e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff960a25640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff95c100af0 0x7ff95c19e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff960a25640 1 -- 172.21.15.69:0/2475822810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95c199320 con 0x7ff95c1072b0 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff961226640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff95c100af0 0x7ff95c19e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff961a27640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c198790 0x7ff95c198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff960a25640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff95c1072b0 0x7ff95c19eb60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00e9f0 tx=0x7ff94c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff9527fc640 1 -- 172.21.15.69:0/2475822810 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00ccc0 con 0x7ff95c1072b0 2024-04-23T10:27:00.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff96348a640 1 -- 172.21.15.69:0/2475822810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff95c199610 con 0x7ff95c1072b0 2024-04-23T10:27:00.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff9527fc640 1 -- 172.21.15.69:0/2475822810 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff94c0054f0 con 0x7ff95c1072b0 2024-04-23T10:27:00.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff9527fc640 1 -- 172.21.15.69:0/2475822810 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c010690 con 0x7ff95c1072b0 2024-04-23T10:27:00.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.727+0000 7ff96348a640 1 -- 172.21.15.69:0/2475822810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff95c1a57f0 con 0x7ff95c1072b0 2024-04-23T10:27:00.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.728+0000 7ff96348a640 1 -- 172.21.15.69:0/2475822810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff95c06a030 con 0x7ff95c1072b0 2024-04-23T10:27:00.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.730+0000 7ff9527fc640 1 -- 172.21.15.69:0/2475822810 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7ff94c0046c0 con 0x7ff95c1072b0 2024-04-23T10:27:00.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.730+0000 7ff9527fc640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff9480a3db0 0x7ff9480a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:00.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.730+0000 7ff961226640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff9480a3db0 0x7ff9480a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:00.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.730+0000 7ff9527fc640 1 -- 172.21.15.69:0/2475822810 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7ff94c0d10c0 con 0x7ff95c1072b0 2024-04-23T10:27:00.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.731+0000 7ff961226640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff9480a3db0 0x7ff9480a6270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff958005ab0 tx=0x7ff958005a20 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:00.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.734+0000 7ff9527fc640 1 -- 172.21.15.69:0/2475822810 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff94c053ff0 con 0x7ff95c1072b0 2024-04-23T10:27:00.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.935+0000 7ff96348a640 1 -- 172.21.15.69:0/2475822810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff95c10a4b0 con 0x7ff95c1072b0 2024-04-23T10:27:00.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.936+0000 7ff9527fc640 1 -- 172.21.15.69:0/2475822810 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7ff95c199610 con 0x7ff95c1072b0 2024-04-23T10:27:00.935 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-04-23T10:27:00.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 -- 172.21.15.69:0/2475822810 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff9480a3db0 msgr2=0x7ff9480a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff9480a3db0 0x7ff9480a6270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff958005ab0 tx=0x7ff958005a20 comp rx=0 tx=0).stop 2024-04-23T10:27:00.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 -- 172.21.15.69:0/2475822810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff95c1072b0 msgr2=0x7ff95c19eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:00.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff95c1072b0 0x7ff95c19eb60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00e9f0 tx=0x7ff94c00eeb0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 -- 172.21.15.69:0/2475822810 shutdown_connections 2024-04-23T10:27:00.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff9480a3db0 0x7ff9480a6270 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff95c1072b0 0x7ff95c19eb60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff95c198790 0x7ff95c198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 --2- 172.21.15.69:0/2475822810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff95c100af0 0x7ff95c19e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:00.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 -- 172.21.15.69:0/2475822810 >> 172.21.15.69:0/2475822810 conn(0x7ff95c0760e0 msgr2=0x7ff95c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:00.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 -- 172.21.15.69:0/2475822810 shutdown_connections 2024-04-23T10:27:00.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:00.938+0000 7ff96348a640 1 -- 172.21.15.69:0/2475822810 wait complete. 2024-04-23T10:27:00.947 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:27:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:27:00.787+0000 7f4a32cf8700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:27:00.947 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:27:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:27:00.787+0000 7f4a32cf8700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:27:00.947 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:27:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:27:00.787+0000 7f4a32cf8700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:27:00.947 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:27:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:27:00.787+0000 7f4a32cf8700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:27:00.947 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:27:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:27:00.787+0000 7f4a32cf8700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-23T10:27:00.949 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:27:01.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.050+0000 7f2d63aef640 1 -- 172.21.15.69:0/2651687343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d5c101a50 msgr2=0x7f2d5c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.050+0000 7f2d63aef640 1 --2- 172.21.15.69:0/2651687343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d5c101a50 0x7f2d5c105a90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009900 tx=0x7f2d4c02a410 comp rx=0 tx=0).stop 2024-04-23T10:27:01.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.050+0000 7f2d63aef640 1 -- 172.21.15.69:0/2651687343 shutdown_connections 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.050+0000 7f2d63aef640 1 --2- 172.21.15.69:0/2651687343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d5c101a50 0x7f2d5c105a90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.050+0000 7f2d63aef640 1 --2- 172.21.15.69:0/2651687343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d5c106170 0x7f2d5c10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.050+0000 7f2d63aef640 1 --2- 172.21.15.69:0/2651687343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5c1010a0 0x7f2d5c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.050+0000 7f2d63aef640 1 -- 172.21.15.69:0/2651687343 >> 172.21.15.69:0/2651687343 conn(0x7f2d5c077f50 msgr2=0x7f2d5c078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d63aef640 1 -- 172.21.15.69:0/2651687343 shutdown_connections 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d63aef640 1 -- 172.21.15.69:0/2651687343 wait complete. 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d63aef640 1 Processor -- start 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d63aef640 1 -- start start 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d63aef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d5c1010a0 0x7f2d5c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d63aef640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d5c106170 0x7f2d5c10ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d63aef640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5c10f150 0x7f2d5c1a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d63aef640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c112310 con 0x7f2d5c106170 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d63aef640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c112190 con 0x7f2d5c10f150 2024-04-23T10:27:01.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d63aef640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c112490 con 0x7f2d5c1010a0 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d6108a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d5c106170 0x7f2d5c10ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d6108a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d5c106170 0x7f2d5c10ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49042/0 (socket says 172.21.15.69:49042) 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.051+0000 7f2d6108a640 1 -- 172.21.15.69:0/3463082576 learned_addr learned my addr 172.21.15.69:0/3463082576 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d6188b640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d5c1010a0 0x7f2d5c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d6208c640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5c10f150 0x7f2d5c1a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d6108a640 1 -- 172.21.15.69:0/3463082576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d5c1010a0 msgr2=0x7f2d5c10e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d6108a640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d5c1010a0 0x7f2d5c10e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d6108a640 1 -- 172.21.15.69:0/3463082576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5c10f150 msgr2=0x7f2d5c1a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d6108a640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5c10f150 0x7f2d5c1a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d6108a640 1 -- 172.21.15.69:0/3463082576 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c1a7080 con 0x7f2d5c106170 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d6208c640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5c10f150 0x7f2d5c1a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d6108a640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d5c106170 0x7f2d5c10ec10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c005940 tx=0x7f2d4c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d52ffd640 1 -- 172.21.15.69:0/3463082576 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c03f030 con 0x7f2d5c106170 2024-04-23T10:27:01.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d52ffd640 1 -- 172.21.15.69:0/3463082576 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2d4c0318f0 con 0x7f2d5c106170 2024-04-23T10:27:01.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d63aef640 1 -- 172.21.15.69:0/3463082576 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5c1a7310 con 0x7f2d5c106170 2024-04-23T10:27:01.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d52ffd640 1 -- 172.21.15.69:0/3463082576 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c035070 con 0x7f2d5c106170 2024-04-23T10:27:01.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.052+0000 7f2d63aef640 1 -- 172.21.15.69:0/3463082576 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d5c1a7800 con 0x7f2d5c106170 2024-04-23T10:27:01.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.053+0000 7f2d63aef640 1 -- 172.21.15.69:0/3463082576 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d5c068d70 con 0x7f2d5c106170 2024-04-23T10:27:01.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.054+0000 7f2d52ffd640 1 -- 172.21.15.69:0/3463082576 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f2d4c042030 con 0x7f2d5c106170 2024-04-23T10:27:01.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.055+0000 7f2d52ffd640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2d480a3de0 0x7f2d480a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.055+0000 7f2d6188b640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2d480a3de0 0x7f2d480a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.055+0000 7f2d52ffd640 1 -- 172.21.15.69:0/3463082576 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f2d4c0f0ac0 con 0x7f2d5c106170 2024-04-23T10:27:01.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.055+0000 7f2d6188b640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2d480a3de0 0x7f2d480a62a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2d54005e10 tx=0x7f2d54005da0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:01.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.059+0000 7f2d52ffd640 1 -- 172.21.15.69:0/3463082576 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2d4c0bd020 con 0x7f2d5c106170 2024-04-23T10:27:01.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:00 smithi069 ceph-mon[29593]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:27:01.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:00 smithi069 ceph-mon[29593]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 90 KiB/s wr, 67 op/s 2024-04-23T10:27:01.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:00 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3475502662' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:27:01.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:00 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2349170535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:27:01.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:00 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2475822810' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:27:01.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.281+0000 7f2d63aef640 1 -- 172.21.15.69:0/3463082576 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d5c1093a0 con 0x7f2d5c106170 2024-04-23T10:27:01.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.282+0000 7f2d52ffd640 1 -- 172.21.15.69:0/3463082576 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11930 (secure 0 0 0) 0x7f2d4c0bc920 con 0x7f2d5c106170 2024-04-23T10:27:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:27:01.281 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:26:51.903461+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24392,24416,24487,24463,24421]},"id":1}]} 2024-04-23T10:27:01.281 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 26 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 -- 172.21.15.69:0/3463082576 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2d480a3de0 msgr2=0x7f2d480a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2d480a3de0 0x7f2d480a62a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2d54005e10 tx=0x7f2d54005da0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 -- 172.21.15.69:0/3463082576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d5c106170 msgr2=0x7f2d5c10ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d5c106170 0x7f2d5c10ec10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c005940 tx=0x7f2d4c0042f0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 -- 172.21.15.69:0/3463082576 shutdown_connections 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2d480a3de0 0x7f2d480a62a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d5c106170 0x7f2d5c10ec10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5c10f150 0x7f2d5c1a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 --2- 172.21.15.69:0/3463082576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d5c1010a0 0x7f2d5c10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 -- 172.21.15.69:0/3463082576 >> 172.21.15.69:0/3463082576 conn(0x7f2d5c077f50 msgr2=0x7f2d5c0fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 -- 172.21.15.69:0/3463082576 shutdown_connections 2024-04-23T10:27:01.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.285+0000 7f2d63aef640 1 -- 172.21.15.69:0/3463082576 wait complete. 2024-04-23T10:27:01.295 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:27:01.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:00 smithi167 ceph-mon[32940]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:27:01.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:00 smithi167 ceph-mon[32940]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 90 KiB/s wr, 67 op/s 2024-04-23T10:27:01.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:00 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3475502662' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:27:01.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:00 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2349170535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:27:01.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:00 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2475822810' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:27:01.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.395+0000 7faa11cc2640 1 -- 172.21.15.69:0/4247719373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa0c101a50 msgr2=0x7faa0c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.395+0000 7faa11cc2640 1 --2- 172.21.15.69:0/4247719373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa0c101a50 0x7faa0c105a90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faa00009900 tx=0x7faa0002a410 comp rx=0 tx=0).stop 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.395+0000 7faa11cc2640 1 -- 172.21.15.69:0/4247719373 shutdown_connections 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.395+0000 7faa11cc2640 1 --2- 172.21.15.69:0/4247719373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa0c101a50 0x7faa0c105a90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.395+0000 7faa11cc2640 1 --2- 172.21.15.69:0/4247719373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa0c106170 0x7faa0c10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.395+0000 7faa11cc2640 1 --2- 172.21.15.69:0/4247719373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa0c1010a0 0x7faa0c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.395+0000 7faa11cc2640 1 -- 172.21.15.69:0/4247719373 >> 172.21.15.69:0/4247719373 conn(0x7faa0c077f50 msgr2=0x7faa0c078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.395+0000 7faa11cc2640 1 -- 172.21.15.69:0/4247719373 shutdown_connections 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.395+0000 7faa11cc2640 1 -- 172.21.15.69:0/4247719373 wait complete. 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.395+0000 7faa11cc2640 1 Processor -- start 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa11cc2640 1 -- start start 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa11cc2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa0c1010a0 0x7faa0c1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa11cc2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa0c106170 0x7faa0c199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa11cc2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa0c19a150 0x7faa0c1a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa11cc2640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c1111f0 con 0x7faa0c19a150 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa11cc2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c111070 con 0x7faa0c1010a0 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa11cc2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c111370 con 0x7faa0c106170 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa0c19a150 0x7faa0c1a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa0c19a150 0x7faa0c1a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49058/0 (socket says 172.21.15.69:49058) 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0bfff640 1 -- 172.21.15.69:0/778432030 learned_addr learned my addr 172.21.15.69:0/778432030 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0b7fe640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa0c1010a0 0x7faa0c1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0affd640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa0c106170 0x7faa0c199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0bfff640 1 -- 172.21.15.69:0/778432030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa0c106170 msgr2=0x7faa0c199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0bfff640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa0c106170 0x7faa0c199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0bfff640 1 -- 172.21.15.69:0/778432030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa0c1010a0 msgr2=0x7faa0c1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0bfff640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa0c1010a0 0x7faa0c1996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0bfff640 1 -- 172.21.15.69:0/778432030 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c1a4ed0 con 0x7faa0c19a150 2024-04-23T10:27:01.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0affd640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa0c106170 0x7faa0c199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:01.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.396+0000 7faa0bfff640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa0c19a150 0x7faa0c1a4750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faa0400eaa0 tx=0x7faa0400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:01.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.397+0000 7faa08ff9640 1 -- 172.21.15.69:0/778432030 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0400cdb0 con 0x7faa0c19a150 2024-04-23T10:27:01.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.397+0000 7faa11cc2640 1 -- 172.21.15.69:0/778432030 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c1a51c0 con 0x7faa0c19a150 2024-04-23T10:27:01.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.397+0000 7faa08ff9640 1 -- 172.21.15.69:0/778432030 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa04005020 con 0x7faa0c19a150 2024-04-23T10:27:01.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.397+0000 7faa08ff9640 1 -- 172.21.15.69:0/778432030 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa040116b0 con 0x7faa0c19a150 2024-04-23T10:27:01.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.397+0000 7faa11cc2640 1 -- 172.21.15.69:0/778432030 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c1a5760 con 0x7faa0c19a150 2024-04-23T10:27:01.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.398+0000 7faa11cc2640 1 -- 172.21.15.69:0/778432030 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c068d70 con 0x7faa0c19a150 2024-04-23T10:27:01.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.399+0000 7faa08ff9640 1 -- 172.21.15.69:0/778432030 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7faa040051d0 con 0x7faa0c19a150 2024-04-23T10:27:01.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.399+0000 7faa08ff9640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fa9f40a3db0 0x7fa9f40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.399+0000 7faa08ff9640 1 -- 172.21.15.69:0/778432030 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7faa040d0bb0 con 0x7faa0c19a150 2024-04-23T10:27:01.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.399+0000 7faa0b7fe640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fa9f40a3db0 0x7fa9f40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.400+0000 7faa0b7fe640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fa9f40a3db0 0x7fa9f40a6270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc005fd0 tx=0x7fa9fc005850 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:01.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.404+0000 7faa08ff9640 1 -- 172.21.15.69:0/778432030 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faa04016030 con 0x7faa0c19a150 2024-04-23T10:27:01.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:00 smithi146 ceph-mon[32800]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-23T10:27:01.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:00 smithi146 ceph-mon[32800]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 90 KiB/s wr, 67 op/s 2024-04-23T10:27:01.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:00 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3475502662' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:27:01.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:00 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2349170535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:27:01.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:00 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2475822810' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:27:01.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.604+0000 7faa11cc2640 1 -- 172.21.15.69:0/778432030 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa0c109400 con 0x7faa0c19a150 2024-04-23T10:27:01.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.606+0000 7faa08ff9640 1 -- 172.21.15.69:0/778432030 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22971 (secure 0 0 0) 0x7faa0409d110 con 0x7faa0c19a150 2024-04-23T10:27:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:27:01.605 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":89,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:26:53.261556+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/2621408239":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1024244898":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1462548780":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6800/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3272003821":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:27:01.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 -- 172.21.15.69:0/778432030 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fa9f40a3db0 msgr2=0x7fa9f40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fa9f40a3db0 0x7fa9f40a6270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc005fd0 tx=0x7fa9fc005850 comp rx=0 tx=0).stop 2024-04-23T10:27:01.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 -- 172.21.15.69:0/778432030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa0c19a150 msgr2=0x7faa0c1a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa0c19a150 0x7faa0c1a4750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faa0400eaa0 tx=0x7faa0400ef60 comp rx=0 tx=0).stop 2024-04-23T10:27:01.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 -- 172.21.15.69:0/778432030 shutdown_connections 2024-04-23T10:27:01.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fa9f40a3db0 0x7fa9f40a6270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa0c19a150 0x7faa0c1a4750 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa0c106170 0x7faa0c199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 --2- 172.21.15.69:0/778432030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa0c1010a0 0x7faa0c1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 -- 172.21.15.69:0/778432030 >> 172.21.15.69:0/778432030 conn(0x7faa0c077f50 msgr2=0x7faa0c0feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:01.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 -- 172.21.15.69:0/778432030 shutdown_connections 2024-04-23T10:27:01.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.608+0000 7faa11cc2640 1 -- 172.21.15.69:0/778432030 wait complete. 2024-04-23T10:27:01.619 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with random seed 105024 2024-04-23T10:27:01.619 DEBUG:tasks.quiescer:Yielding 2024-04-23T10:27:01.619 INFO:teuthology.run_tasks:Running task workunit... 2024-04-23T10:27:01.632 INFO:tasks.workunit:Pulling workunits from ref 0a6c3ed699031b80a2b419e7e795368719871394 2024-04-23T10:27:01.633 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-23T10:27:01.633 INFO:tasks.workunit:timeout=3h 2024-04-23T10:27:01.633 INFO:tasks.workunit:cleanup=True 2024-04-23T10:27:01.633 DEBUG:teuthology.orchestra.run.smithi069:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-23T10:27:01.634 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:27:01.648 INFO:teuthology.orchestra.run.smithi069.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-23T10:27:01.649 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-23T10:27:01.649 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 73h/115d Inode: 1099511628283 Links: 2 2024-04-23T10:27:01.649 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:27:01.649 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-23T10:27:01.649 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-04-23 10:24:59.374701128 +0000 2024-04-23T10:27:01.649 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-04-23 10:24:59.374701128 +0000 2024-04-23T10:27:01.649 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-04-23 10:26:51.212028117 +0000 2024-04-23T10:27:01.649 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-04-23 10:24:59.374701128 +0000 2024-04-23T10:27:01.649 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-23T10:27:01.649 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-23T10:27:01.725 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0a6c3ed699031b80a2b419e7e795368719871394 2024-04-23T10:27:01.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.734+0000 7f34f0720640 1 -- 172.21.15.69:0/938692396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34e8103b50 msgr2=0x7f34e810c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.734+0000 7f34f0720640 1 --2- 172.21.15.69:0/938692396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34e8103b50 0x7f34e810c030 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009900 tx=0x7f34e402a480 comp rx=0 tx=0).stop 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 -- 172.21.15.69:0/938692396 shutdown_connections 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 --2- 172.21.15.69:0/938692396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34e8103b50 0x7f34e810c030 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 --2- 172.21.15.69:0/938692396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e810c570 0x7f34e810e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 --2- 172.21.15.69:0/938692396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e8103230 0x7f34e8103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 -- 172.21.15.69:0/938692396 >> 172.21.15.69:0/938692396 conn(0x7f34e8077fb0 msgr2=0x7f34e80783c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 -- 172.21.15.69:0/938692396 shutdown_connections 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 -- 172.21.15.69:0/938692396 wait complete. 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 Processor -- start 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 -- start start 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34e8103230 0x7f34e819e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e8103b50 0x7f34e819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e810c570 0x7f34e8198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f34e8112370 con 0x7f34e8103230 2024-04-23T10:27:01.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f34e81121f0 con 0x7f34e810c570 2024-04-23T10:27:01.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34f0720640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f34e81124f0 con 0x7f34e8103b50 2024-04-23T10:27:01.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34ee4bc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34e8103230 0x7f34e819e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34ee4bc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34e8103230 0x7f34e819e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49066/0 (socket says 172.21.15.69:49066) 2024-04-23T10:27:01.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.735+0000 7f34ee4bc640 1 -- 172.21.15.69:0/1119182204 learned_addr learned my addr 172.21.15.69:0/1119182204 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:01.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34eecbd640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e810c570 0x7f34e8198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34ee4bc640 1 -- 172.21.15.69:0/1119182204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e8103b50 msgr2=0x7f34e819e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34edcbb640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e8103b50 0x7f34e819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34ee4bc640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e8103b50 0x7f34e819e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34ee4bc640 1 -- 172.21.15.69:0/1119182204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e810c570 msgr2=0x7f34e8198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34ee4bc640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e810c570 0x7f34e8198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34ee4bc640 1 -- 172.21.15.69:0/1119182204 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e8198df0 con 0x7f34e8103230 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34eecbd640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e810c570 0x7f34e8198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34edcbb640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e8103b50 0x7f34e819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34ee4bc640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34e8103230 0x7f34e819e470 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f34d800c920 tx=0x7f34d800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34df7fe640 1 -- 172.21.15.69:0/1119182204 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8007c70 con 0x7f34e8103230 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34f0720640 1 -- 172.21.15.69:0/1119182204 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e81990e0 con 0x7f34e8103230 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34df7fe640 1 -- 172.21.15.69:0/1119182204 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f34d8007e10 con 0x7f34e8103230 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34df7fe640 1 -- 172.21.15.69:0/1119182204 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d80188c0 con 0x7f34e8103230 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.736+0000 7f34f0720640 1 -- 172.21.15.69:0/1119182204 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e81a5330 con 0x7f34e8103230 2024-04-23T10:27:01.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.737+0000 7f34f0720640 1 -- 172.21.15.69:0/1119182204 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e80691c0 con 0x7f34e8103230 2024-04-23T10:27:01.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.738+0000 7f34df7fe640 1 -- 172.21.15.69:0/1119182204 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f34d8018a60 con 0x7f34e8103230 2024-04-23T10:27:01.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.739+0000 7f34df7fe640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f34d40a3db0 0x7f34d40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:01.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.739+0000 7f34edcbb640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f34d40a3db0 0x7f34d40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:01.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.739+0000 7f34df7fe640 1 -- 172.21.15.69:0/1119182204 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f34d80d0e80 con 0x7f34e8103230 2024-04-23T10:27:01.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.739+0000 7f34edcbb640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f34d40a3db0 0x7f34d40a6270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f34e4000c00 tx=0x7f34e4032d10 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:01.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.743+0000 7f34df7fe640 1 -- 172.21.15.69:0/1119182204 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f34d8014030 con 0x7f34e8103230 2024-04-23T10:27:01.748 INFO:tasks.workunit.client.0.smithi069.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-23T10:27:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.961+0000 7f34f0720640 1 -- 172.21.15.69:0/1119182204 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34e8199b50 con 0x7f34e8103230 2024-04-23T10:27:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.962+0000 7f34df7fe640 1 -- 172.21.15.69:0/1119182204 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11930 (secure 0 0 0) 0x7f34d809d410 con 0x7f34e8103230 2024-04-23T10:27:01.961 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:27:01.961 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:26:51.903461+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24392,24416,24487,24463,24421]},"id":1}]} 2024-04-23T10:27:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 26 2024-04-23T10:27:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 -- 172.21.15.69:0/1119182204 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f34d40a3db0 msgr2=0x7f34d40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f34d40a3db0 0x7f34d40a6270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f34e4000c00 tx=0x7f34e4032d10 comp rx=0 tx=0).stop 2024-04-23T10:27:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 -- 172.21.15.69:0/1119182204 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34e8103230 msgr2=0x7f34e819e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34e8103230 0x7f34e819e470 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f34d800c920 tx=0x7f34d800cde0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 -- 172.21.15.69:0/1119182204 shutdown_connections 2024-04-23T10:27:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f34d40a3db0 0x7f34d40a6270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e810c570 0x7f34e8198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34e8103b50 0x7f34e819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 --2- 172.21.15.69:0/1119182204 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34e8103230 0x7f34e819e470 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 -- 172.21.15.69:0/1119182204 >> 172.21.15.69:0/1119182204 conn(0x7f34e8077fb0 msgr2=0x7f34e80fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 -- 172.21.15.69:0/1119182204 shutdown_connections 2024-04-23T10:27:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:01.964+0000 7f34f0720640 1 -- 172.21.15.69:0/1119182204 wait complete. 2024-04-23T10:27:01.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-23T10:24:52.877417+0000', 'modified': '2024-04-23T10:26:51.903461+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24487, 'mds_1': 24463, 'mds_2': 24421, 'mds_3': 24416, 'mds_4': 24392}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14631': {'gid': 14631, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.69:6839/441538329', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6838', 'nonce': 441538329}, {'type': 'v1', 'addr': '172.21.15.69:6839', 'nonce': 441538329}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14643': {'gid': 14643, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.69:6841/3448889268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6840', 'nonce': 3448889268}, {'type': 'v1', 'addr': '172.21.15.69:6841', 'nonce': 3448889268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24368': {'gid': 24368, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6833/318414865', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 318414865}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 318414865}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'e', 'rank': 4, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.146:6835/3824729166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 3824729166}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3824729166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'h', 'rank': 3, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.146:6837/1505523103', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 1505523103}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 1505523103}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.167:6833/977410598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6832', 'nonce': 977410598}, {'type': 'v1', 'addr': '172.21.15.167:6833', 'nonce': 977410598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'b', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6839/712940861', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6838', 'nonce': 712940861}, {'type': 'v1', 'addr': '172.21.15.146:6839', 'nonce': 712940861}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6835/2993393777', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 2993393777}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 2993393777}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.167:6837/1671189160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 1671189160}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 1671189160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.167:6839/1688975356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 1688975356}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 1688975356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24487, 'qdb_cluster': [24392, 24416, 24487, 24463, 24421]} 2024-04-23T10:27:01.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-23T10:27:01.975 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-23T10:27:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.114+0000 7f7ce1722640 1 -- 172.21.15.69:0/2267669559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cdc105e70 msgr2=0x7f7cdc106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.114+0000 7f7ce1722640 1 --2- 172.21.15.69:0/2267669559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cdc105e70 0x7f7cdc106250 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009900 tx=0x7f7cd002a470 comp rx=0 tx=0).stop 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.114+0000 7f7ce1722640 1 -- 172.21.15.69:0/2267669559 shutdown_connections 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.114+0000 7f7ce1722640 1 --2- 172.21.15.69:0/2267669559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cdc101aa0 0x7f7cdc10dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.114+0000 7f7ce1722640 1 --2- 172.21.15.69:0/2267669559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc1010e0 0x7f7cdc101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.114+0000 7f7ce1722640 1 --2- 172.21.15.69:0/2267669559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cdc105e70 0x7f7cdc106250 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.114+0000 7f7ce1722640 1 -- 172.21.15.69:0/2267669559 >> 172.21.15.69:0/2267669559 conn(0x7f7cdc077cb0 msgr2=0x7f7cdc0780c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.114+0000 7f7ce1722640 1 -- 172.21.15.69:0/2267669559 shutdown_connections 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.114+0000 7f7ce1722640 1 -- 172.21.15.69:0/2267669559 wait complete. 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7ce1722640 1 Processor -- start 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7ce1722640 1 -- start start 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7ce1722640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cdc1010e0 0x7f7cdc19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7ce1722640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc101aa0 0x7f7cdc19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7ce1722640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cdc105e70 0x7f7cdc198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7ce1722640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc112370 con 0x7f7cdc105e70 2024-04-23T10:27:02.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7ce1722640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1121f0 con 0x7f7cdc101aa0 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7ce1722640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1124f0 con 0x7f7cdc1010e0 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7cdb7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cdc105e70 0x7f7cdc198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7cdb7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cdc105e70 0x7f7cdc198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49084/0 (socket says 172.21.15.69:49084) 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7cdb7fe640 1 -- 172.21.15.69:0/438109627 learned_addr learned my addr 172.21.15.69:0/438109627 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.115+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cdc1010e0 0x7f7cdc19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc101aa0 0x7f7cdc19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7cdb7fe640 1 -- 172.21.15.69:0/438109627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cdc1010e0 msgr2=0x7f7cdc19e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7cdb7fe640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cdc1010e0 0x7f7cdc19e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7cdb7fe640 1 -- 172.21.15.69:0/438109627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc101aa0 msgr2=0x7f7cdc19eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7cdb7fe640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc101aa0 0x7f7cdc19eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7cdb7fe640 1 -- 172.21.15.69:0/438109627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc198f30 con 0x7f7cdc105e70 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7cdb7fe640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cdc105e70 0x7f7cdc198670 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009fd0 tx=0x7f7cd400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7cc3fff640 1 -- 172.21.15.69:0/438109627 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4017070 con 0x7f7cdc105e70 2024-04-23T10:27:02.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7cc3fff640 1 -- 172.21.15.69:0/438109627 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7cd4003e40 con 0x7f7cdc105e70 2024-04-23T10:27:02.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7ce1722640 1 -- 172.21.15.69:0/438109627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc199220 con 0x7f7cdc105e70 2024-04-23T10:27:02.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7cc3fff640 1 -- 172.21.15.69:0/438109627 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4004820 con 0x7f7cdc105e70 2024-04-23T10:27:02.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.116+0000 7f7ce1722640 1 -- 172.21.15.69:0/438109627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc1a5530 con 0x7f7cdc105e70 2024-04-23T10:27:02.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.118+0000 7f7cc3fff640 1 -- 172.21.15.69:0/438109627 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f7cd4003970 con 0x7f7cdc105e70 2024-04-23T10:27:02.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7ce4430740 1 Processor -- start 2024-04-23T10:27:02.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7ce4430740 1 -- start start 2024-04-23T10:27:02.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badcdb0 0x561b4badd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4badd760 0x561b4bae7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4bae7dd0 0x561b4baea220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7ce4430740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561b4ba42c50 con 0x561b4badcdb0 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7ce4430740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b4b9df830 con 0x561b4badd760 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7ce4430740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b4ba3ec10 con 0x561b4bae7dd0 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cc3fff640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7cc40a3e40 0x7f7cc40a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cda7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badcdb0 0x561b4badd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cda7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badcdb0 0x561b4badd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49094/0 (socket says 172.21.15.69:49094) 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cda7fc640 1 -- 172.21.15.69:0/1908303862 learned_addr learned my addr 172.21.15.69:0/1908303862 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cdb7fe640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7cc40a3e40 0x7f7cc40a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/1908303862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4badd760 0x561b4bae7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cc3fff640 1 -- 172.21.15.69:0/438109627 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f7cd40d0820 con 0x7f7cdc105e70 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cda7fc640 1 -- 172.21.15.69:0/1908303862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4bae7dd0 msgr2=0x561b4baea220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/1908303862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4bae7dd0 0x561b4baea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cda7fc640 1 -- 172.21.15.69:0/1908303862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4badd760 msgr2=0x561b4bae7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/1908303862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4badd760 0x561b4bae7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cda7fc640 1 -- 172.21.15.69:0/1908303862 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b4b7552d0 con 0x561b4badcdb0 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/1908303862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4badd760 0x561b4bae7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/1908303862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badcdb0 0x561b4badd190 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00bd50 tx=0x7f7ccc0127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8722aa4e4d2d7ab4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.119+0000 7f7cdb7fe640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7cc40a3e40 0x7f7cc40a6300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40cde80 tx=0x7f7cd4087040 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7cc17fa640 1 -- 172.21.15.69:0/1908303862 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0120d0 con 0x561b4badcdb0 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7cc17fa640 1 -- 172.21.15.69:0/1908303862 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7ccc016070 con 0x561b4badcdb0 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7cc17fa640 1 -- 172.21.15.69:0/1908303862 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00f740 con 0x561b4badcdb0 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7ce4430740 1 -- 172.21.15.69:0/1908303862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badcdb0 msgr2=0x561b4badd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1908303862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badcdb0 0x561b4badd190 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00bd50 tx=0x7f7ccc0127c0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7ce4430740 1 -- 172.21.15.69:0/1908303862 shutdown_connections 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1908303862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4bae7dd0 0x561b4baea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1908303862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4badd760 0x561b4bae7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1908303862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badcdb0 0x561b4badd190 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7ce4430740 1 -- 172.21.15.69:0/1908303862 >> 172.21.15.69:0/1908303862 conn(0x561b4bad9070 msgr2=0x561b4bad9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7ce4430740 1 -- 172.21.15.69:0/1908303862 shutdown_connections 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.120+0000 7f7ce4430740 1 -- 172.21.15.69:0/1908303862 wait complete. 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7ce4430740 1 -- start start 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7ce4430740 1 Processor -- start 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bae4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4bae7dd0 0x561b4bae5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7ce4430740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561b4baead40 con 0x561b4badd760 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7ce4430740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b4b9dd470 con 0x561b4bae7dd0 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7ce4430740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b4baeaec0 con 0x561b4badcdb0 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7ce4430740 10 client.0 _ll_register_callbacks cb 0x561b4ba02f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cdaffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cdaffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49102/0 (socket says 172.21.15.69:49102) 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cdaffd640 1 -- 172.21.15.69:0/3511520025 learned_addr learned my addr 172.21.15.69:0/3511520025 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bae4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4bae7dd0 0x561b4bae5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cdaffd640 1 -- 172.21.15.69:0/3511520025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 msgr2=0x561b4bae4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bae4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cdaffd640 1 -- 172.21.15.69:0/3511520025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4bae7dd0 msgr2=0x561b4bae5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4bae7dd0 0x561b4bae5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cdaffd640 1 -- 172.21.15.69:0/3511520025 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b4b81f6b0 con 0x561b4badd760 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4bae7dd0 0x561b4bae5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.121+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae51d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00314e0 tx=0x7f7cd0031540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54f639508ebd5d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7cbeff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7cbeff5640 1 -- 172.21.15.69:0/3511520025 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0035040 con 0x561b4badd760 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7cbeff5640 1 -- 172.21.15.69:0/3511520025 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f7cd0004040 con 0x561b4badd760 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7ce4430740 1 -- 172.21.15.69:0/3511520025 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ccc016070 con 0x561b4badd760 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7cbeff5640 1 -- 172.21.15.69:0/3511520025 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7cd0004240 con 0x561b4badd760 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7ce4430740 10 client.15585 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:02.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7ce4430740 1 -- 172.21.15.69:0/3511520025 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561b4baf6f90 con 0x561b4badd760 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7cbeff5640 1 -- 172.21.15.69:0/3511520025 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7ccc016070 con 0x561b4badd760 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7cbeff5640 1 -- 172.21.15.69:0/3511520025 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7cd0004a70 con 0x561b4badd760 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7ce4430740 10 client.15585 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7ce4430740 10 client.15585 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7ce4430740 20 client.15585 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7ce4430740 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x561b4baf95a0 0x561b4bafaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7ce4430740 4 client.15585 mds_command: new command op to 24392 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.122+0000 7f7ce4430740 1 -- 172.21.15.69:0/3511520025 --> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b4ba50670 con 0x561b4baf95a0 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.123+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x561b4baf95a0 0x561b4bafaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.123+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x561b4baf95a0 0x561b4bafaa10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8d2f8ada23ce0d61 server_cookie=50d8d7b755129b12 in_seq=0 out_seq=0 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.123+0000 7f7cbeff5640 10 client.15585 ms_handle_connect on v2:172.21.15.146:6834/3824729166 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7cbeff5640 1 -- 172.21.15.69:0/3511520025 <== mds.4 v2:172.21.15.146:6834/3824729166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561b4ba50670 con 0x561b4baf95a0 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7cbeff5640 10 client.15585 handle_command_reply: tid=0 2024-04-23T10:27:02.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 1 client.15585 shutdown 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 1 -- 172.21.15.69:0/3511520025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 msgr2=0x561b4bae51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae51d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00314e0 tx=0x7f7cd0031540 comp rx=0 tx=0).stop 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 1 -- 172.21.15.69:0/3511520025 shutdown_connections 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x561b4baf95a0 0x561b4bafaa10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae51d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4bae7dd0 0x561b4bae5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 1 --2- 172.21.15.69:0/3511520025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bae4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7cbeff5640 0 client.15585 ms_handle_reset on v2:172.21.15.146:6834/3824729166 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 1 -- 172.21.15.69:0/3511520025 >> 172.21.15.69:0/3511520025 conn(0x561b4bad9070 msgr2=0x561b4badeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 1 -- 172.21.15.69:0/3511520025 shutdown_connections 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 1 -- 172.21.15.69:0/3511520025 wait complete. 2024-04-23T10:27:02.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.124+0000 7f7ce4430740 20 client.15585 trim_cache size 0 max 16384 2024-04-23T10:27:02.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.142+0000 7f7ce4430740 1 Processor -- start 2024-04-23T10:27:02.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.142+0000 7f7ce4430740 1 -- start start 2024-04-23T10:27:02.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.142+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bae74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.142+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.142+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4bae7dd0 0x561b4badf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.142+0000 7f7ce4430740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561b4baf8d50 con 0x561b4badd760 2024-04-23T10:27:02.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.142+0000 7f7ce4430740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b4baf9420 con 0x561b4bae7dd0 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.142+0000 7f7ce4430740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b4baf9af0 con 0x561b4badcdb0 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.142+0000 7f7cdaffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.142+0000 7f7cdaffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49110/0 (socket says 172.21.15.69:49110) 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.142+0000 7f7cdaffd640 1 -- 172.21.15.69:0/1326329218 learned_addr learned my addr 172.21.15.69:0/1326329218 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.143+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/1326329218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bae74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.143+0000 7f7cdaffd640 1 -- 172.21.15.69:0/1326329218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 msgr2=0x561b4bae74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.143+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/1326329218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bae74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.143+0000 7f7cdaffd640 1 -- 172.21.15.69:0/1326329218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4bae7dd0 msgr2=0x561b4badf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.143+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/1326329218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4bae7dd0 0x561b4badf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.143+0000 7f7cdaffd640 1 -- 172.21.15.69:0/1326329218 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b4baea680 con 0x561b4badd760 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.143+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/1326329218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bae74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.143+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/1326329218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae5530 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0006010 tx=0x7f7cd0004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96020be1e8ae7abe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.143+0000 7f7cc0ff9640 1 -- 172.21.15.69:0/1326329218 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0035030 con 0x561b4badd760 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.143+0000 7f7cc0ff9640 1 -- 172.21.15.69:0/1326329218 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7cd0004c20 con 0x561b4badd760 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.143+0000 7f7cc0ff9640 1 -- 172.21.15.69:0/1326329218 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0003de0 con 0x561b4badd760 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 -- 172.21.15.69:0/1326329218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 msgr2=0x561b4bae5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1326329218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae5530 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0006010 tx=0x7f7cd0004570 comp rx=0 tx=0).stop 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 -- 172.21.15.69:0/1326329218 shutdown_connections 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1326329218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4badd760 0x561b4bae5530 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1326329218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4bae7dd0 0x561b4badf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1326329218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bae74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 -- 172.21.15.69:0/1326329218 >> 172.21.15.69:0/1326329218 conn(0x561b4bad9070 msgr2=0x561b4bad9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 -- 172.21.15.69:0/1326329218 shutdown_connections 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 -- 172.21.15.69:0/1326329218 wait complete. 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 -- start start 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 Processor -- start 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bb02ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4badd760 0x561b4bb03020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4bae7dd0 0x561b4bafc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561b4bafa890 con 0x561b4bae7dd0 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b4bafa1c0 con 0x561b4badd760 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b4bafaf60 con 0x561b4badcdb0 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7ce4430740 10 client.0 _ll_register_callbacks cb 0x7f7cd0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7cda7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4bae7dd0 0x561b4bafc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7cda7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4bae7dd0 0x561b4bafc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49120/0 (socket says 172.21.15.69:49120) 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.144+0000 7f7cda7fc640 1 -- 172.21.15.69:0/1700630789 learned_addr learned my addr 172.21.15.69:0/1700630789 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bb02ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4badd760 0x561b4bb03020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cda7fc640 1 -- 172.21.15.69:0/1700630789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 msgr2=0x561b4bb02ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bb02ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cda7fc640 1 -- 172.21.15.69:0/1700630789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4badd760 msgr2=0x561b4bb03020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4badd760 0x561b4bb03020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cda7fc640 1 -- 172.21.15.69:0/1700630789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b4bafc890 con 0x561b4bae7dd0 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cda7fc640 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4bae7dd0 0x561b4bafc090 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00bd20 tx=0x7f7ccc010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718b028af47ee23 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cbeff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cbeff5640 1 -- 172.21.15.69:0/1700630789 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0052d0 con 0x561b4bae7dd0 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cbeff5640 1 -- 172.21.15.69:0/1700630789 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f7ccc005470 con 0x561b4bae7dd0 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7ce4430740 1 -- 172.21.15.69:0/1700630789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cd0004c20 con 0x561b4bae7dd0 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cbeff5640 1 -- 172.21.15.69:0/1700630789 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7ccc005670 con 0x561b4bae7dd0 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7ce4430740 10 client.15591 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7ce4430740 1 -- 172.21.15.69:0/1700630789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561b4bb00fc0 con 0x561b4bae7dd0 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cbeff5640 1 -- 172.21.15.69:0/1700630789 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7cd0004c20 con 0x561b4bae7dd0 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7cbeff5640 1 -- 172.21.15.69:0/1700630789 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7ccc0039c0 con 0x561b4bae7dd0 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.145+0000 7f7ce4430740 10 client.15591 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.146+0000 7f7ce4430740 10 client.15591 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:27:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.146+0000 7f7ce4430740 20 client.15591 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.146+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x561b4bb63860 0x561b4bb62570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.146+0000 7f7ce4430740 4 client.15591 mds_command: new command op to 24392 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.146+0000 7f7ce4430740 1 -- 172.21.15.69:0/1700630789 --> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] -- command(tid 0: {"prefix": "status"}) -- 0x561b4ba4a4e0 con 0x561b4bb63860 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.146+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x561b4bb63860 0x561b4bb62570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.146+0000 7f7cbeff5640 10 client.15591 ms_handle_connect on v2:172.21.15.146:6834/3824729166 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.146+0000 7f7cdaffd640 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x561b4bb63860 0x561b4bb62570 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a2191f41b645893 server_cookie=8be7403446b58614 in_seq=0 out_seq=0 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.146+0000 7f7cbeff5640 1 -- 172.21.15.69:0/1700630789 <== mds.4 v2:172.21.15.146:6834/3824729166 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561b4ba4a4e0 con 0x561b4bb63860 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7cbeff5640 10 client.15591 handle_command_reply: tid=0 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 1 client.15591 shutdown 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 1 -- 172.21.15.69:0/1700630789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4bae7dd0 msgr2=0x561b4bafc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4bae7dd0 0x561b4bafc090 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00bd20 tx=0x7f7ccc010f30 comp rx=0 tx=0).stop 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 1 -- 172.21.15.69:0/1700630789 shutdown_connections 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.146:6834/3824729166,v1:172.21.15.146:6835/3824729166] conn(0x561b4bb63860 0x561b4bb62570 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561b4bae7dd0 0x561b4bafc090 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b4badd760 0x561b4bb03020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 1 --2- 172.21.15.69:0/1700630789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b4badcdb0 0x561b4bb02ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7cbeff5640 0 client.15591 ms_handle_reset on v2:172.21.15.146:6834/3824729166 2024-04-23T10:27:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 1 -- 172.21.15.69:0/1700630789 >> 172.21.15.69:0/1700630789 conn(0x561b4bad9070 msgr2=0x561b4bae3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 1 -- 172.21.15.69:0/1700630789 shutdown_connections 2024-04-23T10:27:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 1 -- 172.21.15.69:0/1700630789 wait complete. 2024-04-23T10:27:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce4430740 20 client.15591 trim_cache size 0 max 16384 2024-04-23T10:27:02.152 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:27:02.152 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:27:02.152 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 4, 2024-04-23T10:27:02.152 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24392, 2024-04-23T10:27:02.153 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:27:02.153 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:27:02.153 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:27:02.153 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 123.820652393, 2024-04-23T10:27:02.153 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 26, 2024-04-23T10:27:02.153 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 89, 2024-04-23T10:27:02.153 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 88, 2024-04-23T10:27:02.153 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 153.64677674800001 2024-04-23T10:27:02.153 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:27:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce1722640 1 -- 172.21.15.69:0/438109627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7cc40a3e40 msgr2=0x7f7cc40a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce1722640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7cc40a3e40 0x7f7cc40a6300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40cde80 tx=0x7f7cd4087040 comp rx=0 tx=0).stop 2024-04-23T10:27:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce1722640 1 -- 172.21.15.69:0/438109627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cdc105e70 msgr2=0x7f7cdc198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.147+0000 7f7ce1722640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cdc105e70 0x7f7cdc198670 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009fd0 tx=0x7f7cd400b260 comp rx=0 tx=0).stop 2024-04-23T10:27:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.148+0000 7f7ce1722640 1 -- 172.21.15.69:0/438109627 shutdown_connections 2024-04-23T10:27:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.148+0000 7f7ce1722640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7cc40a3e40 0x7f7cc40a6300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.148+0000 7f7ce1722640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cdc105e70 0x7f7cdc198670 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.148+0000 7f7ce1722640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc101aa0 0x7f7cdc19eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.148+0000 7f7ce1722640 1 --2- 172.21.15.69:0/438109627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cdc1010e0 0x7f7cdc19e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.148+0000 7f7ce1722640 1 -- 172.21.15.69:0/438109627 >> 172.21.15.69:0/438109627 conn(0x7f7cdc077cb0 msgr2=0x7f7cdc0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.148+0000 7f7ce1722640 1 -- 172.21.15.69:0/438109627 shutdown_connections 2024-04-23T10:27:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.148+0000 7f7ce1722640 1 -- 172.21.15.69:0/438109627 wait complete. 2024-04-23T10:27:02.157 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-23T10:27:02.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:01 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3463082576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:02.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:01 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/778432030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:27:02.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:01 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1119182204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:02.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.257+0000 7fdba10dc640 1 -- 172.21.15.69:0/4033938999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9c102180 msgr2=0x7fdb9c102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.257+0000 7fdba10dc640 1 --2- 172.21.15.69:0/4033938999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9c102180 0x7fdb9c102560 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009900 tx=0x7fdb9402a410 comp rx=0 tx=0).stop 2024-04-23T10:27:02.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.257+0000 7fdba10dc640 1 -- 172.21.15.69:0/4033938999 shutdown_connections 2024-04-23T10:27:02.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.257+0000 7fdba10dc640 1 --2- 172.21.15.69:0/4033938999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c107250 0x7fdb9c10ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.257+0000 7fdba10dc640 1 --2- 172.21.15.69:0/4033938999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c102b30 0x7fdb9c106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.257+0000 7fdba10dc640 1 --2- 172.21.15.69:0/4033938999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9c102180 0x7fdb9c102560 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.257+0000 7fdba10dc640 1 -- 172.21.15.69:0/4033938999 >> 172.21.15.69:0/4033938999 conn(0x7fdb9c0792d0 msgr2=0x7fdb9c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.257+0000 7fdba10dc640 1 -- 172.21.15.69:0/4033938999 shutdown_connections 2024-04-23T10:27:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.257+0000 7fdba10dc640 1 -- 172.21.15.69:0/4033938999 wait complete. 2024-04-23T10:27:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.257+0000 7fdba10dc640 1 Processor -- start 2024-04-23T10:27:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdba10dc640 1 -- start start 2024-04-23T10:27:02.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdba10dc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c102180 0x7fdb9c19e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdba10dc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c107250 0x7fdb9c19e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdba10dc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9c198670 0x7fdb9c198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdba10dc640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c112350 con 0x7fdb9c198670 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdba10dc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c1121d0 con 0x7fdb9c102180 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdba10dc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c1124d0 con 0x7fdb9c107250 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9b59e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9c198670 0x7fdb9c198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9b59e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9c198670 0x7fdb9c198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49132/0 (socket says 172.21.15.69:49132) 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9b59e640 1 -- 172.21.15.69:0/4219418106 learned_addr learned my addr 172.21.15.69:0/4219418106 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9ad9d640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c102180 0x7fdb9c19e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c107250 0x7fdb9c19e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9b59e640 1 -- 172.21.15.69:0/4219418106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c107250 msgr2=0x7fdb9c19e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9b59e640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c107250 0x7fdb9c19e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9b59e640 1 -- 172.21.15.69:0/4219418106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c102180 msgr2=0x7fdb9c19e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9b59e640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c102180 0x7fdb9c19e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9b59e640 1 -- 172.21.15.69:0/4219418106 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9c199190 con 0x7fdb9c198670 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c107250 0x7fdb9c19e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.258+0000 7fdb9b59e640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9c198670 0x7fdb9c198b20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00c970 tx=0x7fdb8c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.259+0000 7fdb83fff640 1 -- 172.21.15.69:0/4219418106 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c007bb0 con 0x7fdb9c198670 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.259+0000 7fdb83fff640 1 -- 172.21.15.69:0/4219418106 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdb8c007d50 con 0x7fdb9c198670 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.259+0000 7fdba10dc640 1 -- 172.21.15.69:0/4219418106 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9c199480 con 0x7fdb9c198670 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.259+0000 7fdb83fff640 1 -- 172.21.15.69:0/4219418106 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0187c0 con 0x7fdb9c198670 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.259+0000 7fdba10dc640 1 -- 172.21.15.69:0/4219418106 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb9c1a5630 con 0x7fdb9c198670 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdb83fff640 1 -- 172.21.15.69:0/4219418106 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fdb8c00fa40 con 0x7fdb9c198670 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdba3df1740 1 Processor -- start 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdba3df1740 1 -- start start 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab333db0 0x559bab334190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab334760 0x559bab33e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab33edd0 0x559bab341220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdba3df1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x559bab299c50 con 0x559bab334760 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdba3df1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559bab236830 con 0x559bab333db0 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdba3df1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559bab295c10 con 0x559bab33edd0 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdb9ad9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab334760 0x559bab33e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdb83fff640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fdb840a3e40 0x7fdb840a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdb9ad9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab334760 0x559bab33e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49148/0 (socket says 172.21.15.69:49148) 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdb9ad9d640 1 -- 172.21.15.69:0/1468882449 learned_addr learned my addr 172.21.15.69:0/1468882449 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/1468882449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab33edd0 0x559bab341220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdb9b59e640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fdb840a3e40 0x7fdb840a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.261+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/1468882449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab333db0 0x559bab334190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb83fff640 1 -- 172.21.15.69:0/4219418106 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fdb8c0d0b40 con 0x7fdb9c198670 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb9ad9d640 1 -- 172.21.15.69:0/1468882449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab33edd0 msgr2=0x559bab341220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb9ad9d640 1 --2- 172.21.15.69:0/1468882449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab33edd0 0x559bab341220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb9ad9d640 1 -- 172.21.15.69:0/1468882449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab333db0 msgr2=0x559bab334190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb9ad9d640 1 --2- 172.21.15.69:0/1468882449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab333db0 0x559bab334190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb9ad9d640 1 -- 172.21.15.69:0/1468882449 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559baafac2d0 con 0x559bab334760 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/1468882449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab33edd0 0x559bab341220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb9ad9d640 1 --2- 172.21.15.69:0/1468882449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab334760 0x559bab33e800 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009900 tx=0x7fdb94032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289635f299075c87 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb9b59e640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fdb840a3e40 0x7fdb840a6300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0ce1a0 tx=0x7fdb8c0bd040 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb817fa640 1 -- 172.21.15.69:0/1468882449 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94035040 con 0x559bab334760 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb817fa640 1 -- 172.21.15.69:0/1468882449 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdb94031710 con 0x559bab334760 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.262+0000 7fdb817fa640 1 -- 172.21.15.69:0/1468882449 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb940047a0 con 0x559bab334760 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 -- 172.21.15.69:0/1468882449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab334760 msgr2=0x559bab33e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 --2- 172.21.15.69:0/1468882449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab334760 0x559bab33e800 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009900 tx=0x7fdb94032d30 comp rx=0 tx=0).stop 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 -- 172.21.15.69:0/1468882449 shutdown_connections 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 --2- 172.21.15.69:0/1468882449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab334760 0x559bab33e800 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 --2- 172.21.15.69:0/1468882449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab33edd0 0x559bab341220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 --2- 172.21.15.69:0/1468882449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab333db0 0x559bab334190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 -- 172.21.15.69:0/1468882449 >> 172.21.15.69:0/1468882449 conn(0x559bab330070 msgr2=0x559bab330450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 -- 172.21.15.69:0/1468882449 shutdown_connections 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 -- 172.21.15.69:0/1468882449 wait complete. 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 -- start start 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 Processor -- start 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab333db0 0x559bab33bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab334760 0x559bab33c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab33edd0 0x559bab33c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x559bab341ce0 con 0x559bab33edd0 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559bab234470 con 0x559bab334760 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559bab341e60 con 0x559bab333db0 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdba3df1740 10 client.0 _ll_register_callbacks cb 0x559bab259f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdb9a59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab33edd0 0x559bab33c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdb9a59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab33edd0 0x559bab33c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49152/0 (socket says 172.21.15.69:49152) 2024-04-23T10:27:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.263+0000 7fdb9a59c640 1 -- 172.21.15.69:0/3885215889 learned_addr learned my addr 172.21.15.69:0/3885215889 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb9ad9d640 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab334760 0x559bab33c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab333db0 0x559bab33bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb9a59c640 1 -- 172.21.15.69:0/3885215889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab333db0 msgr2=0x559bab33bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab333db0 0x559bab33bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb9a59c640 1 -- 172.21.15.69:0/3885215889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab334760 msgr2=0x559bab33c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab334760 0x559bab33c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb9a59c640 1 -- 172.21.15.69:0/3885215889 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bab0766b0 con 0x559bab33edd0 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb9ad9d640 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab334760 0x559bab33c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab33edd0 0x559bab33c720 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009f90 tx=0x7fdb9000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79f939efcae76a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb7eff5640 1 -- 172.21.15.69:0/3885215889 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90013040 con 0x559bab33edd0 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb7eff5640 1 -- 172.21.15.69:0/3885215889 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fdb90018410 con 0x559bab33edd0 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdba3df1740 1 -- 172.21.15.69:0/3885215889 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb94031710 con 0x559bab33edd0 2024-04-23T10:27:02.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb7eff5640 1 -- 172.21.15.69:0/3885215889 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdb90018610 con 0x559bab33edd0 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdba3df1740 10 client.15603 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdba3df1740 1 -- 172.21.15.69:0/3885215889 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559bab34dfa0 con 0x559bab33edd0 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb7eff5640 1 -- 172.21.15.69:0/3885215889 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdb94031710 con 0x559bab33edd0 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdb7eff5640 1 -- 172.21.15.69:0/3885215889 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdb90021860 con 0x559bab33edd0 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdba3df1740 10 client.15603 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdba3df1740 10 client.15603 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdba3df1740 20 client.15603 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.264+0000 7fdba3df1740 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x559bab3505b0 0x559bab351a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.265+0000 7fdba3df1740 4 client.15603 mds_command: new command op to 24416 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.265+0000 7fdba3df1740 1 -- 172.21.15.69:0/3885215889 --> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bab2a7670 con 0x559bab3505b0 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.265+0000 7fdb9ad9d640 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x559bab3505b0 0x559bab351a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.265+0000 7fdb9ad9d640 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x559bab3505b0 0x559bab351a20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=534ebb6b5eab8ba0 server_cookie=67cdd323548ba3d6 in_seq=0 out_seq=0 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.265+0000 7fdb7eff5640 10 client.15603 ms_handle_connect on v2:172.21.15.146:6836/1505523103 2024-04-23T10:27:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdb7eff5640 1 -- 172.21.15.69:0/3885215889 <== mds.3 v2:172.21.15.146:6836/1505523103 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559bab2a7670 con 0x559bab3505b0 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdb7eff5640 10 client.15603 handle_command_reply: tid=0 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 1 client.15603 shutdown 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 1 -- 172.21.15.69:0/3885215889 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab33edd0 msgr2=0x559bab33c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab33edd0 0x559bab33c720 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009f90 tx=0x7fdb9000c040 comp rx=0 tx=0).stop 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 1 -- 172.21.15.69:0/3885215889 shutdown_connections 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x559bab3505b0 0x559bab351a20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab33edd0 0x559bab33c720 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab334760 0x559bab33c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdb7eff5640 0 client.15603 ms_handle_reset on v2:172.21.15.146:6836/1505523103 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 1 --2- 172.21.15.69:0/3885215889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab333db0 0x559bab33bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 1 -- 172.21.15.69:0/3885215889 >> 172.21.15.69:0/3885215889 conn(0x559bab330070 msgr2=0x559bab335ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 1 -- 172.21.15.69:0/3885215889 shutdown_connections 2024-04-23T10:27:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 1 -- 172.21.15.69:0/3885215889 wait complete. 2024-04-23T10:27:02.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.266+0000 7fdba3df1740 20 client.15603 trim_cache size 0 max 16384 2024-04-23T10:27:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdba3df1740 1 Processor -- start 2024-04-23T10:27:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdba3df1740 1 -- start start 2024-04-23T10:27:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab34b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab334760 0x559bab35a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab33edd0 0x559bab3363b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdba3df1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x559bab34fd60 con 0x559bab333db0 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdba3df1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559bab350430 con 0x559bab33edd0 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdba3df1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559bab350b00 con 0x559bab334760 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdb9a59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab34b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdb9a59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab34b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49166/0 (socket says 172.21.15.69:49166) 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdb9a59c640 1 -- 172.21.15.69:0/1203159656 learned_addr learned my addr 172.21.15.69:0/1203159656 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdb9a59c640 1 -- 172.21.15.69:0/1203159656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab334760 msgr2=0x559bab35a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/1203159656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab334760 0x559bab35a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdb9a59c640 1 -- 172.21.15.69:0/1203159656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab33edd0 msgr2=0x559bab3363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/1203159656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab33edd0 0x559bab3363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.284+0000 7fdb9a59c640 1 -- 172.21.15.69:0/1203159656 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bab33a1f0 con 0x559bab333db0 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/1203159656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab34b660 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdb90021d00 tx=0x7fdb90009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d737470b7f6f288 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdb80ff9640 1 -- 172.21.15.69:0/1203159656 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9002e070 con 0x559bab333db0 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdb80ff9640 1 -- 172.21.15.69:0/1203159656 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdb9001d070 con 0x559bab333db0 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdb80ff9640 1 -- 172.21.15.69:0/1203159656 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90021750 con 0x559bab333db0 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdba3df1740 1 -- 172.21.15.69:0/1203159656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 msgr2=0x559bab34b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdba3df1740 1 --2- 172.21.15.69:0/1203159656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab34b660 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdb90021d00 tx=0x7fdb90009e70 comp rx=0 tx=0).stop 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdba3df1740 1 -- 172.21.15.69:0/1203159656 shutdown_connections 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdba3df1740 1 --2- 172.21.15.69:0/1203159656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab33edd0 0x559bab3363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdba3df1740 1 --2- 172.21.15.69:0/1203159656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab334760 0x559bab35a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdba3df1740 1 --2- 172.21.15.69:0/1203159656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab34b660 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdba3df1740 1 -- 172.21.15.69:0/1203159656 >> 172.21.15.69:0/1203159656 conn(0x559bab330070 msgr2=0x559bab33a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdba3df1740 1 -- 172.21.15.69:0/1203159656 shutdown_connections 2024-04-23T10:27:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.285+0000 7fdba3df1740 1 -- 172.21.15.69:0/1203159656 wait complete. 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdba3df1740 1 -- start start 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdba3df1740 1 Processor -- start 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab357d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab334760 0x559bab3582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdba3df1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab33edd0 0x559bab3b9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdba3df1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x559bab3518a0 con 0x559bab333db0 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdba3df1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559bab3511d0 con 0x559bab334760 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdba3df1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559bab351f70 con 0x559bab33edd0 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdba3df1740 10 client.0 _ll_register_callbacks cb 0x7fdb90009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdb9a59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab357d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdb9a59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab357d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49178/0 (socket says 172.21.15.69:49178) 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdb9a59c640 1 -- 172.21.15.69:0/2174831209 learned_addr learned my addr 172.21.15.69:0/2174831209 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdb9a59c640 1 -- 172.21.15.69:0/2174831209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab33edd0 msgr2=0x559bab3b9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/2174831209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab33edd0 0x559bab3b9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdb9a59c640 1 -- 172.21.15.69:0/2174831209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab334760 msgr2=0x559bab3582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/2174831209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab334760 0x559bab3582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdb9a59c640 1 -- 172.21.15.69:0/2174831209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bab3b9ad0 con 0x559bab333db0 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdb9a59c640 1 --2- 172.21.15.69:0/2174831209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab357d60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000ad00 tx=0x7fdb900049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0605c6dab6531f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.286+0000 7fdb7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdb7eff5640 1 -- 172.21.15.69:0/2174831209 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90037070 con 0x559bab333db0 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdb7eff5640 1 -- 172.21.15.69:0/2174831209 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fdb900217c0 con 0x559bab333db0 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdba3df1740 1 -- 172.21.15.69:0/2174831209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb9001d070 con 0x559bab333db0 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdb7eff5640 1 -- 172.21.15.69:0/2174831209 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdb9002e050 con 0x559bab333db0 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdba3df1740 10 client.15609 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdba3df1740 1 -- 172.21.15.69:0/2174831209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559bab3bacd0 con 0x559bab333db0 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdb7eff5640 1 -- 172.21.15.69:0/2174831209 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdb9001d070 con 0x559bab333db0 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdb7eff5640 1 -- 172.21.15.69:0/2174831209 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdb90033990 con 0x559bab333db0 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdba3df1740 10 client.15609 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdba3df1740 10 client.15609 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-23T10:27:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdba3df1740 20 client.15609 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdba3df1740 1 --2- 172.21.15.69:0/2174831209 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x559bab3bf530 0x559bab3be240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdba3df1740 4 client.15609 mds_command: new command op to 24416 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdba3df1740 1 -- 172.21.15.69:0/2174831209 --> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] -- command(tid 0: {"prefix": "status"}) -- 0x559bab2a14e0 con 0x559bab3bf530 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.287+0000 7fdb9ad9d640 1 --2- 172.21.15.69:0/2174831209 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x559bab3bf530 0x559bab3be240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdb9ad9d640 1 --2- 172.21.15.69:0/2174831209 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x559bab3bf530 0x559bab3be240 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4de38970731ba283 server_cookie=1592ff95f547fb24 in_seq=0 out_seq=0 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdb7eff5640 10 client.15609 ms_handle_connect on v2:172.21.15.146:6836/1505523103 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdb7eff5640 1 -- 172.21.15.69:0/2174831209 <== mds.3 v2:172.21.15.146:6836/1505523103 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x559bab2a14e0 con 0x559bab3bf530 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdb7eff5640 10 client.15609 handle_command_reply: tid=0 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 1 client.15609 shutdown 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 1 -- 172.21.15.69:0/2174831209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 msgr2=0x559bab357d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 1 --2- 172.21.15.69:0/2174831209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab357d60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000ad00 tx=0x7fdb900049c0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 1 -- 172.21.15.69:0/2174831209 shutdown_connections 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 1 --2- 172.21.15.69:0/2174831209 >> [v2:172.21.15.146:6836/1505523103,v1:172.21.15.146:6837/1505523103] conn(0x559bab3bf530 0x559bab3be240 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 1 --2- 172.21.15.69:0/2174831209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559bab33edd0 0x559bab3b9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdb7eff5640 0 client.15609 ms_handle_reset on v2:172.21.15.146:6836/1505523103 2024-04-23T10:27:02.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 1 --2- 172.21.15.69:0/2174831209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559bab334760 0x559bab3582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 1 --2- 172.21.15.69:0/2174831209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559bab333db0 0x559bab357d60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 1 -- 172.21.15.69:0/2174831209 >> 172.21.15.69:0/2174831209 conn(0x559bab330070 msgr2=0x559bab34a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 1 -- 172.21.15.69:0/2174831209 shutdown_connections 2024-04-23T10:27:02.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 1 -- 172.21.15.69:0/2174831209 wait complete. 2024-04-23T10:27:02.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.288+0000 7fdba3df1740 20 client.15609 trim_cache size 0 max 16384 2024-04-23T10:27:02.295 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:27:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:27:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 3, 2024-04-23T10:27:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24416, 2024-04-23T10:27:02.295 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:27:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:27:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:27:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 124.968761968, 2024-04-23T10:27:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 26, 2024-04-23T10:27:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 89, 2024-04-23T10:27:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 88, 2024-04-23T10:27:02.296 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 145.416763162 2024-04-23T10:27:02.296 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:27:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 -- 172.21.15.69:0/4219418106 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fdb840a3e40 msgr2=0x7fdb840a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fdb840a3e40 0x7fdb840a6300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0ce1a0 tx=0x7fdb8c0bd040 comp rx=0 tx=0).stop 2024-04-23T10:27:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 -- 172.21.15.69:0/4219418106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9c198670 msgr2=0x7fdb9c198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9c198670 0x7fdb9c198b20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00c970 tx=0x7fdb8c00ce30 comp rx=0 tx=0).stop 2024-04-23T10:27:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 -- 172.21.15.69:0/4219418106 shutdown_connections 2024-04-23T10:27:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fdb840a3e40 0x7fdb840a6300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9c198670 0x7fdb9c198b20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb9c107250 0x7fdb9c19e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 --2- 172.21.15.69:0/4219418106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c102180 0x7fdb9c19e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 -- 172.21.15.69:0/4219418106 >> 172.21.15.69:0/4219418106 conn(0x7fdb9c0792d0 msgr2=0x7fdb9c1000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 -- 172.21.15.69:0/4219418106 shutdown_connections 2024-04-23T10:27:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.289+0000 7fdba10dc640 1 -- 172.21.15.69:0/4219418106 wait complete. 2024-04-23T10:27:02.299 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-04-23T10:27:02.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:01 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3463082576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:02.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:01 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/778432030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:27:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:01 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1119182204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:02.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.399+0000 7f7da2b3d640 1 -- 172.21.15.69:0/269938278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c100d00 msgr2=0x7f7d9c1010e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.399+0000 7f7da2b3d640 1 --2- 172.21.15.69:0/269938278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c100d00 0x7f7d9c1010e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009900 tx=0x7f7d9402a410 comp rx=0 tx=0).stop 2024-04-23T10:27:02.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.399+0000 7f7da2b3d640 1 -- 172.21.15.69:0/269938278 shutdown_connections 2024-04-23T10:27:02.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.399+0000 7f7da2b3d640 1 --2- 172.21.15.69:0/269938278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d9c10e8b0 0x7f7d9c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.399+0000 7f7da2b3d640 1 --2- 172.21.15.69:0/269938278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c101620 0x7f7d9c10e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.399+0000 7f7da2b3d640 1 --2- 172.21.15.69:0/269938278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c100d00 0x7f7d9c1010e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.399+0000 7f7da2b3d640 1 -- 172.21.15.69:0/269938278 >> 172.21.15.69:0/269938278 conn(0x7f7d9c0771d0 msgr2=0x7f7d9c0775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.399+0000 7f7da2b3d640 1 -- 172.21.15.69:0/269938278 shutdown_connections 2024-04-23T10:27:02.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.399+0000 7f7da2b3d640 1 -- 172.21.15.69:0/269938278 wait complete. 2024-04-23T10:27:02.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da2b3d640 1 Processor -- start 2024-04-23T10:27:02.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da2b3d640 1 -- start start 2024-04-23T10:27:02.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da2b3d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c100d00 0x7f7d9c1a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da2b3d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c101620 0x7f7d9c1a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da2b3d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d9c10e8b0 0x7f7d9c19a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da2b3d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c114500 con 0x7f7d9c100d00 2024-04-23T10:27:02.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da2b3d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c114380 con 0x7f7d9c101620 2024-04-23T10:27:02.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da2b3d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c114680 con 0x7f7d9c10e8b0 2024-04-23T10:27:02.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da08d9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c100d00 0x7f7d9c1a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da08d9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c100d00 0x7f7d9c1a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49186/0 (socket says 172.21.15.69:49186) 2024-04-23T10:27:02.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da08d9640 1 -- 172.21.15.69:0/1643591916 learned_addr learned my addr 172.21.15.69:0/1643591916 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7d9bfff640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c101620 0x7f7d9c1a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da08d9640 1 -- 172.21.15.69:0/1643591916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d9c10e8b0 msgr2=0x7f7d9c19a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da08d9640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d9c10e8b0 0x7f7d9c19a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da08d9640 1 -- 172.21.15.69:0/1643591916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c101620 msgr2=0x7f7d9c1a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da08d9640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c101620 0x7f7d9c1a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.400+0000 7f7da08d9640 1 -- 172.21.15.69:0/1643591916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9c19afe0 con 0x7f7d9c100d00 2024-04-23T10:27:02.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.401+0000 7f7da08d9640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c100d00 0x7f7d9c1a06b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7d94005ab0 tx=0x7f7d940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.401+0000 7f7d99ffb640 1 -- 172.21.15.69:0/1643591916 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9403f030 con 0x7f7d9c100d00 2024-04-23T10:27:02.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.401+0000 7f7d99ffb640 1 -- 172.21.15.69:0/1643591916 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d94003cd0 con 0x7f7d9c100d00 2024-04-23T10:27:02.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.401+0000 7f7da2b3d640 1 -- 172.21.15.69:0/1643591916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9c19b270 con 0x7f7d9c100d00 2024-04-23T10:27:02.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.401+0000 7f7d99ffb640 1 -- 172.21.15.69:0/1643591916 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94035070 con 0x7f7d9c100d00 2024-04-23T10:27:02.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.401+0000 7f7da2b3d640 1 -- 172.21.15.69:0/1643591916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d9c1a7570 con 0x7f7d9c100d00 2024-04-23T10:27:02.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.403+0000 7f7d99ffb640 1 -- 172.21.15.69:0/1643591916 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f7d94042030 con 0x7f7d9c100d00 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.403+0000 7f7da584c740 1 Processor -- start 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.403+0000 7f7da584c740 1 -- start start 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7da584c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8265db0 0x5625b8266190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7da584c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8266760 0x5625b8270800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7da584c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8273220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7da584c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5625b81cbc50 con 0x5625b8270dd0 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7da584c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5625b8168830 con 0x5625b8266760 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7da584c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5625b81c7c10 con 0x5625b8265db0 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d99ffb640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7d880a3ec0 0x7f7d880a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d9bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8273220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d9bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8273220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49188/0 (socket says 172.21.15.69:49188) 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7da10da640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7d880a3ec0 0x7f7d880a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d9bfff640 1 -- 172.21.15.69:0/718447254 learned_addr learned my addr 172.21.15.69:0/718447254 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7da08d9640 1 --2- 172.21.15.69:0/718447254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8266760 0x5625b8270800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d99ffb640 1 -- 172.21.15.69:0/1643591916 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f7d940f0f30 con 0x7f7d9c100d00 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7da10da640 1 --2- 172.21.15.69:0/718447254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8265db0 0x5625b8266190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d9bfff640 1 -- 172.21.15.69:0/718447254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8265db0 msgr2=0x5625b8266190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d9bfff640 1 --2- 172.21.15.69:0/718447254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8265db0 0x5625b8266190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d9bfff640 1 -- 172.21.15.69:0/718447254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8266760 msgr2=0x5625b8270800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d9bfff640 1 --2- 172.21.15.69:0/718447254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8266760 0x5625b8270800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d9bfff640 1 -- 172.21.15.69:0/718447254 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625b7ede2d0 con 0x5625b8270dd0 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d9bfff640 1 --2- 172.21.15.69:0/718447254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8273220 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009f00 tx=0x7f7d8c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2535e76ed7031ae8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7da10da640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7d880a3ec0 0x7f7d880a6380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7d84005fd0 tx=0x7f7d84014840 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.404+0000 7f7d92ffd640 1 -- 172.21.15.69:0/718447254 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c016070 con 0x5625b8270dd0 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.405+0000 7f7d92ffd640 1 -- 172.21.15.69:0/718447254 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d8c01bb30 con 0x5625b8270dd0 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.405+0000 7f7d92ffd640 1 -- 172.21.15.69:0/718447254 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c012cb0 con 0x5625b8270dd0 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.405+0000 7f7da584c740 1 -- 172.21.15.69:0/718447254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 msgr2=0x5625b8273220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.405+0000 7f7da584c740 1 --2- 172.21.15.69:0/718447254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8273220 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009f00 tx=0x7f7d8c010740 comp rx=0 tx=0).stop 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.405+0000 7f7da584c740 1 -- 172.21.15.69:0/718447254 shutdown_connections 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.405+0000 7f7da584c740 1 --2- 172.21.15.69:0/718447254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8273220 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.405+0000 7f7da584c740 1 --2- 172.21.15.69:0/718447254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8266760 0x5625b8270800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.405+0000 7f7da584c740 1 --2- 172.21.15.69:0/718447254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8265db0 0x5625b8266190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.405+0000 7f7da584c740 1 -- 172.21.15.69:0/718447254 >> 172.21.15.69:0/718447254 conn(0x5625b8262070 msgr2=0x5625b8262450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.405+0000 7f7da584c740 1 -- 172.21.15.69:0/718447254 shutdown_connections 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.405+0000 7f7da584c740 1 -- 172.21.15.69:0/718447254 wait complete. 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7da584c740 1 -- start start 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7da584c740 1 Processor -- start 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7da584c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8265db0 0x5625b826dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7da584c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8266760 0x5625b826e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7da584c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8270dd0 0x5625b826e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7da584c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5625b8273d40 con 0x5625b8266760 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7da584c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5625b8166470 con 0x5625b8265db0 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7da584c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5625b8273ec0 con 0x5625b8270dd0 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7da584c740 10 client.0 _ll_register_callbacks cb 0x5625b818bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7d9bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8266760 0x5625b826e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7d9bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8266760 0x5625b826e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49196/0 (socket says 172.21.15.69:49196) 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7d9bfff640 1 -- 172.21.15.69:0/559059499 learned_addr learned my addr 172.21.15.69:0/559059499 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7da08d9640 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8265db0 0x5625b826dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7d9bfff640 1 -- 172.21.15.69:0/559059499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8270dd0 msgr2=0x5625b826e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7d9bfff640 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8270dd0 0x5625b826e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7d9bfff640 1 -- 172.21.15.69:0/559059499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8265db0 msgr2=0x5625b826dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7d9bfff640 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8265db0 0x5625b826dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7d9bfff640 1 -- 172.21.15.69:0/559059499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625b7fa86b0 con 0x5625b8266760 2024-04-23T10:27:02.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7da08d9640 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8265db0 0x5625b826dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7d9bfff640 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8266760 0x5625b826e280 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c012700 tx=0x7f7d8c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff48ad65fbf5bb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.406+0000 7f7d7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7d7bfff640 1 -- 172.21.15.69:0/559059499 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c016040 con 0x5625b8266760 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7d7bfff640 1 -- 172.21.15.69:0/559059499 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f7d8c003970 con 0x5625b8266760 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7da584c740 1 -- 172.21.15.69:0/559059499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d8c01bb30 con 0x5625b8266760 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7d7bfff640 1 -- 172.21.15.69:0/559059499 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7d8c003b70 con 0x5625b8266760 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7da584c740 10 client.15621 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7da584c740 1 -- 172.21.15.69:0/559059499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5625b8280040 con 0x5625b8266760 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7d7bfff640 1 -- 172.21.15.69:0/559059499 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d8c01bb30 con 0x5625b8266760 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7d7bfff640 1 -- 172.21.15.69:0/559059499 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7d8c00f040 con 0x5625b8266760 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7da584c740 10 client.15621 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7da584c740 10 client.15621 resolve_mds: resolved name 'l' to daemon mds.l 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7da584c740 20 client.15621 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:02.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7da584c740 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5625b8282430 0x5625b82838a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7da584c740 4 client.15621 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7da584c740 1 -- 172.21.15.69:0/559059499 --> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625b81d9670 con 0x5625b8282430 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.407+0000 7f7da08d9640 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5625b8282430 0x5625b82838a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.408+0000 7f7d7bfff640 10 client.15621 ms_handle_connect on v2:172.21.15.167:6832/977410598 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.408+0000 7f7da08d9640 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5625b8282430 0x5625b82838a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=579c6bad5e52491e server_cookie=558b42f1fd848e4c in_seq=0 out_seq=0 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7d7bfff640 1 -- 172.21.15.69:0/559059499 <== mds.2 v2:172.21.15.167:6832/977410598 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5625b81d9670 con 0x5625b8282430 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7d7bfff640 10 client.15621 handle_command_reply: tid=0 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 1 client.15621 shutdown 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 1 -- 172.21.15.69:0/559059499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8266760 msgr2=0x5625b826e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8266760 0x5625b826e280 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c012700 tx=0x7f7d8c009b60 comp rx=0 tx=0).stop 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 1 -- 172.21.15.69:0/559059499 shutdown_connections 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5625b8282430 0x5625b82838a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8266760 0x5625b826e280 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8270dd0 0x5625b826e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7d7bfff640 0 client.15621 ms_handle_reset on v2:172.21.15.167:6832/977410598 2024-04-23T10:27:02.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 1 --2- 172.21.15.69:0/559059499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8265db0 0x5625b826dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 1 -- 172.21.15.69:0/559059499 >> 172.21.15.69:0/559059499 conn(0x5625b8262070 msgr2=0x5625b8267ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 1 -- 172.21.15.69:0/559059499 shutdown_connections 2024-04-23T10:27:02.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 1 -- 172.21.15.69:0/559059499 wait complete. 2024-04-23T10:27:02.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.409+0000 7f7da584c740 20 client.15621 trim_cache size 0 max 16384 2024-04-23T10:27:02.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:01 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3463082576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:02.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:01 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/778432030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:27:02.431 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:01 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1119182204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:02.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da584c740 1 Processor -- start 2024-04-23T10:27:02.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da584c740 1 -- start start 2024-04-23T10:27:02.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da584c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8265db0 0x5625b82813f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da584c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8266760 0x5625b826e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da584c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8270dd0 0x5625b8268200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da584c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5625b8281be0 con 0x5625b8265db0 2024-04-23T10:27:02.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da584c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5625b82822b0 con 0x5625b8270dd0 2024-04-23T10:27:02.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da584c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5625b8282980 con 0x5625b8266760 2024-04-23T10:27:02.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da08d9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8265db0 0x5625b82813f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da08d9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8265db0 0x5625b82813f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49206/0 (socket says 172.21.15.69:49206) 2024-04-23T10:27:02.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da08d9640 1 -- 172.21.15.69:0/2340890853 learned_addr learned my addr 172.21.15.69:0/2340890853 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da10da640 1 --2- 172.21.15.69:0/2340890853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8270dd0 0x5625b8268200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7d9bfff640 1 --2- 172.21.15.69:0/2340890853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8266760 0x5625b826e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da08d9640 1 -- 172.21.15.69:0/2340890853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8266760 msgr2=0x5625b826e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da08d9640 1 --2- 172.21.15.69:0/2340890853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8266760 0x5625b826e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da08d9640 1 -- 172.21.15.69:0/2340890853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8270dd0 msgr2=0x5625b8268200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da08d9640 1 --2- 172.21.15.69:0/2340890853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8270dd0 0x5625b8268200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da08d9640 1 -- 172.21.15.69:0/2340890853 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625b825d960 con 0x5625b8265db0 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da10da640 1 --2- 172.21.15.69:0/2340890853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8270dd0 0x5625b8268200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7d9bfff640 1 --2- 172.21.15.69:0/2340890853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8266760 0x5625b826e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7da08d9640 1 --2- 172.21.15.69:0/2340890853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8265db0 0x5625b82813f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7d94005ec0 tx=0x7f7d9408e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17360a355d16391 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.427+0000 7f7d927fc640 1 -- 172.21.15.69:0/2340890853 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94049040 con 0x5625b8265db0 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7d927fc640 1 -- 172.21.15.69:0/2340890853 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d940bcd20 con 0x5625b8265db0 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7d927fc640 1 -- 172.21.15.69:0/2340890853 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d940b9390 con 0x5625b8265db0 2024-04-23T10:27:02.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7da584c740 1 -- 172.21.15.69:0/2340890853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8265db0 msgr2=0x5625b82813f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7da584c740 1 --2- 172.21.15.69:0/2340890853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8265db0 0x5625b82813f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7d94005ec0 tx=0x7f7d9408e760 comp rx=0 tx=0).stop 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7da584c740 1 -- 172.21.15.69:0/2340890853 shutdown_connections 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7da584c740 1 --2- 172.21.15.69:0/2340890853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8270dd0 0x5625b8268200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7da584c740 1 --2- 172.21.15.69:0/2340890853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8266760 0x5625b826e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7da584c740 1 --2- 172.21.15.69:0/2340890853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8265db0 0x5625b82813f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7da584c740 1 -- 172.21.15.69:0/2340890853 >> 172.21.15.69:0/2340890853 conn(0x5625b8262070 msgr2=0x5625b8262450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7da584c740 1 -- 172.21.15.69:0/2340890853 shutdown_connections 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7da584c740 1 -- 172.21.15.69:0/2340890853 wait complete. 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7da584c740 1 -- start start 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.428+0000 7f7da584c740 1 Processor -- start 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da584c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8265db0 0x5625b8289650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da584c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8266760 0x5625b8289b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da584c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8284ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da584c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5625b8283720 con 0x5625b8270dd0 2024-04-23T10:27:02.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da584c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5625b8283050 con 0x5625b8266760 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da584c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5625b8283df0 con 0x5625b8265db0 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da584c740 10 client.0 _ll_register_callbacks cb 0x7f7d940b9070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da10da640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8284ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da10da640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8284ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49216/0 (socket says 172.21.15.69:49216) 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da10da640 1 -- 172.21.15.69:0/229470791 learned_addr learned my addr 172.21.15.69:0/229470791 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da08d9640 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8265db0 0x5625b8289650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7d9bfff640 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8266760 0x5625b8289b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da10da640 1 -- 172.21.15.69:0/229470791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8265db0 msgr2=0x5625b8289650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da10da640 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8265db0 0x5625b8289650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da10da640 1 -- 172.21.15.69:0/229470791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8266760 msgr2=0x5625b8289b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da10da640 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8266760 0x5625b8289b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da10da640 1 -- 172.21.15.69:0/229470791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625b82851e0 con 0x5625b8270dd0 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da08d9640 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8265db0 0x5625b8289650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:02.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7da10da640 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8284ba0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7d84014310 tx=0x7f7d84005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c53779ac67fc3c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7d7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7d7bfff640 1 -- 172.21.15.69:0/229470791 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84025030 con 0x5625b8270dd0 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.429+0000 7f7d7bfff640 1 -- 172.21.15.69:0/229470791 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f7d84009050 con 0x5625b8270dd0 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7da584c740 1 -- 172.21.15.69:0/229470791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d940bcd20 con 0x5625b8270dd0 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7d7bfff640 1 -- 172.21.15.69:0/229470791 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7d8402f050 con 0x5625b8270dd0 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7da584c740 10 client.15627 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7da584c740 1 -- 172.21.15.69:0/229470791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5625b8288c60 con 0x5625b8270dd0 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7d7bfff640 1 -- 172.21.15.69:0/229470791 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d940bcd20 con 0x5625b8270dd0 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7d7bfff640 1 -- 172.21.15.69:0/229470791 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7d8401e070 con 0x5625b8270dd0 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7da584c740 10 client.15627 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7da584c740 10 client.15627 resolve_mds: resolved name 'l' to daemon mds.l 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7da584c740 20 client.15627 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7da584c740 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5625b82ec8b0 0x5625b82eb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7da584c740 4 client.15627 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:27:02.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7da584c740 1 -- 172.21.15.69:0/229470791 --> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] -- command(tid 0: {"prefix": "status"}) -- 0x5625b81d34e0 con 0x5625b82ec8b0 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.430+0000 7f7da08d9640 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5625b82ec8b0 0x5625b82eb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da08d9640 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5625b82ec8b0 0x5625b82eb5c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=defe7cbaaf673448 server_cookie=7116e3a5e71d7c3b in_seq=0 out_seq=0 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7d7bfff640 10 client.15627 ms_handle_connect on v2:172.21.15.167:6832/977410598 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7d7bfff640 1 -- 172.21.15.69:0/229470791 <== mds.2 v2:172.21.15.167:6832/977410598 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5625b81d34e0 con 0x5625b82ec8b0 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7d7bfff640 10 client.15627 handle_command_reply: tid=0 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 1 client.15627 shutdown 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 1 -- 172.21.15.69:0/229470791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 msgr2=0x5625b8284ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8284ba0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7d84014310 tx=0x7f7d84005f40 comp rx=0 tx=0).stop 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 1 -- 172.21.15.69:0/229470791 shutdown_connections 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.167:6832/977410598,v1:172.21.15.167:6833/977410598] conn(0x5625b82ec8b0 0x5625b82eb5c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5625b8270dd0 0x5625b8284ba0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5625b8266760 0x5625b8289b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7d7bfff640 0 client.15627 ms_handle_reset on v2:172.21.15.167:6832/977410598 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 1 --2- 172.21.15.69:0/229470791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625b8265db0 0x5625b8289650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 1 -- 172.21.15.69:0/229470791 >> 172.21.15.69:0/229470791 conn(0x5625b8262070 msgr2=0x5625b82813f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 1 -- 172.21.15.69:0/229470791 shutdown_connections 2024-04-23T10:27:02.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 1 -- 172.21.15.69:0/229470791 wait complete. 2024-04-23T10:27:02.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.431+0000 7f7da584c740 20 client.15627 trim_cache size 0 max 16384 2024-04-23T10:27:02.438 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:27:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:27:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 2, 2024-04-23T10:27:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24421, 2024-04-23T10:27:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:27:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:27:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:27:02.438 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 126.11595620600001, 2024-04-23T10:27:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 26, 2024-04-23T10:27:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 89, 2024-04-23T10:27:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 88, 2024-04-23T10:27:02.439 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 165.488434907 2024-04-23T10:27:02.439 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 -- 172.21.15.69:0/1643591916 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7d880a3ec0 msgr2=0x7f7d880a6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7d880a3ec0 0x7f7d880a6380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7d84005fd0 tx=0x7f7d84014840 comp rx=0 tx=0).stop 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 -- 172.21.15.69:0/1643591916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c100d00 msgr2=0x7f7d9c1a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c100d00 0x7f7d9c1a06b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7d94005ab0 tx=0x7f7d940042f0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 -- 172.21.15.69:0/1643591916 shutdown_connections 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7d880a3ec0 0x7f7d880a6380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d9c10e8b0 0x7f7d9c19a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c101620 0x7f7d9c1a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 --2- 172.21.15.69:0/1643591916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c100d00 0x7f7d9c1a06b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 -- 172.21.15.69:0/1643591916 >> 172.21.15.69:0/1643591916 conn(0x7f7d9c0771d0 msgr2=0x7f7d9c10fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 -- 172.21.15.69:0/1643591916 shutdown_connections 2024-04-23T10:27:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.432+0000 7f7da2b3d640 1 -- 172.21.15.69:0/1643591916 wait complete. 2024-04-23T10:27:02.441 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-23T10:27:02.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.543+0000 7fada15cd640 1 -- 172.21.15.69:0/2587674943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad9c102b50 msgr2=0x7fad9c106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.543+0000 7fada15cd640 1 --2- 172.21.15.69:0/2587674943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad9c102b50 0x7fad9c106b90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fad90009900 tx=0x7fad9002a410 comp rx=0 tx=0).stop 2024-04-23T10:27:02.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.543+0000 7fada15cd640 1 -- 172.21.15.69:0/2587674943 shutdown_connections 2024-04-23T10:27:02.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.543+0000 7fada15cd640 1 --2- 172.21.15.69:0/2587674943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad9c102b50 0x7fad9c106b90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.543+0000 7fada15cd640 1 --2- 172.21.15.69:0/2587674943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad9c107270 0x7fad9c10ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.543+0000 7fada15cd640 1 --2- 172.21.15.69:0/2587674943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad9c1021a0 0x7fad9c102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.543+0000 7fada15cd640 1 -- 172.21.15.69:0/2587674943 >> 172.21.15.69:0/2587674943 conn(0x7fad9c0fda20 msgr2=0x7fad9c0ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.543+0000 7fada15cd640 1 -- 172.21.15.69:0/2587674943 shutdown_connections 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.543+0000 7fada15cd640 1 -- 172.21.15.69:0/2587674943 wait complete. 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.543+0000 7fada15cd640 1 Processor -- start 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fada15cd640 1 -- start start 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fada15cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad9c1021a0 0x7fad9c19e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fada15cd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad9c107270 0x7fad9c19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fada15cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad9c1985f0 0x7fad9c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fada15cd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c1122f0 con 0x7fad9c107270 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fada15cd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c112170 con 0x7fad9c1021a0 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fada15cd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c112470 con 0x7fad9c1985f0 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad9a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad9c107270 0x7fad9c19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad9a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad9c107270 0x7fad9c19e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49244/0 (socket says 172.21.15.69:49244) 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad9a7fc640 1 -- 172.21.15.69:0/1615534743 learned_addr learned my addr 172.21.15.69:0/1615534743 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad9affd640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad9c1021a0 0x7fad9c19e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad9a7fc640 1 -- 172.21.15.69:0/1615534743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad9c1985f0 msgr2=0x7fad9c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad9b7fe640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad9c1985f0 0x7fad9c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad9c1985f0 0x7fad9c198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad9a7fc640 1 -- 172.21.15.69:0/1615534743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad9c1021a0 msgr2=0x7fad9c19e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad9c1021a0 0x7fad9c19e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad9a7fc640 1 -- 172.21.15.69:0/1615534743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c199110 con 0x7fad9c107270 2024-04-23T10:27:02.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad9c107270 0x7fad9c19e930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fad90005940 tx=0x7fad900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad83fff640 1 -- 172.21.15.69:0/1615534743 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9003f030 con 0x7fad9c107270 2024-04-23T10:27:02.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.544+0000 7fad83fff640 1 -- 172.21.15.69:0/1615534743 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fad900318f0 con 0x7fad9c107270 2024-04-23T10:27:02.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.545+0000 7fada15cd640 1 -- 172.21.15.69:0/1615534743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9c1993a0 con 0x7fad9c107270 2024-04-23T10:27:02.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.545+0000 7fad83fff640 1 -- 172.21.15.69:0/1615534743 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad90035070 con 0x7fad9c107270 2024-04-23T10:27:02.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.545+0000 7fada15cd640 1 -- 172.21.15.69:0/1615534743 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9c1a55a0 con 0x7fad9c107270 2024-04-23T10:27:02.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fad83fff640 1 -- 172.21.15.69:0/1615534743 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fad90042030 con 0x7fad9c107270 2024-04-23T10:27:02.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fada43be740 1 Processor -- start 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fada43be740 1 -- start start 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fada43be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd2db0 0x564eafbd3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fada43be740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd3760 0x564eafbdd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fad83fff640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fad840a3ec0 0x7fad840a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fada43be740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbdddd0 0x564eafbe0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fada43be740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564eafb38c50 con 0x564eafbd3760 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fada43be740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564eafad5830 con 0x564eafbdddd0 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fada43be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564eafb34c10 con 0x564eafbd2db0 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fad9affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd3760 0x564eafbdd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fad9b7fe640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fad840a3ec0 0x7fad840a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fad9affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd3760 0x564eafbdd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49252/0 (socket says 172.21.15.69:49252) 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fad9affd640 1 -- 172.21.15.69:0/3591948823 learned_addr learned my addr 172.21.15.69:0/3591948823 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fad83fff640 1 -- 172.21.15.69:0/1615534743 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fad900f0d30 con 0x7fad9c107270 2024-04-23T10:27:02.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/3591948823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbdddd0 0x564eafbe0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.547+0000 7fad9b7fe640 1 --2- 172.21.15.69:0/3591948823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd2db0 0x564eafbd3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.548+0000 7fad9affd640 1 -- 172.21.15.69:0/3591948823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd2db0 msgr2=0x564eafbd3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.548+0000 7fad9affd640 1 --2- 172.21.15.69:0/3591948823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd2db0 0x564eafbd3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.548+0000 7fad9affd640 1 -- 172.21.15.69:0/3591948823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbdddd0 msgr2=0x564eafbe0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.548+0000 7fad9affd640 1 --2- 172.21.15.69:0/3591948823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbdddd0 0x564eafbe0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.548+0000 7fad9affd640 1 -- 172.21.15.69:0/3591948823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eaf84b2d0 con 0x564eafbd3760 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.548+0000 7fad9b7fe640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fad840a3ec0 0x7fad840a6380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad94008fd0 tx=0x7fad94014950 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.548+0000 7fad9affd640 1 --2- 172.21.15.69:0/3591948823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd3760 0x564eafbdd800 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009d20 tx=0x7fad8c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2240ce4b904ceac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.548+0000 7fad817fa640 1 -- 172.21.15.69:0/3591948823 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c019620 con 0x564eafbd3760 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.548+0000 7fad817fa640 1 -- 172.21.15.69:0/3591948823 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fad8c019c90 con 0x564eafbd3760 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.548+0000 7fad817fa640 1 -- 172.21.15.69:0/3591948823 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c018ca0 con 0x564eafbd3760 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 -- 172.21.15.69:0/3591948823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd3760 msgr2=0x564eafbdd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 --2- 172.21.15.69:0/3591948823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd3760 0x564eafbdd800 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009d20 tx=0x7fad8c011810 comp rx=0 tx=0).stop 2024-04-23T10:27:02.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 -- 172.21.15.69:0/3591948823 shutdown_connections 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 --2- 172.21.15.69:0/3591948823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd3760 0x564eafbdd800 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 --2- 172.21.15.69:0/3591948823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbdddd0 0x564eafbe0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 --2- 172.21.15.69:0/3591948823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd2db0 0x564eafbd3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 -- 172.21.15.69:0/3591948823 >> 172.21.15.69:0/3591948823 conn(0x564eafbcf070 msgr2=0x564eafbcf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 -- 172.21.15.69:0/3591948823 shutdown_connections 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 -- 172.21.15.69:0/3591948823 wait complete. 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 -- start start 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 Processor -- start 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbdacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd3760 0x564eafbdb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbdddd0 0x564eafbdb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564eafbe0d40 con 0x564eafbd2db0 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564eafad3470 con 0x564eafbdddd0 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564eafbe0ec0 con 0x564eafbd3760 2024-04-23T10:27:02.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fad9affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbdacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fada43be740 10 client.0 _ll_register_callbacks cb 0x564eafaf8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fad9affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbdacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49256/0 (socket says 172.21.15.69:49256) 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.549+0000 7fad9affd640 1 -- 172.21.15.69:0/2770400641 learned_addr learned my addr 172.21.15.69:0/2770400641 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad9b7fe640 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbdddd0 0x564eafbdb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd3760 0x564eafbdb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad9affd640 1 -- 172.21.15.69:0/2770400641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd3760 msgr2=0x564eafbdb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad9affd640 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd3760 0x564eafbdb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad9affd640 1 -- 172.21.15.69:0/2770400641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbdddd0 msgr2=0x564eafbdb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad9affd640 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbdddd0 0x564eafbdb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad9affd640 1 -- 172.21.15.69:0/2770400641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eaf9156b0 con 0x564eafbd2db0 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad9b7fe640 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbdddd0 0x564eafbdb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd3760 0x564eafbdb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad9affd640 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbdacc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fad8c018c50 tx=0x7fad8c018c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9953772409be10 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:02.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad7eff5640 1 -- 172.21.15.69:0/2770400641 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c026070 con 0x564eafbd2db0 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad7eff5640 1 -- 172.21.15.69:0/2770400641 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fad8c005460 con 0x564eafbd2db0 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fada43be740 1 -- 172.21.15.69:0/2770400641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad8c019c90 con 0x564eafbd2db0 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad7eff5640 1 -- 172.21.15.69:0/2770400641 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fad8c031050 con 0x564eafbd2db0 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fada43be740 10 client.15639 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fada43be740 1 -- 172.21.15.69:0/2770400641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564eafbecfc0 con 0x564eafbd2db0 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad7eff5640 1 -- 172.21.15.69:0/2770400641 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fad8c019c90 con 0x564eafbd2db0 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fad7eff5640 1 -- 172.21.15.69:0/2770400641 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fad8c0198f0 con 0x564eafbd2db0 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fada43be740 10 client.15639 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fada43be740 10 client.15639 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fada43be740 20 client.15639 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fada43be740 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x564eafbef3d0 0x564eafbf0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fada43be740 4 client.15639 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.550+0000 7fada43be740 1 -- 172.21.15.69:0/2770400641 --> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564eafb46670 con 0x564eafbef3d0 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.551+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x564eafbef3d0 0x564eafbf0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.551+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x564eafbef3d0 0x564eafbf0840 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f3166c3abe01d6f server_cookie=2547bab37b467bed in_seq=0 out_seq=0 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.551+0000 7fad7eff5640 10 client.15639 ms_handle_connect on v2:172.21.15.167:6836/1671189160 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fad7eff5640 1 -- 172.21.15.69:0/2770400641 <== mds.1 v2:172.21.15.167:6836/1671189160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564eafb46670 con 0x564eafbef3d0 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fad7eff5640 10 client.15639 handle_command_reply: tid=0 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 1 client.15639 shutdown 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 1 -- 172.21.15.69:0/2770400641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 msgr2=0x564eafbdacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbdacc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fad8c018c50 tx=0x7fad8c018c80 comp rx=0 tx=0).stop 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 1 -- 172.21.15.69:0/2770400641 shutdown_connections 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x564eafbef3d0 0x564eafbf0840 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbdddd0 0x564eafbdb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fad7eff5640 0 client.15639 ms_handle_reset on v2:172.21.15.167:6836/1671189160 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd3760 0x564eafbdb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 1 --2- 172.21.15.69:0/2770400641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbdacc0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 1 -- 172.21.15.69:0/2770400641 >> 172.21.15.69:0/2770400641 conn(0x564eafbcf070 msgr2=0x564eafbd4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 1 -- 172.21.15.69:0/2770400641 shutdown_connections 2024-04-23T10:27:02.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 1 -- 172.21.15.69:0/2770400641 wait complete. 2024-04-23T10:27:02.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.552+0000 7fada43be740 20 client.15639 trim_cache size 0 max 16384 2024-04-23T10:27:02.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fada43be740 1 Processor -- start 2024-04-23T10:27:02.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fada43be740 1 -- start start 2024-04-23T10:27:02.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fada43be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd2db0 0x564eafbee3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fada43be740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 0x564eafbd5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fada43be740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbdddd0 0x564eafbd9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fada43be740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564eafbeeb80 con 0x564eafbdddd0 2024-04-23T10:27:02.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fada43be740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564eafbef250 con 0x564eafbd3760 2024-04-23T10:27:02.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fada43be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564eafbef920 con 0x564eafbd2db0 2024-04-23T10:27:02.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbdddd0 0x564eafbd9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbdddd0 0x564eafbd9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49264/0 (socket says 172.21.15.69:49264) 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9b7fe640 1 -- 172.21.15.69:0/1227783981 learned_addr learned my addr 172.21.15.69:0/1227783981 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9affd640 1 --2- 172.21.15.69:0/1227783981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd2db0 0x564eafbee3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/1227783981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 0x564eafbd5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9b7fe640 1 -- 172.21.15.69:0/1227783981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd2db0 msgr2=0x564eafbee3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9b7fe640 1 --2- 172.21.15.69:0/1227783981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd2db0 0x564eafbee3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9b7fe640 1 -- 172.21.15.69:0/1227783981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 msgr2=0x564eafbd5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9b7fe640 1 --2- 172.21.15.69:0/1227783981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 0x564eafbd5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9b7fe640 1 -- 172.21.15.69:0/1227783981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eafbd5a60 con 0x564eafbdddd0 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9affd640 1 --2- 172.21.15.69:0/1227783981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd2db0 0x564eafbee3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/1227783981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 0x564eafbd5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad9b7fe640 1 --2- 172.21.15.69:0/1227783981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbdddd0 0x564eafbd9ca0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fad940140c0 tx=0x7fad94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48091d89fcc17861 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad80ff9640 1 -- 172.21.15.69:0/1227783981 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad94024070 con 0x564eafbdddd0 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad80ff9640 1 -- 172.21.15.69:0/1227783981 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fad94012b20 con 0x564eafbdddd0 2024-04-23T10:27:02.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.570+0000 7fad80ff9640 1 -- 172.21.15.69:0/1227783981 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad94020b20 con 0x564eafbdddd0 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.571+0000 7fada43be740 1 -- 172.21.15.69:0/1227783981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbdddd0 msgr2=0x564eafbd9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.571+0000 7fada43be740 1 --2- 172.21.15.69:0/1227783981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbdddd0 0x564eafbd9ca0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fad940140c0 tx=0x7fad94017000 comp rx=0 tx=0).stop 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.571+0000 7fada43be740 1 -- 172.21.15.69:0/1227783981 shutdown_connections 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.571+0000 7fada43be740 1 --2- 172.21.15.69:0/1227783981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbdddd0 0x564eafbd9ca0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.571+0000 7fada43be740 1 --2- 172.21.15.69:0/1227783981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 0x564eafbd5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.571+0000 7fada43be740 1 --2- 172.21.15.69:0/1227783981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbd2db0 0x564eafbee3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.571+0000 7fada43be740 1 -- 172.21.15.69:0/1227783981 >> 172.21.15.69:0/1227783981 conn(0x564eafbcf070 msgr2=0x564eafbd9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.571+0000 7fada43be740 1 -- 172.21.15.69:0/1227783981 shutdown_connections 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.571+0000 7fada43be740 1 -- 172.21.15.69:0/1227783981 wait complete. 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.571+0000 7fada43be740 1 -- start start 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.571+0000 7fada43be740 1 Processor -- start 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fada43be740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbf8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fada43be740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 0x564eafbf8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fada43be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbdddd0 0x564eafbf1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fada43be740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564eafbf06c0 con 0x564eafbd2db0 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fada43be740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564eafbefff0 con 0x564eafbd3760 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fada43be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564eafbf0d90 con 0x564eafbdddd0 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fada43be740 10 client.0 _ll_register_callbacks cb 0x7fad90005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbf8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbf8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49266/0 (socket says 172.21.15.69:49266) 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9affd640 1 -- 172.21.15.69:0/558707169 learned_addr learned my addr 172.21.15.69:0/558707169 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9b7fe640 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbdddd0 0x564eafbf1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 0x564eafbf8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9affd640 1 -- 172.21.15.69:0/558707169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbdddd0 msgr2=0x564eafbf1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9affd640 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbdddd0 0x564eafbf1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9affd640 1 -- 172.21.15.69:0/558707169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 msgr2=0x564eafbf8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9affd640 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 0x564eafbf8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9affd640 1 -- 172.21.15.69:0/558707169 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eafbf2560 con 0x564eafbd2db0 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 0x564eafbf8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad9affd640 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbf8910 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009800 tx=0x7fad8c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2926b8ffb5dce5dd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad7eff5640 1 -- 172.21.15.69:0/558707169 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c026070 con 0x564eafbd2db0 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad7eff5640 1 -- 172.21.15.69:0/558707169 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fad8c004910 con 0x564eafbd2db0 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fada43be740 1 -- 172.21.15.69:0/558707169 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad94012b20 con 0x564eafbd2db0 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fad7eff5640 1 -- 172.21.15.69:0/558707169 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fad8c011d10 con 0x564eafbd2db0 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fada43be740 10 client.15645 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.572+0000 7fada43be740 1 -- 172.21.15.69:0/558707169 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564eafbf6e50 con 0x564eafbd2db0 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.573+0000 7fad7eff5640 1 -- 172.21.15.69:0/558707169 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fad94012b20 con 0x564eafbd2db0 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.573+0000 7fad7eff5640 1 -- 172.21.15.69:0/558707169 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fad8c005470 con 0x564eafbd2db0 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.573+0000 7fada43be740 10 client.15645 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.573+0000 7fada43be740 10 client.15645 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.573+0000 7fada43be740 20 client.15645 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:02.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.573+0000 7fada43be740 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x564eafc599d0 0x564eafc586e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.573+0000 7fada43be740 4 client.15645 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.573+0000 7fada43be740 1 -- 172.21.15.69:0/558707169 --> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] -- command(tid 0: {"prefix": "status"}) -- 0x564eafb404e0 con 0x564eafc599d0 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.573+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x564eafc599d0 0x564eafc586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.573+0000 7fad7eff5640 10 client.15645 ms_handle_connect on v2:172.21.15.167:6836/1671189160 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.573+0000 7fad9a7fc640 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x564eafc599d0 0x564eafc586e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d66159bc4912d261 server_cookie=f74ced3959a4ceed in_seq=0 out_seq=0 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fad7eff5640 1 -- 172.21.15.69:0/558707169 <== mds.1 v2:172.21.15.167:6836/1671189160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x564eafb404e0 con 0x564eafc599d0 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fad7eff5640 10 client.15645 handle_command_reply: tid=0 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 1 client.15645 shutdown 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 1 -- 172.21.15.69:0/558707169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 msgr2=0x564eafbf8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbf8910 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009800 tx=0x7fad8c005dc0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 1 -- 172.21.15.69:0/558707169 shutdown_connections 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.167:6836/1671189160,v1:172.21.15.167:6837/1671189160] conn(0x564eafc599d0 0x564eafc586e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eafbdddd0 0x564eafbf1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564eafbd3760 0x564eafbf8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fad7eff5640 0 client.15645 ms_handle_reset on v2:172.21.15.167:6836/1671189160 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 1 --2- 172.21.15.69:0/558707169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564eafbd2db0 0x564eafbf8910 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 1 -- 172.21.15.69:0/558707169 >> 172.21.15.69:0/558707169 conn(0x564eafbcf070 msgr2=0x564eafbe9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 1 -- 172.21.15.69:0/558707169 shutdown_connections 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 1 -- 172.21.15.69:0/558707169 wait complete. 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada43be740 20 client.15645 trim_cache size 0 max 16384 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 1, 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24463, 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:27:02.580 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:27:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 126.737597201, 2024-04-23T10:27:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 26, 2024-04-23T10:27:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 89, 2024-04-23T10:27:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 88, 2024-04-23T10:27:02.581 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 148.433198527 2024-04-23T10:27:02.581 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada15cd640 1 -- 172.21.15.69:0/1615534743 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fad840a3ec0 msgr2=0x7fad840a6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada15cd640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fad840a3ec0 0x7fad840a6380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad94008fd0 tx=0x7fad94014950 comp rx=0 tx=0).stop 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada15cd640 1 -- 172.21.15.69:0/1615534743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad9c107270 msgr2=0x7fad9c19e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada15cd640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad9c107270 0x7fad9c19e930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fad90005940 tx=0x7fad900042f0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada15cd640 1 -- 172.21.15.69:0/1615534743 shutdown_connections 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada15cd640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fad840a3ec0 0x7fad840a6380 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada15cd640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad9c107270 0x7fad9c19e930 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada15cd640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad9c1985f0 0x7fad9c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada15cd640 1 --2- 172.21.15.69:0/1615534743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad9c1021a0 0x7fad9c19e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.574+0000 7fada15cd640 1 -- 172.21.15.69:0/1615534743 >> 172.21.15.69:0/1615534743 conn(0x7fad9c0fda20 msgr2=0x7fad9c0fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.575+0000 7fada15cd640 1 -- 172.21.15.69:0/1615534743 shutdown_connections 2024-04-23T10:27:02.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.575+0000 7fada15cd640 1 -- 172.21.15.69:0/1615534743 wait complete. 2024-04-23T10:27:02.584 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-23T10:27:02.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.684+0000 7fac462fa640 1 -- 172.21.15.69:0/2175990085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac40107250 msgr2=0x7fac4010ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.684+0000 7fac462fa640 1 --2- 172.21.15.69:0/2175990085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac40107250 0x7fac4010ee20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fac38009ca0 tx=0x7fac3802a8c0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.684+0000 7fac462fa640 1 -- 172.21.15.69:0/2175990085 shutdown_connections 2024-04-23T10:27:02.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.684+0000 7fac462fa640 1 --2- 172.21.15.69:0/2175990085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac40107250 0x7fac4010ee20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.684+0000 7fac462fa640 1 --2- 172.21.15.69:0/2175990085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac40102b30 0x7fac40106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.684+0000 7fac462fa640 1 --2- 172.21.15.69:0/2175990085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac40102180 0x7fac40102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.684+0000 7fac462fa640 1 -- 172.21.15.69:0/2175990085 >> 172.21.15.69:0/2175990085 conn(0x7fac400792d0 msgr2=0x7fac400796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.684+0000 7fac462fa640 1 -- 172.21.15.69:0/2175990085 shutdown_connections 2024-04-23T10:27:02.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.684+0000 7fac462fa640 1 -- 172.21.15.69:0/2175990085 wait complete. 2024-04-23T10:27:02.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.684+0000 7fac462fa640 1 Processor -- start 2024-04-23T10:27:02.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac462fa640 1 -- start start 2024-04-23T10:27:02.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac462fa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac40102180 0x7fac401a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac462fa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac40107250 0x7fac401a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac462fa640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac4019a7e0 0x7fac4019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac462fa640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fac40112350 con 0x7fac4019a7e0 2024-04-23T10:27:02.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac462fa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fac401121d0 con 0x7fac40107250 2024-04-23T10:27:02.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac462fa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fac401124d0 con 0x7fac40102180 2024-04-23T10:27:02.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac44897640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac4019a7e0 0x7fac4019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac44897640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac4019a7e0 0x7fac4019ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49282/0 (socket says 172.21.15.69:49282) 2024-04-23T10:27:02.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac44897640 1 -- 172.21.15.69:0/2105361799 learned_addr learned my addr 172.21.15.69:0/2105361799 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac40107250 0x7fac401a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac3ffff640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac40102180 0x7fac401a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac44897640 1 -- 172.21.15.69:0/2105361799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac40102180 msgr2=0x7fac401a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac44897640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac40102180 0x7fac401a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac44897640 1 -- 172.21.15.69:0/2105361799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac40107250 msgr2=0x7fac401a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac44897640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac40107250 0x7fac401a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac44897640 1 -- 172.21.15.69:0/2105361799 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4019b370 con 0x7fac4019a7e0 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.685+0000 7fac44897640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac4019a7e0 0x7fac4019ac90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fac38005e30 tx=0x7fac38003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.686+0000 7fac3d7fa640 1 -- 172.21.15.69:0/2105361799 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38031650 con 0x7fac4019a7e0 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.686+0000 7fac3d7fa640 1 -- 172.21.15.69:0/2105361799 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac380317f0 con 0x7fac4019a7e0 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.686+0000 7fac462fa640 1 -- 172.21.15.69:0/2105361799 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4019b600 con 0x7fac4019a7e0 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.686+0000 7fac3d7fa640 1 -- 172.21.15.69:0/2105361799 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3802fb70 con 0x7fac4019a7e0 2024-04-23T10:27:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.686+0000 7fac462fa640 1 -- 172.21.15.69:0/2105361799 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac401a77e0 con 0x7fac4019a7e0 2024-04-23T10:27:02.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac3d7fa640 1 -- 172.21.15.69:0/2105361799 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fac3802fd70 con 0x7fac4019a7e0 2024-04-23T10:27:02.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac49011740 1 Processor -- start 2024-04-23T10:27:02.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac49011740 1 -- start start 2024-04-23T10:27:02.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac49011740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44557db0 0x564f44558190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac49011740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f44562800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac49011740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44562dd0 0x564f44565220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac49011740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564f444bdc50 con 0x564f44562dd0 2024-04-23T10:27:02.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac49011740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564f4445a830 con 0x564f44557db0 2024-04-23T10:27:02.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac49011740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564f444b9c10 con 0x564f44558760 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac3d7fa640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fac280a3e40 0x7fac280a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac3f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44562dd0 0x564f44565220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac3f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44562dd0 0x564f44565220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49286/0 (socket says 172.21.15.69:49286) 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac3f7fe640 1 -- 172.21.15.69:0/77170168 learned_addr learned my addr 172.21.15.69:0/77170168 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac3ffff640 1 --2- 172.21.15.69:0/77170168 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f44562800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.688+0000 7fac44897640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fac280a3e40 0x7fac280a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/77170168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44557db0 0x564f44558190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac3d7fa640 1 -- 172.21.15.69:0/2105361799 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fac380f1e00 con 0x7fac4019a7e0 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac3f7fe640 1 -- 172.21.15.69:0/77170168 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 msgr2=0x564f44562800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/77170168 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f44562800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac3f7fe640 1 -- 172.21.15.69:0/77170168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44557db0 msgr2=0x564f44558190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/77170168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44557db0 0x564f44558190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac3f7fe640 1 -- 172.21.15.69:0/77170168 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f441d02d0 con 0x564f44562dd0 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/77170168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44562dd0 0x564f44565220 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fac34012540 tx=0x7fac34005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd52e798267ccaf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac44897640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fac280a3e40 0x7fac280a6300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac380ef570 tx=0x7fac38090780 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac267fc640 1 -- 172.21.15.69:0/77170168 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34004030 con 0x564f44562dd0 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac267fc640 1 -- 172.21.15.69:0/77170168 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac340054f0 con 0x564f44562dd0 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.689+0000 7fac267fc640 1 -- 172.21.15.69:0/77170168 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34004ca0 con 0x564f44562dd0 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 -- 172.21.15.69:0/77170168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44562dd0 msgr2=0x564f44565220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 --2- 172.21.15.69:0/77170168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44562dd0 0x564f44565220 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fac34012540 tx=0x7fac34005c90 comp rx=0 tx=0).stop 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 -- 172.21.15.69:0/77170168 shutdown_connections 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 --2- 172.21.15.69:0/77170168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44562dd0 0x564f44565220 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 --2- 172.21.15.69:0/77170168 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f44562800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 --2- 172.21.15.69:0/77170168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44557db0 0x564f44558190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 -- 172.21.15.69:0/77170168 >> 172.21.15.69:0/77170168 conn(0x564f44554070 msgr2=0x564f44554450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 -- 172.21.15.69:0/77170168 shutdown_connections 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 -- 172.21.15.69:0/77170168 wait complete. 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 -- start start 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 Processor -- start 2024-04-23T10:27:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4455fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f44560240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 0x564f44560780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564f44565d40 con 0x564f44557db0 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564f44458470 con 0x564f44562dd0 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.690+0000 7fac49011740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564f44565ec0 con 0x564f44558760 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac49011740 10 client.0 _ll_register_callbacks cb 0x564f4447df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac3f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4455fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac3f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4455fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49294/0 (socket says 172.21.15.69:49294) 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac3f7fe640 1 -- 172.21.15.69:0/3333231355 learned_addr learned my addr 172.21.15.69:0/3333231355 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac3ffff640 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f44560240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac3f7fe640 1 -- 172.21.15.69:0/3333231355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 msgr2=0x564f44560240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f44560240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac3f7fe640 1 -- 172.21.15.69:0/3333231355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 msgr2=0x564f44560780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 0x564f44560780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac3f7fe640 1 -- 172.21.15.69:0/3333231355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f4429a6b0 con 0x564f44557db0 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac3ffff640 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f44560240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4455fd00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fac34005760 tx=0x7fac340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce45c7f5d582132f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac1f7fe640 1 -- 172.21.15.69:0/3333231355 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34004c80 con 0x564f44557db0 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac1f7fe640 1 -- 172.21.15.69:0/3333231355 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fac34004e20 con 0x564f44557db0 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac49011740 1 -- 172.21.15.69:0/3333231355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac340054f0 con 0x564f44557db0 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac1f7fe640 1 -- 172.21.15.69:0/3333231355 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fac34005020 con 0x564f44557db0 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac49011740 10 client.15657 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.691+0000 7fac49011740 1 -- 172.21.15.69:0/3333231355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564f44572010 con 0x564f44557db0 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.692+0000 7fac1f7fe640 1 -- 172.21.15.69:0/3333231355 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac340054f0 con 0x564f44557db0 2024-04-23T10:27:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.692+0000 7fac1f7fe640 1 -- 172.21.15.69:0/3333231355 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fac3401c020 con 0x564f44557db0 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.692+0000 7fac49011740 10 client.15657 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.692+0000 7fac49011740 10 client.15657 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.692+0000 7fac49011740 20 client.15657 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.692+0000 7fac49011740 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x564f44574370 0x564f445757e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.692+0000 7fac49011740 4 client.15657 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.692+0000 7fac49011740 1 -- 172.21.15.69:0/3333231355 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f444cb670 con 0x564f44574370 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.692+0000 7fac3ffff640 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x564f44574370 0x564f445757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.692+0000 7fac1f7fe640 10 client.15657 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.692+0000 7fac3ffff640 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x564f44574370 0x564f445757e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90128b3aa29d8dbc server_cookie=113bed87a5df52ff in_seq=0 out_seq=0 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac1f7fe640 1 -- 172.21.15.69:0/3333231355 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564f444cb670 con 0x564f44574370 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac1f7fe640 10 client.15657 handle_command_reply: tid=0 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac49011740 1 client.15657 shutdown 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac49011740 1 -- 172.21.15.69:0/3333231355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 msgr2=0x564f4455fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac49011740 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4455fd00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fac34005760 tx=0x7fac340046c0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac49011740 1 -- 172.21.15.69:0/3333231355 shutdown_connections 2024-04-23T10:27:02.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac49011740 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x564f44574370 0x564f445757e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac49011740 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 0x564f44560780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac49011740 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f44560240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac1f7fe640 0 client.15657 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:02.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac49011740 1 --2- 172.21.15.69:0/3333231355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4455fd00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac49011740 1 -- 172.21.15.69:0/3333231355 >> 172.21.15.69:0/3333231355 conn(0x564f44554070 msgr2=0x564f44559ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac49011740 1 -- 172.21.15.69:0/3333231355 shutdown_connections 2024-04-23T10:27:02.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.693+0000 7fac49011740 1 -- 172.21.15.69:0/3333231355 wait complete. 2024-04-23T10:27:02.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.694+0000 7fac49011740 20 client.15657 trim_cache size 0 max 16384 2024-04-23T10:27:02.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.711+0000 7fac49011740 1 Processor -- start 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.711+0000 7fac49011740 1 -- start start 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.711+0000 7fac49011740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44557db0 0x564f4455a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.711+0000 7fac49011740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44558760 0x564f4456e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.711+0000 7fac49011740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 0x564f4457dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.711+0000 7fac49011740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564f44573b20 con 0x564f44558760 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.711+0000 7fac49011740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564f445741f0 con 0x564f44562dd0 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.711+0000 7fac49011740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564f445748c0 con 0x564f44557db0 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.712+0000 7fac3ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44558760 0x564f4456e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.712+0000 7fac3ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44558760 0x564f4456e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49298/0 (socket says 172.21.15.69:49298) 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.712+0000 7fac3ffff640 1 -- 172.21.15.69:0/1837552428 learned_addr learned my addr 172.21.15.69:0/1837552428 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.712+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/1837552428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44557db0 0x564f4455a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.712+0000 7fac3ffff640 1 -- 172.21.15.69:0/1837552428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44557db0 msgr2=0x564f4455a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.712+0000 7fac3ffff640 1 --2- 172.21.15.69:0/1837552428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44557db0 0x564f4455a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.712+0000 7fac3ffff640 1 -- 172.21.15.69:0/1837552428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 msgr2=0x564f4457dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.712+0000 7fac3ffff640 1 --2- 172.21.15.69:0/1837552428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 0x564f4457dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.712+0000 7fac3ffff640 1 -- 172.21.15.69:0/1837552428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f445651c0 con 0x564f44558760 2024-04-23T10:27:02.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.712+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/1837552428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44557db0 0x564f4455a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:02.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac3ffff640 1 --2- 172.21.15.69:0/1837552428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44558760 0x564f4456e820 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x564f44558b40 tx=0x7fac30016430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440f5a02878098a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac25ffb640 1 -- 172.21.15.69:0/1837552428 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30016ad0 con 0x564f44558760 2024-04-23T10:27:02.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac25ffb640 1 -- 172.21.15.69:0/1837552428 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac30016c70 con 0x564f44558760 2024-04-23T10:27:02.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac25ffb640 1 -- 172.21.15.69:0/1837552428 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac300235f0 con 0x564f44558760 2024-04-23T10:27:02.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac49011740 1 -- 172.21.15.69:0/1837552428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44558760 msgr2=0x564f4456e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac49011740 1 --2- 172.21.15.69:0/1837552428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44558760 0x564f4456e820 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x564f44558b40 tx=0x7fac30016430 comp rx=0 tx=0).stop 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac49011740 1 -- 172.21.15.69:0/1837552428 shutdown_connections 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac49011740 1 --2- 172.21.15.69:0/1837552428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44558760 0x564f4456e820 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac49011740 1 --2- 172.21.15.69:0/1837552428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 0x564f4457dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac49011740 1 --2- 172.21.15.69:0/1837552428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44557db0 0x564f4455a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac49011740 1 -- 172.21.15.69:0/1837552428 >> 172.21.15.69:0/1837552428 conn(0x564f44554070 msgr2=0x564f4456e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac49011740 1 -- 172.21.15.69:0/1837552428 shutdown_connections 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.713+0000 7fac49011740 1 -- 172.21.15.69:0/1837552428 wait complete. 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac49011740 1 -- start start 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac49011740 1 Processor -- start 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac49011740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4457d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac49011740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f4457de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac49011740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 0x564f44577cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac49011740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564f44575660 con 0x564f44557db0 2024-04-23T10:27:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac49011740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564f44574f90 con 0x564f44562dd0 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac49011740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564f44575d30 con 0x564f44558760 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac49011740 10 client.0 _ll_register_callbacks cb 0x7fac3000a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac3f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4457d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac3f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4457d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49306/0 (socket says 172.21.15.69:49306) 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac3f7fe640 1 -- 172.21.15.69:0/1783981436 learned_addr learned my addr 172.21.15.69:0/1783981436 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac3f7fe640 1 -- 172.21.15.69:0/1783981436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 msgr2=0x564f4457de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/1783981436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f4457de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac3f7fe640 1 -- 172.21.15.69:0/1783981436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 msgr2=0x564f44577cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/1783981436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 0x564f44577cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.714+0000 7fac3f7fe640 1 -- 172.21.15.69:0/1783981436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f44578520 con 0x564f44557db0 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac3f7fe640 1 --2- 172.21.15.69:0/1783981436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4457d950 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fac34010740 tx=0x7fac34010500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c26a421095e9db server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac1f7fe640 1 -- 172.21.15.69:0/1783981436 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac340053c0 con 0x564f44557db0 2024-04-23T10:27:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac1f7fe640 1 -- 172.21.15.69:0/1783981436 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fac34005560 con 0x564f44557db0 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac49011740 1 -- 172.21.15.69:0/1783981436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac30016c70 con 0x564f44557db0 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac1f7fe640 1 -- 172.21.15.69:0/1783981436 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fac34042050 con 0x564f44557db0 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac49011740 10 client.15663 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac49011740 1 -- 172.21.15.69:0/1783981436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564f445dae80 con 0x564f44557db0 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac1f7fe640 1 -- 172.21.15.69:0/1783981436 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac30016c70 con 0x564f44557db0 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac1f7fe640 1 -- 172.21.15.69:0/1783981436 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fac3401c050 con 0x564f44557db0 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac49011740 10 client.15663 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac49011740 10 client.15663 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac49011740 20 client.15663 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac49011740 1 --2- 172.21.15.69:0/1783981436 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x564f445dfa10 0x564f445de720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac49011740 4 client.15663 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac49011740 1 -- 172.21.15.69:0/1783981436 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "status"}) -- 0x564f444c54e0 con 0x564f445dfa10 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.715+0000 7fac3ffff640 1 --2- 172.21.15.69:0/1783981436 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x564f445dfa10 0x564f445de720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac3ffff640 1 --2- 172.21.15.69:0/1783981436 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x564f445dfa10 0x564f445de720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be2301295fb962b8 server_cookie=b8a1655bf5882b2b in_seq=0 out_seq=0 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac1f7fe640 10 client.15663 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac1f7fe640 1 -- 172.21.15.69:0/1783981436 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564f444c54e0 con 0x564f445dfa10 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac1f7fe640 10 client.15663 handle_command_reply: tid=0 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 1 client.15663 shutdown 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 1 -- 172.21.15.69:0/1783981436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 msgr2=0x564f4457d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 1 --2- 172.21.15.69:0/1783981436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4457d950 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fac34010740 tx=0x7fac34010500 comp rx=0 tx=0).stop 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 1 -- 172.21.15.69:0/1783981436 shutdown_connections 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 1 --2- 172.21.15.69:0/1783981436 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x564f445dfa10 0x564f445de720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 1 --2- 172.21.15.69:0/1783981436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564f44562dd0 0x564f44577cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 1 --2- 172.21.15.69:0/1783981436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f44558760 0x564f4457de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac1f7fe640 0 client.15663 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 1 --2- 172.21.15.69:0/1783981436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f44557db0 0x564f4457d950 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 1 -- 172.21.15.69:0/1783981436 >> 172.21.15.69:0/1783981436 conn(0x564f44554070 msgr2=0x564f4456e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 1 -- 172.21.15.69:0/1783981436 shutdown_connections 2024-04-23T10:27:02.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 1 -- 172.21.15.69:0/1783981436 wait complete. 2024-04-23T10:27:02.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.716+0000 7fac49011740 20 client.15663 trim_cache size 0 max 16384 2024-04-23T10:27:02.722 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:27:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "ac4c3a2c-0159-11ef-bc93-c7b262605968", 2024-04-23T10:27:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2024-04-23T10:27:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24487, 2024-04-23T10:27:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-04-23T10:27:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-04-23T10:27:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-04-23T10:27:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 128.89682249000001, 2024-04-23T10:27:02.722 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 26, 2024-04-23T10:27:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 89, 2024-04-23T10:27:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 88, 2024-04-23T10:27:02.723 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 143.09492159600001 2024-04-23T10:27:02.723 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 -- 172.21.15.69:0/2105361799 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fac280a3e40 msgr2=0x7fac280a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fac280a3e40 0x7fac280a6300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac380ef570 tx=0x7fac38090780 comp rx=0 tx=0).stop 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 -- 172.21.15.69:0/2105361799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac4019a7e0 msgr2=0x7fac4019ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac4019a7e0 0x7fac4019ac90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fac38005e30 tx=0x7fac38003f90 comp rx=0 tx=0).stop 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 -- 172.21.15.69:0/2105361799 shutdown_connections 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fac280a3e40 0x7fac280a6300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac4019a7e0 0x7fac4019ac90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac40107250 0x7fac401a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 --2- 172.21.15.69:0/2105361799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac40102180 0x7fac401a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 -- 172.21.15.69:0/2105361799 >> 172.21.15.69:0/2105361799 conn(0x7fac400792d0 msgr2=0x7fac40100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 -- 172.21.15.69:0/2105361799 shutdown_connections 2024-04-23T10:27:02.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:02.717+0000 7fac462fa640 1 -- 172.21.15.69:0/2105361799 wait complete. 2024-04-23T10:27:02.726 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-23T10:27:03.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:02 smithi167 ceph-mon[32940]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 131 KiB/s wr, 79 op/s 2024-04-23T10:27:03.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:02 smithi167 ceph-mon[32940]: mgrmap e24: x(active, since 8s), standbys: y, z 2024-04-23T10:27:03.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:02 smithi146 ceph-mon[32800]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 131 KiB/s wr, 79 op/s 2024-04-23T10:27:03.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:02 smithi146 ceph-mon[32800]: mgrmap e24: x(active, since 8s), standbys: y, z 2024-04-23T10:27:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:02 smithi069 ceph-mon[29593]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 131 KiB/s wr, 79 op/s 2024-04-23T10:27:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:02 smithi069 ceph-mon[29593]: mgrmap e24: x(active, since 8s), standbys: y, z 2024-04-23T10:27:05.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:05 smithi167 ceph-mon[32940]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-04-23T10:27:05.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:05 smithi146 ceph-mon[32800]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-04-23T10:27:05.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:05 smithi069 ceph-mon[29593]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-04-23T10:27:07.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:07 smithi167 ceph-mon[32940]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 73 op/s 2024-04-23T10:27:07.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:07 smithi146 ceph-mon[32800]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 73 op/s 2024-04-23T10:27:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:07 smithi069 ceph-mon[29593]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 73 op/s 2024-04-23T10:27:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.783+0000 7f8126079640 1 -- 172.21.15.69:0/1285792339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8120101aa0 msgr2=0x7f8120105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.783+0000 7f8126079640 1 --2- 172.21.15.69:0/1285792339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8120101aa0 0x7f8120105a90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8108009900 tx=0x7f810802a410 comp rx=0 tx=0).stop 2024-04-23T10:27:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.783+0000 7f8126079640 1 -- 172.21.15.69:0/1285792339 shutdown_connections 2024-04-23T10:27:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.783+0000 7f8126079640 1 --2- 172.21.15.69:0/1285792339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8120101aa0 0x7f8120105a90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.783+0000 7f8126079640 1 --2- 172.21.15.69:0/1285792339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8120106170 0x7f812010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.783+0000 7f8126079640 1 --2- 172.21.15.69:0/1285792339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81201010f0 0x7f81201014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.783+0000 7f8126079640 1 -- 172.21.15.69:0/1285792339 >> 172.21.15.69:0/1285792339 conn(0x7f8120077fd0 msgr2=0x7f81200783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.783+0000 7f8126079640 1 -- 172.21.15.69:0/1285792339 shutdown_connections 2024-04-23T10:27:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.784+0000 7f8126079640 1 -- 172.21.15.69:0/1285792339 wait complete. 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.784+0000 7f8126079640 1 Processor -- start 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.784+0000 7f8126079640 1 -- start start 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.784+0000 7f8126079640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81201010f0 0x7f812019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.784+0000 7f8126079640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8120106170 0x7f812019e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.784+0000 7f8126079640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8120198630 0x7f8120198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.784+0000 7f8126079640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8120111240 con 0x7f81201010f0 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.784+0000 7f8126079640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f81201110c0 con 0x7f8120198630 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.784+0000 7f8126079640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f81201113c0 con 0x7f8120106170 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81201010f0 0x7f812019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81201010f0 0x7f812019e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49328/0 (socket says 172.21.15.69:49328) 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811f7fe640 1 -- 172.21.15.69:0/540995273 learned_addr learned my addr 172.21.15.69:0/540995273 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811effd640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8120106170 0x7f812019e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811ffff640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8120198630 0x7f8120198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811f7fe640 1 -- 172.21.15.69:0/540995273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8120106170 msgr2=0x7f812019e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811f7fe640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8120106170 0x7f812019e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811f7fe640 1 -- 172.21.15.69:0/540995273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8120198630 msgr2=0x7f8120198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811f7fe640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8120198630 0x7f8120198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811f7fe640 1 -- 172.21.15.69:0/540995273 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8120199150 con 0x7f81201010f0 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811ffff640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8120198630 0x7f8120198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811f7fe640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81201010f0 0x7f812019e430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f811000ea80 tx=0x7f811000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811cff9640 1 -- 172.21.15.69:0/540995273 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811000ce40 con 0x7f81201010f0 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811cff9640 1 -- 172.21.15.69:0/540995273 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8110005020 con 0x7f81201010f0 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f8126079640 1 -- 172.21.15.69:0/540995273 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8120199440 con 0x7f81201010f0 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f811cff9640 1 -- 172.21.15.69:0/540995273 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110011760 con 0x7f81201010f0 2024-04-23T10:27:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.785+0000 7f8126079640 1 -- 172.21.15.69:0/540995273 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81201a55f0 con 0x7f81201010f0 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f811cff9640 1 -- 172.21.15.69:0/540995273 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f81100051d0 con 0x7f81201010f0 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f8128d8f740 1 Processor -- start 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f8128d8f740 1 -- start start 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f811cff9640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f810c0a3ee0 0x7f810c0a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2620 0x56140a5c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5cd800 0x56140a5cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f8128d8f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56140a527970 con 0x56140a5c2f40 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f8128d8f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56140a4c44a0 con 0x56140a5c2620 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f8128d8f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56140a523930 con 0x56140a5cd800 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f811effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f811ffff640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f810c0a3ee0 0x7f810c0a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f811effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49344/0 (socket says 172.21.15.69:49344) 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f811effd640 1 -- 172.21.15.69:0/1699699342 learned_addr learned my addr 172.21.15.69:0/1699699342 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.788+0000 7f811cff9640 1 -- 172.21.15.69:0/540995273 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f81100d0d60 con 0x7f81201010f0 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f811ffff640 1 --2- 172.21.15.69:0/1699699342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5cd800 0x56140a5cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f811f7fe640 1 --2- 172.21.15.69:0/1699699342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2620 0x56140a5c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f811effd640 1 -- 172.21.15.69:0/1699699342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5cd800 msgr2=0x56140a5cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f811effd640 1 --2- 172.21.15.69:0/1699699342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5cd800 0x56140a5cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f811effd640 1 -- 172.21.15.69:0/1699699342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2620 msgr2=0x56140a5c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f811effd640 1 --2- 172.21.15.69:0/1699699342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2620 0x56140a5c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f811effd640 1 -- 172.21.15.69:0/1699699342 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140a23a210 con 0x56140a5c2f40 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f811ffff640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f810c0a3ee0 0x7f810c0a63a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8118005fd0 tx=0x7f81180138e0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f811effd640 1 --2- 172.21.15.69:0/1699699342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5cd2c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8108009900 tx=0x7f8108005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318b23480546c0ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f8115ffb640 1 -- 172.21.15.69:0/1699699342 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108040070 con 0x56140a5c2f40 2024-04-23T10:27:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f8115ffb640 1 -- 172.21.15.69:0/1699699342 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8108004480 con 0x56140a5c2f40 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.789+0000 7f8115ffb640 1 -- 172.21.15.69:0/1699699342 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108035040 con 0x56140a5c2f40 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.790+0000 7f8128d8f740 1 -- 172.21.15.69:0/1699699342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 msgr2=0x56140a5cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.790+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1699699342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5cd2c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8108009900 tx=0x7f8108005c00 comp rx=0 tx=0).stop 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.790+0000 7f8128d8f740 1 -- 172.21.15.69:0/1699699342 shutdown_connections 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.790+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1699699342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5cd2c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.790+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1699699342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5cd800 0x56140a5cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.790+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1699699342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2620 0x56140a5c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.790+0000 7f8128d8f740 1 -- 172.21.15.69:0/1699699342 >> 172.21.15.69:0/1699699342 conn(0x56140a5beb30 msgr2=0x56140a5bef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.790+0000 7f8128d8f740 1 -- 172.21.15.69:0/1699699342 shutdown_connections 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.790+0000 7f8128d8f740 1 -- 172.21.15.69:0/1699699342 wait complete. 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.790+0000 7f8128d8f740 1 -- start start 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.790+0000 7f8128d8f740 1 Processor -- start 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2620 0x56140a5cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2f40 0x56140a5ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f8128d8f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56140a5d03d0 con 0x56140a5cd800 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f8128d8f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56140a4c20b0 con 0x56140a5c2f40 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f8128d8f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56140a5d0550 con 0x56140a5c2620 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f8128d8f740 10 client.0 _ll_register_callbacks cb 0x56140a4afd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f811ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f811ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49360/0 (socket says 172.21.15.69:49360) 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f811ffff640 1 -- 172.21.15.69:0/2557632955 learned_addr learned my addr 172.21.15.69:0/2557632955 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f811f7fe640 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2620 0x56140a5cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f811effd640 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2f40 0x56140a5ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f811ffff640 1 -- 172.21.15.69:0/2557632955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2620 msgr2=0x56140a5cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f811ffff640 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2620 0x56140a5cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f811ffff640 1 -- 172.21.15.69:0/2557632955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2f40 msgr2=0x56140a5ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f811ffff640 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2f40 0x56140a5ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f811ffff640 1 -- 172.21.15.69:0/2557632955 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56140a306620 con 0x56140a5cd800 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f811ffff640 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5ca950 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f81180116d0 tx=0x7f8118004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3cef8442318da3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f80feffd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f80feffd640 1 -- 172.21.15.69:0/2557632955 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8118024030 con 0x56140a5cd800 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f80feffd640 1 -- 172.21.15.69:0/2557632955 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f811801f710 con 0x56140a5cd800 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.791+0000 7f8128d8f740 1 -- 172.21.15.69:0/2557632955 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8108004480 con 0x56140a5cd800 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f80feffd640 1 -- 172.21.15.69:0/2557632955 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f811801f910 con 0x56140a5cd800 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f8128d8f740 10 client.15675 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f8128d8f740 1 -- 172.21.15.69:0/2557632955 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56140a5dc2b0 con 0x56140a5cd800 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f80feffd640 1 -- 172.21.15.69:0/2557632955 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8108004480 con 0x56140a5cd800 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f80feffd640 1 -- 172.21.15.69:0/2557632955 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8118032c70 con 0x56140a5cd800 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f8128d8f740 10 client.15675 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f8128d8f740 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:27:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f8128d8f740 20 client.15675 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f8128d8f740 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x56140a5dd720 0x56140a5dfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f8128d8f740 4 client.15675 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f8128d8f740 1 -- 172.21.15.69:0/2557632955 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56140a535390 con 0x56140a5dd720 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.792+0000 7f811f7fe640 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x56140a5dd720 0x56140a5dfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.793+0000 7f811f7fe640 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x56140a5dd720 0x56140a5dfb70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccaea14c0707e669 server_cookie=ab2a8f11c1860c52 in_seq=0 out_seq=0 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.793+0000 7f80feffd640 10 client.15675 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.793+0000 7f80feffd640 1 -- 172.21.15.69:0/2557632955 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56140a535390 con 0x56140a5dd720 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.793+0000 7f80feffd640 10 client.15675 handle_command_reply: tid=0 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.793+0000 7f8128d8f740 1 client.15675 shutdown 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f8128d8f740 1 -- 172.21.15.69:0/2557632955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 msgr2=0x56140a5ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f8128d8f740 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5ca950 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f81180116d0 tx=0x7f8118004730 comp rx=0 tx=0).stop 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f8128d8f740 1 -- 172.21.15.69:0/2557632955 shutdown_connections 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f8128d8f740 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x56140a5dd720 0x56140a5dfb70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f8128d8f740 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5ca950 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f8128d8f740 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2f40 0x56140a5ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f80feffd640 0 client.15675 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f8128d8f740 1 --2- 172.21.15.69:0/2557632955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2620 0x56140a5cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f8128d8f740 1 -- 172.21.15.69:0/2557632955 >> 172.21.15.69:0/2557632955 conn(0x56140a5beb30 msgr2=0x56140a5c48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f8128d8f740 1 -- 172.21.15.69:0/2557632955 shutdown_connections 2024-04-23T10:27:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f8128d8f740 1 -- 172.21.15.69:0/2557632955 wait complete. 2024-04-23T10:27:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.794+0000 7f8128d8f740 20 client.15675 trim_cache size 0 max 16384 2024-04-23T10:27:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.808+0000 7f8128d8f740 1 Processor -- start 2024-04-23T10:27:08.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f8128d8f740 1 -- start start 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2620 0x56140a5d9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5e54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5cd800 0x56140a5e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f8128d8f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f81201adb00 con 0x56140a5c2f40 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f8128d8f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f81201af640 con 0x56140a5cd800 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f8128d8f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f81201ae1d0 con 0x56140a5c2620 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f811effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5e54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f811effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5e54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49376/0 (socket says 172.21.15.69:49376) 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f811effd640 1 -- 172.21.15.69:0/1519884509 learned_addr learned my addr 172.21.15.69:0/1519884509 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f811ffff640 1 --2- 172.21.15.69:0/1519884509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5cd800 0x56140a5e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f811effd640 1 -- 172.21.15.69:0/1519884509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2620 msgr2=0x56140a5d9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f811effd640 1 --2- 172.21.15.69:0/1519884509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2620 0x56140a5d9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f811effd640 1 -- 172.21.15.69:0/1519884509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5cd800 msgr2=0x56140a5e5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f811effd640 1 --2- 172.21.15.69:0/1519884509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5cd800 0x56140a5e5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f811effd640 1 -- 172.21.15.69:0/1519884509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56140a5c6030 con 0x56140a5c2f40 2024-04-23T10:27:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f811ffff640 1 --2- 172.21.15.69:0/1519884509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5cd800 0x56140a5e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f811effd640 1 --2- 172.21.15.69:0/1519884509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5e54d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8108009900 tx=0x7f8108005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7997ac09c63cec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f81157fa640 1 -- 172.21.15.69:0/1519884509 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108035070 con 0x56140a5c2f40 2024-04-23T10:27:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f81157fa640 1 -- 172.21.15.69:0/1519884509 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f810804d070 con 0x56140a5c2f40 2024-04-23T10:27:08.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.809+0000 7f81157fa640 1 -- 172.21.15.69:0/1519884509 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108040040 con 0x56140a5c2f40 2024-04-23T10:27:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.810+0000 7f8128d8f740 1 -- 172.21.15.69:0/1519884509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 msgr2=0x56140a5e54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.810+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1519884509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5e54d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8108009900 tx=0x7f8108005850 comp rx=0 tx=0).stop 2024-04-23T10:27:08.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.810+0000 7f8128d8f740 1 -- 172.21.15.69:0/1519884509 shutdown_connections 2024-04-23T10:27:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.810+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1519884509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5c2f40 0x56140a5e54d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.810+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1519884509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5cd800 0x56140a5e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.810+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1519884509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2620 0x56140a5d9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.810+0000 7f8128d8f740 1 -- 172.21.15.69:0/1519884509 >> 172.21.15.69:0/1519884509 conn(0x56140a5beb30 msgr2=0x56140a5bd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.810+0000 7f8128d8f740 1 -- 172.21.15.69:0/1519884509 shutdown_connections 2024-04-23T10:27:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.810+0000 7f8128d8f740 1 -- 172.21.15.69:0/1519884509 wait complete. 2024-04-23T10:27:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.810+0000 7f8128d8f740 1 -- start start 2024-04-23T10:27:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f8128d8f740 1 Processor -- start 2024-04-23T10:27:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2620 0x56140a5d32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2f40 0x56140a5d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f8128d8f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5d3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f8128d8f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f81201aef70 con 0x56140a5cd800 2024-04-23T10:27:08.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f8128d8f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f81201ae8a0 con 0x56140a5c2620 2024-04-23T10:27:08.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f8128d8f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f81201abae0 con 0x56140a5c2f40 2024-04-23T10:27:08.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f8128d8f740 10 client.0 _ll_register_callbacks cb 0x7f81180114a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:08.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5d3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5d3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49382/0 (socket says 172.21.15.69:49382) 2024-04-23T10:27:08.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811ffff640 1 -- 172.21.15.69:0/1833869435 learned_addr learned my addr 172.21.15.69:0/1833869435 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:08.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811f7fe640 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2620 0x56140a5d32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811effd640 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2f40 0x56140a5d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811ffff640 1 -- 172.21.15.69:0/1833869435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2f40 msgr2=0x56140a5d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811ffff640 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2f40 0x56140a5d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811ffff640 1 -- 172.21.15.69:0/1833869435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2620 msgr2=0x56140a5d32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811ffff640 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2620 0x56140a5d32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811ffff640 1 -- 172.21.15.69:0/1833869435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56140a647260 con 0x56140a5cd800 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811f7fe640 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2620 0x56140a5d32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f811ffff640 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5d3d60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f811800b5c0 tx=0x7f811800b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c14327793d0619 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.811+0000 7f80feffd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f80feffd640 1 -- 172.21.15.69:0/1833869435 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8118024040 con 0x56140a5cd800 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f80feffd640 1 -- 172.21.15.69:0/1833869435 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f811800b8f0 con 0x56140a5cd800 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f8128d8f740 1 -- 172.21.15.69:0/1833869435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f810804d070 con 0x56140a5cd800 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f80feffd640 1 -- 172.21.15.69:0/1833869435 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f811802b740 con 0x56140a5cd800 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f8128d8f740 10 client.15681 fetch_fsmap learned FSMap version 26 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f8128d8f740 1 -- 172.21.15.69:0/1833869435 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56140a6484e0 con 0x56140a5cd800 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f80feffd640 1 -- 172.21.15.69:0/1833869435 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f810804d070 con 0x56140a5cd800 2024-04-23T10:27:08.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f80feffd640 1 -- 172.21.15.69:0/1833869435 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8118032450 con 0x56140a5cd800 2024-04-23T10:27:08.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f8128d8f740 10 client.15681 fetch_fsmap finished waiting for FSMap version 26 2024-04-23T10:27:08.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f8128d8f740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:27:08.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f8128d8f740 20 client.15681 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:08.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x56140a648b90 0x56140a64afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:08.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f8128d8f740 4 client.15681 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:27:08.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f8128d8f740 1 -- 172.21.15.69:0/1833869435 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56140a52f200 con 0x56140a648b90 2024-04-23T10:27:08.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.812+0000 7f811f7fe640 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x56140a648b90 0x56140a64afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:08.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.813+0000 7f80feffd640 10 client.15681 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:08.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.813+0000 7f811f7fe640 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x56140a648b90 0x56140a64afb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ff8d8b614d46ab4 server_cookie=48e9c4843323ab8b in_seq=0 out_seq=0 2024-04-23T10:27:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f80feffd640 1 -- 172.21.15.69:0/1833869435 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56140a52f200 con 0x56140a648b90 2024-04-23T10:27:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f80feffd640 10 client.15681 handle_command_reply: tid=0 2024-04-23T10:27:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 1 client.15681 shutdown 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 1 -- 172.21.15.69:0/1833869435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 msgr2=0x56140a5d3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5d3d60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f811800b5c0 tx=0x7f811800b5f0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 1 -- 172.21.15.69:0/1833869435 shutdown_connections 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x56140a648b90 0x56140a64afb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56140a5cd800 0x56140a5d3d60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56140a5c2f40 0x56140a5d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f80feffd640 0 client.15681 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 1 --2- 172.21.15.69:0/1833869435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56140a5c2620 0x56140a5d32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 1 -- 172.21.15.69:0/1833869435 >> 172.21.15.69:0/1833869435 conn(0x56140a5beb30 msgr2=0x56140a5bdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 1 -- 172.21.15.69:0/1833869435 shutdown_connections 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 1 -- 172.21.15.69:0/1833869435 wait complete. 2024-04-23T10:27:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.826+0000 7f8128d8f740 20 client.15681 trim_cache size 0 max 16384 2024-04-23T10:27:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:27:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:27:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:27:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:27:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 -- 172.21.15.69:0/540995273 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f810c0a3ee0 msgr2=0x7f810c0a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f810c0a3ee0 0x7f810c0a63a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8118005fd0 tx=0x7f81180138e0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 -- 172.21.15.69:0/540995273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81201010f0 msgr2=0x7f812019e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81201010f0 0x7f812019e430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f811000ea80 tx=0x7f811000ef40 comp rx=0 tx=0).stop 2024-04-23T10:27:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 -- 172.21.15.69:0/540995273 shutdown_connections 2024-04-23T10:27:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f810c0a3ee0 0x7f810c0a63a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8120198630 0x7f8120198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8120106170 0x7f812019e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 --2- 172.21.15.69:0/540995273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81201010f0 0x7f812019e430 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 -- 172.21.15.69:0/540995273 >> 172.21.15.69:0/540995273 conn(0x7f8120077fd0 msgr2=0x7f8120069880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 -- 172.21.15.69:0/540995273 shutdown_connections 2024-04-23T10:27:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:08.827+0000 7f8126079640 1 -- 172.21.15.69:0/540995273 wait complete. 2024-04-23T10:27:09.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:09 smithi167 ceph-mon[32940]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 66 op/s 2024-04-23T10:27:09.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:09 smithi146 ceph-mon[32800]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 66 op/s 2024-04-23T10:27:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:09 smithi069 ceph-mon[29593]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 66 op/s 2024-04-23T10:27:11.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:11 smithi167 ceph-mon[32940]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 100 KiB/s wr, 68 op/s 2024-04-23T10:27:11.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:11 smithi146 ceph-mon[32800]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 100 KiB/s wr, 68 op/s 2024-04-23T10:27:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:11 smithi069 ceph-mon[29593]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 100 KiB/s wr, 68 op/s 2024-04-23T10:27:13.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:13 smithi167 ceph-mon[32940]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 65 KiB/s wr, 47 op/s 2024-04-23T10:27:13.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:13 smithi146 ceph-mon[32800]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 65 KiB/s wr, 47 op/s 2024-04-23T10:27:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:13 smithi069 ceph-mon[29593]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 65 KiB/s wr, 47 op/s 2024-04-23T10:27:15.294 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:15 smithi069 ceph-mon[29593]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 29 op/s 2024-04-23T10:27:15.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:15 smithi167 ceph-mon[32940]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 29 op/s 2024-04-23T10:27:15.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:15 smithi146 ceph-mon[32800]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 26 KiB/s wr, 29 op/s 2024-04-23T10:27:16.308 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:16 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:27:16.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:16 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:27:16.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:16 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:27:17.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:17 smithi167 ceph-mon[32940]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 33 op/s 2024-04-23T10:27:17.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:17 smithi146 ceph-mon[32800]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 33 op/s 2024-04-23T10:27:17.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:17 smithi069 ceph-mon[29593]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 33 op/s 2024-04-23T10:27:17.728 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.9 2024-04-23T10:27:17.728 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:27:17.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.830+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/2828567458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a641010a0 msgr2=0x7f9a64101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:17.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.830+0000 7f9a6bbfe640 1 --2- 172.21.15.69:0/2828567458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a641010a0 0x7f9a64101480 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009900 tx=0x7f9a6002a410 comp rx=0 tx=0).stop 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.830+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/2828567458 shutdown_connections 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.830+0000 7f9a6bbfe640 1 --2- 172.21.15.69:0/2828567458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a64106170 0x7f9a6410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.830+0000 7f9a6bbfe640 1 --2- 172.21.15.69:0/2828567458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a64101a50 0x7f9a64105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.830+0000 7f9a6bbfe640 1 --2- 172.21.15.69:0/2828567458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a641010a0 0x7f9a64101480 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.830+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/2828567458 >> 172.21.15.69:0/2828567458 conn(0x7f9a64077f50 msgr2=0x7f9a64078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.830+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/2828567458 shutdown_connections 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.830+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/2828567458 wait complete. 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6bbfe640 1 Processor -- start 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6bbfe640 1 -- start start 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6bbfe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a641010a0 0x7f9a64199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6bbfe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a64106170 0x7f9a64199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6bbfe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a6419a140 0x7f9a641a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6bbfe640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64111210 con 0x7f9a641010a0 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6bbfe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64111090 con 0x7f9a64106170 2024-04-23T10:27:17.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6bbfe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64111390 con 0x7f9a6419a140 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6999a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a641010a0 0x7f9a64199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6999a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a641010a0 0x7f9a64199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55468/0 (socket says 172.21.15.69:55468) 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6999a640 1 -- 172.21.15.69:0/1876904161 learned_addr learned my addr 172.21.15.69:0/1876904161 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.831+0000 7f9a6a19b640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a6419a140 0x7f9a641a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a6999a640 1 -- 172.21.15.69:0/1876904161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a6419a140 msgr2=0x7f9a641a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a69199640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a64106170 0x7f9a64199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a6999a640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a6419a140 0x7f9a641a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a6999a640 1 -- 172.21.15.69:0/1876904161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a64106170 msgr2=0x7f9a64199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a6999a640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a64106170 0x7f9a64199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a6999a640 1 -- 172.21.15.69:0/1876904161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a641a4ec0 con 0x7f9a641010a0 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a69199640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a64106170 0x7f9a64199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a6999a640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a641010a0 0x7f9a64199670 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9a60005ab0 tx=0x7f9a600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a5affd640 1 -- 172.21.15.69:0/1876904161 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6003f030 con 0x7f9a641010a0 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a5affd640 1 -- 172.21.15.69:0/1876904161 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9a60003cd0 con 0x7f9a641010a0 2024-04-23T10:27:17.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/1876904161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a641a5150 con 0x7f9a641010a0 2024-04-23T10:27:17.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a5affd640 1 -- 172.21.15.69:0/1876904161 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60035070 con 0x7f9a641010a0 2024-04-23T10:27:17.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.832+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/1876904161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a641a5640 con 0x7f9a641010a0 2024-04-23T10:27:17.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.833+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/1876904161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a64068d70 con 0x7f9a641010a0 2024-04-23T10:27:17.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.835+0000 7f9a5affd640 1 -- 172.21.15.69:0/1876904161 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f9a60042030 con 0x7f9a641010a0 2024-04-23T10:27:17.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.836+0000 7f9a5affd640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f9a500a3e40 0x7f9a500a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:17.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.836+0000 7f9a69199640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f9a500a3e40 0x7f9a500a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:17.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.836+0000 7f9a5affd640 1 -- 172.21.15.69:0/1876904161 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f9a600f1120 con 0x7f9a641010a0 2024-04-23T10:27:17.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.836+0000 7f9a69199640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f9a500a3e40 0x7f9a500a6300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9a64069c30 tx=0x7f9a54005d30 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:17.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:17.839+0000 7f9a5affd640 1 -- 172.21.15.69:0/1876904161 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9a600bd670 con 0x7f9a641010a0 2024-04-23T10:27:18.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.063+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/1876904161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a641093a0 con 0x7f9a641010a0 2024-04-23T10:27:18.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.064+0000 7f9a5affd640 1 -- 172.21.15.69:0/1876904161 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11931 (secure 0 0 0) 0x7f9a600bcf70 con 0x7f9a641010a0 2024-04-23T10:27:18.063 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:27:18.063 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:27:14.627745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24421,24463,24487,24392,24416]},"id":1}]} 2024-04-23T10:27:18.063 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 27 2024-04-23T10:27:18.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/1876904161 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f9a500a3e40 msgr2=0x7f9a500a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:18.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f9a500a3e40 0x7f9a500a6300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9a64069c30 tx=0x7f9a54005d30 comp rx=0 tx=0).stop 2024-04-23T10:27:18.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/1876904161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a641010a0 msgr2=0x7f9a64199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:18.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a641010a0 0x7f9a64199670 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9a60005ab0 tx=0x7f9a600042f0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/1876904161 shutdown_connections 2024-04-23T10:27:18.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f9a500a3e40 0x7f9a500a6300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a6419a140 0x7f9a641a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a64106170 0x7f9a64199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 --2- 172.21.15.69:0/1876904161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a641010a0 0x7f9a64199670 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/1876904161 >> 172.21.15.69:0/1876904161 conn(0x7f9a64077f50 msgr2=0x7f9a640fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:18.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/1876904161 shutdown_connections 2024-04-23T10:27:18.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.066+0000 7f9a6bbfe640 1 -- 172.21.15.69:0/1876904161 wait complete. 2024-04-23T10:27:18.076 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 60 --expiration 81.9 --await-for 42.0' 2024-04-23T10:27:18.076 DEBUG:teuthology.orchestra.run.smithi069:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24487 quiesce db / --timeout 60 --expiration 81.9 --await-for 42.0 2024-04-23T10:27:18.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.189+0000 7f2432776640 1 -- 172.21.15.69:0/2340248181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c101a50 msgr2=0x7f242c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.189+0000 7f2432776640 1 --2- 172.21.15.69:0/2340248181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c101a50 0x7f242c105a90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2420009900 tx=0x7f242002a410 comp rx=0 tx=0).stop 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.189+0000 7f2432776640 1 -- 172.21.15.69:0/2340248181 shutdown_connections 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.189+0000 7f2432776640 1 --2- 172.21.15.69:0/2340248181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c101a50 0x7f242c105a90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.189+0000 7f2432776640 1 --2- 172.21.15.69:0/2340248181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f242c106170 0x7f242c10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.189+0000 7f2432776640 1 --2- 172.21.15.69:0/2340248181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f242c1010a0 0x7f242c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.189+0000 7f2432776640 1 -- 172.21.15.69:0/2340248181 >> 172.21.15.69:0/2340248181 conn(0x7f242c077f50 msgr2=0x7f242c078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.190+0000 7f2432776640 1 -- 172.21.15.69:0/2340248181 shutdown_connections 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.190+0000 7f2432776640 1 -- 172.21.15.69:0/2340248181 wait complete. 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.190+0000 7f2432776640 1 Processor -- start 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.190+0000 7f2432776640 1 -- start start 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.190+0000 7f2432776640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f242c1010a0 0x7f242c19e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.190+0000 7f2432776640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f242c106170 0x7f242c19e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.190+0000 7f2432776640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c1985b0 0x7f242c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.190+0000 7f2432776640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f242c1111f0 con 0x7f242c1985b0 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.190+0000 7f2432776640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f242c111070 con 0x7f242c1010a0 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.190+0000 7f2432776640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f242c111370 con 0x7f242c106170 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f2430d13640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c1985b0 0x7f242c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f2430d13640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c1985b0 0x7f242c198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55474/0 (socket says 172.21.15.69:55474) 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f2430d13640 1 -- 172.21.15.69:0/3289103535 learned_addr learned my addr 172.21.15.69:0/3289103535 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f242bfff640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f242c1010a0 0x7f242c19e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f242b7fe640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f242c106170 0x7f242c19e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f2430d13640 1 -- 172.21.15.69:0/3289103535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f242c106170 msgr2=0x7f242c19e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f2430d13640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f242c106170 0x7f242c19e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f2430d13640 1 -- 172.21.15.69:0/3289103535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f242c1010a0 msgr2=0x7f242c19e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f2430d13640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f242c1010a0 0x7f242c19e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f2430d13640 1 -- 172.21.15.69:0/3289103535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242c1990d0 con 0x7f242c1985b0 2024-04-23T10:27:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f2430d13640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c1985b0 0x7f242c198a60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f242400eaa0 tx=0x7f242400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:18.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f24297fa640 1 -- 172.21.15.69:0/3289103535 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424004d20 con 0x7f242c1985b0 2024-04-23T10:27:18.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f2432776640 1 -- 172.21.15.69:0/3289103535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f242c1993c0 con 0x7f242c1985b0 2024-04-23T10:27:18.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f24297fa640 1 -- 172.21.15.69:0/3289103535 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2424005020 con 0x7f242c1985b0 2024-04-23T10:27:18.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f24297fa640 1 -- 172.21.15.69:0/3289103535 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24240116b0 con 0x7f242c1985b0 2024-04-23T10:27:18.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.191+0000 7f2432776640 1 -- 172.21.15.69:0/3289103535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f242c1a5660 con 0x7f242c1985b0 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.194+0000 7f24297fa640 1 -- 172.21.15.69:0/3289103535 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f24240051d0 con 0x7f242c1985b0 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.194+0000 7f243556d740 1 Processor -- start 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.194+0000 7f243556d740 1 -- start start 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.194+0000 7f243556d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x562784991480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.194+0000 7f243556d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627849919c0 0x56278499bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.194+0000 7f243556d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56278499c090 0x56278499e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.194+0000 7f243556d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5627848f6370 con 0x56278499c090 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.194+0000 7f243556d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5627848932e0 con 0x5627849919c0 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f243556d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5627848f2330 con 0x5627849910a0 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56278499c090 0x56278499e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56278499c090 0x56278499e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55478/0 (socket says 172.21.15.69:55478) 2024-04-23T10:27:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242b7fe640 1 -- 172.21.15.69:0/846495663 learned_addr learned my addr 172.21.15.69:0/846495663 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242bfff640 1 --2- 172.21.15.69:0/846495663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627849919c0 0x56278499bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242b7fe640 1 --2- 172.21.15.69:0/846495663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x562784991480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242b7fe640 1 -- 172.21.15.69:0/846495663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 msgr2=0x562784991480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242b7fe640 1 --2- 172.21.15.69:0/846495663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x562784991480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242b7fe640 1 -- 172.21.15.69:0/846495663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627849919c0 msgr2=0x56278499bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242b7fe640 1 --2- 172.21.15.69:0/846495663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627849919c0 0x56278499bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242b7fe640 1 -- 172.21.15.69:0/846495663 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627846d4d80 con 0x56278499c090 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242bfff640 1 --2- 172.21.15.69:0/846495663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627849919c0 0x56278499bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f24297fa640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f24140a3e40 0x7f24140a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242b7fe640 1 --2- 172.21.15.69:0/846495663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56278499c090 0x56278499e480 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f242c06b6f0 tx=0x7f2420005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2137f14c3aa64957 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f242bfff640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f24140a3e40 0x7f24140a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f24297fa640 1 -- 172.21.15.69:0/3289103535 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f24240d0c10 con 0x7f242c1985b0 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f24127fc640 1 -- 172.21.15.69:0/846495663 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420035040 con 0x56278499c090 2024-04-23T10:27:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f24127fc640 1 -- 172.21.15.69:0/846495663 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2420004030 con 0x56278499c090 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.195+0000 7f24127fc640 1 -- 172.21.15.69:0/846495663 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420003bd0 con 0x56278499c090 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.196+0000 7f243556d740 1 -- 172.21.15.69:0/846495663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56278499c090 msgr2=0x56278499e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.196+0000 7f242bfff640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f24140a3e40 0x7f24140a6300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x562784992660 tx=0x7f241c00a2d0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.196+0000 7f243556d740 1 --2- 172.21.15.69:0/846495663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56278499c090 0x56278499e480 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f242c06b6f0 tx=0x7f2420005b50 comp rx=0 tx=0).stop 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.196+0000 7f243556d740 1 -- 172.21.15.69:0/846495663 shutdown_connections 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.196+0000 7f243556d740 1 --2- 172.21.15.69:0/846495663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56278499c090 0x56278499e480 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.196+0000 7f243556d740 1 --2- 172.21.15.69:0/846495663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627849919c0 0x56278499bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.196+0000 7f243556d740 1 --2- 172.21.15.69:0/846495663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x562784991480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.196+0000 7f243556d740 1 -- 172.21.15.69:0/846495663 >> 172.21.15.69:0/846495663 conn(0x56278498d3c0 msgr2=0x56278498d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.196+0000 7f243556d740 1 -- 172.21.15.69:0/846495663 shutdown_connections 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.196+0000 7f243556d740 1 -- 172.21.15.69:0/846495663 wait complete. 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.196+0000 7f243556d740 1 -- start start 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f243556d740 1 Processor -- start 2024-04-23T10:27:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f243556d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x5627849990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f243556d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x5627849995e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f243556d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56278499c090 0x562784999b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f243556d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56278499ee20 con 0x5627849919c0 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f243556d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562784890fb0 con 0x56278499c090 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f243556d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56278499efa0 con 0x5627849910a0 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f243556d740 10 client.0 _ll_register_callbacks cb 0x5627848909a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f242b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x5627849995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f242b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x5627849995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55490/0 (socket says 172.21.15.69:55490) 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f242b7fe640 1 -- 172.21.15.69:0/4007536762 learned_addr learned my addr 172.21.15.69:0/4007536762 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f2430d13640 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56278499c090 0x562784999b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f242b7fe640 1 -- 172.21.15.69:0/4007536762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 msgr2=0x5627849990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f242bfff640 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x5627849990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f242b7fe640 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x5627849990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f242b7fe640 1 -- 172.21.15.69:0/4007536762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56278499c090 msgr2=0x562784999b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f242b7fe640 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56278499c090 0x562784999b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.197+0000 7f242b7fe640 1 -- 172.21.15.69:0/4007536762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562784735510 con 0x5627849919c0 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f242b7fe640 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x5627849995e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2420005e90 tx=0x7f2420003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6b2630018560b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f240b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f240b7fe640 1 -- 172.21.15.69:0/4007536762 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420050060 con 0x5627849919c0 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f240b7fe640 1 -- 172.21.15.69:0/4007536762 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f2420031820 con 0x5627849919c0 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f243556d740 1 -- 172.21.15.69:0/4007536762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2420004030 con 0x5627849919c0 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f240b7fe640 1 -- 172.21.15.69:0/4007536762 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2420035070 con 0x5627849919c0 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f243556d740 10 client.15699 fetch_fsmap learned FSMap version 27 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f243556d740 1 -- 172.21.15.69:0/4007536762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5627845c8670 con 0x5627849919c0 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f240b7fe640 1 -- 172.21.15.69:0/4007536762 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2420004030 con 0x5627849919c0 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f240b7fe640 1 -- 172.21.15.69:0/4007536762 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f242003a040 con 0x5627849919c0 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f243556d740 10 client.15699 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f243556d740 10 client.15699 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:27:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f243556d740 20 client.15699 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f243556d740 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5627849ac2d0 0x5627849ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f243556d740 4 client.15699 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.198+0000 7f243556d740 1 -- 172.21.15.69:0/4007536762 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562784903d90 con 0x5627849ac2d0 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.199+0000 7f242bfff640 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5627849ac2d0 0x5627849ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.199+0000 7f240b7fe640 10 client.15699 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.199+0000 7f242bfff640 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5627849ac2d0 0x5627849ae6c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6af7dda3c244b4e server_cookie=111391a6f330e271 in_seq=0 out_seq=0 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f240b7fe640 1 -- 172.21.15.69:0/4007536762 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562784903d90 con 0x5627849ac2d0 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f240b7fe640 10 client.15699 handle_command_reply: tid=0 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 1 client.15699 shutdown 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 1 -- 172.21.15.69:0/4007536762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 msgr2=0x5627849995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x5627849995e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2420005e90 tx=0x7f2420003730 comp rx=0 tx=0).stop 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 1 -- 172.21.15.69:0/4007536762 shutdown_connections 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5627849ac2d0 0x5627849ae6c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x5627849995e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56278499c090 0x562784999b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 1 --2- 172.21.15.69:0/4007536762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x5627849990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 1 -- 172.21.15.69:0/4007536762 >> 172.21.15.69:0/4007536762 conn(0x56278498d3c0 msgr2=0x5627849931c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f240b7fe640 0 client.15699 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 1 -- 172.21.15.69:0/4007536762 shutdown_connections 2024-04-23T10:27:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 1 -- 172.21.15.69:0/4007536762 wait complete. 2024-04-23T10:27:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.200+0000 7f243556d740 20 client.15699 trim_cache size 0 max 16384 2024-04-23T10:27:18.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.219+0000 7f243556d740 1 Processor -- start 2024-04-23T10:27:18.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.219+0000 7f243556d740 1 -- start start 2024-04-23T10:27:18.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.219+0000 7f243556d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x562784997fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.219+0000 7f243556d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x562784993910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.219+0000 7f243556d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56278499c090 0x5627849b1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.219+0000 7f243556d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f242c1adb90 con 0x5627849919c0 2024-04-23T10:27:18.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.219+0000 7f243556d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f242c1af700 con 0x56278499c090 2024-04-23T10:27:18.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f243556d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f242c1ae260 con 0x5627849910a0 2024-04-23T10:27:18.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f242b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x562784993910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f242b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x562784993910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55498/0 (socket says 172.21.15.69:55498) 2024-04-23T10:27:18.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f242b7fe640 1 -- 172.21.15.69:0/2416441056 learned_addr learned my addr 172.21.15.69:0/2416441056 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f242bfff640 1 --2- 172.21.15.69:0/2416441056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x562784997fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f2430d13640 1 --2- 172.21.15.69:0/2416441056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56278499c090 0x5627849b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f242b7fe640 1 -- 172.21.15.69:0/2416441056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 msgr2=0x562784997fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f242b7fe640 1 --2- 172.21.15.69:0/2416441056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x562784997fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f242b7fe640 1 -- 172.21.15.69:0/2416441056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56278499c090 msgr2=0x5627849b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f242b7fe640 1 --2- 172.21.15.69:0/2416441056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56278499c090 0x5627849b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f242b7fe640 1 -- 172.21.15.69:0/2416441056 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562784993e50 con 0x5627849919c0 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f242b7fe640 1 --2- 172.21.15.69:0/2416441056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x562784993910 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2420009900 tx=0x7f2420005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3071e4c6c8feab84 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f2411ffb640 1 -- 172.21.15.69:0/2416441056 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420050070 con 0x5627849919c0 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f2411ffb640 1 -- 172.21.15.69:0/2416441056 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2420055950 con 0x5627849919c0 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.220+0000 7f2411ffb640 1 -- 172.21.15.69:0/2416441056 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242003dd00 con 0x5627849919c0 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.221+0000 7f243556d740 1 -- 172.21.15.69:0/2416441056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 msgr2=0x562784993910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.221+0000 7f243556d740 1 --2- 172.21.15.69:0/2416441056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x562784993910 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2420009900 tx=0x7f2420005b50 comp rx=0 tx=0).stop 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.221+0000 7f243556d740 1 -- 172.21.15.69:0/2416441056 shutdown_connections 2024-04-23T10:27:18.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.221+0000 7f243556d740 1 --2- 172.21.15.69:0/2416441056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849919c0 0x562784993910 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.221+0000 7f243556d740 1 --2- 172.21.15.69:0/2416441056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56278499c090 0x5627849b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.221+0000 7f243556d740 1 --2- 172.21.15.69:0/2416441056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627849910a0 0x562784997fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.221+0000 7f243556d740 1 -- 172.21.15.69:0/2416441056 >> 172.21.15.69:0/2416441056 conn(0x56278498d3c0 msgr2=0x5627849a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.221+0000 7f243556d740 1 -- 172.21.15.69:0/2416441056 shutdown_connections 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.221+0000 7f243556d740 1 -- 172.21.15.69:0/2416441056 wait complete. 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.221+0000 7f243556d740 1 -- start start 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f243556d740 1 Processor -- start 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f243556d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849910a0 0x5627849aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f243556d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627849919c0 0x5627849af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f243556d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56278499c090 0x5627849afa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f243556d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f242c1af000 con 0x5627849910a0 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f243556d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f242c1ae930 con 0x5627849919c0 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f243556d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f242c1abb70 con 0x56278499c090 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f243556d740 10 client.0 _ll_register_callbacks cb 0x7f24200035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:18.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f242bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849910a0 0x5627849aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f242bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849910a0 0x5627849aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55500/0 (socket says 172.21.15.69:55500) 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f242bfff640 1 -- 172.21.15.69:0/275163762 learned_addr learned my addr 172.21.15.69:0/275163762 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f242b7fe640 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627849919c0 0x5627849af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f2430d13640 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56278499c090 0x5627849afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f242bfff640 1 -- 172.21.15.69:0/275163762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56278499c090 msgr2=0x5627849afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f242bfff640 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56278499c090 0x5627849afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f242bfff640 1 -- 172.21.15.69:0/275163762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627849919c0 msgr2=0x5627849af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f242bfff640 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627849919c0 0x5627849af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f242bfff640 1 -- 172.21.15.69:0/275163762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562784a11700 con 0x5627849910a0 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f242bfff640 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849910a0 0x5627849aef90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f241c01b410 tx=0x7f241c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ae4571fdeb1772 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.222+0000 7f240b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f240b7fe640 1 -- 172.21.15.69:0/275163762 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c01bd30 con 0x5627849910a0 2024-04-23T10:27:18.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f240b7fe640 1 -- 172.21.15.69:0/275163762 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f241c029070 con 0x5627849910a0 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f243556d740 1 -- 172.21.15.69:0/275163762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2420055950 con 0x5627849910a0 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f240b7fe640 1 -- 172.21.15.69:0/275163762 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f241c029270 con 0x5627849910a0 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f243556d740 10 client.15705 fetch_fsmap learned FSMap version 27 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f243556d740 1 -- 172.21.15.69:0/275163762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562784a12a20 con 0x5627849910a0 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f240b7fe640 1 -- 172.21.15.69:0/275163762 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2420055950 con 0x5627849910a0 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f240b7fe640 1 -- 172.21.15.69:0/275163762 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f241c032a50 con 0x5627849910a0 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f243556d740 10 client.15705 fetch_fsmap finished waiting for FSMap version 27 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f243556d740 10 client.15705 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f243556d740 20 client.15705 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f243556d740 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562784a131f0 0x562784a15610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f243556d740 4 client.15705 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.9, "await_for": 42.0}] 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f243556d740 1 -- 172.21.15.69:0/275163762 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.9, "await_for": 42.0}) -- 0x5627848fdc00 con 0x562784a131f0 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.223+0000 7f242b7fe640 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562784a131f0 0x562784a15610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:18.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.224+0000 7f242b7fe640 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562784a131f0 0x562784a15610 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d188e6f79fc9a3a server_cookie=d1373ae23d1c5411 in_seq=0 out_seq=0 2024-04-23T10:27:18.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.224+0000 7f240b7fe640 10 client.15705 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f240b7fe640 1 -- 172.21.15.69:0/275163762 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5627848fdc00 con 0x562784a131f0 2024-04-23T10:27:18.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f240b7fe640 10 client.15705 handle_command_reply: tid=0 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 1 client.15705 shutdown 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 1 -- 172.21.15.69:0/275163762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849910a0 msgr2=0x5627849aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849910a0 0x5627849aef90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f241c01b410 tx=0x7f241c0046c0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 1 -- 172.21.15.69:0/275163762 shutdown_connections 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562784a131f0 0x562784a15610 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56278499c090 0x5627849afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5627849919c0 0x5627849af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 1 --2- 172.21.15.69:0/275163762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5627849910a0 0x5627849aef90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 1 -- 172.21.15.69:0/275163762 >> 172.21.15.69:0/275163762 conn(0x56278498d3c0 msgr2=0x56278499a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f240b7fe640 0 client.15705 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 1 -- 172.21.15.69:0/275163762 shutdown_connections 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 1 -- 172.21.15.69:0/275163762 wait complete. 2024-04-23T10:27:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.232+0000 7f243556d740 20 client.15705 trim_cache size 0 max 16384 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 27, 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: "leader": 24487, 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: "set_version": 2, 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: "sets": { 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: "85f25a17": { 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: "version": 2, 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: "age_ref": 0.0, 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "QUIESCED", 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:27:18.233 INFO:teuthology.orchestra.run.smithi069.stdout: "timeout": 60.0, 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: "expiration": 81.9, 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: "members": { 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: "file:/": { 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: "excluded": false, 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "QUIESCED", 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:27:18.234 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:27:18.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 -- 172.21.15.69:0/3289103535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f24140a3e40 msgr2=0x7f24140a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:18.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f24140a3e40 0x7f24140a6300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x562784992660 tx=0x7f241c00a2d0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 -- 172.21.15.69:0/3289103535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c1985b0 msgr2=0x7f242c198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:18.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c1985b0 0x7f242c198a60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f242400eaa0 tx=0x7f242400eea0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 -- 172.21.15.69:0/3289103535 shutdown_connections 2024-04-23T10:27:18.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f24140a3e40 0x7f24140a6300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c1985b0 0x7f242c198a60 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f242c106170 0x7f242c19e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 --2- 172.21.15.69:0/3289103535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f242c1010a0 0x7f242c19e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:18.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 -- 172.21.15.69:0/3289103535 >> 172.21.15.69:0/3289103535 conn(0x7f242c077f50 msgr2=0x7f242c0693c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:18.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 -- 172.21.15.69:0/3289103535 shutdown_connections 2024-04-23T10:27:18.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:18.233+0000 7f2432776640 1 -- 172.21.15.69:0/3289103535 wait complete. 2024-04-23T10:27:18.243 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '85f25a17', quiesce took 0.5 seconds. Will release after: 21.9 2024-04-23T10:27:19.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:19 smithi167 ceph-mon[32940]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-04-23T10:27:19.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:19 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1876904161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:19.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:19 smithi146 ceph-mon[32800]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-04-23T10:27:19.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:19 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1876904161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:19.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:19 smithi069 ceph-mon[29593]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-04-23T10:27:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:19 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1876904161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:21.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:21 smithi167 ceph-mon[32940]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-04-23T10:27:21.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:21 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:27:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:21 smithi146 ceph-mon[32800]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-04-23T10:27:21.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:21 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:27:21.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:21 smithi069 ceph-mon[29593]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-04-23T10:27:21.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:21 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:27:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.913+0000 7f3f15320640 1 -- 172.21.15.69:0/369032335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f10106170 msgr2=0x7f3f1010dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.913+0000 7f3f15320640 1 --2- 172.21.15.69:0/369032335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f10106170 0x7f3f1010dd40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009ca0 tx=0x7f3f0802a8c0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.913+0000 7f3f15320640 1 -- 172.21.15.69:0/369032335 shutdown_connections 2024-04-23T10:27:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.913+0000 7f3f15320640 1 --2- 172.21.15.69:0/369032335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f10106170 0x7f3f1010dd40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.913+0000 7f3f15320640 1 --2- 172.21.15.69:0/369032335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f10101aa0 0x7f3f10105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.913+0000 7f3f15320640 1 --2- 172.21.15.69:0/369032335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f101010f0 0x7f3f101014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.913+0000 7f3f15320640 1 -- 172.21.15.69:0/369032335 >> 172.21.15.69:0/369032335 conn(0x7f3f10077fd0 msgr2=0x7f3f100783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.913+0000 7f3f15320640 1 -- 172.21.15.69:0/369032335 shutdown_connections 2024-04-23T10:27:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.913+0000 7f3f15320640 1 -- 172.21.15.69:0/369032335 wait complete. 2024-04-23T10:27:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.913+0000 7f3f15320640 1 Processor -- start 2024-04-23T10:27:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f15320640 1 -- start start 2024-04-23T10:27:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f15320640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f101010f0 0x7f3f101995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f15320640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f10106170 0x7f3f10199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f15320640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1019a0a0 0x7f3f101a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f15320640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3f10111270 con 0x7f3f101010f0 2024-04-23T10:27:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f15320640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101110f0 con 0x7f3f10106170 2024-04-23T10:27:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f15320640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101113f0 con 0x7f3f1019a0a0 2024-04-23T10:27:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f101010f0 0x7f3f101995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0effd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f101010f0 0x7f3f101995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60200/0 (socket says 172.21.15.69:60200) 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0effd640 1 -- 172.21.15.69:0/3361222627 learned_addr learned my addr 172.21.15.69:0/3361222627 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0e7fc640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f10106170 0x7f3f10199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0effd640 1 -- 172.21.15.69:0/3361222627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1019a0a0 msgr2=0x7f3f101a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0f7fe640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1019a0a0 0x7f3f101a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0effd640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1019a0a0 0x7f3f101a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0effd640 1 -- 172.21.15.69:0/3361222627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f10106170 msgr2=0x7f3f10199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0effd640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f10106170 0x7f3f10199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0effd640 1 -- 172.21.15.69:0/3361222627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f101a4e20 con 0x7f3f101010f0 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0e7fc640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f10106170 0x7f3f10199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.914+0000 7f3f0effd640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f101010f0 0x7f3f101995d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000d950 tx=0x7f3f0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.915+0000 7f3ef7fff640 1 -- 172.21.15.69:0/3361222627 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00017070 con 0x7f3f101010f0 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.915+0000 7f3f15320640 1 -- 172.21.15.69:0/3361222627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f101a5110 con 0x7f3f101010f0 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.915+0000 7f3ef7fff640 1 -- 172.21.15.69:0/3361222627 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3f00009c30 con 0x7f3f101010f0 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.915+0000 7f3ef7fff640 1 -- 172.21.15.69:0/3361222627 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000f6b0 con 0x7f3f101010f0 2024-04-23T10:27:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.915+0000 7f3f15320640 1 -- 172.21.15.69:0/3361222627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f101a5660 con 0x7f3f101010f0 2024-04-23T10:27:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.917+0000 7f3ef7fff640 1 -- 172.21.15.69:0/3361222627 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f3f000109c0 con 0x7f3f101010f0 2024-04-23T10:27:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.917+0000 7f3f18037740 1 Processor -- start 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f18037740 1 -- start start 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3ef7fff640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3ef80a3ee0 0x7f3ef80a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f18037740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63b620 0x55dd2e63ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f18037740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e6462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f0f7fe640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3ef80a3ee0 0x7f3ef80a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f18037740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e646800 0x55dd2e648bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f18037740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dd2e5a0970 con 0x55dd2e63bf40 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f18037740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dd2e53d4a0 con 0x55dd2e646800 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f18037740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dd2e59c930 con 0x55dd2e63b620 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3ef7fff640 1 -- 172.21.15.69:0/3361222627 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f3f000d0770 con 0x7f3f101010f0 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f0e7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e6462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f0e7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e6462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60212/0 (socket says 172.21.15.69:60212) 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f0e7fc640 1 -- 172.21.15.69:0/3389018161 learned_addr learned my addr 172.21.15.69:0/3389018161 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f0e7fc640 1 -- 172.21.15.69:0/3389018161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63b620 msgr2=0x55dd2e63ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f0e7fc640 1 --2- 172.21.15.69:0/3389018161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63b620 0x55dd2e63ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f0e7fc640 1 -- 172.21.15.69:0/3389018161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e646800 msgr2=0x55dd2e648bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f0e7fc640 1 --2- 172.21.15.69:0/3389018161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e646800 0x55dd2e648bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f0e7fc640 1 -- 172.21.15.69:0/3389018161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd2e2b3210 con 0x55dd2e63bf40 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f0f7fe640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3ef80a3ee0 0x7f3ef80a63a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3f08006010 tx=0x7f3f080093f0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.918+0000 7f3f0e7fc640 1 --2- 172.21.15.69:0/3389018161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e6462c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400a9a0 tx=0x7f3f0400ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb83e801f41a909 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3ef57fa640 1 -- 172.21.15.69:0/3389018161 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04015070 con 0x55dd2e63bf40 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3ef57fa640 1 -- 172.21.15.69:0/3389018161 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3f0400cb80 con 0x55dd2e63bf40 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3ef57fa640 1 -- 172.21.15.69:0/3389018161 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f040105b0 con 0x55dd2e63bf40 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3f18037740 1 -- 172.21.15.69:0/3389018161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 msgr2=0x55dd2e6462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3f18037740 1 --2- 172.21.15.69:0/3389018161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e6462c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400a9a0 tx=0x7f3f0400ae60 comp rx=0 tx=0).stop 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3f18037740 1 -- 172.21.15.69:0/3389018161 shutdown_connections 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3f18037740 1 --2- 172.21.15.69:0/3389018161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e6462c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3f18037740 1 --2- 172.21.15.69:0/3389018161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e646800 0x55dd2e648bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3f18037740 1 --2- 172.21.15.69:0/3389018161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63b620 0x55dd2e63ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3f18037740 1 -- 172.21.15.69:0/3389018161 >> 172.21.15.69:0/3389018161 conn(0x55dd2e637b30 msgr2=0x55dd2e637f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3f18037740 1 -- 172.21.15.69:0/3389018161 shutdown_connections 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.919+0000 7f3f18037740 1 -- 172.21.15.69:0/3389018161 wait complete. 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f18037740 1 -- start start 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f18037740 1 Processor -- start 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f18037740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63b620 0x55dd2e646170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f18037740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e643460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f18037740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e646800 0x55dd2e6439c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f18037740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dd2e649430 con 0x55dd2e63bf40 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f18037740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dd2e53b0b0 con 0x55dd2e63b620 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f18037740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dd2e6495b0 con 0x55dd2e646800 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f18037740 10 client.0 _ll_register_callbacks cb 0x55dd2e528d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f0e7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e643460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f0e7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e643460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60216/0 (socket says 172.21.15.69:60216) 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.920+0000 7f3f0e7fc640 1 -- 172.21.15.69:0/2700938276 learned_addr learned my addr 172.21.15.69:0/2700938276 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3f0effd640 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63b620 0x55dd2e646170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3f0f7fe640 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e646800 0x55dd2e6439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3f0e7fc640 1 -- 172.21.15.69:0/2700938276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e646800 msgr2=0x55dd2e6439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3f0e7fc640 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e646800 0x55dd2e6439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3f0e7fc640 1 -- 172.21.15.69:0/2700938276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63b620 msgr2=0x55dd2e646170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3f0e7fc640 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63b620 0x55dd2e646170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3f0e7fc640 1 -- 172.21.15.69:0/2700938276 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd2e37f620 con 0x55dd2e63bf40 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3f0e7fc640 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e643460 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3f04011e40 tx=0x7f3f040113f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e0d8a58dde160a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3ef2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/2700938276 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04024070 con 0x55dd2e63bf40 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/2700938276 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f3f0401e860 con 0x55dd2e63bf40 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3f18037740 1 -- 172.21.15.69:0/2700938276 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f0400cb80 con 0x55dd2e63bf40 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/2700938276 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3f04015040 con 0x55dd2e63bf40 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3f18037740 10 client.15717 fetch_fsmap learned FSMap version 28 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.921+0000 7f3f18037740 1 -- 172.21.15.69:0/2700938276 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd2e655360 con 0x55dd2e63bf40 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.922+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/2700938276 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3f0400cb80 con 0x55dd2e63bf40 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.922+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/2700938276 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3f04028c20 con 0x55dd2e63bf40 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.922+0000 7f3f18037740 10 client.15717 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:27:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.922+0000 7f3f18037740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:27:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.922+0000 7f3f18037740 20 client.15717 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.922+0000 7f3f18037740 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dd2e656cd0 0x55dd2e6590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.922+0000 7f3f18037740 4 client.15717 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.922+0000 7f3f18037740 1 -- 172.21.15.69:0/2700938276 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd2e5ae390 con 0x55dd2e656cd0 2024-04-23T10:27:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.922+0000 7f3f0effd640 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dd2e656cd0 0x55dd2e6590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.923+0000 7f3f0effd640 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dd2e656cd0 0x55dd2e6590f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53794723b07716fb server_cookie=3cf69be3d10f7dbd in_seq=0 out_seq=0 2024-04-23T10:27:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.923+0000 7f3ef2ff5640 10 client.15717 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/2700938276 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dd2e5ae390 con 0x55dd2e656cd0 2024-04-23T10:27:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3ef2ff5640 10 client.15717 handle_command_reply: tid=0 2024-04-23T10:27:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 1 client.15717 shutdown 2024-04-23T10:27:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 1 -- 172.21.15.69:0/2700938276 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 msgr2=0x55dd2e643460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e643460 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3f04011e40 tx=0x7f3f040113f0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 1 -- 172.21.15.69:0/2700938276 shutdown_connections 2024-04-23T10:27:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dd2e656cd0 0x55dd2e6590f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e63bf40 0x55dd2e643460 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e646800 0x55dd2e6439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 1 --2- 172.21.15.69:0/2700938276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63b620 0x55dd2e646170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3ef2ff5640 0 client.15717 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 1 -- 172.21.15.69:0/2700938276 >> 172.21.15.69:0/2700938276 conn(0x55dd2e637b30 msgr2=0x55dd2e63d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 1 -- 172.21.15.69:0/2700938276 shutdown_connections 2024-04-23T10:27:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 1 -- 172.21.15.69:0/2700938276 wait complete. 2024-04-23T10:27:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.924+0000 7f3f18037740 20 client.15717 trim_cache size 0 max 16384 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.938+0000 7f3f18037740 1 Processor -- start 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.938+0000 7f3f18037740 1 -- start start 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f18037740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63b620 0x55dd2e6522f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f18037740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63bf40 0x55dd2e63e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f18037740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e645ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f18037740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101ab930 con 0x55dd2e646800 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f18037740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101ad530 con 0x55dd2e63bf40 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f18037740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101ac000 con 0x55dd2e63b620 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f0f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e645ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f0f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e645ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60224/0 (socket says 172.21.15.69:60224) 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f0f7fe640 1 -- 172.21.15.69:0/2049169791 learned_addr learned my addr 172.21.15.69:0/2049169791 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f0f7fe640 1 -- 172.21.15.69:0/2049169791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63b620 msgr2=0x55dd2e6522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f0effd640 1 --2- 172.21.15.69:0/2049169791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63b620 0x55dd2e6522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f0e7fc640 1 --2- 172.21.15.69:0/2049169791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63bf40 0x55dd2e63e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f0f7fe640 1 --2- 172.21.15.69:0/2049169791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63b620 0x55dd2e6522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f0f7fe640 1 -- 172.21.15.69:0/2049169791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63bf40 msgr2=0x55dd2e63e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f0f7fe640 1 --2- 172.21.15.69:0/2049169791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63bf40 0x55dd2e63e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f0f7fe640 1 -- 172.21.15.69:0/2049169791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd2e649540 con 0x55dd2e646800 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3f0f7fe640 1 --2- 172.21.15.69:0/2049169791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e645ca0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3f08035000 tx=0x7f3f0803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d6680e3b39ea35 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3ef4ff9640 1 -- 172.21.15.69:0/2049169791 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08031e10 con 0x55dd2e646800 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3ef4ff9640 1 -- 172.21.15.69:0/2049169791 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3f0803f070 con 0x55dd2e646800 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.939+0000 7f3ef4ff9640 1 -- 172.21.15.69:0/2049169791 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0802fa30 con 0x55dd2e646800 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.940+0000 7f3f18037740 1 -- 172.21.15.69:0/2049169791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 msgr2=0x55dd2e645ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.940+0000 7f3f18037740 1 --2- 172.21.15.69:0/2049169791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e645ca0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3f08035000 tx=0x7f3f0803d000 comp rx=0 tx=0).stop 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.940+0000 7f3f18037740 1 -- 172.21.15.69:0/2049169791 shutdown_connections 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.940+0000 7f3f18037740 1 --2- 172.21.15.69:0/2049169791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e645ca0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.940+0000 7f3f18037740 1 --2- 172.21.15.69:0/2049169791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63bf40 0x55dd2e63e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.940+0000 7f3f18037740 1 --2- 172.21.15.69:0/2049169791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63b620 0x55dd2e6522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.940+0000 7f3f18037740 1 -- 172.21.15.69:0/2049169791 >> 172.21.15.69:0/2049169791 conn(0x55dd2e637b30 msgr2=0x55dd2e63e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.940+0000 7f3f18037740 1 -- 172.21.15.69:0/2049169791 shutdown_connections 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.940+0000 7f3f18037740 1 -- 172.21.15.69:0/2049169791 wait complete. 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.940+0000 7f3f18037740 1 -- start start 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.940+0000 7f3f18037740 1 Processor -- start 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f18037740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63b620 0x55dd2e64e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f18037740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63bf40 0x55dd2e64ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f18037740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e63f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f18037740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101acda0 con 0x55dd2e646800 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f18037740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101ac6d0 con 0x55dd2e63b620 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f18037740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101a9930 con 0x55dd2e63bf40 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f18037740 10 client.0 _ll_register_callbacks cb 0x7f3f0400c980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f0f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e63f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f0f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e63f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60238/0 (socket says 172.21.15.69:60238) 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f0f7fe640 1 -- 172.21.15.69:0/1775548225 learned_addr learned my addr 172.21.15.69:0/1775548225 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f0effd640 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63b620 0x55dd2e64e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f0f7fe640 1 -- 172.21.15.69:0/1775548225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63bf40 msgr2=0x55dd2e64ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f0f7fe640 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63bf40 0x55dd2e64ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f0f7fe640 1 -- 172.21.15.69:0/1775548225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63b620 msgr2=0x55dd2e64e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f0f7fe640 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63b620 0x55dd2e64e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f0f7fe640 1 -- 172.21.15.69:0/1775548225 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd2e63ff20 con 0x55dd2e646800 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f0f7fe640 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e63f810 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3f0802b0a0 tx=0x7f3f080047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cada1c783fa10340 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3ef2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/1775548225 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08060060 con 0x55dd2e646800 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/1775548225 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f3f08003e00 con 0x55dd2e646800 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.941+0000 7f3f18037740 1 -- 172.21.15.69:0/1775548225 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f0803f070 con 0x55dd2e646800 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/1775548225 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3f080045c0 con 0x55dd2e646800 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3f18037740 10 client.15723 fetch_fsmap learned FSMap version 28 2024-04-23T10:27:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3f18037740 1 -- 172.21.15.69:0/1775548225 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd2e6bcc20 con 0x55dd2e646800 2024-04-23T10:27:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/1775548225 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3f0803f070 con 0x55dd2e646800 2024-04-23T10:27:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/1775548225 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3f08030a80 con 0x55dd2e646800 2024-04-23T10:27:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3f18037740 10 client.15723 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:27:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3f18037740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:27:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3f18037740 20 client.15723 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3f18037740 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dd2e6bd3b0 0x55dd2e6bf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3f18037740 4 client.15723 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:27:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3f18037740 1 -- 172.21.15.69:0/1775548225 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dd2e5a8200 con 0x55dd2e6bd3b0 2024-04-23T10:27:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.942+0000 7f3f0effd640 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dd2e6bd3b0 0x55dd2e6bf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.943+0000 7f3ef2ff5640 10 client.15723 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.943+0000 7f3f0effd640 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dd2e6bd3b0 0x55dd2e6bf7d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=547d843626f136df server_cookie=dc8b70e79b18cdc7 in_seq=0 out_seq=0 2024-04-23T10:27:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3ef2ff5640 1 -- 172.21.15.69:0/1775548225 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dd2e5a8200 con 0x55dd2e6bd3b0 2024-04-23T10:27:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3ef2ff5640 10 client.15723 handle_command_reply: tid=0 2024-04-23T10:27:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 1 client.15723 shutdown 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 1 -- 172.21.15.69:0/1775548225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 msgr2=0x55dd2e63f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e63f810 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3f0802b0a0 tx=0x7f3f080047d0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 1 -- 172.21.15.69:0/1775548225 shutdown_connections 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dd2e6bd3b0 0x55dd2e6bf7d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd2e646800 0x55dd2e63f810 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3ef2ff5640 0 client.15723 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd2e63bf40 0x55dd2e64ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 1 --2- 172.21.15.69:0/1775548225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd2e63b620 0x55dd2e64e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 1 -- 172.21.15.69:0/1775548225 >> 172.21.15.69:0/1775548225 conn(0x55dd2e637b30 msgr2=0x55dd2e63d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 1 -- 172.21.15.69:0/1775548225 shutdown_connections 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 1 -- 172.21.15.69:0/1775548225 wait complete. 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.951+0000 7f3f18037740 20 client.15723 trim_cache size 0 max 16384 2024-04-23T10:27:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:27:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:27:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:27:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:27:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 -- 172.21.15.69:0/3361222627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3ef80a3ee0 msgr2=0x7f3ef80a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3ef80a3ee0 0x7f3ef80a63a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3f08006010 tx=0x7f3f080093f0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 -- 172.21.15.69:0/3361222627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f101010f0 msgr2=0x7f3f101995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f101010f0 0x7f3f101995d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000d950 tx=0x7f3f0000de10 comp rx=0 tx=0).stop 2024-04-23T10:27:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 -- 172.21.15.69:0/3361222627 shutdown_connections 2024-04-23T10:27:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f3ef80a3ee0 0x7f3ef80a63a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1019a0a0 0x7f3f101a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f10106170 0x7f3f10199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 --2- 172.21.15.69:0/3361222627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f101010f0 0x7f3f101995d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 -- 172.21.15.69:0/3361222627 >> 172.21.15.69:0/3361222627 conn(0x7f3f10077fd0 msgr2=0x7f3f100fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 -- 172.21.15.69:0/3361222627 shutdown_connections 2024-04-23T10:27:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:21.952+0000 7f3f15320640 1 -- 172.21.15.69:0/3361222627 wait complete. 2024-04-23T10:27:23.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:23 smithi167 ceph-mon[32940]: pgmap v17: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.4 KiB/s wr, 16 op/s 2024-04-23T10:27:23.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:23 smithi146 ceph-mon[32800]: pgmap v17: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.4 KiB/s wr, 16 op/s 2024-04-23T10:27:23.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:23 smithi069 ceph-mon[29593]: pgmap v17: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.4 KiB/s wr, 16 op/s 2024-04-23T10:27:25.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:25 smithi167 ceph-mon[32940]: pgmap v18: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-04-23T10:27:25.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:25 smithi146 ceph-mon[32800]: pgmap v18: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-04-23T10:27:25.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:25 smithi069 ceph-mon[29593]: pgmap v18: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-04-23T10:27:27.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:27 smithi167 ceph-mon[32940]: pgmap v19: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.0 KiB/s wr, 14 op/s 2024-04-23T10:27:27.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:27 smithi146 ceph-mon[32800]: pgmap v19: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.0 KiB/s wr, 14 op/s 2024-04-23T10:27:27.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:27 smithi069 ceph-mon[29593]: pgmap v19: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.0 KiB/s wr, 14 op/s 2024-04-23T10:27:29.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:29 smithi167 ceph-mon[32940]: pgmap v20: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T10:27:29.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:29 smithi146 ceph-mon[32800]: pgmap v20: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T10:27:29.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:29 smithi069 ceph-mon[29593]: pgmap v20: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T10:27:31.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:31 smithi167 ceph-mon[32940]: pgmap v21: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-04-23T10:27:31.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:31 smithi146 ceph-mon[32800]: pgmap v21: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-04-23T10:27:31.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:31 smithi069 ceph-mon[29593]: pgmap v21: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-04-23T10:27:33.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:33 smithi167 ceph-mon[32940]: pgmap v22: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-04-23T10:27:33.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:33 smithi146 ceph-mon[32800]: pgmap v22: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-04-23T10:27:33.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:33 smithi069 ceph-mon[29593]: pgmap v22: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-04-23T10:27:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.039+0000 7fbcc622a640 1 -- 172.21.15.69:0/4175707982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbcc0103b00 msgr2=0x7fbcc010bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.039+0000 7fbcc622a640 1 --2- 172.21.15.69:0/4175707982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbcc0103b00 0x7fbcc010bfe0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009900 tx=0x7fbcb402a510 comp rx=0 tx=0).stop 2024-04-23T10:27:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.039+0000 7fbcc622a640 1 -- 172.21.15.69:0/4175707982 shutdown_connections 2024-04-23T10:27:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.039+0000 7fbcc622a640 1 --2- 172.21.15.69:0/4175707982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbcc0103b00 0x7fbcc010bfe0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.039+0000 7fbcc622a640 1 --2- 172.21.15.69:0/4175707982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcc010c520 0x7fbcc010e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.039+0000 7fbcc622a640 1 --2- 172.21.15.69:0/4175707982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcc01031e0 0x7fbcc01035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.039+0000 7fbcc622a640 1 -- 172.21.15.69:0/4175707982 >> 172.21.15.69:0/4175707982 conn(0x7fbcc0077fd0 msgr2=0x7fbcc00783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.039+0000 7fbcc622a640 1 -- 172.21.15.69:0/4175707982 shutdown_connections 2024-04-23T10:27:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.039+0000 7fbcc622a640 1 -- 172.21.15.69:0/4175707982 wait complete. 2024-04-23T10:27:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.040+0000 7fbcc622a640 1 Processor -- start 2024-04-23T10:27:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.040+0000 7fbcc622a640 1 -- start start 2024-04-23T10:27:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.040+0000 7fbcc622a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcc01031e0 0x7fbcc019e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.040+0000 7fbcc622a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcc0103b00 0x7fbcc019e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.040+0000 7fbcc622a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbcc010c520 0x7fbcc0198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.040+0000 7fbcc622a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc01122f0 con 0x7fbcc010c520 2024-04-23T10:27:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.040+0000 7fbcc622a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc0112170 con 0x7fbcc01031e0 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.040+0000 7fbcc622a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc0112470 con 0x7fbcc0103b00 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbcc010c520 0x7fbcc0198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbcc010c520 0x7fbcc0198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44976/0 (socket says 172.21.15.69:44976) 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbffff640 1 -- 172.21.15.69:0/3908041144 learned_addr learned my addr 172.21.15.69:0/3908041144 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcc01031e0 0x7fbcc019e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbeffd640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcc0103b00 0x7fbcc019e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbffff640 1 -- 172.21.15.69:0/3908041144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcc0103b00 msgr2=0x7fbcc019e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbffff640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcc0103b00 0x7fbcc019e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbffff640 1 -- 172.21.15.69:0/3908041144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcc01031e0 msgr2=0x7fbcc019e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbffff640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcc01031e0 0x7fbcc019e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbffff640 1 -- 172.21.15.69:0/3908041144 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc0198d90 con 0x7fbcc010c520 2024-04-23T10:27:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbffff640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbcc010c520 0x7fbcc0198610 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800eaa0 tx=0x7fbcb800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbcff9640 1 -- 172.21.15.69:0/3908041144 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb800cdb0 con 0x7fbcc010c520 2024-04-23T10:27:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbcff9640 1 -- 172.21.15.69:0/3908041144 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcb8005020 con 0x7fbcc010c520 2024-04-23T10:27:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcc622a640 1 -- 172.21.15.69:0/3908041144 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc0199080 con 0x7fbcc010c520 2024-04-23T10:27:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcbcff9640 1 -- 172.21.15.69:0/3908041144 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb80116d0 con 0x7fbcc010c520 2024-04-23T10:27:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.041+0000 7fbcc622a640 1 -- 172.21.15.69:0/3908041144 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc01a5320 con 0x7fbcc010c520 2024-04-23T10:27:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.043+0000 7fbcbcff9640 1 -- 172.21.15.69:0/3908041144 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fbcb80051d0 con 0x7fbcc010c520 2024-04-23T10:27:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcbcff9640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbca80a3ee0 0x7fbca80a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcbcff9640 1 -- 172.21.15.69:0/3908041144 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fbcb80d0c00 con 0x7fbcc010c520 2024-04-23T10:27:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbca80a3ee0 0x7fbca80a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcc901a740 1 Processor -- start 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcc901a740 1 -- start start 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4ff620 0x5593cf4ffa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf50a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf50a800 0x5593cf50cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcc901a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5593cf464970 con 0x5593cf4fff40 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcc901a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5593cf4014a0 con 0x5593cf4ff620 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcc901a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5593cf460930 con 0x5593cf50a800 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbca80a3ee0 0x7fbca80a63a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00058c0 tx=0x7fbcb000a250 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcbeffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf50a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcbeffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf50a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44980/0 (socket says 172.21.15.69:44980) 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcbeffd640 1 -- 172.21.15.69:0/4094696912 learned_addr learned my addr 172.21.15.69:0/4094696912 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcbffff640 1 --2- 172.21.15.69:0/4094696912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf50a800 0x5593cf50cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.044+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/4094696912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4ff620 0x5593cf4ffa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.045+0000 7fbcbeffd640 1 -- 172.21.15.69:0/4094696912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf50a800 msgr2=0x5593cf50cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.045+0000 7fbcbeffd640 1 --2- 172.21.15.69:0/4094696912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf50a800 0x5593cf50cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.045+0000 7fbcbeffd640 1 -- 172.21.15.69:0/4094696912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4ff620 msgr2=0x5593cf4ffa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.045+0000 7fbcbeffd640 1 --2- 172.21.15.69:0/4094696912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4ff620 0x5593cf4ffa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.045+0000 7fbcbeffd640 1 -- 172.21.15.69:0/4094696912 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593cf177210 con 0x5593cf4fff40 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.045+0000 7fbcbffff640 1 --2- 172.21.15.69:0/4094696912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf50a800 0x5593cf50cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.045+0000 7fbcbeffd640 1 --2- 172.21.15.69:0/4094696912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf50a2c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009900 tx=0x7fbcb4031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94239cc98b88d23e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.045+0000 7fbca5ffb640 1 -- 172.21.15.69:0/4094696912 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4040070 con 0x5593cf4fff40 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.045+0000 7fbca5ffb640 1 -- 172.21.15.69:0/4094696912 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcb4031710 con 0x5593cf4fff40 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.045+0000 7fbca5ffb640 1 -- 172.21.15.69:0/4094696912 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4035040 con 0x5593cf4fff40 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.046+0000 7fbcc901a740 1 -- 172.21.15.69:0/4094696912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 msgr2=0x5593cf50a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.046+0000 7fbcc901a740 1 --2- 172.21.15.69:0/4094696912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf50a2c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009900 tx=0x7fbcb4031c70 comp rx=0 tx=0).stop 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.046+0000 7fbcc901a740 1 -- 172.21.15.69:0/4094696912 shutdown_connections 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.046+0000 7fbcc901a740 1 --2- 172.21.15.69:0/4094696912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf50a2c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.046+0000 7fbcc901a740 1 --2- 172.21.15.69:0/4094696912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf50a800 0x5593cf50cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.046+0000 7fbcc901a740 1 --2- 172.21.15.69:0/4094696912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4ff620 0x5593cf4ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.046+0000 7fbcc901a740 1 -- 172.21.15.69:0/4094696912 >> 172.21.15.69:0/4094696912 conn(0x5593cf4fbb30 msgr2=0x5593cf4fbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.046+0000 7fbcc901a740 1 -- 172.21.15.69:0/4094696912 shutdown_connections 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.046+0000 7fbcc901a740 1 -- 172.21.15.69:0/4094696912 wait complete. 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.046+0000 7fbcc901a740 1 -- start start 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcc901a740 1 Processor -- start 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4ff620 0x5593cf50a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fff40 0x5593cf5073b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf50a800 0x5593cf5078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcc901a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5593cf50d3d0 con 0x5593cf50a800 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcc901a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5593cf3ff0b0 con 0x5593cf4fff40 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcc901a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5593cf50d550 con 0x5593cf4ff620 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcc901a740 10 client.0 _ll_register_callbacks cb 0x5593cf3ecd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcbffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf50a800 0x5593cf5078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcbffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf50a800 0x5593cf5078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44988/0 (socket says 172.21.15.69:44988) 2024-04-23T10:27:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcbffff640 1 -- 172.21.15.69:0/367453945 learned_addr learned my addr 172.21.15.69:0/367453945 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcbeffd640 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fff40 0x5593cf5073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4ff620 0x5593cf50a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcbffff640 1 -- 172.21.15.69:0/367453945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4ff620 msgr2=0x5593cf50a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcbffff640 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4ff620 0x5593cf50a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcbffff640 1 -- 172.21.15.69:0/367453945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fff40 msgr2=0x5593cf5073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcbffff640 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fff40 0x5593cf5073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcbffff640 1 -- 172.21.15.69:0/367453945 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593cf243620 con 0x5593cf50a800 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbcbffff640 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf50a800 0x5593cf5078f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8099400 tx=0x7fbcb80a0d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce03da0685b1bd30 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.047+0000 7fbc9effd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbc9effd640 1 -- 172.21.15.69:0/367453945 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb801f040 con 0x5593cf50a800 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbc9effd640 1 -- 172.21.15.69:0/367453945 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fbcb80ce6e0 con 0x5593cf50a800 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbcc901a740 1 -- 172.21.15.69:0/367453945 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcb4031710 con 0x5593cf50a800 2024-04-23T10:27:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbc9effd640 1 -- 172.21.15.69:0/367453945 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbcb80bbb40 con 0x5593cf50a800 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbcc901a740 10 client.15735 fetch_fsmap learned FSMap version 28 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbcc901a740 1 -- 172.21.15.69:0/367453945 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5593cf5192c0 con 0x5593cf50a800 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbc9effd640 1 -- 172.21.15.69:0/367453945 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcb4031710 con 0x5593cf50a800 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbc9effd640 1 -- 172.21.15.69:0/367453945 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbcb800f040 con 0x5593cf50a800 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbcc901a740 10 client.15735 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbcc901a740 10 client.15735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbcc901a740 20 client.15735 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbcc901a740 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5593cf51a780 0x5593cf51cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbcc901a740 4 client.15735 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbcc901a740 1 -- 172.21.15.69:0/367453945 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593cf472390 con 0x5593cf51a780 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.048+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5593cf51a780 0x5593cf51cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.049+0000 7fbc9effd640 10 client.15735 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.049+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5593cf51a780 0x5593cf51cbd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eb430dbd5177736 server_cookie=222202c3c53f7d52 in_seq=0 out_seq=0 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.049+0000 7fbc9effd640 1 -- 172.21.15.69:0/367453945 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5593cf472390 con 0x5593cf51a780 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.049+0000 7fbc9effd640 10 client.15735 handle_command_reply: tid=0 2024-04-23T10:27:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.049+0000 7fbcc901a740 1 client.15735 shutdown 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbcc901a740 1 -- 172.21.15.69:0/367453945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf50a800 msgr2=0x5593cf5078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbcc901a740 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf50a800 0x5593cf5078f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8099400 tx=0x7fbcb80a0d30 comp rx=0 tx=0).stop 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbcc901a740 1 -- 172.21.15.69:0/367453945 shutdown_connections 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbcc901a740 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5593cf51a780 0x5593cf51cbd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbcc901a740 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf50a800 0x5593cf5078f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbcc901a740 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fff40 0x5593cf5073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbcc901a740 1 --2- 172.21.15.69:0/367453945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4ff620 0x5593cf50a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbc9effd640 0 client.15735 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbcc901a740 1 -- 172.21.15.69:0/367453945 >> 172.21.15.69:0/367453945 conn(0x5593cf4fbb30 msgr2=0x5593cf5018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbcc901a740 1 -- 172.21.15.69:0/367453945 shutdown_connections 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbcc901a740 1 -- 172.21.15.69:0/367453945 wait complete. 2024-04-23T10:27:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.050+0000 7fbcc901a740 20 client.15735 trim_cache size 0 max 16384 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.064+0000 7fbcc901a740 1 Processor -- start 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.064+0000 7fbcc901a740 1 -- start start 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.064+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fbb30 0x5593cf516290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4ff620 0x5593cf5224e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf522a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcc901a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc01adb60 con 0x5593cf4fff40 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcc901a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc01af760 con 0x5593cf4fbb30 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcc901a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc01ae230 con 0x5593cf4ff620 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf522a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf522a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45002/0 (socket says 172.21.15.69:45002) 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbffff640 1 -- 172.21.15.69:0/3657407584 learned_addr learned my addr 172.21.15.69:0/3657407584 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/3657407584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fbb30 0x5593cf516290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbeffd640 1 --2- 172.21.15.69:0/3657407584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4ff620 0x5593cf5224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbffff640 1 -- 172.21.15.69:0/3657407584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4ff620 msgr2=0x5593cf5224e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbffff640 1 --2- 172.21.15.69:0/3657407584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4ff620 0x5593cf5224e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbffff640 1 -- 172.21.15.69:0/3657407584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fbb30 msgr2=0x5593cf516290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbffff640 1 --2- 172.21.15.69:0/3657407584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fbb30 0x5593cf516290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbffff640 1 -- 172.21.15.69:0/3657407584 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593cf51d250 con 0x5593cf4fff40 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbeffd640 1 --2- 172.21.15.69:0/3657407584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4ff620 0x5593cf5224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbcbffff640 1 --2- 172.21.15.69:0/3657407584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf522a20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800efd0 tx=0x7fbcb8098e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461103faf5f5e606 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbca57fa640 1 -- 172.21.15.69:0/3657407584 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb80ce4e0 con 0x5593cf4fff40 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbca57fa640 1 -- 172.21.15.69:0/3657407584 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcb80ce680 con 0x5593cf4fff40 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.065+0000 7fbca57fa640 1 -- 172.21.15.69:0/3657407584 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8087310 con 0x5593cf4fff40 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.066+0000 7fbcc901a740 1 -- 172.21.15.69:0/3657407584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 msgr2=0x5593cf522a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.066+0000 7fbcc901a740 1 --2- 172.21.15.69:0/3657407584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf522a20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800efd0 tx=0x7fbcb8098e00 comp rx=0 tx=0).stop 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.066+0000 7fbcc901a740 1 -- 172.21.15.69:0/3657407584 shutdown_connections 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.066+0000 7fbcc901a740 1 --2- 172.21.15.69:0/3657407584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4fff40 0x5593cf522a20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.066+0000 7fbcc901a740 1 --2- 172.21.15.69:0/3657407584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4ff620 0x5593cf5224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.066+0000 7fbcc901a740 1 --2- 172.21.15.69:0/3657407584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fbb30 0x5593cf516290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.066+0000 7fbcc901a740 1 -- 172.21.15.69:0/3657407584 >> 172.21.15.69:0/3657407584 conn(0x5593cf507a50 msgr2=0x5593cf4fa420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.066+0000 7fbcc901a740 1 -- 172.21.15.69:0/3657407584 shutdown_connections 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.066+0000 7fbcc901a740 1 -- 172.21.15.69:0/3657407584 wait complete. 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.066+0000 7fbcc901a740 1 -- start start 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcc901a740 1 Processor -- start 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fbb30 0x5593cf512a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4ff620 0x5593cf50fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcc901a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4fff40 0x5593cf5102d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcc901a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc01aefd0 con 0x5593cf4ff620 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcc901a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc01ae900 con 0x5593cf4fbb30 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcc901a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc01abb40 con 0x5593cf4fff40 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcc901a740 10 client.0 _ll_register_callbacks cb 0x7fbcb809c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbeffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4ff620 0x5593cf50fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbeffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4ff620 0x5593cf50fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45018/0 (socket says 172.21.15.69:45018) 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbeffd640 1 -- 172.21.15.69:0/1803057736 learned_addr learned my addr 172.21.15.69:0/1803057736 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbffff640 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4fff40 0x5593cf5102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fbb30 0x5593cf512a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbeffd640 1 -- 172.21.15.69:0/1803057736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4fff40 msgr2=0x5593cf5102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbeffd640 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4fff40 0x5593cf5102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbeffd640 1 -- 172.21.15.69:0/1803057736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fbb30 msgr2=0x5593cf512a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbeffd640 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fbb30 0x5593cf512a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbeffd640 1 -- 172.21.15.69:0/1803057736 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593cf510970 con 0x5593cf4ff620 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fbb30 0x5593cf512a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbcbeffd640 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4ff620 0x5593cf50fd90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009900 tx=0x7fbcb4031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cac903497cf48b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.067+0000 7fbc9effd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbc9effd640 1 -- 172.21.15.69:0/1803057736 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4035070 con 0x5593cf4ff620 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbc9effd640 1 -- 172.21.15.69:0/1803057736 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fbcb4004450 con 0x5593cf4ff620 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbcc901a740 1 -- 172.21.15.69:0/1803057736 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcb80ce680 con 0x5593cf4ff620 2024-04-23T10:27:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbc9effd640 1 -- 172.21.15.69:0/1803057736 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbcb4040040 con 0x5593cf4ff620 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbcc901a740 10 client.15741 fetch_fsmap learned FSMap version 28 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbcc901a740 1 -- 172.21.15.69:0/1803057736 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5593cf585010 con 0x5593cf4ff620 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbc9effd640 1 -- 172.21.15.69:0/1803057736 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcb80ce680 con 0x5593cf4ff620 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbc9effd640 1 -- 172.21.15.69:0/1803057736 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbcb4004bf0 con 0x5593cf4ff620 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbcc901a740 10 client.15741 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbcc901a740 10 client.15741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbcc901a740 20 client.15741 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbcc901a740 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5593cf50a800 0x5593cf5873f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbcc901a740 4 client.15741 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbcc901a740 1 -- 172.21.15.69:0/1803057736 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5593cf46c200 con 0x5593cf50a800 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.068+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5593cf50a800 0x5593cf5873f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.069+0000 7fbc9effd640 10 client.15741 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.069+0000 7fbcbf7fe640 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5593cf50a800 0x5593cf5873f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d4b24f4cba363b4 server_cookie=a81dffeff2a68503 in_seq=0 out_seq=0 2024-04-23T10:27:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.075+0000 7fbc9effd640 1 -- 172.21.15.69:0/1803057736 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5593cf46c200 con 0x5593cf50a800 2024-04-23T10:27:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.075+0000 7fbc9effd640 10 client.15741 handle_command_reply: tid=0 2024-04-23T10:27:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.075+0000 7fbcc901a740 1 client.15741 shutdown 2024-04-23T10:27:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc901a740 1 -- 172.21.15.69:0/1803057736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4ff620 msgr2=0x5593cf50fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc901a740 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4ff620 0x5593cf50fd90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009900 tx=0x7fbcb4031740 comp rx=0 tx=0).stop 2024-04-23T10:27:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc901a740 1 -- 172.21.15.69:0/1803057736 shutdown_connections 2024-04-23T10:27:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc901a740 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5593cf50a800 0x5593cf5873f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc901a740 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593cf4ff620 0x5593cf50fd90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc901a740 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593cf4fff40 0x5593cf5102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbc9effd640 0 client.15741 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc901a740 1 --2- 172.21.15.69:0/1803057736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593cf4fbb30 0x5593cf512a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc901a740 1 -- 172.21.15.69:0/1803057736 >> 172.21.15.69:0/1803057736 conn(0x5593cf507a50 msgr2=0x5593cf4facb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc901a740 1 -- 172.21.15.69:0/1803057736 shutdown_connections 2024-04-23T10:27:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc901a740 1 -- 172.21.15.69:0/1803057736 wait complete. 2024-04-23T10:27:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc901a740 20 client.15741 trim_cache size 0 max 16384 2024-04-23T10:27:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:27:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:27:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:27:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:27:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc622a640 1 -- 172.21.15.69:0/3908041144 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbca80a3ee0 msgr2=0x7fbca80a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc622a640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbca80a3ee0 0x7fbca80a63a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00058c0 tx=0x7fbcb000a250 comp rx=0 tx=0).stop 2024-04-23T10:27:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc622a640 1 -- 172.21.15.69:0/3908041144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbcc010c520 msgr2=0x7fbcc0198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc622a640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbcc010c520 0x7fbcc0198610 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800eaa0 tx=0x7fbcb800ef60 comp rx=0 tx=0).stop 2024-04-23T10:27:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc622a640 1 -- 172.21.15.69:0/3908041144 shutdown_connections 2024-04-23T10:27:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc622a640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbca80a3ee0 0x7fbca80a63a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc622a640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbcc010c520 0x7fbcc0198610 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc622a640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcc0103b00 0x7fbcc019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc622a640 1 --2- 172.21.15.69:0/3908041144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcc01031e0 0x7fbcc019e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.076+0000 7fbcc622a640 1 -- 172.21.15.69:0/3908041144 >> 172.21.15.69:0/3908041144 conn(0x7fbcc0077fd0 msgr2=0x7fbcc00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.077+0000 7fbcc622a640 1 -- 172.21.15.69:0/3908041144 shutdown_connections 2024-04-23T10:27:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:35.077+0000 7fbcc622a640 1 -- 172.21.15.69:0/3908041144 wait complete. 2024-04-23T10:27:35.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:35 smithi167 ceph-mon[32940]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-23T10:27:35.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:35 smithi146 ceph-mon[32800]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-23T10:27:35.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:35 smithi069 ceph-mon[29593]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-23T10:27:37.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:37 smithi167 ceph-mon[32940]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-23T10:27:37.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:37 smithi146 ceph-mon[32800]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-23T10:27:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:37 smithi069 ceph-mon[29593]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-23T10:27:39.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:39 smithi167 ceph-mon[32940]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-23T10:27:39.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:39 smithi146 ceph-mon[32800]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-23T10:27:39.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:39 smithi069 ceph-mon[29593]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-23T10:27:40.143 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:27:40.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.296+0000 7fcb5a831640 1 -- 172.21.15.69:0/2166640551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb54106170 msgr2=0x7fcb5410dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.296+0000 7fcb5a831640 1 --2- 172.21.15.69:0/2166640551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb54106170 0x7fcb5410dd40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009ca0 tx=0x7fcb4c02e990 comp rx=0 tx=0).stop 2024-04-23T10:27:40.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.297+0000 7fcb5a831640 1 -- 172.21.15.69:0/2166640551 shutdown_connections 2024-04-23T10:27:40.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.297+0000 7fcb5a831640 1 --2- 172.21.15.69:0/2166640551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb54106170 0x7fcb5410dd40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.297+0000 7fcb5a831640 1 --2- 172.21.15.69:0/2166640551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb54101a50 0x7fcb54105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.297+0000 7fcb5a831640 1 --2- 172.21.15.69:0/2166640551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb541010a0 0x7fcb54101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.297+0000 7fcb5a831640 1 -- 172.21.15.69:0/2166640551 >> 172.21.15.69:0/2166640551 conn(0x7fcb54077f50 msgr2=0x7fcb54078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:40.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.297+0000 7fcb5a831640 1 -- 172.21.15.69:0/2166640551 shutdown_connections 2024-04-23T10:27:40.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.297+0000 7fcb5a831640 1 -- 172.21.15.69:0/2166640551 wait complete. 2024-04-23T10:27:40.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.297+0000 7fcb5a831640 1 Processor -- start 2024-04-23T10:27:40.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.297+0000 7fcb5a831640 1 -- start start 2024-04-23T10:27:40.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.298+0000 7fcb5a831640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb541010a0 0x7fcb541965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.298+0000 7fcb5a831640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb54106170 0x7fcb54196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.298+0000 7fcb5a831640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb5419aeb0 0x7fcb5419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.298+0000 7fcb5a831640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fcb54110110 con 0x7fcb5419aeb0 2024-04-23T10:27:40.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.298+0000 7fcb5a831640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5410ff90 con 0x7fcb541010a0 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.298+0000 7fcb5a831640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcb54110290 con 0x7fcb54106170 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.298+0000 7fcb58dce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb5419aeb0 0x7fcb5419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.298+0000 7fcb58dce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb5419aeb0 0x7fcb5419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45166/0 (socket says 172.21.15.69:45166) 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.298+0000 7fcb58dce640 1 -- 172.21.15.69:0/2904178191 learned_addr learned my addr 172.21.15.69:0/2904178191 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.298+0000 7fcb53fff640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb541010a0 0x7fcb541965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.298+0000 7fcb537fe640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb54106170 0x7fcb54196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.299+0000 7fcb58dce640 1 -- 172.21.15.69:0/2904178191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb54106170 msgr2=0x7fcb54196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.299+0000 7fcb58dce640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb54106170 0x7fcb54196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.299+0000 7fcb58dce640 1 -- 172.21.15.69:0/2904178191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb541010a0 msgr2=0x7fcb541965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.299+0000 7fcb58dce640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb541010a0 0x7fcb541965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.299+0000 7fcb58dce640 1 -- 172.21.15.69:0/2904178191 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5419b9a0 con 0x7fcb5419aeb0 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.299+0000 7fcb58dce640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb5419aeb0 0x7fcb5419b360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c006010 tx=0x7fcb4c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.299+0000 7fcb517fa640 1 -- 172.21.15.69:0/2904178191 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c04b070 con 0x7fcb5419aeb0 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.299+0000 7fcb5a831640 1 -- 172.21.15.69:0/2904178191 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5419bc30 con 0x7fcb5419aeb0 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.299+0000 7fcb517fa640 1 -- 172.21.15.69:0/2904178191 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcb4c034aa0 con 0x7fcb5419aeb0 2024-04-23T10:27:40.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.299+0000 7fcb517fa640 1 -- 172.21.15.69:0/2904178191 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c038070 con 0x7fcb5419aeb0 2024-04-23T10:27:40.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.299+0000 7fcb5a831640 1 -- 172.21.15.69:0/2904178191 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb541a33f0 con 0x7fcb5419aeb0 2024-04-23T10:27:40.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.302+0000 7fcb5a831640 1 -- 172.21.15.69:0/2904178191 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb54068d70 con 0x7fcb5419aeb0 2024-04-23T10:27:40.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.302+0000 7fcb517fa640 1 -- 172.21.15.69:0/2904178191 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fcb4c04e070 con 0x7fcb5419aeb0 2024-04-23T10:27:40.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.303+0000 7fcb517fa640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fcb3c0a3e40 0x7fcb3c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.303+0000 7fcb53fff640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fcb3c0a3e40 0x7fcb3c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.303+0000 7fcb517fa640 1 -- 172.21.15.69:0/2904178191 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7fcb4c0f5690 con 0x7fcb5419aeb0 2024-04-23T10:27:40.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.304+0000 7fcb53fff640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fcb3c0a3e40 0x7fcb3c0a6300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb44005fd0 tx=0x7fcb4400b590 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:40.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.312+0000 7fcb517fa640 1 -- 172.21.15.69:0/2904178191 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcb4c082ff0 con 0x7fcb5419aeb0 2024-04-23T10:27:40.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.578+0000 7fcb5a831640 1 -- 172.21.15.69:0/2904178191 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb54101a50 con 0x7fcb5419aeb0 2024-04-23T10:27:40.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.579+0000 7fcb517fa640 1 -- 172.21.15.69:0/2904178191 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11937 (secure 0 0 0) 0x7fcb4c043070 con 0x7fcb5419aeb0 2024-04-23T10:27:40.578 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:27:40.578 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:27:19.628098+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/2993393777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2993393777},{"type":"v1","addr":"172.21.15.167:6835","nonce":2993393777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24416,24392,24487,24421,24463]},"id":1}]} 2024-04-23T10:27:40.579 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 28 2024-04-23T10:27:40.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.581+0000 7fcb5a831640 1 -- 172.21.15.69:0/2904178191 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fcb3c0a3e40 msgr2=0x7fcb3c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.581+0000 7fcb5a831640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fcb3c0a3e40 0x7fcb3c0a6300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb44005fd0 tx=0x7fcb4400b590 comp rx=0 tx=0).stop 2024-04-23T10:27:40.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.581+0000 7fcb5a831640 1 -- 172.21.15.69:0/2904178191 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb5419aeb0 msgr2=0x7fcb5419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.581+0000 7fcb5a831640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb5419aeb0 0x7fcb5419b360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c006010 tx=0x7fcb4c003f10 comp rx=0 tx=0).stop 2024-04-23T10:27:40.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.582+0000 7fcb5a831640 1 -- 172.21.15.69:0/2904178191 shutdown_connections 2024-04-23T10:27:40.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.582+0000 7fcb5a831640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fcb3c0a3e40 0x7fcb3c0a6300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.582+0000 7fcb5a831640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb5419aeb0 0x7fcb5419b360 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.582+0000 7fcb5a831640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb54106170 0x7fcb54196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.582+0000 7fcb5a831640 1 --2- 172.21.15.69:0/2904178191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb541010a0 0x7fcb541965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.582+0000 7fcb5a831640 1 -- 172.21.15.69:0/2904178191 >> 172.21.15.69:0/2904178191 conn(0x7fcb54077f50 msgr2=0x7fcb540feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:40.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.582+0000 7fcb5a831640 1 -- 172.21.15.69:0/2904178191 shutdown_connections 2024-04-23T10:27:40.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.582+0000 7fcb5a831640 1 -- 172.21.15.69:0/2904178191 wait complete. 2024-04-23T10:27:40.592 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id 85f25a17 --release --await' 2024-04-23T10:27:40.592 DEBUG:teuthology.orchestra.run.smithi069:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24487 quiesce db --set-id 85f25a17 --release --await 2024-04-23T10:27:40.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.699+0000 7f9344b75640 1 -- 172.21.15.69:0/1670704352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9340103af0 msgr2=0x7f934010bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.699+0000 7f9344b75640 1 --2- 172.21.15.69:0/1670704352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9340103af0 0x7f934010bfd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9334009900 tx=0x7f933402a510 comp rx=0 tx=0).stop 2024-04-23T10:27:40.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.699+0000 7f9344b75640 1 -- 172.21.15.69:0/1670704352 shutdown_connections 2024-04-23T10:27:40.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.699+0000 7f9344b75640 1 --2- 172.21.15.69:0/1670704352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9340103af0 0x7f934010bfd0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.699+0000 7f9344b75640 1 --2- 172.21.15.69:0/1670704352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f934010c510 0x7f934010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.699+0000 7f9344b75640 1 --2- 172.21.15.69:0/1670704352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93401031d0 0x7f93401035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.699+0000 7f9344b75640 1 -- 172.21.15.69:0/1670704352 >> 172.21.15.69:0/1670704352 conn(0x7f9340077f50 msgr2=0x7f9340078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:40.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.699+0000 7f9344b75640 1 -- 172.21.15.69:0/1670704352 shutdown_connections 2024-04-23T10:27:40.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.699+0000 7f9344b75640 1 -- 172.21.15.69:0/1670704352 wait complete. 2024-04-23T10:27:40.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f9344b75640 1 Processor -- start 2024-04-23T10:27:40.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f9344b75640 1 -- start start 2024-04-23T10:27:40.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f9344b75640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93401031d0 0x7f934019e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f9344b75640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9340103af0 0x7f934019e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f9344b75640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f934010c510 0x7f93401985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f9344b75640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f93401122e0 con 0x7f9340103af0 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f9344b75640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9340112160 con 0x7f934010c510 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f9344b75640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9340112460 con 0x7f93401031d0 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f933dd9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9340103af0 0x7f934019e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f933dd9b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9340103af0 0x7f934019e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45182/0 (socket says 172.21.15.69:45182) 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f933dd9b640 1 -- 172.21.15.69:0/3499434091 learned_addr learned my addr 172.21.15.69:0/3499434091 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f933e59c640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93401031d0 0x7f934019e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.700+0000 7f933ed9d640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f934010c510 0x7f93401985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f933e59c640 1 -- 172.21.15.69:0/3499434091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f934010c510 msgr2=0x7f93401985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f933e59c640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f934010c510 0x7f93401985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f933e59c640 1 -- 172.21.15.69:0/3499434091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9340103af0 msgr2=0x7f934019e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f933e59c640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9340103af0 0x7f934019e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f933e59c640 1 -- 172.21.15.69:0/3499434091 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9340198d40 con 0x7f93401031d0 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f933dd9b640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9340103af0 0x7f934019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f933e59c640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93401031d0 0x7f934019e410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f933000c970 tx=0x7f933000ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f932f7fe640 1 -- 172.21.15.69:0/3499434091 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330007bb0 con 0x7f93401031d0 2024-04-23T10:27:40.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f9344b75640 1 -- 172.21.15.69:0/3499434091 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9340199030 con 0x7f93401031d0 2024-04-23T10:27:40.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f9344b75640 1 -- 172.21.15.69:0/3499434091 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93401a52d0 con 0x7f93401031d0 2024-04-23T10:27:40.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f932f7fe640 1 -- 172.21.15.69:0/3499434091 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9330007d50 con 0x7f93401031d0 2024-04-23T10:27:40.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.701+0000 7f932f7fe640 1 -- 172.21.15.69:0/3499434091 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933000f450 con 0x7f93401031d0 2024-04-23T10:27:40.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.704+0000 7f9347885740 1 Processor -- start 2024-04-23T10:27:40.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f9347885740 1 -- start start 2024-04-23T10:27:40.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f932f7fe640 1 -- 172.21.15.69:0/3499434091 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f933000f5f0 con 0x7f93401031d0 2024-04-23T10:27:40.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f9347885740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebcce0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f9347885740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccef350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f9347885740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebccef890 0x55cebccf1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f9347885740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cebcc456d0 con 0x55cebcce0370 2024-04-23T10:27:40.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f9347885740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cebcbe21a0 con 0x55cebccef890 2024-04-23T10:27:40.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f9347885740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cebcc41690 con 0x55cebcce0c90 2024-04-23T10:27:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f933ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebcce0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f933ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebcce0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45190/0 (socket says 172.21.15.69:45190) 2024-04-23T10:27:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f933ed9d640 1 -- 172.21.15.69:0/2597671400 learned_addr learned my addr 172.21.15.69:0/2597671400 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f933e59c640 1 --2- 172.21.15.69:0/2597671400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f933dd9b640 1 --2- 172.21.15.69:0/2597671400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebccef890 0x55cebccf1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.705+0000 7f933ed9d640 1 -- 172.21.15.69:0/2597671400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 msgr2=0x55cebccef350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f933ed9d640 1 --2- 172.21.15.69:0/2597671400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccef350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f933ed9d640 1 -- 172.21.15.69:0/2597671400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebccef890 msgr2=0x55cebccf1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f933ed9d640 1 --2- 172.21.15.69:0/2597671400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebccef890 0x55cebccf1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f933ed9d640 1 -- 172.21.15.69:0/2597671400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cebcbec5b0 con 0x55cebcce0370 2024-04-23T10:27:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f933dd9b640 1 --2- 172.21.15.69:0/2597671400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebccef890 0x55cebccf1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:27:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f932f7fe640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f93280a3e40 0x7f93280a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f933e59c640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f93280a3e40 0x7f93280a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f933ed9d640 1 --2- 172.21.15.69:0/2597671400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebcce0750 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9338009f50 tx=0x7f93380118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4c9dfd0f00ee6b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f932f7fe640 1 -- 172.21.15.69:0/3499434091 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f93300d0af0 con 0x7f93401031d0 2024-04-23T10:27:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f932cff9640 1 -- 172.21.15.69:0/2597671400 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338004d20 con 0x55cebcce0370 2024-04-23T10:27:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f932cff9640 1 -- 172.21.15.69:0/2597671400 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9338004050 con 0x55cebcce0370 2024-04-23T10:27:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.706+0000 7f932cff9640 1 -- 172.21.15.69:0/2597671400 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338005260 con 0x55cebcce0370 2024-04-23T10:27:40.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.707+0000 7f9347885740 1 -- 172.21.15.69:0/2597671400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 msgr2=0x55cebcce0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.707+0000 7f933e59c640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f93280a3e40 0x7f93280a6300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f93300ce150 tx=0x7f93300d4600 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.707+0000 7f9347885740 1 --2- 172.21.15.69:0/2597671400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebcce0750 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9338009f50 tx=0x7f93380118d0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.707+0000 7f9347885740 1 -- 172.21.15.69:0/2597671400 shutdown_connections 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.707+0000 7f9347885740 1 --2- 172.21.15.69:0/2597671400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebccef890 0x55cebccf1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.707+0000 7f9347885740 1 --2- 172.21.15.69:0/2597671400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccef350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.707+0000 7f9347885740 1 --2- 172.21.15.69:0/2597671400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebcce0750 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.707+0000 7f9347885740 1 -- 172.21.15.69:0/2597671400 >> 172.21.15.69:0/2597671400 conn(0x55cebccdc7b0 msgr2=0x55cebccdcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.708+0000 7f9347885740 1 -- 172.21.15.69:0/2597671400 shutdown_connections 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.708+0000 7f9347885740 1 -- 172.21.15.69:0/2597671400 wait complete. 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.708+0000 7f9347885740 1 -- start start 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.708+0000 7f9347885740 1 Processor -- start 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.708+0000 7f9347885740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccec650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.708+0000 7f9347885740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebcce0c90 0x55cebccecb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.708+0000 7f9347885740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebccef890 0x55cebcced0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.708+0000 7f9347885740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cebccf2770 con 0x55cebcce0370 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.708+0000 7f9347885740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cebcbdfb20 con 0x55cebcce0c90 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.708+0000 7f9347885740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cebccf28f0 con 0x55cebccef890 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f933ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f9347885740 10 client.0 _ll_register_callbacks cb 0x55cebcbdf530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f933ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccec650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45202/0 (socket says 172.21.15.69:45202) 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f933ed9d640 1 -- 172.21.15.69:0/2198724054 learned_addr learned my addr 172.21.15.69:0/2198724054 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f933dd9b640 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebcce0c90 0x55cebccecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f933ed9d640 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebccef890 0x55cebcced0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f933ed9d640 1 -- 172.21.15.69:0/2198724054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebccef890 msgr2=0x55cebcced0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f933ed9d640 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebccef890 0x55cebcced0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f933ed9d640 1 -- 172.21.15.69:0/2198724054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebcce0c90 msgr2=0x55cebccecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f933ed9d640 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebcce0c90 0x55cebccecb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f933ed9d640 1 -- 172.21.15.69:0/2198724054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cebc957920 con 0x55cebcce0370 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f933ed9d640 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccec650 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9338005c40 tx=0x7f9338009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f0a3c1f15d5c46 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f9325ffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f9325ffb640 1 -- 172.21.15.69:0/2198724054 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933802a020 con 0x55cebcce0370 2024-04-23T10:27:40.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f9325ffb640 1 -- 172.21.15.69:0/2198724054 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f9338005040 con 0x55cebcce0370 2024-04-23T10:27:40.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.709+0000 7f9347885740 1 -- 172.21.15.69:0/2198724054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9338004050 con 0x55cebcce0370 2024-04-23T10:27:40.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f9325ffb640 1 -- 172.21.15.69:0/2198724054 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9338004e50 con 0x55cebcce0370 2024-04-23T10:27:40.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f9347885740 10 client.15759 fetch_fsmap learned FSMap version 28 2024-04-23T10:27:40.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f9347885740 1 -- 172.21.15.69:0/2198724054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cebca23d30 con 0x55cebcce0370 2024-04-23T10:27:40.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f9325ffb640 1 -- 172.21.15.69:0/2198724054 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9338004050 con 0x55cebcce0370 2024-04-23T10:27:40.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f9325ffb640 1 -- 172.21.15.69:0/2198724054 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9338025890 con 0x55cebcce0370 2024-04-23T10:27:40.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f9347885740 10 client.15759 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:27:40.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f9347885740 10 client.15759 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f9347885740 20 client.15759 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f9347885740 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55cebccff9a0 0x55cebcd01d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f9347885740 4 client.15759 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f9347885740 1 -- 172.21.15.69:0/2198724054 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cebcc03500 con 0x55cebccff9a0 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.710+0000 7f933dd9b640 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55cebccff9a0 0x55cebcd01d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.711+0000 7f9325ffb640 10 client.15759 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.711+0000 7f933dd9b640 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55cebccff9a0 0x55cebcd01d90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=162d43ca12c64eca server_cookie=9fd9a3b013af1208 in_seq=0 out_seq=0 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9325ffb640 1 -- 172.21.15.69:0/2198724054 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cebcc03500 con 0x55cebccff9a0 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9325ffb640 10 client.15759 handle_command_reply: tid=0 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 1 client.15759 shutdown 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 1 -- 172.21.15.69:0/2198724054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 msgr2=0x55cebccec650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccec650 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9338005c40 tx=0x7f9338009c00 comp rx=0 tx=0).stop 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 1 -- 172.21.15.69:0/2198724054 shutdown_connections 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55cebccff9a0 0x55cebcd01d90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebccef890 0x55cebcced0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebcce0c90 0x55cebccecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 1 --2- 172.21.15.69:0/2198724054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccec650 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 1 -- 172.21.15.69:0/2198724054 >> 172.21.15.69:0/2198724054 conn(0x55cebccdc7b0 msgr2=0x55cebcce2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9325ffb640 0 client.15759 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 1 -- 172.21.15.69:0/2198724054 shutdown_connections 2024-04-23T10:27:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 1 -- 172.21.15.69:0/2198724054 wait complete. 2024-04-23T10:27:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.712+0000 7f9347885740 20 client.15759 trim_cache size 0 max 16384 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f9347885740 1 Processor -- start 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f9347885740 1 -- start start 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f9347885740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebcce0370 0x55cebccfb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f9347885740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccdc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f9347885740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebccef890 0x55cebccecd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f9347885740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f93401ab9d0 con 0x55cebccef890 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f9347885740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f93401ad5d0 con 0x55cebcce0370 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f9347885740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f93401ac0a0 con 0x55cebcce0c90 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f933ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebccef890 0x55cebccecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f933ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebccef890 0x55cebccecd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45218/0 (socket says 172.21.15.69:45218) 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f933ed9d640 1 -- 172.21.15.69:0/4238754068 learned_addr learned my addr 172.21.15.69:0/4238754068 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.746+0000 7f933dd9b640 1 --2- 172.21.15.69:0/4238754068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccdc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.747+0000 7f933ed9d640 1 -- 172.21.15.69:0/4238754068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 msgr2=0x55cebccdc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.747+0000 7f933ed9d640 1 --2- 172.21.15.69:0/4238754068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccdc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.747+0000 7f933ed9d640 1 -- 172.21.15.69:0/4238754068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebcce0370 msgr2=0x55cebccfb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.747+0000 7f933ed9d640 1 --2- 172.21.15.69:0/4238754068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebcce0370 0x55cebccfb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.747+0000 7f933ed9d640 1 -- 172.21.15.69:0/4238754068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cebccd6de0 con 0x55cebccef890 2024-04-23T10:27:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.747+0000 7f933dd9b640 1 --2- 172.21.15.69:0/4238754068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccdc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:27:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.747+0000 7f933ed9d640 1 --2- 172.21.15.69:0/4238754068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebccef890 0x55cebccecd20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9338009d60 tx=0x7f9338005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ab2d781bc35ad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.747+0000 7f9327fff640 1 -- 172.21.15.69:0/4238754068 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338009e20 con 0x55cebccef890 2024-04-23T10:27:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.747+0000 7f9327fff640 1 -- 172.21.15.69:0/4238754068 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9338025910 con 0x55cebccef890 2024-04-23T10:27:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.747+0000 7f9327fff640 1 -- 172.21.15.69:0/4238754068 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933800faf0 con 0x55cebccef890 2024-04-23T10:27:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.748+0000 7f9347885740 1 -- 172.21.15.69:0/4238754068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebccef890 msgr2=0x55cebccecd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.748+0000 7f9347885740 1 --2- 172.21.15.69:0/4238754068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebccef890 0x55cebccecd20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9338009d60 tx=0x7f9338005bd0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.748+0000 7f9347885740 1 -- 172.21.15.69:0/4238754068 shutdown_connections 2024-04-23T10:27:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.748+0000 7f9347885740 1 --2- 172.21.15.69:0/4238754068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebccef890 0x55cebccecd20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.748+0000 7f9347885740 1 --2- 172.21.15.69:0/4238754068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccdc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.748+0000 7f9347885740 1 --2- 172.21.15.69:0/4238754068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebcce0370 0x55cebccfb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.748+0000 7f9347885740 1 -- 172.21.15.69:0/4238754068 >> 172.21.15.69:0/4238754068 conn(0x55cebccdc7b0 msgr2=0x55cebccec610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.748+0000 7f9347885740 1 -- 172.21.15.69:0/4238754068 shutdown_connections 2024-04-23T10:27:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.748+0000 7f9347885740 1 -- 172.21.15.69:0/4238754068 wait complete. 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f9347885740 1 -- start start 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f9347885740 1 Processor -- start 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f9347885740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccf05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f9347885740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccf0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f9347885740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebccef890 0x55cebccf6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f9347885740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f93401ace40 con 0x55cebcce0370 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f9347885740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f93401ac770 con 0x55cebccef890 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f933ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccf05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f9347885740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f93401a99b0 con 0x55cebcce0c90 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f933ed9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccf05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45226/0 (socket says 172.21.15.69:45226) 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f933ed9d640 1 -- 172.21.15.69:0/1296946911 learned_addr learned my addr 172.21.15.69:0/1296946911 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f9347885740 10 client.0 _ll_register_callbacks cb 0x7f9338009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.749+0000 7f933dd9b640 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccf0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.750+0000 7f933ed9d640 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebccef890 0x55cebccf6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.750+0000 7f933ed9d640 1 -- 172.21.15.69:0/1296946911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 msgr2=0x55cebccf0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.750+0000 7f933ed9d640 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccf0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.750+0000 7f933ed9d640 1 -- 172.21.15.69:0/1296946911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebccef890 msgr2=0x55cebccf6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:40.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.750+0000 7f933ed9d640 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebccef890 0x55cebccf6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.750+0000 7f933ed9d640 1 -- 172.21.15.69:0/1296946911 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cebccf70f0 con 0x55cebcce0370 2024-04-23T10:27:40.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.750+0000 7f933ed9d640 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccf05d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f933800f5e0 tx=0x7f933800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33402e5ea885416 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:40.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.750+0000 7f9325ffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:40.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.750+0000 7f9325ffb640 1 -- 172.21.15.69:0/1296946911 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933804b060 con 0x55cebcce0370 2024-04-23T10:27:40.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.750+0000 7f9325ffb640 1 -- 172.21.15.69:0/1296946911 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f933800f830 con 0x55cebcce0370 2024-04-23T10:27:40.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.750+0000 7f9347885740 1 -- 172.21.15.69:0/1296946911 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9338025910 con 0x55cebcce0370 2024-04-23T10:27:40.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.751+0000 7f9325ffb640 1 -- 172.21.15.69:0/1296946911 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9338015030 con 0x55cebcce0370 2024-04-23T10:27:40.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.751+0000 7f9347885740 10 client.15765 fetch_fsmap learned FSMap version 28 2024-04-23T10:27:40.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.751+0000 7f9347885740 1 -- 172.21.15.69:0/1296946911 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cebccf83a0 con 0x55cebcce0370 2024-04-23T10:27:40.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.751+0000 7f9325ffb640 1 -- 172.21.15.69:0/1296946911 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9338025910 con 0x55cebcce0370 2024-04-23T10:27:40.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.751+0000 7f9325ffb640 1 -- 172.21.15.69:0/1296946911 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9338046640 con 0x55cebcce0370 2024-04-23T10:27:40.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.751+0000 7f9347885740 10 client.15765 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:27:40.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.751+0000 7f9347885740 10 client.15765 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:27:40.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.751+0000 7f9347885740 20 client.15765 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.751+0000 7f9347885740 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55cebcd66180 0x55cebcd685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.751+0000 7f9347885740 4 client.15765 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "85f25a17", "release": true, "await": true}] 2024-04-23T10:27:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.751+0000 7f9347885740 1 -- 172.21.15.69:0/1296946911 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "quiesce db", "set_id": "85f25a17", "release": true, "await": true}) -- 0x55cebcc530f0 con 0x55cebcd66180 2024-04-23T10:27:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.752+0000 7f933dd9b640 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55cebcd66180 0x55cebcd685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.752+0000 7f9325ffb640 10 client.15765 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.752+0000 7f933dd9b640 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55cebcd66180 0x55cebcd685a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2988ba65f8e8c163 server_cookie=8a791c6b808f9328 in_seq=0 out_seq=0 2024-04-23T10:27:40.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9325ffb640 1 -- 172.21.15.69:0/1296946911 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55cebcc530f0 con 0x55cebcd66180 2024-04-23T10:27:40.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9325ffb640 10 client.15765 handle_command_reply: tid=0 2024-04-23T10:27:40.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 1 client.15765 shutdown 2024-04-23T10:27:40.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 1 -- 172.21.15.69:0/1296946911 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 msgr2=0x55cebccf05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccf05d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f933800f5e0 tx=0x7f933800f640 comp rx=0 tx=0).stop 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 1 -- 172.21.15.69:0/1296946911 shutdown_connections 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55cebcd66180 0x55cebcd685a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cebccef890 0x55cebccf6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cebcce0c90 0x55cebccf0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 1 --2- 172.21.15.69:0/1296946911 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cebcce0370 0x55cebccf05d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 1 -- 172.21.15.69:0/1296946911 >> 172.21.15.69:0/1296946911 conn(0x55cebccdc7b0 msgr2=0x55cebccecea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9325ffb640 0 client.15765 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 1 -- 172.21.15.69:0/1296946911 shutdown_connections 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 1 -- 172.21.15.69:0/1296946911 wait complete. 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.754+0000 7f9347885740 20 client.15765 trim_cache size 0 max 16384 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:27:40.755 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 28, 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "leader": 24487, 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "set_version": 4, 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "sets": { 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "85f25a17": { 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "version": 4, 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "age_ref": 0.0, 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RELEASED", 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "timeout": 60.0, 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "expiration": 81.9, 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "members": { 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "file:/": { 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "excluded": false, 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:27:40.756 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RELEASED", 2024-04-23T10:27:40.757 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:27:40.757 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:27:40.757 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:27:40.757 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:27:40.757 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:27:40.757 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:27:40.757 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 -- 172.21.15.69:0/3499434091 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f93280a3e40 msgr2=0x7f93280a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f93280a3e40 0x7f93280a6300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f93300ce150 tx=0x7f93300d4600 comp rx=0 tx=0).stop 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 -- 172.21.15.69:0/3499434091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93401031d0 msgr2=0x7f934019e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93401031d0 0x7f934019e410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f933000c970 tx=0x7f933000ce30 comp rx=0 tx=0).stop 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 -- 172.21.15.69:0/3499434091 shutdown_connections 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f93280a3e40 0x7f93280a6300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9340103af0 0x7f934019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f934010c510 0x7f93401985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 --2- 172.21.15.69:0/3499434091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93401031d0 0x7f934019e410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 -- 172.21.15.69:0/3499434091 >> 172.21.15.69:0/3499434091 conn(0x7f9340077f50 msgr2=0x7f93400fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 -- 172.21.15.69:0/3499434091 shutdown_connections 2024-04-23T10:27:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:27:40.755+0000 7f9344b75640 1 -- 172.21.15.69:0/3499434091 wait complete. 2024-04-23T10:27:40.769 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '85f25a17', seconds elapsed: 23.0 2024-04-23T10:27:41.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:41 smithi167 ceph-mon[32940]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-04-23T10:27:41.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:41 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2904178191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:41.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:41 smithi146 ceph-mon[32800]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-04-23T10:27:41.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:41 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2904178191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:41.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:41 smithi069 ceph-mon[29593]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-04-23T10:27:41.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:41 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2904178191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:27:43.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:43 smithi167 ceph-mon[32940]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-23T10:27:43.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:43 smithi146 ceph-mon[32800]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-23T10:27:43.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:43 smithi069 ceph-mon[29593]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-23T10:27:45.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:45 smithi167 ceph-mon[32940]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T10:27:45.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:45 smithi146 ceph-mon[32800]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T10:27:45.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:45 smithi069 ceph-mon[29593]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T10:27:47.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:47 smithi167 ceph-mon[32940]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-04-23T10:27:47.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:47 smithi146 ceph-mon[32800]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-04-23T10:27:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:47 smithi069 ceph-mon[29593]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-04-23T10:27:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.164+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/1684420975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b381010f0 msgr2=0x7f2b381014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.164+0000 7f2b3e0bb640 1 --2- 172.21.15.69:0/1684420975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b381010f0 0x7f2b381014d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2b28009900 tx=0x7f2b2802a410 comp rx=0 tx=0).stop 2024-04-23T10:27:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.164+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/1684420975 shutdown_connections 2024-04-23T10:27:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.164+0000 7f2b3e0bb640 1 --2- 172.21.15.69:0/1684420975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b38106170 0x7f2b3810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.164+0000 7f2b3e0bb640 1 --2- 172.21.15.69:0/1684420975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b38101aa0 0x7f2b38105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.164+0000 7f2b3e0bb640 1 --2- 172.21.15.69:0/1684420975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b381010f0 0x7f2b381014d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.164+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/1684420975 >> 172.21.15.69:0/1684420975 conn(0x7f2b38077fd0 msgr2=0x7f2b380783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.164+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/1684420975 shutdown_connections 2024-04-23T10:27:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.164+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/1684420975 wait complete. 2024-04-23T10:27:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.165+0000 7f2b3e0bb640 1 Processor -- start 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.165+0000 7f2b3e0bb640 1 -- start start 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.165+0000 7f2b3e0bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b381010f0 0x7f2b3819e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.165+0000 7f2b3e0bb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b38106170 0x7f2b3819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.165+0000 7f2b3e0bb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b381985e0 0x7f2b38198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.165+0000 7f2b3e0bb640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2b38111210 con 0x7f2b38106170 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.165+0000 7f2b3e0bb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b38111090 con 0x7f2b381985e0 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.165+0000 7f2b3e0bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b38111390 con 0x7f2b381010f0 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.165+0000 7f2b36ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b38106170 0x7f2b3819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.165+0000 7f2b36ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b38106170 0x7f2b3819e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45250/0 (socket says 172.21.15.69:45250) 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.165+0000 7f2b36ffd640 1 -- 172.21.15.69:0/2084978537 learned_addr learned my addr 172.21.15.69:0/2084978537 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.166+0000 7f2b37fff640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b381985e0 0x7f2b38198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.166+0000 7f2b377fe640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b381010f0 0x7f2b3819e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.166+0000 7f2b36ffd640 1 -- 172.21.15.69:0/2084978537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b381010f0 msgr2=0x7f2b3819e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.166+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b381010f0 0x7f2b3819e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.166+0000 7f2b36ffd640 1 -- 172.21.15.69:0/2084978537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b381985e0 msgr2=0x7f2b38198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.166+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b381985e0 0x7f2b38198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.166+0000 7f2b36ffd640 1 -- 172.21.15.69:0/2084978537 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b38199100 con 0x7f2b38106170 2024-04-23T10:27:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.166+0000 7f2b37fff640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b381985e0 0x7f2b38198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:27:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.166+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b38106170 0x7f2b3819e970 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00e9c0 tx=0x7f2b2c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.166+0000 7f2b34ff9640 1 -- 172.21.15.69:0/2084978537 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c00cd80 con 0x7f2b38106170 2024-04-23T10:27:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.166+0000 7f2b34ff9640 1 -- 172.21.15.69:0/2084978537 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2b2c0054f0 con 0x7f2b38106170 2024-04-23T10:27:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.167+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/2084978537 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b381993f0 con 0x7f2b38106170 2024-04-23T10:27:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.167+0000 7f2b34ff9640 1 -- 172.21.15.69:0/2084978537 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c010690 con 0x7f2b38106170 2024-04-23T10:27:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.167+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/2084978537 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b381a5690 con 0x7f2b38106170 2024-04-23T10:27:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.169+0000 7f2b40dcb740 1 Processor -- start 2024-04-23T10:27:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b40dcb740 1 -- start start 2024-04-23T10:27:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b34ff9640 1 -- 172.21.15.69:0/2084978537 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f2b2c0046c0 con 0x7f2b38106170 2024-04-23T10:27:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ecd6c0 0x563c96ecdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ec9130 0x563c96ec95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ed5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x563c96e24970 con 0x563c96ec9af0 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563c96dc14a0 con 0x563c96ec9130 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563c96e20930 con 0x563c96ecd6c0 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b36ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ed5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b36ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ed5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45258/0 (socket says 172.21.15.69:45258) 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b36ffd640 1 -- 172.21.15.69:0/3127228662 learned_addr learned my addr 172.21.15.69:0/3127228662 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b37fff640 1 --2- 172.21.15.69:0/3127228662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ecd6c0 0x563c96ecdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.170+0000 7f2b377fe640 1 --2- 172.21.15.69:0/3127228662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ec9130 0x563c96ec95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b36ffd640 1 -- 172.21.15.69:0/3127228662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ecd6c0 msgr2=0x563c96ecdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3127228662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ecd6c0 0x563c96ecdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b36ffd640 1 -- 172.21.15.69:0/3127228662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ec9130 msgr2=0x563c96ec95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3127228662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ec9130 0x563c96ec95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b36ffd640 1 -- 172.21.15.69:0/3127228662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c96b37210 con 0x563c96ec9af0 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b377fe640 1 --2- 172.21.15.69:0/3127228662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ec9130 0x563c96ec95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b34ff9640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2b200a3f60 0x7f2b200a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b37fff640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2b200a3f60 0x7f2b200a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b34ff9640 1 -- 172.21.15.69:0/2084978537 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f2b2c0d0f60 con 0x7f2b38106170 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3127228662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ed5610 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0ce670 tx=0x7f2b2c0d9570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ffb3c04ae682df server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b1dffb640 1 -- 172.21.15.69:0/3127228662 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c098f80 con 0x563c96ec9af0 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b1dffb640 1 -- 172.21.15.69:0/3127228662 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2b2c09d3e0 con 0x563c96ec9af0 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.171+0000 7f2b1dffb640 1 -- 172.21.15.69:0/3127228662 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c09c640 con 0x563c96ec9af0 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.172+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3127228662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 msgr2=0x563c96ed5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.172+0000 7f2b37fff640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2b200a3f60 0x7f2b200a6420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009fd0 tx=0x7f2b30009500 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.172+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3127228662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ed5610 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0ce670 tx=0x7f2b2c0d9570 comp rx=0 tx=0).stop 2024-04-23T10:27:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.172+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3127228662 shutdown_connections 2024-04-23T10:27:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.172+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3127228662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ed5610 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.172+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3127228662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ec9130 0x563c96ec95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.172+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3127228662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ecd6c0 0x563c96ecdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.172+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3127228662 >> 172.21.15.69:0/3127228662 conn(0x563c96ebb5e0 msgr2=0x563c96ebb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.172+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3127228662 shutdown_connections 2024-04-23T10:27:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.172+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3127228662 wait complete. 2024-04-23T10:27:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b40dcb740 1 -- start start 2024-04-23T10:27:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b40dcb740 1 Processor -- start 2024-04-23T10:27:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96ed5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9af0 0x563c96ed26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 0x563c96ed2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x563c96ed5c10 con 0x563c96ec9130 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563c96dbf0b0 con 0x563c96ecd6c0 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563c96ed5d90 con 0x563c96ec9af0 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b377fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96ed5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b40dcb740 10 client.0 _ll_register_callbacks cb 0x563c96dacd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b377fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96ed5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45274/0 (socket says 172.21.15.69:45274) 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.173+0000 7f2b377fe640 1 -- 172.21.15.69:0/3614666142 learned_addr learned my addr 172.21.15.69:0/3614666142 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9af0 0x563c96ed26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b37fff640 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 0x563c96ed2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b36ffd640 1 -- 172.21.15.69:0/3614666142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 msgr2=0x563c96ed2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 0x563c96ed2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b36ffd640 1 -- 172.21.15.69:0/3614666142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 msgr2=0x563c96ed5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96ed5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b36ffd640 1 -- 172.21.15.69:0/3614666142 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c96c03620 con 0x563c96ec9af0 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b377fe640 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96ed5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9af0 0x563c96ed26f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0ce620 tx=0x7f2b2c0d32d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e47f44c72cff730a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3614666142 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0b5020 con 0x563c96ec9af0 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3614666142 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b2c09d3e0 con 0x563c96ec9af0 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3614666142 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f2b2c09cf40 con 0x563c96ec9af0 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.174+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3614666142 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b2c09c820 con 0x563c96ec9af0 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.175+0000 7f2b40dcb740 10 client.25273 fetch_fsmap learned FSMap version 28 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.175+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3614666142 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c96ed5c10 con 0x563c96ec9af0 2024-04-23T10:27:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.175+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3614666142 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2b2c09d3e0 con 0x563c96ec9af0 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.175+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3614666142 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2b2c0bd0d0 con 0x563c96ec9af0 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.175+0000 7f2b40dcb740 10 client.25273 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.175+0000 7f2b40dcb740 10 client.25273 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.175+0000 7f2b40dcb740 20 client.25273 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.175+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563c96ee2c80 0x563c96ee5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.175+0000 7f2b40dcb740 4 client.25273 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.175+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3614666142 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c96e32390 con 0x563c96ee2c80 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.175+0000 7f2b377fe640 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563c96ee2c80 0x563c96ee5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.176+0000 7f2b16ffd640 10 client.25273 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.176+0000 7f2b377fe640 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563c96ee2c80 0x563c96ee5070 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c5ab653bd872606 server_cookie=5bbe378c5b6a58d1 in_seq=0 out_seq=0 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3614666142 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563c96e32390 con 0x563c96ee2c80 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b16ffd640 10 client.25273 handle_command_reply: tid=0 2024-04-23T10:27:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 1 client.25273 shutdown 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3614666142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9af0 msgr2=0x563c96ed26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9af0 0x563c96ed26f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0ce620 tx=0x7f2b2c0d32d0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3614666142 shutdown_connections 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563c96ee2c80 0x563c96ee5070 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 0x563c96ed2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9af0 0x563c96ed26f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3614666142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96ed5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3614666142 >> 172.21.15.69:0/3614666142 conn(0x563c96ebb5e0 msgr2=0x563c96ec89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b16ffd640 0 client.25273 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3614666142 shutdown_connections 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3614666142 wait complete. 2024-04-23T10:27:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.177+0000 7f2b40dcb740 20 client.25273 trim_cache size 0 max 16384 2024-04-23T10:27:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.191+0000 7f2b40dcb740 1 Processor -- start 2024-04-23T10:27:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.191+0000 7f2b40dcb740 1 -- start start 2024-04-23T10:27:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9130 0x563c96edeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ecca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 0x563c96ed4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2b381aba30 con 0x563c96ec9af0 2024-04-23T10:27:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b381ad630 con 0x563c96ecd6c0 2024-04-23T10:27:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b381ac100 con 0x563c96ec9130 2024-04-23T10:27:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b36ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ecca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b36ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ecca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45290/0 (socket says 172.21.15.69:45290) 2024-04-23T10:27:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b36ffd640 1 -- 172.21.15.69:0/3822959356 learned_addr learned my addr 172.21.15.69:0/3822959356 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b377fe640 1 --2- 172.21.15.69:0/3822959356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9130 0x563c96edeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b36ffd640 1 -- 172.21.15.69:0/3822959356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9130 msgr2=0x563c96edeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3822959356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9130 0x563c96edeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b36ffd640 1 -- 172.21.15.69:0/3822959356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 msgr2=0x563c96ed4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3822959356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 0x563c96ed4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b36ffd640 1 -- 172.21.15.69:0/3822959356 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c96ebc480 con 0x563c96ec9af0 2024-04-23T10:27:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.192+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3822959356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ecca30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0996b0 tx=0x7f2b2c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48be53266b920dd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.193+0000 7f2b1d7fa640 1 -- 172.21.15.69:0/3822959356 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0b5070 con 0x563c96ec9af0 2024-04-23T10:27:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.193+0000 7f2b1d7fa640 1 -- 172.21.15.69:0/3822959356 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2b2c0d43b0 con 0x563c96ec9af0 2024-04-23T10:27:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.193+0000 7f2b1d7fa640 1 -- 172.21.15.69:0/3822959356 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c09cab0 con 0x563c96ec9af0 2024-04-23T10:27:48.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.193+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3822959356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 msgr2=0x563c96ecca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.193+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3822959356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ecca30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0996b0 tx=0x7f2b2c0057c0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.194+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3822959356 shutdown_connections 2024-04-23T10:27:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.194+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3822959356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9af0 0x563c96ecca30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.194+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3822959356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 0x563c96ed4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.194+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3822959356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9130 0x563c96edeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.194+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3822959356 >> 172.21.15.69:0/3822959356 conn(0x563c96ebb5e0 msgr2=0x563c96ecc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.194+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3822959356 shutdown_connections 2024-04-23T10:27:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.194+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3822959356 wait complete. 2024-04-23T10:27:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.194+0000 7f2b40dcb740 1 -- start start 2024-04-23T10:27:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.194+0000 7f2b40dcb740 1 Processor -- start 2024-04-23T10:27:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96edacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9af0 0x563c96edb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b40dcb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 0x563c96ed6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2b381acea0 con 0x563c96ec9130 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b381ac7d0 con 0x563c96ecd6c0 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b40dcb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b381a9a10 con 0x563c96ec9af0 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b377fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96edacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b40dcb740 10 client.0 _ll_register_callbacks cb 0x7f2b2c0d4dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b377fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96edacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45298/0 (socket says 172.21.15.69:45298) 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b377fe640 1 -- 172.21.15.69:0/3424843219 learned_addr learned my addr 172.21.15.69:0/3424843219 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9af0 0x563c96edb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b37fff640 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 0x563c96ed6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b377fe640 1 -- 172.21.15.69:0/3424843219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9af0 msgr2=0x563c96edb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:48.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b377fe640 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9af0 0x563c96edb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b377fe640 1 -- 172.21.15.69:0/3424843219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 msgr2=0x563c96ed6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b377fe640 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 0x563c96ed6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b377fe640 1 -- 172.21.15.69:0/3424843219 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c96ed6870 con 0x563c96ec9130 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b377fe640 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96edacf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2b28009230 tx=0x7f2b28004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be15483fd63b10f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.195+0000 7f2b16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.196+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3424843219 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28035040 con 0x563c96ec9130 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.196+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3424843219 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f2b28046dc0 con 0x563c96ec9130 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.196+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3424843219 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b2c0d43b0 con 0x563c96ec9130 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.196+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3424843219 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b28046330 con 0x563c96ec9130 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.196+0000 7f2b40dcb740 10 client.15783 fetch_fsmap learned FSMap version 28 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.196+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3424843219 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c96f48ae0 con 0x563c96ec9130 2024-04-23T10:27:48.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.196+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3424843219 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2b2c0d43b0 con 0x563c96ec9130 2024-04-23T10:27:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.197+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3424843219 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2b28004780 con 0x563c96ec9130 2024-04-23T10:27:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.197+0000 7f2b40dcb740 10 client.15783 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:27:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.197+0000 7f2b40dcb740 10 client.15783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:27:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.197+0000 7f2b40dcb740 20 client.15783 populate_metadata read hostname 'smithi069' 2024-04-23T10:27:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.197+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563c96f492e0 0x563c96f4b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:27:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.197+0000 7f2b40dcb740 4 client.15783 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:27:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.197+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3424843219 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c96e2c200 con 0x563c96f492e0 2024-04-23T10:27:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.198+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563c96f492e0 0x563c96f4b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:27:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.198+0000 7f2b36ffd640 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563c96f492e0 0x563c96f4b700 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5861fc13b0527b0a server_cookie=bdc0a546ee45eb5a in_seq=0 out_seq=0 2024-04-23T10:27:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.198+0000 7f2b16ffd640 10 client.15783 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b16ffd640 1 -- 172.21.15.69:0/3424843219 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c96e2c200 con 0x563c96f492e0 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b16ffd640 10 client.15783 handle_command_reply: tid=0 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 1 client.15783 shutdown 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3424843219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 msgr2=0x563c96edacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96edacf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2b28009230 tx=0x7f2b28004280 comp rx=0 tx=0).stop 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3424843219 shutdown_connections 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563c96f492e0 0x563c96f4b700 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b16ffd640 0 client.15783 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c96ecd6c0 0x563c96ed6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c96ec9af0 0x563c96edb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 1 --2- 172.21.15.69:0/3424843219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563c96ec9130 0x563c96edacf0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3424843219 >> 172.21.15.69:0/3424843219 conn(0x563c96ebb5e0 msgr2=0x563c96ec89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3424843219 shutdown_connections 2024-04-23T10:27:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 1 -- 172.21.15.69:0/3424843219 wait complete. 2024-04-23T10:27:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.202+0000 7f2b40dcb740 20 client.15783 trim_cache size 0 max 16384 2024-04-23T10:27:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:27:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:27:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:27:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:27:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/2084978537 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2b200a3f60 msgr2=0x7f2b200a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2b200a3f60 0x7f2b200a6420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009fd0 tx=0x7f2b30009500 comp rx=0 tx=0).stop 2024-04-23T10:27:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/2084978537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b38106170 msgr2=0x7f2b3819e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:27:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b38106170 0x7f2b3819e970 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00e9c0 tx=0x7f2b2c00ee80 comp rx=0 tx=0).stop 2024-04-23T10:27:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/2084978537 shutdown_connections 2024-04-23T10:27:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f2b200a3f60 0x7f2b200a6420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b38106170 0x7f2b3819e970 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b381985e0 0x7f2b38198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 --2- 172.21.15.69:0/2084978537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b381010f0 0x7f2b3819e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:27:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/2084978537 >> 172.21.15.69:0/2084978537 conn(0x7f2b38077fd0 msgr2=0x7f2b38104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:27:48.206 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/2084978537 shutdown_connections 2024-04-23T10:27:48.206 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:27:48.203+0000 7f2b3e0bb640 1 -- 172.21.15.69:0/2084978537 wait complete. 2024-04-23T10:27:49.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:49 smithi167 ceph-mon[32940]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T10:27:49.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:49 smithi146 ceph-mon[32800]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T10:27:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:49 smithi069 ceph-mon[29593]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-04-23T10:27:51.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:51 smithi167 ceph-mon[32940]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-04-23T10:27:51.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:51 smithi146 ceph-mon[32800]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-04-23T10:27:51.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:51 smithi069 ceph-mon[29593]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-04-23T10:27:53.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:53 smithi167 ceph-mon[32940]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T10:27:53.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:53 smithi146 ceph-mon[32800]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T10:27:53.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:53 smithi069 ceph-mon[29593]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T10:27:55.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:55 smithi167 ceph-mon[32940]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T10:27:55.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:55 smithi146 ceph-mon[32800]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T10:27:55.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:55 smithi069 ceph-mon[29593]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T10:27:57.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:57 smithi167 ceph-mon[32940]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T10:27:57.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:57 smithi146 ceph-mon[32800]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T10:27:57.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:57 smithi069 ceph-mon[29593]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T10:27:58.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:58 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:27:58.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:58 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:27:58.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:58 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:27:59.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:59 smithi146 ceph-mon[32800]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T10:27:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:59 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:27:59.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:27:59 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:27:59.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:59 smithi069 ceph-mon[29593]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T10:27:59.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:59 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:27:59.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:27:59 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:27:59.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:59 smithi167 ceph-mon[32940]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-23T10:27:59.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:59 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:27:59.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:27:59 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:28:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:00 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:28:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:00 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:28:00.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:00 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:28:00.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:00 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:28:00.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:00 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:28:00.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:00 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:28:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:00 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:28:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:00 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:28:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:00 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:28:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.300+0000 7f586057d640 1 -- 172.21.15.69:0/4176706938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f585810d2d0 msgr2=0x7f58581197e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.300+0000 7f586057d640 1 --2- 172.21.15.69:0/4176706938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f585810d2d0 0x7f58581197e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5848009930 tx=0x7f584802a420 comp rx=0 tx=0).stop 2024-04-23T10:28:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.300+0000 7f586057d640 1 -- 172.21.15.69:0/4176706938 shutdown_connections 2024-04-23T10:28:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.300+0000 7f586057d640 1 --2- 172.21.15.69:0/4176706938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f585810d2d0 0x7f58581197e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.300+0000 7f586057d640 1 --2- 172.21.15.69:0/4176706938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f585810c910 0x7f585810cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.300+0000 7f586057d640 1 --2- 172.21.15.69:0/4176706938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5858112920 0x7f5858112d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.300+0000 7f586057d640 1 -- 172.21.15.69:0/4176706938 >> 172.21.15.69:0/4176706938 conn(0x7f585806d1b0 msgr2=0x7f585810af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.300+0000 7f586057d640 1 -- 172.21.15.69:0/4176706938 shutdown_connections 2024-04-23T10:28:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.300+0000 7f586057d640 1 -- 172.21.15.69:0/4176706938 wait complete. 2024-04-23T10:28:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f586057d640 1 Processor -- start 2024-04-23T10:28:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f586057d640 1 -- start start 2024-04-23T10:28:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f586057d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f585810c910 0x7f58581a3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f586057d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f585810d2d0 0x7f58581a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f586057d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5858112920 0x7f58581a7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f586057d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f585811cd70 con 0x7f585810c910 2024-04-23T10:28:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f586057d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f585811cbf0 con 0x7f5858112920 2024-04-23T10:28:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f586057d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f585811cef0 con 0x7f585810d2d0 2024-04-23T10:28:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f585e319640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f585810c910 0x7f58581a3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f585e319640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f585810c910 0x7f58581a3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34284/0 (socket says 172.21.15.69:34284) 2024-04-23T10:28:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f585e319640 1 -- 172.21.15.69:0/1818901024 learned_addr learned my addr 172.21.15.69:0/1818901024 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f585eb1a640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5858112920 0x7f58581a7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.301+0000 7f585db18640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f585810d2d0 0x7f58581a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f585e319640 1 -- 172.21.15.69:0/1818901024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f585810d2d0 msgr2=0x7f58581a3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f585e319640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f585810d2d0 0x7f58581a3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f585e319640 1 -- 172.21.15.69:0/1818901024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5858112920 msgr2=0x7f58581a7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f585e319640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5858112920 0x7f58581a7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f585e319640 1 -- 172.21.15.69:0/1818901024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58581a81d0 con 0x7f585810c910 2024-04-23T10:28:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f585eb1a640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5858112920 0x7f58581a7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f585e319640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f585810c910 0x7f58581a3230 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f585000b4a0 tx=0x7f585000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f58577fe640 1 -- 172.21.15.69:0/1818901024 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850014070 con 0x7f585810c910 2024-04-23T10:28:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f586057d640 1 -- 172.21.15.69:0/1818901024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58581a84c0 con 0x7f585810c910 2024-04-23T10:28:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f586057d640 1 -- 172.21.15.69:0/1818901024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58581afd50 con 0x7f585810c910 2024-04-23T10:28:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f58577fe640 1 -- 172.21.15.69:0/1818901024 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5850010ae0 con 0x7f585810c910 2024-04-23T10:28:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.302+0000 7f58577fe640 1 -- 172.21.15.69:0/1818901024 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850017ce0 con 0x7f585810c910 2024-04-23T10:28:01.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.305+0000 7f5863372740 1 Processor -- start 2024-04-23T10:28:01.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.305+0000 7f58577fe640 1 -- 172.21.15.69:0/1818901024 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f5850017070 con 0x7f585810c910 2024-04-23T10:28:01.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.305+0000 7f5863372740 1 -- start start 2024-04-23T10:28:01.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f5863372740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 0x561a16980a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f5863372740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a1698b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f5863372740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1698b800 0x561a1698dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f5863372740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561a168e5970 con 0x561a16980f40 2024-04-23T10:28:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f5863372740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561a168824a0 con 0x561a1698b800 2024-04-23T10:28:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f5863372740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561a168e1930 con 0x561a16980620 2024-04-23T10:28:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f585e319640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a1698b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f585e319640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a1698b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34296/0 (socket says 172.21.15.69:34296) 2024-04-23T10:28:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f585e319640 1 -- 172.21.15.69:0/349250006 learned_addr learned my addr 172.21.15.69:0/349250006 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f585eb1a640 1 --2- 172.21.15.69:0/349250006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 0x561a16980a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f585db18640 1 --2- 172.21.15.69:0/349250006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1698b800 0x561a1698dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f58577fe640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f58400a3f60 0x7f58400a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f585e319640 1 -- 172.21.15.69:0/349250006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 msgr2=0x561a16980a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f585e319640 1 --2- 172.21.15.69:0/349250006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 0x561a16980a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f585e319640 1 -- 172.21.15.69:0/349250006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1698b800 msgr2=0x561a1698dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f585e319640 1 --2- 172.21.15.69:0/349250006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1698b800 0x561a1698dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f585eb1a640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f58400a3f60 0x7f58400a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.306+0000 7f585e319640 1 -- 172.21.15.69:0/349250006 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a165f8210 con 0x561a16980f40 2024-04-23T10:28:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.307+0000 7f58577fe640 1 -- 172.21.15.69:0/1818901024 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f58500cfc40 con 0x7f585810c910 2024-04-23T10:28:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.307+0000 7f585e319640 1 --2- 172.21.15.69:0/349250006 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a1698b2c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f58500cd460 tx=0x7f5850020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c036f8e5b148914 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.307+0000 7f5854bfe640 1 -- 172.21.15.69:0/349250006 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585009b610 con 0x561a16980f40 2024-04-23T10:28:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.307+0000 7f585eb1a640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f58400a3f60 0x7f58400a6420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5848006010 tx=0x7f584802a420 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.307+0000 7f5854bfe640 1 -- 172.21.15.69:0/349250006 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f585009c1d0 con 0x561a16980f40 2024-04-23T10:28:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.307+0000 7f5854bfe640 1 -- 172.21.15.69:0/349250006 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850013170 con 0x561a16980f40 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.308+0000 7f5863372740 1 -- 172.21.15.69:0/349250006 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 msgr2=0x561a1698b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.308+0000 7f5863372740 1 --2- 172.21.15.69:0/349250006 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a1698b2c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f58500cd460 tx=0x7f5850020000 comp rx=0 tx=0).stop 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.308+0000 7f5863372740 1 -- 172.21.15.69:0/349250006 shutdown_connections 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.308+0000 7f5863372740 1 --2- 172.21.15.69:0/349250006 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a1698b2c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.308+0000 7f5863372740 1 --2- 172.21.15.69:0/349250006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1698b800 0x561a1698dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.308+0000 7f5863372740 1 --2- 172.21.15.69:0/349250006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 0x561a16980a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.308+0000 7f5863372740 1 -- 172.21.15.69:0/349250006 >> 172.21.15.69:0/349250006 conn(0x561a1697cb30 msgr2=0x561a1697cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.308+0000 7f5863372740 1 -- 172.21.15.69:0/349250006 shutdown_connections 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.308+0000 7f5863372740 1 -- 172.21.15.69:0/349250006 wait complete. 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f5863372740 1 -- start start 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f5863372740 1 Processor -- start 2024-04-23T10:28:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f5863372740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 0x561a1698b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f5863372740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a16988370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f5863372740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1698b800 0x561a169888b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f5863372740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561a1698e3d0 con 0x561a16980f40 2024-04-23T10:28:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f5863372740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561a168800b0 con 0x561a1698b800 2024-04-23T10:28:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f5863372740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561a1698e550 con 0x561a16980620 2024-04-23T10:28:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f5863372740 10 client.0 _ll_register_callbacks cb 0x561a1686dd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f585db18640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a16988370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f585db18640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a16988370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34310/0 (socket says 172.21.15.69:34310) 2024-04-23T10:28:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f585db18640 1 -- 172.21.15.69:0/3008813023 learned_addr learned my addr 172.21.15.69:0/3008813023 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f585eb1a640 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1698b800 0x561a169888b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f585db18640 1 -- 172.21.15.69:0/3008813023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 msgr2=0x561a1698b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f585db18640 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 0x561a1698b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f585db18640 1 -- 172.21.15.69:0/3008813023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1698b800 msgr2=0x561a169888b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f585db18640 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1698b800 0x561a169888b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f585db18640 1 -- 172.21.15.69:0/3008813023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a166c4620 con 0x561a16980f40 2024-04-23T10:28:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.309+0000 7f585db18640 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a16988370 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f584c0116d0 tx=0x7f584c011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d279b6991fd8da server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f583dffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f583dffb640 1 -- 172.21.15.69:0/3008813023 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c011ea0 con 0x561a16980f40 2024-04-23T10:28:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f583dffb640 1 -- 172.21.15.69:0/3008813023 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f584c00fd50 con 0x561a16980f40 2024-04-23T10:28:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f5863372740 1 -- 172.21.15.69:0/3008813023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f585009c1d0 con 0x561a16980f40 2024-04-23T10:28:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f583dffb640 1 -- 172.21.15.69:0/3008813023 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f584c004b20 con 0x561a16980f40 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f5863372740 10 client.15795 fetch_fsmap learned FSMap version 28 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f5863372740 1 -- 172.21.15.69:0/3008813023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561a1699a350 con 0x561a16980f40 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f583dffb640 1 -- 172.21.15.69:0/3008813023 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f585009c1d0 con 0x561a16980f40 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f583dffb640 1 -- 172.21.15.69:0/3008813023 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f584c012680 con 0x561a16980f40 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f5863372740 10 client.15795 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f5863372740 10 client.15795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f5863372740 20 client.15795 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f5863372740 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x561a1699b8b0 0x561a1699dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f5863372740 4 client.15795 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.310+0000 7f5863372740 1 -- 172.21.15.69:0/3008813023 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a168f3390 con 0x561a1699b8b0 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.311+0000 7f585e319640 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x561a1699b8b0 0x561a1699dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.311+0000 7f585e319640 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x561a1699b8b0 0x561a1699dd30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82416a9ba078b49a server_cookie=866f98ab77643984 in_seq=0 out_seq=0 2024-04-23T10:28:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.311+0000 7f583dffb640 10 client.15795 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f583dffb640 1 -- 172.21.15.69:0/3008813023 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561a168f3390 con 0x561a1699b8b0 2024-04-23T10:28:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f583dffb640 10 client.15795 handle_command_reply: tid=0 2024-04-23T10:28:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 1 client.15795 shutdown 2024-04-23T10:28:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 1 -- 172.21.15.69:0/3008813023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 msgr2=0x561a16988370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a16988370 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f584c0116d0 tx=0x7f584c011b90 comp rx=0 tx=0).stop 2024-04-23T10:28:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 1 -- 172.21.15.69:0/3008813023 shutdown_connections 2024-04-23T10:28:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x561a1699b8b0 0x561a1699dd30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a16980f40 0x561a16988370 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f583dffb640 0 client.15795 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1698b800 0x561a169888b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 1 --2- 172.21.15.69:0/3008813023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 0x561a1698b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 1 -- 172.21.15.69:0/3008813023 >> 172.21.15.69:0/3008813023 conn(0x561a1697cb30 msgr2=0x561a169828b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 1 -- 172.21.15.69:0/3008813023 shutdown_connections 2024-04-23T10:28:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 1 -- 172.21.15.69:0/3008813023 wait complete. 2024-04-23T10:28:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.312+0000 7f5863372740 20 client.15795 trim_cache size 0 max 16384 2024-04-23T10:28:01.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f5863372740 1 Processor -- start 2024-04-23T10:28:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f5863372740 1 -- start start 2024-04-23T10:28:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f5863372740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a1697cb30 0x561a169972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f5863372740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a16980620 0x561a16983af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f5863372740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16987370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f5863372740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f584400e6d0 con 0x561a1698b800 2024-04-23T10:28:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f5863372740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f58440102d0 con 0x561a16980620 2024-04-23T10:28:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f5863372740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f584400eda0 con 0x561a1697cb30 2024-04-23T10:28:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f585eb1a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16987370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f585eb1a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16987370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34318/0 (socket says 172.21.15.69:34318) 2024-04-23T10:28:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f585eb1a640 1 -- 172.21.15.69:0/3534984928 learned_addr learned my addr 172.21.15.69:0/3534984928 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f585db18640 1 --2- 172.21.15.69:0/3534984928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a16980620 0x561a16983af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f585e319640 1 --2- 172.21.15.69:0/3534984928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a1697cb30 0x561a169972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f585eb1a640 1 -- 172.21.15.69:0/3534984928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a1697cb30 msgr2=0x561a169972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f585eb1a640 1 --2- 172.21.15.69:0/3534984928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a1697cb30 0x561a169972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f585eb1a640 1 -- 172.21.15.69:0/3534984928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a16980620 msgr2=0x561a16983af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f585eb1a640 1 --2- 172.21.15.69:0/3534984928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a16980620 0x561a16983af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f585eb1a640 1 -- 172.21.15.69:0/3534984928 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a1697c960 con 0x561a1698b800 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.327+0000 7f585e319640 1 --2- 172.21.15.69:0/3534984928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a1697cb30 0x561a169972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.328+0000 7f585eb1a640 1 --2- 172.21.15.69:0/3534984928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16987370 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5848009930 tx=0x7f5848009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840cb6382ceda72e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.328+0000 7f583ffff640 1 -- 172.21.15.69:0/3534984928 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848043070 con 0x561a1698b800 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.328+0000 7f583ffff640 1 -- 172.21.15.69:0/3534984928 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f584804e070 con 0x561a1698b800 2024-04-23T10:28:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.328+0000 7f583ffff640 1 -- 172.21.15.69:0/3534984928 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848035040 con 0x561a1698b800 2024-04-23T10:28:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.328+0000 7f5863372740 1 -- 172.21.15.69:0/3534984928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 msgr2=0x561a16987370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.328+0000 7f5863372740 1 --2- 172.21.15.69:0/3534984928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16987370 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5848009930 tx=0x7f5848009560 comp rx=0 tx=0).stop 2024-04-23T10:28:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 -- 172.21.15.69:0/3534984928 shutdown_connections 2024-04-23T10:28:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 --2- 172.21.15.69:0/3534984928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16987370 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 --2- 172.21.15.69:0/3534984928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a16980620 0x561a16983af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 --2- 172.21.15.69:0/3534984928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a1697cb30 0x561a169972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 -- 172.21.15.69:0/3534984928 >> 172.21.15.69:0/3534984928 conn(0x561a16988a10 msgr2=0x561a16986c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 -- 172.21.15.69:0/3534984928 shutdown_connections 2024-04-23T10:28:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 -- 172.21.15.69:0/3534984928 wait complete. 2024-04-23T10:28:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 -- start start 2024-04-23T10:28:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 Processor -- start 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1697cb30 0x561a16985740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 0x561a16985c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16a00eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f584400fb40 con 0x561a1698b800 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f584400f470 con 0x561a1697cb30 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f584400c6b0 con 0x561a16980620 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f5863372740 10 client.0 _ll_register_callbacks cb 0x7f584c00af20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f585eb1a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16a00eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f585eb1a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16a00eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34332/0 (socket says 172.21.15.69:34332) 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.329+0000 7f585eb1a640 1 -- 172.21.15.69:0/974109420 learned_addr learned my addr 172.21.15.69:0/974109420 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f585e319640 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1697cb30 0x561a16985740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f585db18640 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 0x561a16985c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f585eb1a640 1 -- 172.21.15.69:0/974109420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 msgr2=0x561a16985c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f585eb1a640 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 0x561a16985c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f585eb1a640 1 -- 172.21.15.69:0/974109420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1697cb30 msgr2=0x561a16985740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f585eb1a640 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1697cb30 0x561a16985740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f585eb1a640 1 -- 172.21.15.69:0/974109420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a1699a180 con 0x561a1698b800 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f585eb1a640 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16a00eb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f584802aa10 tx=0x7f5848003660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16be3a0deada0a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f583dffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f583dffb640 1 -- 172.21.15.69:0/974109420 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584805b060 con 0x561a1698b800 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f583dffb640 1 -- 172.21.15.69:0/974109420 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f5848053470 con 0x561a1698b800 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f5863372740 1 -- 172.21.15.69:0/974109420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f584804e070 con 0x561a1698b800 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f583dffb640 1 -- 172.21.15.69:0/974109420 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5848035070 con 0x561a1698b800 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f5863372740 10 client.15801 fetch_fsmap learned FSMap version 28 2024-04-23T10:28:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.330+0000 7f5863372740 1 -- 172.21.15.69:0/974109420 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561a16a02490 con 0x561a1698b800 2024-04-23T10:28:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.331+0000 7f583dffb640 1 -- 172.21.15.69:0/974109420 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5848053b40 con 0x561a1698b800 2024-04-23T10:28:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.331+0000 7f583dffb640 1 -- 172.21.15.69:0/974109420 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5848046030 con 0x561a1698b800 2024-04-23T10:28:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.331+0000 7f5863372740 10 client.15801 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:28:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.331+0000 7f5863372740 10 client.15801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:28:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.331+0000 7f5863372740 20 client.15801 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.331+0000 7f5863372740 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x561a1699b8b0 0x561a16a04c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.331+0000 7f5863372740 4 client.15801 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:28:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.331+0000 7f5863372740 1 -- 172.21.15.69:0/974109420 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f584804e070 con 0x561a1699b8b0 2024-04-23T10:28:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.331+0000 7f585e319640 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x561a1699b8b0 0x561a16a04c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.331+0000 7f583dffb640 10 client.15801 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:01.331+0000 7f585e319640 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x561a1699b8b0 0x561a16a04c60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7825fb3b2a8bd530 server_cookie=87ef226ba9bf4c8d in_seq=0 out_seq=0 2024-04-23T10:28:01.393 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:01 smithi069 ceph-mon[29593]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T10:28:01.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:01 smithi146 ceph-mon[32800]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T10:28:01.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:01 smithi167 ceph-mon[32940]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-04-23T10:28:03.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:03 smithi146 ceph-mon[32800]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T10:28:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:03 smithi069 ceph-mon[29593]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T10:28:03.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:03 smithi167 ceph-mon[32940]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T10:28:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f583dffb640 1 -- 172.21.15.69:0/974109420 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f584804e070 con 0x561a1699b8b0 2024-04-23T10:28:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f583dffb640 10 client.15801 handle_command_reply: tid=0 2024-04-23T10:28:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 1 client.15801 shutdown 2024-04-23T10:28:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 1 -- 172.21.15.69:0/974109420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 msgr2=0x561a16a00eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16a00eb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f584802aa10 tx=0x7f5848003660 comp rx=0 tx=0).stop 2024-04-23T10:28:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 1 -- 172.21.15.69:0/974109420 shutdown_connections 2024-04-23T10:28:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x561a1699b8b0 0x561a16a04c60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561a1698b800 0x561a16a00eb0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f583dffb640 0 client.15801 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a16980620 0x561a16985c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 1 --2- 172.21.15.69:0/974109420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561a1697cb30 0x561a16985740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 1 -- 172.21.15.69:0/974109420 >> 172.21.15.69:0/974109420 conn(0x561a16988a10 msgr2=0x561a1697b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 1 -- 172.21.15.69:0/974109420 shutdown_connections 2024-04-23T10:28:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 1 -- 172.21.15.69:0/974109420 wait complete. 2024-04-23T10:28:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f5863372740 20 client.15801 trim_cache size 0 max 16384 2024-04-23T10:28:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:28:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:28:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:28:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:28:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f586057d640 1 -- 172.21.15.69:0/1818901024 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f58400a3f60 msgr2=0x7f58400a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f586057d640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f58400a3f60 0x7f58400a6420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5848006010 tx=0x7f584802a420 comp rx=0 tx=0).stop 2024-04-23T10:28:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f586057d640 1 -- 172.21.15.69:0/1818901024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f585810c910 msgr2=0x7f58581a3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.632+0000 7f586057d640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f585810c910 0x7f58581a3230 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f585000b4a0 tx=0x7f585000b960 comp rx=0 tx=0).stop 2024-04-23T10:28:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.633+0000 7f586057d640 1 -- 172.21.15.69:0/1818901024 shutdown_connections 2024-04-23T10:28:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.633+0000 7f586057d640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f58400a3f60 0x7f58400a6420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.633+0000 7f586057d640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5858112920 0x7f58581a7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.633+0000 7f586057d640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f585810d2d0 0x7f58581a3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.633+0000 7f586057d640 1 --2- 172.21.15.69:0/1818901024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f585810c910 0x7f58581a3230 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.633+0000 7f586057d640 1 -- 172.21.15.69:0/1818901024 >> 172.21.15.69:0/1818901024 conn(0x7f585806d1b0 msgr2=0x7f585810f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.633+0000 7f586057d640 1 -- 172.21.15.69:0/1818901024 shutdown_connections 2024-04-23T10:28:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:04.633+0000 7f586057d640 1 -- 172.21.15.69:0/1818901024 wait complete. 2024-04-23T10:28:05.224 INFO:tasks.workunit.client.0.smithi069.stderr:Note: switching to '0a6c3ed699031b80a2b419e7e795368719871394'. 2024-04-23T10:28:05.224 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-04-23T10:28:05.224 INFO:tasks.workunit.client.0.smithi069.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-23T10:28:05.224 INFO:tasks.workunit.client.0.smithi069.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-23T10:28:05.224 INFO:tasks.workunit.client.0.smithi069.stderr:state without impacting any branches by switching back to a branch. 2024-04-23T10:28:05.224 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-04-23T10:28:05.224 INFO:tasks.workunit.client.0.smithi069.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-23T10:28:05.224 INFO:tasks.workunit.client.0.smithi069.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-23T10:28:05.224 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-04-23T10:28:05.225 INFO:tasks.workunit.client.0.smithi069.stderr: git switch -c 2024-04-23T10:28:05.225 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-04-23T10:28:05.225 INFO:tasks.workunit.client.0.smithi069.stderr:Or undo this operation with: 2024-04-23T10:28:05.225 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-04-23T10:28:05.225 INFO:tasks.workunit.client.0.smithi069.stderr: git switch - 2024-04-23T10:28:05.225 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-04-23T10:28:05.225 INFO:tasks.workunit.client.0.smithi069.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-23T10:28:05.225 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-04-23T10:28:05.225 INFO:tasks.workunit.client.0.smithi069.stderr:HEAD is now at 0a6c3ed6990 qa/suites/fs: add quiescer to the fs suite 2024-04-23T10:28:05.226 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-23T10:28:05.254 INFO:tasks.workunit.client.0.smithi069.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-23T10:28:05.256 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T10:28:05.256 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-23T10:28:05.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:05 smithi146 ceph-mon[32800]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T10:28:05.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:05 smithi069 ceph-mon[29593]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T10:28:05.579 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-mon[32940]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-23T10:28:05.833 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: *** Caught signal (Segmentation fault) ** 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: in thread 7fa9dd875700 thread_name:md_log_replay 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev) 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa9eec36d20] 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 2: /usr/bin/ceph-mds(+0x54938f) [0x55e1f3c1938f] 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55e1f3c1cb23] 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 4: (MDLog::_replay_thread()+0x617) [0x55e1f3c77647] 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55e1f3c80d31] 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa9eec2c1ca] 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 7: clone() 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 2024-04-23T10:28:05.581+0000 7fa9dd875700 -1 *** Caught signal (Segmentation fault) ** 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: in thread 7fa9dd875700 thread_name:md_log_replay 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev) 2024-04-23T10:28:05.834 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa9eec36d20] 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 2: /usr/bin/ceph-mds(+0x54938f) [0x55e1f3c1938f] 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55e1f3c1cb23] 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 4: (MDLog::_replay_thread()+0x617) [0x55e1f3c77647] 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55e1f3c80d31] 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa9eec2c1ca] 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 7: clone() 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 0> 2024-04-23T10:28:05.581+0000 7fa9dd875700 -1 *** Caught signal (Segmentation fault) ** 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: in thread 7fa9dd875700 thread_name:md_log_replay 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev) 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa9eec36d20] 2024-04-23T10:28:05.835 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 2: /usr/bin/ceph-mds(+0x54938f) [0x55e1f3c1938f] 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55e1f3c1cb23] 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 4: (MDLog::_replay_thread()+0x617) [0x55e1f3c77647] 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55e1f3c80d31] 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa9eec2c1ca] 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 7: clone() 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 0> 2024-04-23T10:28:05.581+0000 7fa9dd875700 -1 *** Caught signal (Segmentation fault) ** 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: in thread 7fa9dd875700 thread_name:md_log_replay 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev) 2024-04-23T10:28:05.836 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa9eec36d20] 2024-04-23T10:28:05.837 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 2: /usr/bin/ceph-mds(+0x54938f) [0x55e1f3c1938f] 2024-04-23T10:28:05.837 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55e1f3c1cb23] 2024-04-23T10:28:05.837 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 4: (MDLog::_replay_thread()+0x617) [0x55e1f3c77647] 2024-04-23T10:28:05.837 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55e1f3c80d31] 2024-04-23T10:28:05.837 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa9eec2c1ca] 2024-04-23T10:28:05.837 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 7: clone() 2024-04-23T10:28:05.837 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-23T10:28:05.837 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[63282]: 2024-04-23T10:28:05.837 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:05 smithi167 podman[67058]: 2024-04-23 10:28:05.642672676 +0000 UTC m=+0.022217793 container died e7e7cde3c441e5bbd424fd99a266613e280d3216347c46e2b67d8da9c6d30561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416) 2024-04-23T10:28:05.839 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-23T10:28:05.892 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-23T10:28:05.931 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T10:28:05.932 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T10:28:05.932 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-23T10:28:05.970 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T10:28:05.974 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:28:05.974 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-23T10:28:06.029 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-04-23T10:28:06.030 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-04-23T10:28:06.030 DEBUG:teuthology.orchestra.run.smithi069:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a6c3ed699031b80a2b419e7e795368719871394 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-04-23T10:28:06.092 INFO:tasks.workunit.client.0.smithi069.stderr:+ KERNEL=linux-4.0.5 2024-04-23T10:28:06.092 INFO:tasks.workunit.client.0.smithi069.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-04-23T10:28:06.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:06 smithi167 podman[67058]: 2024-04-23 10:28:06.282638452 +0000 UTC m=+0.662183556 container remove e7e7cde3c441e5bbd424fd99a266613e280d3216347c46e2b67d8da9c6d30561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-23T10:28:06.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:06 smithi167 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=139/n/a 2024-04-23T10:28:06.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:06 smithi167 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-23T10:28:07.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:07 smithi146 ceph-mon[32800]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-04-23T10:28:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:07 smithi069 ceph-mon[29593]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-04-23T10:28:07.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:07 smithi167 ceph-mon[32940]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-04-23T10:28:09.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:09 smithi146 ceph-mon[32800]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-23T10:28:09.486 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir untar_tar 2024-04-23T10:28:09.489 INFO:tasks.workunit.client.0.smithi069.stderr:+ cd untar_tar 2024-04-23T10:28:09.489 INFO:tasks.workunit.client.0.smithi069.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-04-23T10:28:09.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:09 smithi069 ceph-mon[29593]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-23T10:28:09.519 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ 2024-04-23T10:28:09.521 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/00-INDEX 2024-04-23T10:28:09.522 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/ 2024-04-23T10:28:09.523 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/README 2024-04-23T10:28:09.524 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-04-23T10:28:09.526 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-04-23T10:28:09.527 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-04-23T10:28:09.528 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-04-23T10:28:09.529 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-04-23T10:28:09.531 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-04-23T10:28:09.532 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-04-23T10:28:09.533 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-04-23T10:28:09.534 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-04-23T10:28:09.535 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-04-23T10:28:09.537 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-04-23T10:28:09.538 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-04-23T10:28:09.539 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-04-23T10:28:09.541 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-04-23T10:28:09.542 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-04-23T10:28:09.543 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-04-23T10:28:09.544 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-04-23T10:28:09.545 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-04-23T10:28:09.546 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-04-23T10:28:09.548 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-04-23T10:28:09.549 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-04-23T10:28:09.550 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-04-23T10:28:09.551 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-04-23T10:28:09.553 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-04-23T10:28:09.554 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-04-23T10:28:09.555 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-04-23T10:28:09.556 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-04-23T10:28:09.557 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-04-23T10:28:09.558 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-04-23T10:28:09.560 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-04-23T10:28:09.561 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-04-23T10:28:09.562 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-04-23T10:28:09.563 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-04-23T10:28:09.564 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-04-23T10:28:09.565 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-04-23T10:28:09.566 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-04-23T10:28:09.567 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-04-23T10:28:09.568 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-04-23T10:28:09.569 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-04-23T10:28:09.570 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-04-23T10:28:09.571 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-04-23T10:28:09.573 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-04-23T10:28:09.574 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-04-23T10:28:09.575 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-04-23T10:28:09.576 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-04-23T10:28:09.578 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-04-23T10:28:09.579 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-04-23T10:28:09.580 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-04-23T10:28:09.581 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-04-23T10:28:09.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:09 smithi167 ceph-mon[32940]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-23T10:28:09.582 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-04-23T10:28:09.583 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-04-23T10:28:09.584 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-04-23T10:28:09.585 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-04-23T10:28:09.586 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-04-23T10:28:09.587 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-04-23T10:28:09.588 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-04-23T10:28:09.589 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-04-23T10:28:09.590 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-04-23T10:28:09.591 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-04-23T10:28:09.592 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-04-23T10:28:09.593 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-04-23T10:28:09.594 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-04-23T10:28:09.595 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-04-23T10:28:09.596 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-04-23T10:28:09.597 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-04-23T10:28:09.598 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-04-23T10:28:09.599 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-04-23T10:28:09.600 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-04-23T10:28:09.601 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-04-23T10:28:09.602 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-04-23T10:28:09.603 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-04-23T10:28:09.604 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-04-23T10:28:09.606 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-04-23T10:28:09.606 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-04-23T10:28:09.607 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-04-23T10:28:09.608 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-04-23T10:28:09.609 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-04-23T10:28:09.610 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-04-23T10:28:09.611 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-04-23T10:28:09.612 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-04-23T10:28:09.613 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-04-23T10:28:09.614 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-04-23T10:28:09.615 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-04-23T10:28:09.616 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-04-23T10:28:09.618 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-04-23T10:28:09.619 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-04-23T10:28:09.620 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-04-23T10:28:09.621 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-04-23T10:28:09.622 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-04-23T10:28:09.623 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-04-23T10:28:09.624 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-04-23T10:28:09.626 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-04-23T10:28:09.627 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-04-23T10:28:09.628 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-04-23T10:28:09.629 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-04-23T10:28:09.630 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-04-23T10:28:09.631 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-04-23T10:28:09.632 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-04-23T10:28:09.633 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-04-23T10:28:09.634 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-04-23T10:28:09.635 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-04-23T10:28:09.636 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-04-23T10:28:09.637 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-04-23T10:28:09.638 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-04-23T10:28:09.639 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-04-23T10:28:09.640 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-04-23T10:28:09.642 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-04-23T10:28:09.643 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-04-23T10:28:09.644 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-04-23T10:28:09.645 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-04-23T10:28:09.646 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-04-23T10:28:09.647 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-04-23T10:28:09.648 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-04-23T10:28:09.649 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-04-23T10:28:09.650 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-04-23T10:28:09.652 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-04-23T10:28:09.653 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-04-23T10:28:09.654 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-04-23T10:28:09.655 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-04-23T10:28:09.656 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-04-23T10:28:09.657 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-04-23T10:28:09.658 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-04-23T10:28:09.659 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-04-23T10:28:09.660 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-04-23T10:28:09.661 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-04-23T10:28:09.662 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-04-23T10:28:09.663 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-04-23T10:28:09.664 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-04-23T10:28:09.665 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-04-23T10:28:09.666 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-04-23T10:28:09.667 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-04-23T10:28:09.668 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-04-23T10:28:09.669 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-04-23T10:28:09.670 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-04-23T10:28:09.671 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-04-23T10:28:09.672 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-04-23T10:28:09.673 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-04-23T10:28:09.674 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-04-23T10:28:09.675 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-04-23T10:28:09.676 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-04-23T10:28:09.677 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-04-23T10:28:09.678 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-04-23T10:28:09.680 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-04-23T10:28:09.680 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-04-23T10:28:09.681 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-04-23T10:28:09.682 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-04-23T10:28:09.683 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-04-23T10:28:09.684 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-04-23T10:28:09.685 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-04-23T10:28:09.686 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-04-23T10:28:09.687 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-04-23T10:28:09.688 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-04-23T10:28:09.689 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-04-23T10:28:09.690 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-04-23T10:28:09.691 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-04-23T10:28:09.692 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-04-23T10:28:09.693 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-04-23T10:28:09.694 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-04-23T10:28:09.695 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-04-23T10:28:09.696 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-04-23T10:28:09.698 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-04-23T10:28:09.698 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-04-23T10:28:09.699 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-04-23T10:28:09.700 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-04-23T10:28:09.701 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-04-23T10:28:09.702 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-04-23T10:28:09.703 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-04-23T10:28:09.704 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-04-23T10:28:09.705 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-04-23T10:28:09.707 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-04-23T10:28:09.708 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-04-23T10:28:09.709 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-04-23T10:28:09.710 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-04-23T10:28:09.712 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-04-23T10:28:09.713 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-04-23T10:28:09.715 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-04-23T10:28:09.717 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-04-23T10:28:09.718 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-04-23T10:28:09.719 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-04-23T10:28:09.720 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-04-23T10:28:09.721 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-04-23T10:28:09.722 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-04-23T10:28:09.723 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-04-23T10:28:09.724 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-04-23T10:28:09.725 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-04-23T10:28:09.726 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-04-23T10:28:09.727 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-04-23T10:28:09.728 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-04-23T10:28:09.729 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-04-23T10:28:09.730 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-04-23T10:28:09.730 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-04-23T10:28:09.731 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-04-23T10:28:09.733 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-04-23T10:28:09.734 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-04-23T10:28:09.735 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-04-23T10:28:11.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:11 smithi146 ceph-mon[32800]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 KiB/s wr, 28 op/s 2024-04-23T10:28:11.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:11 smithi069 ceph-mon[29593]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 KiB/s wr, 28 op/s 2024-04-23T10:28:11.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:11 smithi167 ceph-mon[32940]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 KiB/s wr, 28 op/s 2024-04-23T10:28:11.666 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-04-23T10:28:11.668 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-04-23T10:28:11.670 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-04-23T10:28:11.671 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-04-23T10:28:11.672 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-04-23T10:28:11.673 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-04-23T10:28:11.674 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-04-23T10:28:11.675 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-04-23T10:28:11.676 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-04-23T10:28:11.677 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-04-23T10:28:11.678 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-04-23T10:28:11.679 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-04-23T10:28:11.680 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-04-23T10:28:11.681 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-04-23T10:28:11.682 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-04-23T10:28:11.683 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-04-23T10:28:11.684 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-04-23T10:28:11.686 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-04-23T10:28:11.687 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-04-23T10:28:11.688 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-04-23T10:28:11.689 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-04-23T10:28:11.690 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-04-23T10:28:11.691 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-04-23T10:28:11.692 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-04-23T10:28:11.693 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-04-23T10:28:11.694 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-04-23T10:28:11.695 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-04-23T10:28:11.696 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-04-23T10:28:11.697 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-04-23T10:28:11.698 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-04-23T10:28:11.699 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-04-23T10:28:11.700 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-04-23T10:28:11.701 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-04-23T10:28:11.702 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-04-23T10:28:11.703 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-04-23T10:28:11.704 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-04-23T10:28:11.705 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-04-23T10:28:11.707 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-04-23T10:28:11.708 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-04-23T10:28:11.709 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-04-23T10:28:11.710 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-04-23T10:28:11.711 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-04-23T10:28:11.712 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-04-23T10:28:11.713 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-04-23T10:28:11.714 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-04-23T10:28:11.715 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-04-23T10:28:11.716 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-04-23T10:28:11.717 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-04-23T10:28:11.718 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-04-23T10:28:11.719 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-04-23T10:28:11.720 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-04-23T10:28:11.721 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-04-23T10:28:11.722 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-04-23T10:28:11.723 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-04-23T10:28:11.724 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-04-23T10:28:11.726 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-04-23T10:28:11.726 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-04-23T10:28:11.728 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-04-23T10:28:11.729 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-04-23T10:28:11.730 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-04-23T10:28:11.731 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-04-23T10:28:11.732 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-04-23T10:28:11.733 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-04-23T10:28:11.734 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/Changes 2024-04-23T10:28:11.735 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-04-23T10:28:11.736 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/CodingStyle 2024-04-23T10:28:11.737 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-04-23T10:28:11.738 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-04-23T10:28:11.739 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-04-23T10:28:11.740 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-04-23T10:28:11.741 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/ 2024-04-23T10:28:11.742 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-04-23T10:28:11.743 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-04-23T10:28:11.743 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-04-23T10:28:11.744 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-04-23T10:28:11.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-04-23T10:28:11.746 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-04-23T10:28:11.747 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-04-23T10:28:11.748 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-04-23T10:28:11.748 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-04-23T10:28:11.750 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-04-23T10:28:11.752 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-04-23T10:28:11.753 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-04-23T10:28:11.754 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-04-23T10:28:11.755 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-04-23T10:28:11.757 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-04-23T10:28:11.758 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-04-23T10:28:11.760 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-04-23T10:28:11.761 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-04-23T10:28:11.763 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-04-23T10:28:11.764 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-04-23T10:28:11.765 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-04-23T10:28:11.767 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-04-23T10:28:11.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-04-23T10:28:11.770 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-04-23T10:28:11.771 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-04-23T10:28:11.773 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-04-23T10:28:11.774 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-04-23T10:28:11.776 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-04-23T10:28:11.777 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-04-23T10:28:11.779 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-04-23T10:28:11.780 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-04-23T10:28:11.782 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-04-23T10:28:11.783 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-04-23T10:28:11.785 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-04-23T10:28:11.786 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-04-23T10:28:11.788 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-04-23T10:28:11.790 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-04-23T10:28:11.791 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-04-23T10:28:11.793 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-04-23T10:28:11.794 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-04-23T10:28:11.796 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-04-23T10:28:11.797 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-04-23T10:28:11.798 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-04-23T10:28:11.800 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-04-23T10:28:11.801 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-04-23T10:28:11.802 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-04-23T10:28:11.803 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-04-23T10:28:11.804 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-04-23T10:28:11.805 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-04-23T10:28:11.806 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-04-23T10:28:11.807 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-04-23T10:28:11.809 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-04-23T10:28:11.811 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-04-23T10:28:11.813 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-04-23T10:28:11.813 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-04-23T10:28:11.814 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-04-23T10:28:11.815 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-04-23T10:28:11.816 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-04-23T10:28:11.817 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-04-23T10:28:11.818 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-04-23T10:28:11.819 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-04-23T10:28:11.820 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-04-23T10:28:11.821 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-04-23T10:28:11.822 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-04-23T10:28:11.823 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-04-23T10:28:11.824 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-04-23T10:28:11.825 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-04-23T10:28:11.826 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-04-23T10:28:11.827 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-04-23T10:28:11.827 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-04-23T10:28:11.828 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-04-23T10:28:11.830 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-04-23T10:28:11.831 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-04-23T10:28:11.832 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-04-23T10:28:11.833 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-04-23T10:28:11.834 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-04-23T10:28:11.835 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-04-23T10:28:11.836 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-04-23T10:28:11.836 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-04-23T10:28:11.837 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-04-23T10:28:11.838 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-04-23T10:28:11.839 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-04-23T10:28:11.840 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-04-23T10:28:11.841 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-04-23T10:28:11.842 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-04-23T10:28:11.843 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-04-23T10:28:11.844 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-04-23T10:28:11.845 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-04-23T10:28:11.846 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-04-23T10:28:11.847 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-04-23T10:28:11.848 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-04-23T10:28:11.849 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-04-23T10:28:11.850 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-04-23T10:28:11.851 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-04-23T10:28:11.852 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-04-23T10:28:11.853 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-04-23T10:28:11.854 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-04-23T10:28:11.855 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-04-23T10:28:11.856 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-04-23T10:28:11.857 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-04-23T10:28:11.858 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-04-23T10:28:11.859 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-04-23T10:28:11.860 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-04-23T10:28:11.861 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-04-23T10:28:11.862 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-04-23T10:28:11.863 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-04-23T10:28:11.865 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-04-23T10:28:11.865 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-04-23T10:28:11.867 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-04-23T10:28:11.868 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-04-23T10:28:11.869 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-04-23T10:28:11.870 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-04-23T10:28:11.871 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-04-23T10:28:11.872 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-04-23T10:28:11.873 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-04-23T10:28:11.874 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-04-23T10:28:11.875 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-04-23T10:28:11.876 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-04-23T10:28:11.877 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-04-23T10:28:11.878 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-04-23T10:28:11.879 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-04-23T10:28:11.880 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-04-23T10:28:11.881 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-04-23T10:28:11.882 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-04-23T10:28:11.883 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-04-23T10:28:11.884 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-04-23T10:28:11.885 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-04-23T10:28:11.886 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-04-23T10:28:11.887 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-04-23T10:28:11.888 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-04-23T10:28:11.889 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-04-23T10:28:11.890 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-04-23T10:28:11.891 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-04-23T10:28:11.892 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-04-23T10:28:11.893 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-04-23T10:28:11.894 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-04-23T10:28:11.895 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-04-23T10:28:11.896 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-04-23T10:28:11.897 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-04-23T10:28:11.898 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-04-23T10:28:11.899 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-04-23T10:28:11.900 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-04-23T10:28:11.901 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-04-23T10:28:11.902 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-04-23T10:28:11.903 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-04-23T10:28:11.904 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-04-23T10:28:11.905 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-04-23T10:28:11.906 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-04-23T10:28:11.907 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-04-23T10:28:11.908 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-04-23T10:28:11.909 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-04-23T10:28:11.910 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-04-23T10:28:11.911 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-04-23T10:28:11.912 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-04-23T10:28:11.913 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-04-23T10:28:11.914 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-04-23T10:28:11.915 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-04-23T10:28:11.916 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-04-23T10:28:11.917 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-04-23T10:28:11.918 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-04-23T10:28:11.919 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-04-23T10:28:11.920 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-04-23T10:28:11.921 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-04-23T10:28:11.922 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-04-23T10:28:11.923 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-04-23T10:28:11.924 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-04-23T10:28:11.925 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-04-23T10:28:11.926 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-04-23T10:28:11.927 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-04-23T10:28:11.928 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-04-23T10:28:11.929 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-04-23T10:28:11.930 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-04-23T10:28:11.931 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-04-23T10:28:11.932 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-04-23T10:28:11.933 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-04-23T10:28:11.934 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-04-23T10:28:11.935 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-04-23T10:28:11.935 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-04-23T10:28:11.936 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-04-23T10:28:11.937 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-04-23T10:28:11.938 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-04-23T10:28:11.939 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-04-23T10:28:11.940 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-04-23T10:28:11.941 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-04-23T10:28:11.942 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-04-23T10:28:11.943 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-04-23T10:28:11.944 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-04-23T10:28:11.945 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-04-23T10:28:11.946 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-04-23T10:28:11.947 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-04-23T10:28:11.948 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-04-23T10:28:11.949 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-04-23T10:28:11.950 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-04-23T10:28:11.951 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-04-23T10:28:11.952 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-04-23T10:28:11.953 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-04-23T10:28:11.954 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-04-23T10:28:11.955 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-04-23T10:28:13.384 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:13 smithi167 ceph-mon[32940]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-23T10:28:13.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:13 smithi146 ceph-mon[32800]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-23T10:28:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:13 smithi069 ceph-mon[29593]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-23T10:28:14.278 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-04-23T10:28:14.280 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-04-23T10:28:14.282 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-04-23T10:28:14.283 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-04-23T10:28:14.285 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-04-23T10:28:14.287 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-04-23T10:28:14.288 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-04-23T10:28:14.289 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-04-23T10:28:14.290 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-04-23T10:28:14.291 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-04-23T10:28:14.293 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-04-23T10:28:14.295 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-04-23T10:28:14.296 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-04-23T10:28:14.298 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-04-23T10:28:14.300 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-04-23T10:28:14.301 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-04-23T10:28:14.303 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-04-23T10:28:14.305 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-04-23T10:28:14.306 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-04-23T10:28:14.308 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-04-23T10:28:14.309 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-04-23T10:28:14.311 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-04-23T10:28:14.313 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-04-23T10:28:14.314 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-04-23T10:28:14.316 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-04-23T10:28:14.317 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-04-23T10:28:14.319 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-04-23T10:28:14.321 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-04-23T10:28:14.322 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-04-23T10:28:14.324 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-04-23T10:28:14.326 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-04-23T10:28:14.329 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-04-23T10:28:14.331 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-04-23T10:28:14.332 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-04-23T10:28:14.334 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/EDID/ 2024-04-23T10:28:14.335 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-04-23T10:28:14.337 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-04-23T10:28:14.338 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-04-23T10:28:14.339 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-04-23T10:28:14.340 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-04-23T10:28:14.341 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-04-23T10:28:14.342 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-04-23T10:28:14.343 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-04-23T10:28:14.344 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-04-23T10:28:14.344 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/EDID/hex 2024-04-23T10:28:14.346 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/HOWTO 2024-04-23T10:28:14.346 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-04-23T10:28:14.347 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-04-23T10:28:14.348 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-04-23T10:28:14.349 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-04-23T10:28:14.350 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-04-23T10:28:14.351 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/Makefile 2024-04-23T10:28:14.352 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-04-23T10:28:14.353 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/PCI/ 2024-04-23T10:28:14.354 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-04-23T10:28:14.355 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-04-23T10:28:14.356 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-04-23T10:28:14.357 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-04-23T10:28:14.358 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-04-23T10:28:14.359 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-04-23T10:28:14.360 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-04-23T10:28:14.361 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/ 2024-04-23T10:28:14.362 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-04-23T10:28:14.363 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-04-23T10:28:14.364 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-04-23T10:28:14.365 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-04-23T10:28:14.366 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-04-23T10:28:14.367 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-04-23T10:28:14.368 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-04-23T10:28:14.369 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-04-23T10:28:14.370 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-04-23T10:28:14.371 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-04-23T10:28:14.372 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-04-23T10:28:14.373 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-04-23T10:28:14.374 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-04-23T10:28:14.375 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-04-23T10:28:14.376 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-04-23T10:28:14.377 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-04-23T10:28:14.378 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-04-23T10:28:14.379 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-04-23T10:28:14.380 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/SAK.txt 2024-04-23T10:28:14.381 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/SM501.txt 2024-04-23T10:28:14.382 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-04-23T10:28:14.383 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-04-23T10:28:14.384 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-04-23T10:28:14.385 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-04-23T10:28:14.386 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-04-23T10:28:14.387 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/accounting/ 2024-04-23T10:28:14.389 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-04-23T10:28:14.389 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-04-23T10:28:14.390 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-04-23T10:28:14.391 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-04-23T10:28:14.392 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-04-23T10:28:14.393 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-04-23T10:28:14.394 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-04-23T10:28:14.395 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/ 2024-04-23T10:28:14.396 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-04-23T10:28:14.397 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-04-23T10:28:14.398 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-04-23T10:28:14.399 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-04-23T10:28:14.400 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-04-23T10:28:14.401 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-04-23T10:28:14.402 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-04-23T10:28:14.403 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-04-23T10:28:14.404 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-04-23T10:28:14.405 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-04-23T10:28:14.406 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-04-23T10:28:14.407 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-04-23T10:28:14.408 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-04-23T10:28:14.409 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/aoe/ 2024-04-23T10:28:14.409 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-04-23T10:28:14.410 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-04-23T10:28:14.411 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-04-23T10:28:14.412 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-04-23T10:28:14.413 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-04-23T10:28:14.414 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-04-23T10:28:14.415 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-04-23T10:28:14.416 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/ 2024-04-23T10:28:14.417 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-04-23T10:28:14.418 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-04-23T10:28:14.418 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-04-23T10:28:14.419 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Booting 2024-04-23T10:28:14.420 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-04-23T10:28:14.421 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-04-23T10:28:14.422 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-04-23T10:28:14.423 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-04-23T10:28:14.424 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-04-23T10:28:14.425 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-04-23T10:28:14.426 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-04-23T10:28:14.427 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-04-23T10:28:14.428 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-04-23T10:28:14.429 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-04-23T10:28:14.430 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Porting 2024-04-23T10:28:14.431 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/README 2024-04-23T10:28:14.432 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-04-23T10:28:14.433 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-04-23T10:28:14.434 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-04-23T10:28:14.435 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-04-23T10:28:14.436 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-04-23T10:28:14.437 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-04-23T10:28:14.438 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-04-23T10:28:14.439 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-04-23T10:28:14.440 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-04-23T10:28:14.441 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-04-23T10:28:14.441 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-04-23T10:28:14.443 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-04-23T10:28:14.444 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-04-23T10:28:14.445 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-04-23T10:28:14.446 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-04-23T10:28:14.446 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-04-23T10:28:14.447 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-04-23T10:28:14.448 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-04-23T10:28:14.449 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-04-23T10:28:14.450 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-04-23T10:28:14.451 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-04-23T10:28:14.452 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-04-23T10:28:14.454 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-04-23T10:28:14.454 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-04-23T10:28:14.455 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-04-23T10:28:14.456 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-04-23T10:28:14.457 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-04-23T10:28:14.458 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-04-23T10:28:14.459 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-04-23T10:28:14.460 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-04-23T10:28:14.461 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-04-23T10:28:14.462 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-04-23T10:28:14.463 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-04-23T10:28:14.464 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-04-23T10:28:14.465 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-04-23T10:28:14.466 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-04-23T10:28:14.467 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-04-23T10:28:14.468 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-04-23T10:28:14.469 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-04-23T10:28:14.470 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-04-23T10:28:14.471 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-04-23T10:28:14.472 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-04-23T10:28:14.473 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-04-23T10:28:14.474 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/Setup 2024-04-23T10:28:14.475 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-04-23T10:28:14.475 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-04-23T10:28:14.476 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-04-23T10:28:14.478 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-04-23T10:28:14.479 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-04-23T10:28:14.479 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-04-23T10:28:14.480 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-04-23T10:28:14.481 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-04-23T10:28:14.482 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-04-23T10:28:14.483 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-04-23T10:28:14.484 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-04-23T10:28:14.485 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-04-23T10:28:14.486 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-04-23T10:28:14.487 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-04-23T10:28:14.488 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-04-23T10:28:14.489 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-04-23T10:28:14.490 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-04-23T10:28:14.491 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-04-23T10:28:14.492 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-04-23T10:28:14.493 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-04-23T10:28:14.494 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-04-23T10:28:14.495 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-04-23T10:28:14.496 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-04-23T10:28:14.497 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-04-23T10:28:14.498 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-04-23T10:28:14.499 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-04-23T10:28:14.500 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-04-23T10:28:14.501 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-04-23T10:28:14.502 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-04-23T10:28:14.503 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-04-23T10:28:14.505 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm64/ 2024-04-23T10:28:14.507 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-04-23T10:28:14.508 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-04-23T10:28:14.509 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-04-23T10:28:14.510 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-04-23T10:28:14.511 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-04-23T10:28:14.512 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-04-23T10:28:14.513 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-04-23T10:28:14.514 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-04-23T10:28:14.515 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-04-23T10:28:14.516 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-04-23T10:28:14.518 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-04-23T10:28:14.518 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-04-23T10:28:14.519 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/backlight/ 2024-04-23T10:28:14.520 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-04-23T10:28:14.521 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-04-23T10:28:14.522 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-04-23T10:28:14.523 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/bcache.txt 2024-04-23T10:28:14.524 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-04-23T10:28:14.525 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blackfin/ 2024-04-23T10:28:14.526 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-04-23T10:28:14.527 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-04-23T10:28:14.528 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-04-23T10:28:14.529 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-04-23T10:28:14.530 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-04-23T10:28:14.531 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/ 2024-04-23T10:28:14.532 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-04-23T10:28:14.533 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-04-23T10:28:14.534 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-04-23T10:28:14.535 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-04-23T10:28:14.536 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-04-23T10:28:14.537 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-04-23T10:28:14.538 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-04-23T10:28:14.539 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-04-23T10:28:14.540 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-04-23T10:28:14.541 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-04-23T10:28:14.542 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-04-23T10:28:14.543 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/request.txt 2024-04-23T10:28:14.544 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-04-23T10:28:14.545 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-04-23T10:28:14.546 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-04-23T10:28:14.547 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/ 2024-04-23T10:28:14.548 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-04-23T10:28:14.549 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-04-23T10:28:14.550 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-04-23T10:28:14.551 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-04-23T10:28:14.552 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-04-23T10:28:14.553 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-04-23T10:28:14.554 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-04-23T10:28:14.555 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-04-23T10:28:14.556 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-04-23T10:28:14.557 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-04-23T10:28:14.558 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-04-23T10:28:14.559 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-04-23T10:28:14.560 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-04-23T10:28:14.561 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-04-23T10:28:14.562 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-04-23T10:28:14.563 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-04-23T10:28:14.564 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-04-23T10:28:14.565 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-04-23T10:28:14.566 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-04-23T10:28:14.567 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-04-23T10:28:14.568 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-04-23T10:28:14.570 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-04-23T10:28:14.571 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-04-23T10:28:14.572 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-04-23T10:28:14.573 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-04-23T10:28:14.574 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-04-23T10:28:14.575 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cdrom/ 2024-04-23T10:28:14.576 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-04-23T10:28:14.577 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-04-23T10:28:14.578 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-04-23T10:28:14.579 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-04-23T10:28:14.580 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-04-23T10:28:14.581 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/ 2024-04-23T10:28:14.582 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-04-23T10:28:14.583 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-04-23T10:28:14.584 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-04-23T10:28:14.585 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-04-23T10:28:14.586 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-04-23T10:28:14.587 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-04-23T10:28:14.587 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-04-23T10:28:14.588 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-04-23T10:28:14.589 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-04-23T10:28:14.590 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-04-23T10:28:14.591 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-04-23T10:28:14.592 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-04-23T10:28:14.593 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-04-23T10:28:14.594 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-04-23T10:28:14.595 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/clk.txt 2024-04-23T10:28:14.596 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-04-23T10:28:14.597 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/connector/ 2024-04-23T10:28:14.598 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-04-23T10:28:14.599 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-04-23T10:28:14.600 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-04-23T10:28:14.601 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-04-23T10:28:14.602 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-04-23T10:28:14.603 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/console/ 2024-04-23T10:28:14.604 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/console/console.txt 2024-04-23T10:28:14.605 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-04-23T10:28:14.606 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-04-23T10:28:14.607 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-04-23T10:28:14.608 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-04-23T10:28:14.609 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-04-23T10:28:14.610 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-04-23T10:28:14.612 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-04-23T10:28:14.613 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-04-23T10:28:14.615 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-04-23T10:28:14.617 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-04-23T10:28:14.618 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-04-23T10:28:14.619 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-04-23T10:28:14.621 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-04-23T10:28:14.623 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-04-23T10:28:14.624 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-04-23T10:28:14.626 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-04-23T10:28:14.627 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-04-23T10:28:14.628 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-04-23T10:28:14.629 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-04-23T10:28:14.630 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-04-23T10:28:14.631 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/crc32.txt 2024-04-23T10:28:14.632 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cris/ 2024-04-23T10:28:14.633 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/cris/README 2024-04-23T10:28:14.634 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/crypto/ 2024-04-23T10:28:14.635 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-04-23T10:28:14.636 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-04-23T10:28:14.637 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-04-23T10:28:14.638 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-04-23T10:28:14.639 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-04-23T10:28:14.640 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-04-23T10:28:14.642 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-04-23T10:28:14.643 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-04-23T10:28:14.644 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-04-23T10:28:14.645 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/development-process/ 2024-04-23T10:28:14.646 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-04-23T10:28:14.646 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-04-23T10:28:14.648 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-04-23T10:28:14.649 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-04-23T10:28:14.650 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-04-23T10:28:14.651 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-04-23T10:28:14.652 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-04-23T10:28:14.653 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-04-23T10:28:14.654 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-04-23T10:28:14.655 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-04-23T10:28:14.656 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-04-23T10:28:14.657 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-04-23T10:28:14.658 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-04-23T10:28:14.659 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-04-23T10:28:14.660 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-04-23T10:28:14.661 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-04-23T10:28:14.662 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-04-23T10:28:14.663 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-04-23T10:28:14.664 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-04-23T10:28:14.665 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-04-23T10:28:14.666 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-04-23T10:28:14.667 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-04-23T10:28:14.668 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-04-23T10:28:14.669 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-04-23T10:28:14.670 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-04-23T10:28:14.671 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-04-23T10:28:14.672 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-04-23T10:28:14.673 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-04-23T10:28:14.674 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-04-23T10:28:14.675 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-04-23T10:28:14.676 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-04-23T10:28:14.677 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devices.txt 2024-04-23T10:28:14.679 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/ 2024-04-23T10:28:14.680 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-04-23T10:28:14.681 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-04-23T10:28:14.681 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-04-23T10:28:14.682 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-04-23T10:28:14.683 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-04-23T10:28:14.684 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-04-23T10:28:14.685 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-04-23T10:28:14.686 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-04-23T10:28:14.686 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-04-23T10:28:14.687 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-04-23T10:28:14.688 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-04-23T10:28:14.689 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-04-23T10:28:14.691 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-04-23T10:28:14.691 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-04-23T10:28:14.693 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-04-23T10:28:14.694 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-04-23T10:28:14.695 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-04-23T10:28:14.696 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-04-23T10:28:14.697 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-04-23T10:28:14.698 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-04-23T10:28:14.699 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-04-23T10:28:14.700 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-04-23T10:28:14.701 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-04-23T10:28:14.702 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-04-23T10:28:14.703 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-04-23T10:28:14.704 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-04-23T10:28:14.705 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-04-23T10:28:14.706 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-04-23T10:28:14.707 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-04-23T10:28:14.708 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-04-23T10:28:14.709 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-04-23T10:28:14.710 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-04-23T10:28:14.711 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-04-23T10:28:14.712 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-04-23T10:28:14.714 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-04-23T10:28:14.715 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-04-23T10:28:14.716 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-04-23T10:28:14.717 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-04-23T10:28:14.718 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-04-23T10:28:14.719 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-04-23T10:28:14.720 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-04-23T10:28:14.721 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-04-23T10:28:14.722 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-04-23T10:28:14.723 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-04-23T10:28:14.724 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-04-23T10:28:14.725 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-04-23T10:28:14.726 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-04-23T10:28:14.727 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-04-23T10:28:14.728 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-04-23T10:28:14.729 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-04-23T10:28:14.730 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-04-23T10:28:14.731 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-04-23T10:28:14.732 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-04-23T10:28:14.733 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-04-23T10:28:14.734 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-04-23T10:28:14.735 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-04-23T10:28:14.736 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-04-23T10:28:14.737 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-04-23T10:28:14.738 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-04-23T10:28:14.739 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-04-23T10:28:14.741 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-04-23T10:28:14.742 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-04-23T10:28:14.743 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-04-23T10:28:14.744 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-04-23T10:28:14.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-04-23T10:28:14.746 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-04-23T10:28:14.747 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-04-23T10:28:14.748 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-04-23T10:28:14.749 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-04-23T10:28:14.750 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-04-23T10:28:14.751 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-04-23T10:28:14.752 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-04-23T10:28:14.753 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-04-23T10:28:14.754 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-04-23T10:28:14.755 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-04-23T10:28:14.756 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-04-23T10:28:14.757 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-04-23T10:28:14.759 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-04-23T10:28:14.759 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-04-23T10:28:14.761 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-04-23T10:28:14.762 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-04-23T10:28:14.763 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-04-23T10:28:14.764 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-04-23T10:28:14.765 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-04-23T10:28:14.766 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-04-23T10:28:14.767 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-04-23T10:28:14.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-04-23T10:28:14.769 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-04-23T10:28:14.770 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-04-23T10:28:14.771 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-04-23T10:28:14.772 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-04-23T10:28:14.773 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-04-23T10:28:14.774 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-04-23T10:28:14.775 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-04-23T10:28:14.776 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-04-23T10:28:14.777 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-04-23T10:28:14.778 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-04-23T10:28:14.779 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-04-23T10:28:14.780 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-04-23T10:28:14.781 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-04-23T10:28:14.783 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-04-23T10:28:14.784 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-04-23T10:28:14.785 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-04-23T10:28:14.786 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-04-23T10:28:14.787 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-04-23T10:28:14.789 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-04-23T10:28:14.790 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-04-23T10:28:14.791 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-04-23T10:28:14.792 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-04-23T10:28:14.793 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-04-23T10:28:14.794 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-04-23T10:28:14.795 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-04-23T10:28:14.796 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-04-23T10:28:14.797 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-04-23T10:28:14.798 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-04-23T10:28:14.799 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-04-23T10:28:14.800 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-04-23T10:28:14.801 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-04-23T10:28:14.803 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-04-23T10:28:14.804 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-04-23T10:28:14.805 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-04-23T10:28:14.806 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-04-23T10:28:14.807 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-04-23T10:28:14.808 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-04-23T10:28:14.809 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-04-23T10:28:14.810 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-04-23T10:28:14.810 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-04-23T10:28:14.811 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-04-23T10:28:14.813 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-04-23T10:28:14.814 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-04-23T10:28:14.815 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-04-23T10:28:14.816 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-04-23T10:28:14.817 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-04-23T10:28:14.817 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-04-23T10:28:14.819 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-04-23T10:28:14.820 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-04-23T10:28:14.821 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-04-23T10:28:14.822 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-04-23T10:28:14.823 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-04-23T10:28:14.824 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-04-23T10:28:14.825 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-04-23T10:28:14.826 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-04-23T10:28:14.827 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-04-23T10:28:14.828 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-04-23T10:28:14.829 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-04-23T10:28:14.830 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-04-23T10:28:14.831 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-04-23T10:28:14.833 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-04-23T10:28:14.834 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-04-23T10:28:14.834 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-04-23T10:28:14.836 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-04-23T10:28:14.837 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-04-23T10:28:14.838 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-04-23T10:28:14.839 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-04-23T10:28:14.840 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-04-23T10:28:14.841 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-04-23T10:28:14.842 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-04-23T10:28:14.843 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-04-23T10:28:15.079 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-04-23T10:28:15.080 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-04-23T10:28:15.082 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-04-23T10:28:15.084 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-04-23T10:28:15.086 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-04-23T10:28:15.087 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-04-23T10:28:15.089 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-04-23T10:28:15.090 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-04-23T10:28:15.092 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-04-23T10:28:15.093 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-04-23T10:28:15.095 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-04-23T10:28:15.096 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-04-23T10:28:15.098 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-04-23T10:28:15.100 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-04-23T10:28:15.101 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-04-23T10:28:15.103 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-04-23T10:28:15.105 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-04-23T10:28:15.106 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-04-23T10:28:15.108 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-04-23T10:28:15.109 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-04-23T10:28:15.110 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-04-23T10:28:15.113 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-04-23T10:28:15.114 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-04-23T10:28:15.114 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-04-23T10:28:15.114 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-04-23T10:28:15.115 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-04-23T10:28:15.116 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-04-23T10:28:15.117 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-04-23T10:28:15.118 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-04-23T10:28:15.119 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-04-23T10:28:15.120 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-04-23T10:28:15.121 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-04-23T10:28:15.121 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-04-23T10:28:15.122 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-04-23T10:28:15.123 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-04-23T10:28:15.124 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-04-23T10:28:15.125 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-04-23T10:28:15.126 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-04-23T10:28:15.127 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-04-23T10:28:15.128 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-04-23T10:28:15.129 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-04-23T10:28:15.130 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-04-23T10:28:15.132 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-04-23T10:28:15.133 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-04-23T10:28:15.134 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-04-23T10:28:15.135 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-04-23T10:28:15.136 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-04-23T10:28:15.137 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-04-23T10:28:15.138 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-04-23T10:28:15.139 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-04-23T10:28:15.141 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-04-23T10:28:15.141 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-04-23T10:28:15.143 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-04-23T10:28:15.144 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-04-23T10:28:15.145 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-04-23T10:28:15.146 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-04-23T10:28:15.147 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-04-23T10:28:15.148 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-04-23T10:28:15.149 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-04-23T10:28:15.150 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-04-23T10:28:15.151 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-04-23T10:28:15.152 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-04-23T10:28:15.153 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-04-23T10:28:15.154 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-04-23T10:28:15.155 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-04-23T10:28:15.157 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-04-23T10:28:15.158 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-04-23T10:28:15.159 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-04-23T10:28:15.160 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-04-23T10:28:15.161 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-04-23T10:28:15.162 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-04-23T10:28:15.163 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-04-23T10:28:15.164 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-04-23T10:28:15.165 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-04-23T10:28:15.166 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-04-23T10:28:15.167 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-04-23T10:28:15.168 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-04-23T10:28:15.170 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-04-23T10:28:15.170 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-04-23T10:28:15.171 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-04-23T10:28:15.172 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-04-23T10:28:15.173 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-04-23T10:28:15.174 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-04-23T10:28:15.175 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-04-23T10:28:15.176 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-04-23T10:28:15.177 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-04-23T10:28:15.178 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-04-23T10:28:15.179 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-04-23T10:28:15.180 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-04-23T10:28:15.181 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-04-23T10:28:15.182 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-04-23T10:28:15.183 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-04-23T10:28:15.184 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-04-23T10:28:15.185 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-04-23T10:28:15.187 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-04-23T10:28:15.188 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-04-23T10:28:15.189 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-04-23T10:28:15.190 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-04-23T10:28:15.191 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-04-23T10:28:15.192 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-04-23T10:28:15.193 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-04-23T10:28:15.194 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-04-23T10:28:15.195 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-04-23T10:28:15.196 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-04-23T10:28:15.197 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-04-23T10:28:15.198 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-04-23T10:28:15.199 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-04-23T10:28:15.200 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-04-23T10:28:15.201 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-04-23T10:28:15.202 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-04-23T10:28:15.203 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-04-23T10:28:15.204 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-04-23T10:28:15.205 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-04-23T10:28:15.206 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-04-23T10:28:15.207 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-04-23T10:28:15.208 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-04-23T10:28:15.209 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-04-23T10:28:15.210 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-04-23T10:28:15.211 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-04-23T10:28:15.212 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-04-23T10:28:15.213 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-04-23T10:28:15.214 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-04-23T10:28:15.216 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-04-23T10:28:15.216 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-04-23T10:28:15.217 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-04-23T10:28:15.218 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-04-23T10:28:15.219 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-04-23T10:28:15.220 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-04-23T10:28:15.221 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-04-23T10:28:15.222 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-04-23T10:28:15.223 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-04-23T10:28:15.224 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-04-23T10:28:15.225 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-04-23T10:28:15.226 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-04-23T10:28:15.227 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-04-23T10:28:15.228 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-04-23T10:28:15.229 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-04-23T10:28:15.230 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-04-23T10:28:15.231 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-04-23T10:28:15.232 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-04-23T10:28:15.233 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-04-23T10:28:15.234 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-04-23T10:28:15.236 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-04-23T10:28:15.236 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-04-23T10:28:15.238 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-04-23T10:28:15.239 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-04-23T10:28:15.240 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-04-23T10:28:15.241 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-04-23T10:28:15.242 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-04-23T10:28:15.243 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-04-23T10:28:15.244 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-04-23T10:28:15.245 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-04-23T10:28:15.246 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-04-23T10:28:15.247 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-04-23T10:28:15.248 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-04-23T10:28:15.249 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-04-23T10:28:15.250 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-04-23T10:28:15.251 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-04-23T10:28:15.252 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-04-23T10:28:15.253 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-04-23T10:28:15.254 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-04-23T10:28:15.255 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-04-23T10:28:15.256 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-04-23T10:28:15.257 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-04-23T10:28:15.258 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-04-23T10:28:15.259 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-04-23T10:28:15.260 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-04-23T10:28:15.261 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-04-23T10:28:15.262 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-04-23T10:28:15.263 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-04-23T10:28:15.264 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-04-23T10:28:15.265 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-04-23T10:28:15.266 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-04-23T10:28:15.267 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-04-23T10:28:15.268 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-04-23T10:28:15.270 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-04-23T10:28:15.271 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-04-23T10:28:15.272 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-04-23T10:28:15.272 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-04-23T10:28:15.274 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-04-23T10:28:15.274 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-04-23T10:28:15.275 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-04-23T10:28:15.276 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-04-23T10:28:15.277 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-04-23T10:28:15.278 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-04-23T10:28:15.279 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-04-23T10:28:15.280 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-04-23T10:28:15.281 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-04-23T10:28:15.282 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-04-23T10:28:15.283 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-04-23T10:28:15.284 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-04-23T10:28:15.286 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-04-23T10:28:15.287 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-04-23T10:28:15.287 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-04-23T10:28:15.288 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-04-23T10:28:15.289 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-04-23T10:28:15.290 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-04-23T10:28:15.291 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-04-23T10:28:15.292 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-04-23T10:28:15.293 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-04-23T10:28:15.294 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-04-23T10:28:15.295 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-04-23T10:28:15.296 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-04-23T10:28:15.297 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-04-23T10:28:15.298 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-04-23T10:28:15.299 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-04-23T10:28:15.300 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-04-23T10:28:15.301 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-04-23T10:28:15.302 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-04-23T10:28:15.303 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-04-23T10:28:15.304 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-04-23T10:28:15.305 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-04-23T10:28:15.305 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-04-23T10:28:15.306 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-04-23T10:28:15.308 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-04-23T10:28:15.308 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-04-23T10:28:15.309 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-04-23T10:28:15.310 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-04-23T10:28:15.313 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-04-23T10:28:15.313 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-04-23T10:28:15.313 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-04-23T10:28:15.314 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-04-23T10:28:15.315 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-04-23T10:28:15.316 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-04-23T10:28:15.317 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-04-23T10:28:15.318 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-04-23T10:28:15.319 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-04-23T10:28:15.320 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-04-23T10:28:15.321 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-04-23T10:28:15.322 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-04-23T10:28:15.323 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-04-23T10:28:15.324 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-04-23T10:28:15.325 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-04-23T10:28:15.326 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-04-23T10:28:15.327 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-04-23T10:28:15.328 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-04-23T10:28:15.329 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-04-23T10:28:15.330 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-04-23T10:28:15.331 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-04-23T10:28:15.332 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-04-23T10:28:15.333 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-04-23T10:28:15.334 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-04-23T10:28:15.335 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-04-23T10:28:15.336 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-04-23T10:28:15.337 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-04-23T10:28:15.338 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-04-23T10:28:15.339 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-04-23T10:28:15.340 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-04-23T10:28:15.341 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-04-23T10:28:15.342 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-04-23T10:28:15.343 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-04-23T10:28:15.344 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-04-23T10:28:15.345 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-04-23T10:28:15.346 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-04-23T10:28:15.347 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-04-23T10:28:15.348 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-04-23T10:28:15.349 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-04-23T10:28:15.350 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-04-23T10:28:15.351 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-04-23T10:28:15.352 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-04-23T10:28:15.353 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-04-23T10:28:15.354 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-04-23T10:28:15.355 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-04-23T10:28:15.356 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-04-23T10:28:15.357 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-04-23T10:28:15.358 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-04-23T10:28:15.359 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-04-23T10:28:15.360 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-04-23T10:28:15.361 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-04-23T10:28:15.362 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-04-23T10:28:15.363 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-04-23T10:28:15.364 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-04-23T10:28:15.365 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-04-23T10:28:15.367 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-04-23T10:28:15.368 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-04-23T10:28:15.369 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-04-23T10:28:15.370 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-04-23T10:28:15.371 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-04-23T10:28:15.372 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-04-23T10:28:15.372 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-04-23T10:28:15.374 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-04-23T10:28:15.375 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-04-23T10:28:15.375 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-04-23T10:28:15.377 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-04-23T10:28:15.377 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-04-23T10:28:15.379 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-04-23T10:28:15.380 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-04-23T10:28:15.381 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-04-23T10:28:15.382 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-04-23T10:28:15.383 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-04-23T10:28:15.384 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-04-23T10:28:15.385 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-04-23T10:28:15.386 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-04-23T10:28:15.387 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-04-23T10:28:15.388 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-04-23T10:28:15.389 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-04-23T10:28:15.390 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-04-23T10:28:15.391 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-04-23T10:28:15.393 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-04-23T10:28:15.394 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-04-23T10:28:15.395 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-04-23T10:28:15.396 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-04-23T10:28:15.397 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-04-23T10:28:15.398 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-04-23T10:28:15.399 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-04-23T10:28:15.400 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-04-23T10:28:15.401 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-04-23T10:28:15.402 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-04-23T10:28:15.403 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-04-23T10:28:15.404 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-04-23T10:28:15.405 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-04-23T10:28:15.406 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-04-23T10:28:15.407 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-04-23T10:28:15.408 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-04-23T10:28:15.409 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-04-23T10:28:15.411 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-04-23T10:28:15.412 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-04-23T10:28:15.413 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-04-23T10:28:15.414 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-04-23T10:28:15.415 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-04-23T10:28:15.416 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-04-23T10:28:15.417 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-04-23T10:28:15.418 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-04-23T10:28:15.419 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-04-23T10:28:15.420 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-04-23T10:28:15.421 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-04-23T10:28:15.422 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-04-23T10:28:15.423 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-04-23T10:28:15.424 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-04-23T10:28:15.425 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-04-23T10:28:15.426 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-04-23T10:28:15.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:15 smithi146 ceph-mon[32800]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-23T10:28:15.427 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-04-23T10:28:15.428 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-04-23T10:28:15.429 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-04-23T10:28:15.430 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-04-23T10:28:15.431 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-04-23T10:28:15.432 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-04-23T10:28:15.433 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-04-23T10:28:15.434 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-04-23T10:28:15.435 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-04-23T10:28:15.436 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-04-23T10:28:15.436 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-04-23T10:28:15.437 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-04-23T10:28:15.438 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-04-23T10:28:15.439 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-04-23T10:28:15.440 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-04-23T10:28:15.441 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-04-23T10:28:15.442 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-04-23T10:28:15.443 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-04-23T10:28:15.444 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-04-23T10:28:15.445 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-04-23T10:28:15.446 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-04-23T10:28:15.447 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-04-23T10:28:15.448 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-04-23T10:28:15.449 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-04-23T10:28:15.450 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-04-23T10:28:15.451 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-04-23T10:28:15.452 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-04-23T10:28:15.453 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-04-23T10:28:15.454 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-04-23T10:28:15.455 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-04-23T10:28:15.456 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-04-23T10:28:15.457 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-04-23T10:28:15.458 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-04-23T10:28:15.459 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-04-23T10:28:15.460 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-04-23T10:28:15.461 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-04-23T10:28:15.462 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-04-23T10:28:15.463 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-04-23T10:28:15.464 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-04-23T10:28:15.465 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-04-23T10:28:15.466 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-04-23T10:28:15.467 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-04-23T10:28:15.468 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-04-23T10:28:15.469 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-04-23T10:28:15.470 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-04-23T10:28:15.471 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-04-23T10:28:15.472 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-04-23T10:28:15.473 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-04-23T10:28:15.474 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-04-23T10:28:15.475 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-04-23T10:28:15.476 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-04-23T10:28:15.477 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-04-23T10:28:15.478 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-04-23T10:28:15.479 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-04-23T10:28:15.480 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-04-23T10:28:15.481 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-04-23T10:28:15.482 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-04-23T10:28:15.484 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-04-23T10:28:15.484 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-04-23T10:28:15.485 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-04-23T10:28:15.486 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-04-23T10:28:15.487 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-04-23T10:28:15.488 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-04-23T10:28:15.489 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-04-23T10:28:15.490 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-04-23T10:28:15.491 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-04-23T10:28:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:15 smithi069 ceph-mon[29593]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-23T10:28:15.492 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-04-23T10:28:15.493 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-04-23T10:28:15.494 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-04-23T10:28:15.495 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-04-23T10:28:15.497 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-04-23T10:28:15.498 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-04-23T10:28:15.499 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-04-23T10:28:15.501 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-04-23T10:28:15.502 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-04-23T10:28:15.504 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-04-23T10:28:15.505 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-04-23T10:28:15.507 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-04-23T10:28:15.508 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-04-23T10:28:15.510 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-04-23T10:28:15.511 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-04-23T10:28:15.513 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-04-23T10:28:15.514 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-04-23T10:28:15.517 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-04-23T10:28:15.517 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-04-23T10:28:15.519 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-04-23T10:28:15.520 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-04-23T10:28:15.522 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-04-23T10:28:15.524 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-04-23T10:28:15.525 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-04-23T10:28:15.527 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-04-23T10:28:15.528 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-04-23T10:28:15.529 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-04-23T10:28:15.531 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-04-23T10:28:15.533 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-04-23T10:28:15.534 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-04-23T10:28:15.536 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-04-23T10:28:15.537 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-04-23T10:28:15.539 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-04-23T10:28:15.540 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-04-23T10:28:15.542 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-04-23T10:28:15.544 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-04-23T10:28:15.545 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-04-23T10:28:15.547 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-04-23T10:28:15.548 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-04-23T10:28:15.550 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-04-23T10:28:15.552 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-04-23T10:28:15.554 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-04-23T10:28:15.555 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-04-23T10:28:15.556 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-04-23T10:28:15.558 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-04-23T10:28:15.560 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-04-23T10:28:15.561 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-04-23T10:28:15.563 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-04-23T10:28:15.565 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-04-23T10:28:15.566 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-04-23T10:28:15.568 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-04-23T10:28:15.569 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-04-23T10:28:15.571 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-04-23T10:28:15.573 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-04-23T10:28:15.574 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-04-23T10:28:15.576 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-04-23T10:28:15.577 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-04-23T10:28:15.579 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-04-23T10:28:15.580 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-04-23T10:28:15.582 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-04-23T10:28:15.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:15 smithi167 ceph-mon[32940]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-23T10:28:15.583 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-04-23T10:28:15.584 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-04-23T10:28:15.585 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-04-23T10:28:15.586 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-04-23T10:28:15.587 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-04-23T10:28:15.588 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-04-23T10:28:15.589 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-04-23T10:28:15.590 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-04-23T10:28:15.591 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-04-23T10:28:15.592 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-04-23T10:28:15.593 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-04-23T10:28:15.594 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-04-23T10:28:15.595 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-04-23T10:28:15.596 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-04-23T10:28:15.598 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-04-23T10:28:15.598 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-04-23T10:28:15.600 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-04-23T10:28:15.601 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-04-23T10:28:15.602 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-04-23T10:28:15.603 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-04-23T10:28:15.604 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-04-23T10:28:15.606 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-04-23T10:28:15.607 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-04-23T10:28:15.608 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-04-23T10:28:15.609 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-04-23T10:28:15.610 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-04-23T10:28:15.611 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-04-23T10:28:15.612 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-04-23T10:28:15.613 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-04-23T10:28:15.614 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-04-23T10:28:15.615 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-04-23T10:28:15.616 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-04-23T10:28:15.617 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-04-23T10:28:15.618 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-04-23T10:28:15.619 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-04-23T10:28:15.620 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-04-23T10:28:15.621 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-04-23T10:28:15.622 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-04-23T10:28:15.623 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-04-23T10:28:15.624 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-04-23T10:28:15.625 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-04-23T10:28:15.626 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-04-23T10:28:15.627 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-04-23T10:28:15.628 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-04-23T10:28:15.629 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-04-23T10:28:15.848 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-04-23T10:28:15.849 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-04-23T10:28:15.850 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-04-23T10:28:15.851 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-04-23T10:28:15.852 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-04-23T10:28:15.854 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-04-23T10:28:15.855 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-04-23T10:28:15.856 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-04-23T10:28:15.857 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-04-23T10:28:15.858 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-04-23T10:28:15.859 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-04-23T10:28:15.860 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-04-23T10:28:15.861 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-04-23T10:28:15.862 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-04-23T10:28:15.863 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-04-23T10:28:15.864 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-04-23T10:28:15.865 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-04-23T10:28:15.866 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-04-23T10:28:15.867 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-04-23T10:28:15.870 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-04-23T10:28:15.871 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-04-23T10:28:15.872 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-04-23T10:28:15.873 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-04-23T10:28:15.875 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-04-23T10:28:15.876 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-04-23T10:28:15.877 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-04-23T10:28:15.878 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-04-23T10:28:15.879 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-04-23T10:28:15.880 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-04-23T10:28:15.881 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-04-23T10:28:15.882 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-04-23T10:28:15.883 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-04-23T10:28:15.884 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-04-23T10:28:15.885 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-04-23T10:28:15.886 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-04-23T10:28:15.888 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-04-23T10:28:15.889 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-04-23T10:28:15.890 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-04-23T10:28:15.891 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-04-23T10:28:15.892 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-04-23T10:28:15.893 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-04-23T10:28:15.894 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-04-23T10:28:15.895 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-04-23T10:28:15.896 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-04-23T10:28:15.897 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-04-23T10:28:15.898 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-04-23T10:28:15.899 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-04-23T10:28:15.900 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-04-23T10:28:15.901 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-04-23T10:28:15.902 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-04-23T10:28:15.903 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-04-23T10:28:15.904 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-04-23T10:28:15.905 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-04-23T10:28:15.906 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-04-23T10:28:15.907 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-04-23T10:28:15.908 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-04-23T10:28:15.909 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-04-23T10:28:15.910 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-04-23T10:28:15.911 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-04-23T10:28:15.912 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-04-23T10:28:15.913 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-04-23T10:28:15.914 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-04-23T10:28:15.915 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-04-23T10:28:15.916 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-04-23T10:28:15.917 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-04-23T10:28:15.919 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-04-23T10:28:15.920 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-04-23T10:28:15.921 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-04-23T10:28:15.922 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-04-23T10:28:15.923 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-04-23T10:28:15.924 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-04-23T10:28:15.925 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-04-23T10:28:15.927 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-04-23T10:28:15.929 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-04-23T10:28:15.930 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-04-23T10:28:15.932 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-04-23T10:28:15.933 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-04-23T10:28:15.935 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-04-23T10:28:15.936 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-04-23T10:28:15.937 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-04-23T10:28:15.938 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-04-23T10:28:15.939 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-04-23T10:28:15.940 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-04-23T10:28:15.941 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-04-23T10:28:15.942 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-04-23T10:28:15.944 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-04-23T10:28:15.945 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-04-23T10:28:15.946 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-04-23T10:28:15.947 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-04-23T10:28:15.948 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-04-23T10:28:15.949 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-04-23T10:28:15.950 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-04-23T10:28:15.951 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-04-23T10:28:15.952 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-04-23T10:28:15.953 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-04-23T10:28:15.954 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-04-23T10:28:15.955 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-04-23T10:28:15.956 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-04-23T10:28:15.957 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-04-23T10:28:15.958 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-04-23T10:28:15.959 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-04-23T10:28:15.960 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-04-23T10:28:15.961 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-04-23T10:28:15.962 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-04-23T10:28:15.963 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-04-23T10:28:15.964 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-04-23T10:28:15.965 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-04-23T10:28:15.967 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-04-23T10:28:15.968 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-04-23T10:28:15.969 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-04-23T10:28:15.970 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-04-23T10:28:15.971 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-04-23T10:28:15.972 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-04-23T10:28:15.973 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-04-23T10:28:15.974 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-04-23T10:28:15.975 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-04-23T10:28:15.976 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-04-23T10:28:15.977 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-04-23T10:28:15.978 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-04-23T10:28:15.979 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-04-23T10:28:15.980 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-04-23T10:28:15.981 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-04-23T10:28:15.982 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-04-23T10:28:15.983 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-04-23T10:28:15.984 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-04-23T10:28:15.985 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-04-23T10:28:15.986 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-04-23T10:28:15.987 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-04-23T10:28:15.988 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-04-23T10:28:15.989 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-04-23T10:28:15.990 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-04-23T10:28:15.991 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-04-23T10:28:15.992 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-04-23T10:28:15.993 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-04-23T10:28:15.994 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-04-23T10:28:15.995 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-04-23T10:28:15.996 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-04-23T10:28:15.997 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-04-23T10:28:15.998 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-04-23T10:28:16.000 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-04-23T10:28:16.001 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-04-23T10:28:16.002 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-04-23T10:28:16.003 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-04-23T10:28:16.004 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-04-23T10:28:16.005 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-04-23T10:28:16.006 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-04-23T10:28:16.007 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-04-23T10:28:16.008 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-04-23T10:28:16.009 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-04-23T10:28:16.010 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-04-23T10:28:16.011 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-04-23T10:28:16.012 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-04-23T10:28:16.014 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-04-23T10:28:16.015 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-04-23T10:28:16.016 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-04-23T10:28:16.017 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-04-23T10:28:16.018 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-04-23T10:28:16.019 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-04-23T10:28:16.020 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-04-23T10:28:16.021 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-04-23T10:28:16.022 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-04-23T10:28:16.023 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-04-23T10:28:16.024 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-04-23T10:28:16.026 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-04-23T10:28:16.027 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-04-23T10:28:16.028 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-04-23T10:28:16.029 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-04-23T10:28:16.030 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-04-23T10:28:16.031 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-04-23T10:28:16.032 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-04-23T10:28:16.033 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-04-23T10:28:16.034 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-04-23T10:28:16.035 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-04-23T10:28:16.036 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-04-23T10:28:16.037 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-04-23T10:28:16.038 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-04-23T10:28:16.039 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-04-23T10:28:16.040 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-04-23T10:28:16.041 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-04-23T10:28:16.042 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-04-23T10:28:16.043 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-04-23T10:28:16.044 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-04-23T10:28:16.045 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-04-23T10:28:16.046 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-04-23T10:28:16.047 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-04-23T10:28:16.048 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-04-23T10:28:16.049 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-04-23T10:28:16.050 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-04-23T10:28:16.051 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-04-23T10:28:16.052 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-04-23T10:28:16.053 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-04-23T10:28:16.054 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-04-23T10:28:16.055 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-04-23T10:28:16.056 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-04-23T10:28:16.057 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-04-23T10:28:16.058 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-04-23T10:28:16.059 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-04-23T10:28:16.060 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-04-23T10:28:16.061 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-04-23T10:28:16.061 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-04-23T10:28:16.062 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-04-23T10:28:16.064 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-04-23T10:28:16.064 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-04-23T10:28:16.065 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-04-23T10:28:16.066 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-04-23T10:28:16.067 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-04-23T10:28:16.068 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-04-23T10:28:16.069 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-04-23T10:28:16.070 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-04-23T10:28:16.071 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-04-23T10:28:16.072 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-04-23T10:28:16.073 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-04-23T10:28:16.074 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-04-23T10:28:16.075 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-04-23T10:28:16.076 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-04-23T10:28:16.077 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-04-23T10:28:16.078 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-04-23T10:28:16.079 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-04-23T10:28:16.080 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-04-23T10:28:16.081 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-04-23T10:28:16.082 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-04-23T10:28:16.083 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-04-23T10:28:16.084 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-04-23T10:28:16.085 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-04-23T10:28:16.086 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-04-23T10:28:16.087 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-04-23T10:28:16.088 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-04-23T10:28:16.089 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-04-23T10:28:16.090 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-04-23T10:28:16.091 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-04-23T10:28:16.092 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-04-23T10:28:16.093 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-04-23T10:28:16.093 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-04-23T10:28:16.095 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-04-23T10:28:16.095 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-04-23T10:28:16.096 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-04-23T10:28:16.097 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-04-23T10:28:16.099 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-04-23T10:28:16.100 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-04-23T10:28:16.100 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-04-23T10:28:16.101 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-04-23T10:28:16.102 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-04-23T10:28:16.103 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-04-23T10:28:16.104 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-04-23T10:28:16.105 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-04-23T10:28:16.106 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-04-23T10:28:16.107 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-04-23T10:28:16.108 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-04-23T10:28:16.109 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-04-23T10:28:16.110 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-04-23T10:28:16.111 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-04-23T10:28:16.111 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-04-23T10:28:16.113 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-04-23T10:28:16.114 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-04-23T10:28:16.115 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-04-23T10:28:16.116 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-04-23T10:28:16.117 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-04-23T10:28:16.119 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-04-23T10:28:16.120 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-04-23T10:28:16.121 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-04-23T10:28:16.122 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-04-23T10:28:16.124 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-04-23T10:28:16.125 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-04-23T10:28:16.129 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-04-23T10:28:16.130 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-04-23T10:28:16.130 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-04-23T10:28:16.130 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-04-23T10:28:16.131 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-04-23T10:28:16.133 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-04-23T10:28:16.134 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-04-23T10:28:16.135 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-04-23T10:28:16.136 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-04-23T10:28:16.137 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-04-23T10:28:16.138 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-04-23T10:28:16.139 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-04-23T10:28:16.141 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-04-23T10:28:16.142 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-04-23T10:28:16.143 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-04-23T10:28:16.144 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-04-23T10:28:16.145 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-04-23T10:28:16.147 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-04-23T10:28:16.148 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-04-23T10:28:16.149 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-04-23T10:28:16.150 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-04-23T10:28:16.151 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-04-23T10:28:16.153 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-04-23T10:28:16.154 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-04-23T10:28:16.155 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-04-23T10:28:16.156 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-04-23T10:28:16.157 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-04-23T10:28:16.158 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-04-23T10:28:16.160 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-04-23T10:28:16.161 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-04-23T10:28:16.162 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-04-23T10:28:16.163 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-04-23T10:28:16.164 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-04-23T10:28:16.165 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-04-23T10:28:16.167 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-04-23T10:28:16.168 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-04-23T10:28:16.169 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-04-23T10:28:16.170 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-04-23T10:28:16.171 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-04-23T10:28:16.172 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-04-23T10:28:16.174 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-04-23T10:28:16.175 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-04-23T10:28:16.176 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-04-23T10:28:16.178 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-04-23T10:28:16.179 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-04-23T10:28:16.181 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-04-23T10:28:16.182 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-04-23T10:28:16.184 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-04-23T10:28:16.185 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-04-23T10:28:16.187 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-04-23T10:28:16.188 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-04-23T10:28:16.190 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-04-23T10:28:16.191 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-04-23T10:28:16.193 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-04-23T10:28:16.194 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-04-23T10:28:16.196 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-04-23T10:28:16.197 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-04-23T10:28:16.199 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-04-23T10:28:16.200 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-04-23T10:28:16.202 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-04-23T10:28:16.203 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-04-23T10:28:16.205 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-04-23T10:28:16.206 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-04-23T10:28:16.208 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-04-23T10:28:16.209 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-04-23T10:28:16.211 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-04-23T10:28:16.212 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-04-23T10:28:16.214 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-04-23T10:28:16.215 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-04-23T10:28:16.217 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-04-23T10:28:16.218 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-04-23T10:28:16.220 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-04-23T10:28:16.221 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-04-23T10:28:16.223 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-04-23T10:28:16.224 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-04-23T10:28:16.226 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-04-23T10:28:16.227 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-04-23T10:28:16.229 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-04-23T10:28:16.230 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-04-23T10:28:16.231 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-04-23T10:28:16.233 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-04-23T10:28:16.234 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-04-23T10:28:16.236 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-04-23T10:28:16.238 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-04-23T10:28:16.239 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-04-23T10:28:16.241 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-04-23T10:28:16.242 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-04-23T10:28:16.243 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-04-23T10:28:16.245 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-04-23T10:28:16.246 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-04-23T10:28:16.247 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-04-23T10:28:16.248 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-04-23T10:28:16.249 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-04-23T10:28:16.250 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-04-23T10:28:16.252 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-04-23T10:28:16.253 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-04-23T10:28:16.254 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-04-23T10:28:16.255 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-04-23T10:28:16.257 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-04-23T10:28:16.258 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-04-23T10:28:16.259 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-04-23T10:28:16.260 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-04-23T10:28:16.261 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-04-23T10:28:16.262 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-04-23T10:28:16.263 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-04-23T10:28:16.265 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-04-23T10:28:16.266 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-04-23T10:28:16.267 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-04-23T10:28:16.268 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-04-23T10:28:16.269 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-04-23T10:28:16.271 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-04-23T10:28:16.272 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-04-23T10:28:16.273 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-04-23T10:28:16.274 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-04-23T10:28:16.275 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-04-23T10:28:16.276 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-04-23T10:28:16.278 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-04-23T10:28:16.279 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-04-23T10:28:16.280 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-04-23T10:28:16.281 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-04-23T10:28:16.282 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-04-23T10:28:16.283 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-04-23T10:28:16.284 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-04-23T10:28:16.286 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-04-23T10:28:16.287 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-04-23T10:28:16.288 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-04-23T10:28:16.289 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-04-23T10:28:16.290 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-04-23T10:28:16.292 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-04-23T10:28:16.293 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-04-23T10:28:16.294 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-04-23T10:28:16.295 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-04-23T10:28:16.297 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-04-23T10:28:16.297 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-04-23T10:28:16.299 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-04-23T10:28:16.300 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-04-23T10:28:16.301 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-04-23T10:28:16.302 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-04-23T10:28:16.303 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-04-23T10:28:16.305 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-04-23T10:28:16.306 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-04-23T10:28:16.307 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-04-23T10:28:16.308 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-04-23T10:28:16.309 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-04-23T10:28:16.311 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-04-23T10:28:16.312 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-04-23T10:28:16.313 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-04-23T10:28:16.314 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-04-23T10:28:16.315 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-04-23T10:28:16.317 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-04-23T10:28:16.318 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-04-23T10:28:16.319 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-04-23T10:28:16.320 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-04-23T10:28:16.321 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-04-23T10:28:16.323 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-04-23T10:28:16.324 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-04-23T10:28:16.325 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-04-23T10:28:16.326 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-04-23T10:28:16.328 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-04-23T10:28:16.330 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-04-23T10:28:16.333 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-04-23T10:28:16.334 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-04-23T10:28:16.335 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-04-23T10:28:16.337 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-04-23T10:28:16.339 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-04-23T10:28:16.341 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-04-23T10:28:16.342 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-04-23T10:28:16.344 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-04-23T10:28:16.346 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-04-23T10:28:16.348 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-04-23T10:28:16.349 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-04-23T10:28:16.351 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-04-23T10:28:16.353 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-04-23T10:28:16.355 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-04-23T10:28:16.356 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-04-23T10:28:16.358 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-04-23T10:28:16.360 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-04-23T10:28:16.362 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-04-23T10:28:16.363 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-04-23T10:28:16.365 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-04-23T10:28:16.367 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-04-23T10:28:16.368 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-04-23T10:28:16.370 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-04-23T10:28:16.372 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-04-23T10:28:16.373 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-04-23T10:28:16.375 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-04-23T10:28:16.377 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-04-23T10:28:16.379 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-04-23T10:28:16.380 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-04-23T10:28:16.382 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-04-23T10:28:16.384 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-04-23T10:28:16.386 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-04-23T10:28:16.388 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-04-23T10:28:16.389 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-04-23T10:28:16.391 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-04-23T10:28:16.393 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-04-23T10:28:16.394 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-04-23T10:28:16.396 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-04-23T10:28:16.398 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-04-23T10:28:16.400 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-04-23T10:28:16.401 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-04-23T10:28:16.403 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-04-23T10:28:16.405 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-04-23T10:28:16.407 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-04-23T10:28:16.408 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-04-23T10:28:16.410 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-04-23T10:28:16.412 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-04-23T10:28:16.414 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-04-23T10:28:16.415 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-04-23T10:28:16.417 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-04-23T10:28:16.419 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-04-23T10:28:16.420 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-04-23T10:28:16.422 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-04-23T10:28:16.424 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-04-23T10:28:16.426 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-04-23T10:28:16.428 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-04-23T10:28:16.430 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-04-23T10:28:16.431 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-04-23T10:28:16.433 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-04-23T10:28:16.435 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-04-23T10:28:16.437 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-04-23T10:28:16.438 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-04-23T10:28:16.440 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-04-23T10:28:16.442 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-04-23T10:28:16.444 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-04-23T10:28:16.445 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-04-23T10:28:16.447 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-04-23T10:28:16.449 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-04-23T10:28:16.451 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-04-23T10:28:16.452 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-04-23T10:28:16.454 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-04-23T10:28:16.456 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-04-23T10:28:16.458 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-04-23T10:28:16.460 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-04-23T10:28:16.461 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-04-23T10:28:16.463 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-04-23T10:28:16.465 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-04-23T10:28:16.467 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-04-23T10:28:16.469 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-04-23T10:28:16.470 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-04-23T10:28:16.472 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-04-23T10:28:16.473 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-04-23T10:28:16.475 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-04-23T10:28:16.476 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-04-23T10:28:16.478 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-04-23T10:28:16.479 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-04-23T10:28:16.481 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-04-23T10:28:16.482 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-04-23T10:28:16.484 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-04-23T10:28:16.485 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-04-23T10:28:16.487 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-04-23T10:28:16.488 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-04-23T10:28:16.490 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-04-23T10:28:16.492 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-04-23T10:28:16.493 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-04-23T10:28:16.495 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-04-23T10:28:16.496 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-04-23T10:28:16.498 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-04-23T10:28:16.499 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-04-23T10:28:16.501 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-04-23T10:28:16.502 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-04-23T10:28:16.504 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-04-23T10:28:16.505 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-04-23T10:28:16.507 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-04-23T10:28:16.508 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-04-23T10:28:16.510 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-04-23T10:28:16.512 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-04-23T10:28:16.513 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-04-23T10:28:16.514 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-04-23T10:28:16.516 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-04-23T10:28:16.517 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-04-23T10:28:16.519 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-04-23T10:28:16.520 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-04-23T10:28:16.522 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-04-23T10:28:16.524 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-04-23T10:28:16.525 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-04-23T10:28:16.527 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-04-23T10:28:16.528 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-04-23T10:28:16.530 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-04-23T10:28:16.531 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-04-23T10:28:16.533 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-04-23T10:28:16.535 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-04-23T10:28:16.536 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-04-23T10:28:16.538 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-04-23T10:28:16.539 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-04-23T10:28:16.541 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-04-23T10:28:16.543 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-04-23T10:28:16.544 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-04-23T10:28:16.546 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-04-23T10:28:16.547 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-04-23T10:28:16.548 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-04-23T10:28:16.549 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-04-23T10:28:16.550 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-04-23T10:28:16.551 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-04-23T10:28:16.552 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-04-23T10:28:16.553 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-04-23T10:28:16.554 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-04-23T10:28:16.555 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-04-23T10:28:16.556 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-04-23T10:28:16.557 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-04-23T10:28:16.558 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-04-23T10:28:16.559 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-04-23T10:28:16.560 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-04-23T10:28:16.561 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-04-23T10:28:16.562 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-04-23T10:28:16.563 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-04-23T10:28:16.564 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-04-23T10:28:16.565 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-04-23T10:28:16.566 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-04-23T10:28:16.567 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-04-23T10:28:16.568 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-04-23T10:28:16.569 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-04-23T10:28:16.570 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-04-23T10:28:16.571 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-04-23T10:28:16.571 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-04-23T10:28:16.573 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-04-23T10:28:16.574 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-04-23T10:28:16.574 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-04-23T10:28:16.576 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-04-23T10:28:16.576 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-04-23T10:28:16.577 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-04-23T10:28:16.578 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-04-23T10:28:16.579 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-04-23T10:28:16.580 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-04-23T10:28:16.581 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-04-23T10:28:16.582 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-04-23T10:28:16.583 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-04-23T10:28:16.584 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-04-23T10:28:16.585 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-04-23T10:28:16.586 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-04-23T10:28:16.587 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-04-23T10:28:16.588 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-04-23T10:28:16.589 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-04-23T10:28:16.590 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-04-23T10:28:16.591 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-04-23T10:28:16.592 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-04-23T10:28:16.593 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-04-23T10:28:16.594 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-04-23T10:28:16.595 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-04-23T10:28:16.596 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-04-23T10:28:16.597 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-04-23T10:28:16.598 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-04-23T10:28:16.599 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-04-23T10:28:16.599 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-04-23T10:28:16.600 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-04-23T10:28:16.601 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-04-23T10:28:16.602 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-04-23T10:28:16.603 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-04-23T10:28:16.604 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-04-23T10:28:16.605 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-04-23T10:28:16.606 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-04-23T10:28:16.607 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-04-23T10:28:16.608 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-04-23T10:28:16.609 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-04-23T10:28:16.610 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-04-23T10:28:16.611 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-04-23T10:28:16.612 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-04-23T10:28:16.613 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-04-23T10:28:16.614 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-04-23T10:28:16.615 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-04-23T10:28:16.616 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-04-23T10:28:16.617 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-04-23T10:28:16.618 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-04-23T10:28:16.619 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-04-23T10:28:16.620 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-04-23T10:28:16.621 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-04-23T10:28:16.623 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-04-23T10:28:16.624 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-04-23T10:28:16.625 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-04-23T10:28:16.626 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-04-23T10:28:16.627 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-04-23T10:28:16.628 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-04-23T10:28:16.629 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-04-23T10:28:16.630 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-04-23T10:28:16.631 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-04-23T10:28:16.632 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-04-23T10:28:16.633 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-04-23T10:28:16.634 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-04-23T10:28:16.635 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-04-23T10:28:16.636 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-04-23T10:28:16.637 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-04-23T10:28:16.639 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-04-23T10:28:16.641 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-04-23T10:28:16.642 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-04-23T10:28:16.643 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-04-23T10:28:16.644 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-04-23T10:28:16.645 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-04-23T10:28:16.646 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-04-23T10:28:16.647 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-04-23T10:28:16.648 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-04-23T10:28:16.649 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-04-23T10:28:16.650 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-04-23T10:28:16.651 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-04-23T10:28:16.652 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-04-23T10:28:16.653 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-04-23T10:28:16.654 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-04-23T10:28:16.655 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-04-23T10:28:16.656 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-04-23T10:28:16.658 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-04-23T10:28:16.659 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-04-23T10:28:16.660 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-04-23T10:28:16.661 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-04-23T10:28:16.662 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-04-23T10:28:16.663 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-04-23T10:28:16.664 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-04-23T10:28:16.666 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-04-23T10:28:16.667 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-04-23T10:28:16.668 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-04-23T10:28:16.670 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-04-23T10:28:16.670 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-04-23T10:28:16.672 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-04-23T10:28:16.672 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-04-23T10:28:16.673 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-04-23T10:28:16.675 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-04-23T10:28:16.676 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-04-23T10:28:16.678 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-04-23T10:28:16.679 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-04-23T10:28:16.681 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-04-23T10:28:16.682 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-04-23T10:28:16.684 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-04-23T10:28:16.686 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-04-23T10:28:16.687 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-04-23T10:28:16.689 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-04-23T10:28:16.690 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-04-23T10:28:16.692 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-04-23T10:28:16.693 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-04-23T10:28:16.694 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-04-23T10:28:16.695 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-04-23T10:28:16.696 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-04-23T10:28:16.697 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-04-23T10:28:16.698 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-04-23T10:28:16.699 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-04-23T10:28:16.700 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-04-23T10:28:16.701 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-04-23T10:28:16.702 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-04-23T10:28:16.703 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-04-23T10:28:16.704 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-04-23T10:28:16.705 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-04-23T10:28:16.705 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-04-23T10:28:16.707 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-04-23T10:28:16.708 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-04-23T10:28:16.709 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-04-23T10:28:16.710 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-04-23T10:28:16.712 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-04-23T10:28:16.713 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-04-23T10:28:16.715 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-04-23T10:28:16.716 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-04-23T10:28:16.717 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-04-23T10:28:16.718 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-04-23T10:28:16.719 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-04-23T10:28:16.721 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-04-23T10:28:16.722 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-04-23T10:28:16.723 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-04-23T10:28:16.724 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-04-23T10:28:16.725 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-04-23T10:28:16.726 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-04-23T10:28:16.728 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-04-23T10:28:16.729 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-04-23T10:28:16.731 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-04-23T10:28:16.733 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-04-23T10:28:16.734 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-04-23T10:28:16.735 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-04-23T10:28:16.736 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-04-23T10:28:16.737 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-04-23T10:28:16.738 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-04-23T10:28:16.742 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-04-23T10:28:16.742 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-04-23T10:28:16.742 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-04-23T10:28:16.742 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-04-23T10:28:16.743 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-04-23T10:28:16.744 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-04-23T10:28:16.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-04-23T10:28:16.746 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-04-23T10:28:16.747 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-04-23T10:28:16.748 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-04-23T10:28:16.749 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-04-23T10:28:16.750 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-04-23T10:28:16.751 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-04-23T10:28:16.752 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-04-23T10:28:16.753 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-04-23T10:28:16.754 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-04-23T10:28:16.755 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-04-23T10:28:16.756 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-04-23T10:28:16.757 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-04-23T10:28:16.758 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-04-23T10:28:16.759 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-04-23T10:28:16.760 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-04-23T10:28:16.762 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-04-23T10:28:16.763 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-04-23T10:28:16.764 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-04-23T10:28:16.764 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-04-23T10:28:16.766 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-04-23T10:28:16.767 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-04-23T10:28:16.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-04-23T10:28:16.769 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-04-23T10:28:16.770 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-04-23T10:28:16.771 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-04-23T10:28:16.772 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-04-23T10:28:16.773 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-04-23T10:28:16.774 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-04-23T10:28:16.775 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-04-23T10:28:16.776 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-04-23T10:28:16.777 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-04-23T10:28:16.778 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-04-23T10:28:16.779 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-04-23T10:28:16.780 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-04-23T10:28:16.781 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-04-23T10:28:16.782 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-04-23T10:28:16.783 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-04-23T10:28:16.784 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-04-23T10:28:16.785 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-04-23T10:28:16.786 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-04-23T10:28:16.787 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-04-23T10:28:16.788 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-04-23T10:28:16.789 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-04-23T10:28:16.790 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-04-23T10:28:16.791 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-04-23T10:28:16.792 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-04-23T10:28:16.793 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-04-23T10:28:16.794 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-04-23T10:28:16.795 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-04-23T10:28:16.796 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-04-23T10:28:16.797 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-04-23T10:28:16.799 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-04-23T10:28:16.800 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-04-23T10:28:16.801 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-04-23T10:28:16.802 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-04-23T10:28:16.803 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-04-23T10:28:16.804 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-04-23T10:28:16.805 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-04-23T10:28:16.806 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-04-23T10:28:16.807 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-04-23T10:28:16.808 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-04-23T10:28:16.809 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-04-23T10:28:16.811 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-04-23T10:28:16.812 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-04-23T10:28:16.813 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-04-23T10:28:16.814 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-04-23T10:28:16.815 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-04-23T10:28:16.816 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-04-23T10:28:16.817 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-04-23T10:28:16.818 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-04-23T10:28:16.819 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-04-23T10:28:16.820 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-04-23T10:28:16.821 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-04-23T10:28:16.822 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-04-23T10:28:16.823 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-04-23T10:28:16.824 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-04-23T10:28:16.825 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-04-23T10:28:16.826 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-04-23T10:28:16.828 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-04-23T10:28:16.828 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-04-23T10:28:16.829 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-04-23T10:28:16.831 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-04-23T10:28:16.832 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-04-23T10:28:16.833 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-04-23T10:28:16.834 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-04-23T10:28:16.835 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-04-23T10:28:16.836 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-04-23T10:28:16.837 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-04-23T10:28:16.838 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-04-23T10:28:16.839 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-04-23T10:28:16.840 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-04-23T10:28:16.841 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-04-23T10:28:16.842 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-04-23T10:28:16.843 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-04-23T10:28:16.844 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-04-23T10:28:16.845 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-04-23T10:28:16.846 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-04-23T10:28:16.847 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-04-23T10:28:16.848 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-04-23T10:28:16.848 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:16 smithi167 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 1. 2024-04-23T10:28:16.848 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:16 smithi167 systemd[1]: Stopped Ceph mds.f for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:28:16.849 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:16 smithi167 systemd[1]: Starting Ceph mds.f for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:28:16.849 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:16 smithi167 podman[67162]: 2024-04-23 10:28:16.725199051 +0000 UTC m=+0.020565103 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:28:16.849 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-04-23T10:28:16.851 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-04-23T10:28:16.852 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-04-23T10:28:16.853 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-04-23T10:28:16.854 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-04-23T10:28:16.855 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-04-23T10:28:16.856 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-04-23T10:28:16.858 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-04-23T10:28:16.858 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-04-23T10:28:16.859 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-04-23T10:28:16.860 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-04-23T10:28:16.862 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-04-23T10:28:16.863 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-04-23T10:28:16.864 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-04-23T10:28:16.865 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-04-23T10:28:16.866 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-04-23T10:28:16.867 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-04-23T10:28:16.868 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-04-23T10:28:16.869 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-04-23T10:28:16.872 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-04-23T10:28:16.873 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-04-23T10:28:16.874 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-04-23T10:28:16.875 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-04-23T10:28:16.876 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-04-23T10:28:16.877 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-04-23T10:28:16.878 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-04-23T10:28:16.879 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-04-23T10:28:16.880 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-04-23T10:28:16.881 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-04-23T10:28:16.882 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-04-23T10:28:16.883 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-04-23T10:28:16.884 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-04-23T10:28:16.885 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-04-23T10:28:16.885 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-04-23T10:28:16.887 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-04-23T10:28:16.888 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-04-23T10:28:16.890 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-04-23T10:28:16.891 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-04-23T10:28:16.892 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-04-23T10:28:16.893 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-04-23T10:28:16.894 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-04-23T10:28:16.895 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-04-23T10:28:16.896 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-04-23T10:28:16.897 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-04-23T10:28:16.898 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-04-23T10:28:16.899 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-04-23T10:28:16.900 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-04-23T10:28:16.901 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-04-23T10:28:16.902 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-04-23T10:28:16.904 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-04-23T10:28:16.905 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-04-23T10:28:16.906 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-04-23T10:28:16.907 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-04-23T10:28:16.908 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-04-23T10:28:16.909 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-04-23T10:28:16.910 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-04-23T10:28:16.911 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-04-23T10:28:16.912 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-04-23T10:28:16.913 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-04-23T10:28:16.914 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-04-23T10:28:16.915 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-04-23T10:28:16.916 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-04-23T10:28:16.918 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-04-23T10:28:16.919 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-04-23T10:28:16.919 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-04-23T10:28:16.921 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-04-23T10:28:16.922 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-04-23T10:28:16.923 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-04-23T10:28:16.924 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-04-23T10:28:16.925 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-04-23T10:28:16.926 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-04-23T10:28:16.927 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-04-23T10:28:16.928 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-04-23T10:28:16.929 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-04-23T10:28:16.930 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-04-23T10:28:16.931 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-04-23T10:28:16.932 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-04-23T10:28:16.933 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-04-23T10:28:16.934 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-04-23T10:28:16.935 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-04-23T10:28:16.936 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-04-23T10:28:16.937 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-04-23T10:28:16.938 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-04-23T10:28:16.939 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-04-23T10:28:16.940 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-04-23T10:28:16.941 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-04-23T10:28:16.942 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-04-23T10:28:16.943 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-04-23T10:28:16.944 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-04-23T10:28:16.946 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-04-23T10:28:16.948 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-04-23T10:28:16.950 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-04-23T10:28:16.951 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-04-23T10:28:16.953 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-04-23T10:28:16.954 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-04-23T10:28:16.956 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-04-23T10:28:16.957 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-04-23T10:28:16.959 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-04-23T10:28:16.960 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-04-23T10:28:16.962 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-04-23T10:28:16.964 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-04-23T10:28:16.965 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-04-23T10:28:16.966 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-04-23T10:28:16.967 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-04-23T10:28:16.969 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-04-23T10:28:16.969 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-04-23T10:28:16.971 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-04-23T10:28:16.972 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-04-23T10:28:16.974 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-04-23T10:28:16.975 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-04-23T10:28:16.976 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-04-23T10:28:16.977 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-04-23T10:28:16.979 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-04-23T10:28:16.980 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-04-23T10:28:16.982 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-04-23T10:28:16.983 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-04-23T10:28:16.985 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-04-23T10:28:16.986 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-04-23T10:28:16.988 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-04-23T10:28:16.989 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-04-23T10:28:16.991 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-04-23T10:28:16.992 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-04-23T10:28:16.994 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-04-23T10:28:16.995 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-04-23T10:28:16.997 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-04-23T10:28:16.998 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-04-23T10:28:17.000 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-04-23T10:28:17.001 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-04-23T10:28:17.003 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-04-23T10:28:17.004 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-04-23T10:28:17.006 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-04-23T10:28:17.007 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-04-23T10:28:17.009 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-04-23T10:28:17.010 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-04-23T10:28:17.011 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-04-23T10:28:17.013 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-04-23T10:28:17.014 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-04-23T10:28:17.016 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-04-23T10:28:17.017 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-04-23T10:28:17.018 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-04-23T10:28:17.020 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-04-23T10:28:17.021 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-04-23T10:28:17.022 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-04-23T10:28:17.023 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-04-23T10:28:17.025 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-04-23T10:28:17.026 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-04-23T10:28:17.027 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-04-23T10:28:17.028 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-04-23T10:28:17.029 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-04-23T10:28:17.030 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-04-23T10:28:17.030 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-04-23T10:28:17.032 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-04-23T10:28:17.033 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-04-23T10:28:17.034 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-04-23T10:28:17.035 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-04-23T10:28:17.036 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-04-23T10:28:17.037 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-04-23T10:28:17.038 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-04-23T10:28:17.039 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-04-23T10:28:17.040 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-04-23T10:28:17.041 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-04-23T10:28:17.042 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-04-23T10:28:17.043 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-04-23T10:28:17.044 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-04-23T10:28:17.045 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-04-23T10:28:17.046 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-04-23T10:28:17.047 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-04-23T10:28:17.048 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-04-23T10:28:17.049 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-04-23T10:28:17.113 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:16 smithi167 podman[67162]: 2024-04-23 10:28:16.850666909 +0000 UTC m=+0.146032958 container create 1d2d8b4331da08a715182ece9e5f559d38157ee1f35323585d2c603705f6e666 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-04-23T10:28:17.387 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-04-23T10:28:17.388 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-04-23T10:28:17.389 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-04-23T10:28:17.390 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-04-23T10:28:17.391 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-04-23T10:28:17.392 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-04-23T10:28:17.393 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-04-23T10:28:17.394 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-04-23T10:28:17.395 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-04-23T10:28:17.396 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-04-23T10:28:17.397 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-04-23T10:28:17.398 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-04-23T10:28:17.399 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-04-23T10:28:17.400 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-04-23T10:28:17.401 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-04-23T10:28:17.402 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-04-23T10:28:17.403 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-04-23T10:28:17.404 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-04-23T10:28:17.405 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-04-23T10:28:17.406 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-04-23T10:28:17.408 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-04-23T10:28:17.409 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-04-23T10:28:17.410 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-04-23T10:28:17.411 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-04-23T10:28:17.412 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-04-23T10:28:17.413 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-04-23T10:28:17.414 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-04-23T10:28:17.415 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-04-23T10:28:17.415 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-04-23T10:28:17.416 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-04-23T10:28:17.417 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-04-23T10:28:17.418 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-04-23T10:28:17.419 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-04-23T10:28:17.420 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-04-23T10:28:17.421 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-04-23T10:28:17.422 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-04-23T10:28:17.422 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-04-23T10:28:17.424 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-04-23T10:28:17.424 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-04-23T10:28:17.425 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-04-23T10:28:17.426 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-04-23T10:28:17.427 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-04-23T10:28:17.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:17 smithi146 ceph-mon[32800]: pgmap v44: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.7 MiB/s wr, 49 op/s 2024-04-23T10:28:17.428 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-04-23T10:28:17.428 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-04-23T10:28:17.429 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-04-23T10:28:17.430 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-04-23T10:28:17.431 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-04-23T10:28:17.432 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-04-23T10:28:17.433 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-04-23T10:28:17.434 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-04-23T10:28:17.435 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-04-23T10:28:17.436 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-04-23T10:28:17.437 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-04-23T10:28:17.437 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-04-23T10:28:17.438 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-04-23T10:28:17.439 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-04-23T10:28:17.440 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-04-23T10:28:17.441 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-04-23T10:28:17.442 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-04-23T10:28:17.443 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-04-23T10:28:17.443 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-04-23T10:28:17.444 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-04-23T10:28:17.445 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-04-23T10:28:17.446 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-04-23T10:28:17.447 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-04-23T10:28:17.448 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-04-23T10:28:17.449 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-04-23T10:28:17.450 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-04-23T10:28:17.451 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-04-23T10:28:17.452 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-04-23T10:28:17.453 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/digsig.txt 2024-04-23T10:28:17.454 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-04-23T10:28:17.454 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-04-23T10:28:17.455 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-04-23T10:28:17.456 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-04-23T10:28:17.457 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-04-23T10:28:17.458 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-04-23T10:28:17.459 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dontdiff 2024-04-23T10:28:17.460 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/driver-model/ 2024-04-23T10:28:17.460 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-04-23T10:28:17.461 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-04-23T10:28:17.462 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-04-23T10:28:17.463 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-04-23T10:28:17.464 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-04-23T10:28:17.465 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-04-23T10:28:17.466 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-04-23T10:28:17.466 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-04-23T10:28:17.467 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-04-23T10:28:17.468 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-04-23T10:28:17.469 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/ 2024-04-23T10:28:17.470 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-04-23T10:28:17.471 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-04-23T10:28:17.472 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-04-23T10:28:17.472 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-04-23T10:28:17.473 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-04-23T10:28:17.474 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-04-23T10:28:17.475 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-04-23T10:28:17.476 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-04-23T10:28:17.477 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-04-23T10:28:17.477 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-04-23T10:28:17.478 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-04-23T10:28:17.479 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-04-23T10:28:17.480 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-04-23T10:28:17.481 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-04-23T10:28:17.482 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-04-23T10:28:17.483 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-04-23T10:28:17.484 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-04-23T10:28:17.485 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-04-23T10:28:17.486 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/edac.txt 2024-04-23T10:28:17.487 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-04-23T10:28:17.488 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/eisa.txt 2024-04-23T10:28:17.489 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-04-23T10:28:17.490 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/extcon/ 2024-04-23T10:28:17.491 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-04-23T10:28:17.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:17 smithi069 ceph-mon[29593]: pgmap v44: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.7 MiB/s wr, 49 op/s 2024-04-23T10:28:17.492 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-04-23T10:28:17.492 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-04-23T10:28:17.493 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-04-23T10:28:17.494 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-04-23T10:28:17.495 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/ 2024-04-23T10:28:17.496 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-04-23T10:28:17.497 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-04-23T10:28:17.498 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-04-23T10:28:17.499 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-04-23T10:28:17.500 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-04-23T10:28:17.501 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-04-23T10:28:17.502 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-04-23T10:28:17.503 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-04-23T10:28:17.504 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-04-23T10:28:17.505 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-04-23T10:28:17.506 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-04-23T10:28:17.507 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-04-23T10:28:17.508 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-04-23T10:28:17.509 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-04-23T10:28:17.510 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-04-23T10:28:17.511 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-04-23T10:28:17.512 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-04-23T10:28:17.513 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-04-23T10:28:17.514 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-04-23T10:28:17.515 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-04-23T10:28:17.516 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-04-23T10:28:17.517 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-04-23T10:28:17.518 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-04-23T10:28:17.519 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-04-23T10:28:17.520 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-04-23T10:28:17.521 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-04-23T10:28:17.522 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-04-23T10:28:17.523 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-04-23T10:28:17.523 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-04-23T10:28:17.524 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-04-23T10:28:17.525 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-04-23T10:28:17.526 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-04-23T10:28:17.527 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-04-23T10:28:17.528 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-04-23T10:28:17.529 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-04-23T10:28:17.530 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ 2024-04-23T10:28:17.531 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-04-23T10:28:17.532 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-04-23T10:28:17.533 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-04-23T10:28:17.534 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-04-23T10:28:17.535 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-04-23T10:28:17.536 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-04-23T10:28:17.536 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-04-23T10:28:17.537 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-04-23T10:28:17.538 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-04-23T10:28:17.539 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-04-23T10:28:17.540 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-04-23T10:28:17.541 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-04-23T10:28:17.542 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-04-23T10:28:17.543 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-04-23T10:28:17.544 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-04-23T10:28:17.545 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-04-23T10:28:17.546 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-04-23T10:28:17.547 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-04-23T10:28:17.548 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-04-23T10:28:17.549 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-04-23T10:28:17.550 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-04-23T10:28:17.551 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-04-23T10:28:17.552 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-04-23T10:28:17.553 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-04-23T10:28:17.554 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-04-23T10:28:17.555 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-04-23T10:28:17.556 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-04-23T10:28:17.557 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-04-23T10:28:17.558 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-04-23T10:28:17.562 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-04-23T10:28:17.562 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-04-23T10:28:17.562 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-04-23T10:28:17.562 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-04-23T10:28:17.562 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-04-23T10:28:17.563 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-04-23T10:28:17.564 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-04-23T10:28:17.565 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-04-23T10:28:17.566 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-04-23T10:28:17.567 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-04-23T10:28:17.568 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-04-23T10:28:17.569 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-04-23T10:28:17.570 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-04-23T10:28:17.571 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-04-23T10:28:17.572 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-04-23T10:28:17.572 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-04-23T10:28:17.573 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-04-23T10:28:17.574 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-04-23T10:28:17.575 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-04-23T10:28:17.576 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-04-23T10:28:17.577 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-04-23T10:28:17.578 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-04-23T10:28:17.579 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-04-23T10:28:17.580 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-04-23T10:28:17.581 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-04-23T10:28:17.582 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-04-23T10:28:17.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:17 smithi167 ceph-mon[32940]: pgmap v44: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.7 MiB/s wr, 49 op/s 2024-04-23T10:28:17.582 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:17 smithi167 podman[67162]: 2024-04-23 10:28:17.115306941 +0000 UTC m=+0.410672989 container init 1d2d8b4331da08a715182ece9e5f559d38157ee1f35323585d2c603705f6e666 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:28:17.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:17 smithi167 podman[67162]: 2024-04-23 10:28:17.119007236 +0000 UTC m=+0.414373296 container start 1d2d8b4331da08a715182ece9e5f559d38157ee1f35323585d2c603705f6e666 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-23T10:28:17.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:17 smithi167 ceph-mds[67181]: -- 172.21.15.167:0/1803440382 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f84dcc7a40 con 0x55f84dc9a800 2024-04-23T10:28:17.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[67177]: starting mds.f at 2024-04-23T10:28:17.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:17 smithi167 bash[67162]: 1d2d8b4331da08a715182ece9e5f559d38157ee1f35323585d2c603705f6e666 2024-04-23T10:28:17.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:28:17 smithi167 systemd[1]: Started Ceph mds.f for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:28:17.583 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-04-23T10:28:17.584 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-04-23T10:28:17.585 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-04-23T10:28:17.586 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-04-23T10:28:17.587 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-04-23T10:28:17.588 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-04-23T10:28:17.589 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-04-23T10:28:17.590 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-04-23T10:28:17.591 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-04-23T10:28:17.592 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-04-23T10:28:17.593 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-04-23T10:28:17.594 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-04-23T10:28:17.594 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-04-23T10:28:17.595 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-04-23T10:28:17.596 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-04-23T10:28:17.597 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-04-23T10:28:17.598 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-04-23T10:28:17.599 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-04-23T10:28:17.600 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-04-23T10:28:17.601 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-04-23T10:28:17.602 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-04-23T10:28:17.603 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-04-23T10:28:17.604 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-04-23T10:28:17.605 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-04-23T10:28:17.606 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-04-23T10:28:17.607 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-04-23T10:28:17.608 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-04-23T10:28:17.609 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-04-23T10:28:17.610 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-04-23T10:28:17.610 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-04-23T10:28:17.611 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-04-23T10:28:17.612 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-04-23T10:28:17.613 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-04-23T10:28:17.614 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-04-23T10:28:17.615 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-04-23T10:28:17.616 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-04-23T10:28:17.617 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-04-23T10:28:17.618 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-04-23T10:28:17.619 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-04-23T10:28:17.620 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-04-23T10:28:17.621 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-04-23T10:28:17.622 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-04-23T10:28:17.623 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-04-23T10:28:17.624 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-04-23T10:28:17.625 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-04-23T10:28:17.626 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-04-23T10:28:17.627 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-04-23T10:28:17.628 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-04-23T10:28:17.629 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-04-23T10:28:17.629 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-04-23T10:28:17.630 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-04-23T10:28:17.631 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-04-23T10:28:17.632 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-04-23T10:28:17.633 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-04-23T10:28:17.634 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-04-23T10:28:17.635 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-04-23T10:28:17.636 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-04-23T10:28:17.637 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-04-23T10:28:17.638 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-04-23T10:28:17.639 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-04-23T10:28:17.640 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-04-23T10:28:17.641 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-04-23T10:28:17.642 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-04-23T10:28:17.643 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-04-23T10:28:17.644 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/ 2024-04-23T10:28:17.644 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-04-23T10:28:17.645 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-04-23T10:28:17.646 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-04-23T10:28:17.647 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-04-23T10:28:17.648 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-04-23T10:28:17.649 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-04-23T10:28:17.650 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-04-23T10:28:17.651 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-04-23T10:28:17.651 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-04-23T10:28:17.652 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-04-23T10:28:17.653 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-04-23T10:28:17.654 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/frv/ 2024-04-23T10:28:17.655 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-04-23T10:28:17.656 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-04-23T10:28:17.657 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-04-23T10:28:17.658 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-04-23T10:28:17.659 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-04-23T10:28:17.660 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-04-23T10:28:17.660 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-04-23T10:28:17.662 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-04-23T10:28:17.662 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-04-23T10:28:17.663 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-04-23T10:28:17.664 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-04-23T10:28:17.665 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/gcov.txt 2024-04-23T10:28:17.666 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-04-23T10:28:17.667 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/gpio/ 2024-04-23T10:28:17.668 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-04-23T10:28:17.668 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-04-23T10:28:17.670 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-04-23T10:28:17.671 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-04-23T10:28:17.671 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-04-23T10:28:17.672 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-04-23T10:28:17.673 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-04-23T10:28:17.674 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hid/ 2024-04-23T10:28:17.675 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-04-23T10:28:17.676 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-04-23T10:28:17.677 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-04-23T10:28:17.678 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-04-23T10:28:17.678 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-04-23T10:28:17.679 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/highuid.txt 2024-04-23T10:28:17.680 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hsi.txt 2024-04-23T10:28:17.682 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-04-23T10:28:17.682 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ 2024-04-23T10:28:17.683 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-04-23T10:28:17.684 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-04-23T10:28:17.685 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-04-23T10:28:17.686 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-04-23T10:28:17.687 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-04-23T10:28:17.688 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-04-23T10:28:17.689 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-04-23T10:28:17.689 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-04-23T10:28:17.690 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-04-23T10:28:17.691 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-04-23T10:28:17.692 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-04-23T10:28:17.693 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-04-23T10:28:17.694 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-04-23T10:28:17.695 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-04-23T10:28:17.696 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-04-23T10:28:17.697 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-04-23T10:28:17.697 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-04-23T10:28:17.698 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-04-23T10:28:17.699 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-04-23T10:28:17.700 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-04-23T10:28:17.701 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-04-23T10:28:17.702 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-04-23T10:28:17.703 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-04-23T10:28:17.703 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-04-23T10:28:17.704 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-04-23T10:28:17.705 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-04-23T10:28:17.706 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-04-23T10:28:17.707 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-04-23T10:28:17.708 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-04-23T10:28:17.709 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-04-23T10:28:17.710 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-04-23T10:28:17.711 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-04-23T10:28:17.714 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-04-23T10:28:17.715 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-04-23T10:28:17.716 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-04-23T10:28:17.717 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-04-23T10:28:17.718 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-04-23T10:28:17.719 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-04-23T10:28:17.719 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-04-23T10:28:17.720 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-04-23T10:28:17.721 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-04-23T10:28:17.722 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-04-23T10:28:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.723+0000 7f1fa7e91640 1 -- 172.21.15.69:0/1517042315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fa0101aa0 msgr2=0x7f1fa0105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.723+0000 7f1fa7e91640 1 --2- 172.21.15.69:0/1517042315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fa0101aa0 0x7f1fa0105a90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009900 tx=0x7f1f9002a410 comp rx=0 tx=0).stop 2024-04-23T10:28:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 -- 172.21.15.69:0/1517042315 shutdown_connections 2024-04-23T10:28:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 --2- 172.21.15.69:0/1517042315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fa0101aa0 0x7f1fa0105a90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 --2- 172.21.15.69:0/1517042315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fa0106170 0x7f1fa010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 --2- 172.21.15.69:0/1517042315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa01010f0 0x7f1fa01014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 -- 172.21.15.69:0/1517042315 >> 172.21.15.69:0/1517042315 conn(0x7f1fa0077fd0 msgr2=0x7f1fa00783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 -- 172.21.15.69:0/1517042315 shutdown_connections 2024-04-23T10:28:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 -- 172.21.15.69:0/1517042315 wait complete. 2024-04-23T10:28:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 Processor -- start 2024-04-23T10:28:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 -- start start 2024-04-23T10:28:17.724 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-04-23T10:28:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa01010f0 0x7f1fa01995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fa0106170 0x7f1fa0199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fa019a0b0 0x7f1fa01a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa0111240 con 0x7f1fa0106170 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa01110c0 con 0x7f1fa01010f0 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.724+0000 7f1fa7e91640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa01113c0 con 0x7f1fa019a0b0 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa542c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fa0106170 0x7f1fa0199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa542c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fa0106170 0x7f1fa0199b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59540/0 (socket says 172.21.15.69:59540) 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa542c640 1 -- 172.21.15.69:0/4170967559 learned_addr learned my addr 172.21.15.69:0/4170967559 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa642e640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fa019a0b0 0x7f1fa01a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa01010f0 0x7f1fa01995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa542c640 1 -- 172.21.15.69:0/4170967559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fa019a0b0 msgr2=0x7f1fa01a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa542c640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fa019a0b0 0x7f1fa01a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa542c640 1 -- 172.21.15.69:0/4170967559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa01010f0 msgr2=0x7f1fa01995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa542c640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa01010f0 0x7f1fa01995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa542c640 1 -- 172.21.15.69:0/4170967559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa01a4e30 con 0x7f1fa0106170 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa642e640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fa019a0b0 0x7f1fa01a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:28:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa542c640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fa0106170 0x7f1fa0199b20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1f90004770 tx=0x7f1f90003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:17.727 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-04-23T10:28:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1f96ffd640 1 -- 172.21.15.69:0/4170967559 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9003f070 con 0x7f1fa0106170 2024-04-23T10:28:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1f96ffd640 1 -- 172.21.15.69:0/4170967559 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f90031be0 con 0x7f1fa0106170 2024-04-23T10:28:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa7e91640 1 -- 172.21.15.69:0/4170967559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa01a50c0 con 0x7f1fa0106170 2024-04-23T10:28:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1f96ffd640 1 -- 172.21.15.69:0/4170967559 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90035030 con 0x7f1fa0106170 2024-04-23T10:28:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.725+0000 7f1fa7e91640 1 -- 172.21.15.69:0/4170967559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa01a55b0 con 0x7f1fa0106170 2024-04-23T10:28:17.728 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-04-23T10:28:17.728 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-04-23T10:28:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.728+0000 7f1f96ffd640 1 -- 172.21.15.69:0/4170967559 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f1f90042070 con 0x7f1fa0106170 2024-04-23T10:28:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.728+0000 7f1faaba9740 1 Processor -- start 2024-04-23T10:28:17.729 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-04-23T10:28:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.728+0000 7f1faaba9740 1 -- start start 2024-04-23T10:28:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 0x560d076048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604e20 0x560d076136d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07613c10 0x560d07616000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1faaba9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560d07569970 con 0x560d07604e20 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1faaba9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560d075064a0 con 0x560d07604500 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1faaba9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560d07565930 con 0x560d07613c10 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa5c2d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604e20 0x560d076136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa5c2d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604e20 0x560d076136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59556/0 (socket says 172.21.15.69:59556) 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/3448875097 learned_addr learned my addr 172.21.15.69:0/3448875097 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa542c640 1 --2- 172.21.15.69:0/3448875097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07613c10 0x560d07616000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1f96ffd640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1f8c0a3ee0 0x7f1f8c0a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa642e640 1 --2- 172.21.15.69:0/3448875097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 0x560d076048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/3448875097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07613c10 msgr2=0x560d07616000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/3448875097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07613c10 0x560d07616000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/3448875097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 msgr2=0x560d076048e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/3448875097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 0x560d076048e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/3448875097 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0727c210 con 0x560d07604e20 2024-04-23T10:28:17.732 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-04-23T10:28:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa642e640 1 --2- 172.21.15.69:0/3448875097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 0x560d076048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1f96ffd640 1 -- 172.21.15.69:0/4170967559 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f1f900f1080 con 0x7f1fa0106170 2024-04-23T10:28:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa642e640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1f8c0a3ee0 0x7f1f8c0a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/3448875097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604e20 0x560d076136d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00bd00 tx=0x7f1f9c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61a42081363f64b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1f8bfff640 1 -- 172.21.15.69:0/3448875097 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c005220 con 0x560d07604e20 2024-04-23T10:28:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1f8bfff640 1 -- 172.21.15.69:0/3448875097 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f9c004c70 con 0x560d07604e20 2024-04-23T10:28:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.729+0000 7f1f8bfff640 1 -- 172.21.15.69:0/3448875097 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c011800 con 0x560d07604e20 2024-04-23T10:28:17.733 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-04-23T10:28:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.730+0000 7f1fa642e640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1f8c0a3ee0 0x7f1f8c0a63a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1f980099e0 tx=0x7f1f98004a40 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.730+0000 7f1faaba9740 1 -- 172.21.15.69:0/3448875097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604e20 msgr2=0x560d076136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.730+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3448875097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604e20 0x560d076136d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00bd00 tx=0x7f1f9c0107a0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.730+0000 7f1faaba9740 1 -- 172.21.15.69:0/3448875097 shutdown_connections 2024-04-23T10:28:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.730+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3448875097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604e20 0x560d076136d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.730+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3448875097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07613c10 0x560d07616000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.730+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3448875097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 0x560d076048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.730+0000 7f1faaba9740 1 -- 172.21.15.69:0/3448875097 >> 172.21.15.69:0/3448875097 conn(0x560d07600b30 msgr2=0x560d07600f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.730+0000 7f1faaba9740 1 -- 172.21.15.69:0/3448875097 shutdown_connections 2024-04-23T10:28:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.730+0000 7f1faaba9740 1 -- 172.21.15.69:0/3448875097 wait complete. 2024-04-23T10:28:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1faaba9740 1 -- start start 2024-04-23T10:28:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1faaba9740 1 Processor -- start 2024-04-23T10:28:17.735 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-04-23T10:28:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 0x560d076135b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07604e20 0x560d076108a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07613c10 0x560d07610e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1faaba9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560d07616840 con 0x560d07613c10 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1faaba9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560d075040b0 con 0x560d07604500 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1faaba9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560d076169c0 con 0x560d07604e20 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1faaba9740 10 client.0 _ll_register_callbacks cb 0x560d074f1d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1fa642e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07613c10 0x560d07610e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1fa642e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07613c10 0x560d07610e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59566/0 (socket says 172.21.15.69:59566) 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1fa642e640 1 -- 172.21.15.69:0/3753538433 learned_addr learned my addr 172.21.15.69:0/3753538433 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1fa542c640 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07604e20 0x560d076108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 0x560d076135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1fa642e640 1 -- 172.21.15.69:0/3753538433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07604e20 msgr2=0x560d076108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1fa642e640 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07604e20 0x560d076108a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.731+0000 7f1fa642e640 1 -- 172.21.15.69:0/3753538433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 msgr2=0x560d076135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1fa642e640 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 0x560d076135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1fa642e640 1 -- 172.21.15.69:0/3753538433 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d07348620 con 0x560d07613c10 2024-04-23T10:28:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 0x560d076135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:17.738 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-04-23T10:28:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1fa642e640 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07613c10 0x560d07610e40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1f98012c30 tx=0x7f1f98004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21ddc1b0446d8d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1f897fa640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1f897fa640 1 -- 172.21.15.69:0/3753538433 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9801c660 con 0x560d07613c10 2024-04-23T10:28:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1f897fa640 1 -- 172.21.15.69:0/3753538433 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f1f9801c800 con 0x560d07613c10 2024-04-23T10:28:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1faaba9740 1 -- 172.21.15.69:0/3753538433 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f9c004c70 con 0x560d07613c10 2024-04-23T10:28:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1f897fa640 1 -- 172.21.15.69:0/3753538433 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1f9801ca00 con 0x560d07613c10 2024-04-23T10:28:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1faaba9740 10 client.15819 fetch_fsmap learned FSMap version 28 2024-04-23T10:28:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1faaba9740 1 -- 172.21.15.69:0/3753538433 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d07622800 con 0x560d07613c10 2024-04-23T10:28:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1f897fa640 1 -- 172.21.15.69:0/3753538433 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f9c004c70 con 0x560d07613c10 2024-04-23T10:28:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1f897fa640 1 -- 172.21.15.69:0/3753538433 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1f9801ece0 con 0x560d07613c10 2024-04-23T10:28:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1faaba9740 10 client.15819 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:28:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1faaba9740 10 client.15819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:28:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1faaba9740 20 client.15819 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560d07623dd0 0x560d07626270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1faaba9740 4 client.15819 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:28:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.732+0000 7f1faaba9740 1 -- 172.21.15.69:0/3753538433 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d07577390 con 0x560d07623dd0 2024-04-23T10:28:17.740 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-04-23T10:28:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.733+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560d07623dd0 0x560d07626270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.733+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560d07623dd0 0x560d07626270 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0cf0d222f958817 server_cookie=c8e62d57dbc0405a in_seq=0 out_seq=0 2024-04-23T10:28:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.733+0000 7f1f897fa640 10 client.15819 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:17.741 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-04-23T10:28:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1f897fa640 1 -- 172.21.15.69:0/3753538433 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560d07577390 con 0x560d07623dd0 2024-04-23T10:28:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1f897fa640 10 client.15819 handle_command_reply: tid=0 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 1 client.15819 shutdown 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 1 -- 172.21.15.69:0/3753538433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07613c10 msgr2=0x560d07610e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07613c10 0x560d07610e40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1f98012c30 tx=0x7f1f98004ab0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 1 -- 172.21.15.69:0/3753538433 shutdown_connections 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560d07623dd0 0x560d07626270 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07613c10 0x560d07610e40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07604e20 0x560d076108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3753538433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604500 0x560d076135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 1 -- 172.21.15.69:0/3753538433 >> 172.21.15.69:0/3753538433 conn(0x560d07600b30 msgr2=0x560d076069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1f897fa640 0 client.15819 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 1 -- 172.21.15.69:0/3753538433 shutdown_connections 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 1 -- 172.21.15.69:0/3753538433 wait complete. 2024-04-23T10:28:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.734+0000 7f1faaba9740 20 client.15819 trim_cache size 0 max 16384 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-04-23T10:28:17.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-04-23T10:28:17.746 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-04-23T10:28:17.746 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-04-23T10:28:17.746 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-04-23T10:28:17.746 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-04-23T10:28:17.747 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-04-23T10:28:17.748 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-04-23T10:28:17.749 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-04-23T10:28:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1faaba9740 1 Processor -- start 2024-04-23T10:28:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1faaba9740 1 -- start start 2024-04-23T10:28:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07604e20 0x560d0760f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07613c10 0x560d076130e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1faaba9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa01ab9e0 con 0x560d07604500 2024-04-23T10:28:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1faaba9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa01ad5e0 con 0x560d07613c10 2024-04-23T10:28:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1faaba9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa01ac0b0 con 0x560d07604e20 2024-04-23T10:28:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1fa5c2d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1fa5c2d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59578/0 (socket says 172.21.15.69:59578) 2024-04-23T10:28:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/1656975143 learned_addr learned my addr 172.21.15.69:0/1656975143 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1fa542c640 1 --2- 172.21.15.69:0/1656975143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07604e20 0x560d0760f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.751 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-04-23T10:28:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/1656975143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07604e20 msgr2=0x560d0760f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/1656975143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07604e20 0x560d0760f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/1656975143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07613c10 msgr2=0x560d076130e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/1656975143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07613c10 0x560d076130e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/1656975143 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d07601700 con 0x560d07604500 2024-04-23T10:28:17.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1fa542c640 1 --2- 172.21.15.69:0/1656975143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07604e20 0x560d0760f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:17.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.751+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/1656975143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761f740 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c010ca0 tx=0x7f1f9c0056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7caf1eb627580c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:17.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1f8b7fe640 1 -- 172.21.15.69:0/1656975143 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c027670 con 0x560d07604500 2024-04-23T10:28:17.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1f8b7fe640 1 -- 172.21.15.69:0/1656975143 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f9c02c070 con 0x560d07604500 2024-04-23T10:28:17.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1f8b7fe640 1 -- 172.21.15.69:0/1656975143 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c01b430 con 0x560d07604500 2024-04-23T10:28:17.753 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-04-23T10:28:17.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1faaba9740 1 -- 172.21.15.69:0/1656975143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 msgr2=0x560d0761f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:17.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1faaba9740 1 --2- 172.21.15.69:0/1656975143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761f740 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c010ca0 tx=0x7f1f9c0056f0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1faaba9740 1 -- 172.21.15.69:0/1656975143 shutdown_connections 2024-04-23T10:28:17.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1faaba9740 1 --2- 172.21.15.69:0/1656975143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07613c10 0x560d076130e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1faaba9740 1 --2- 172.21.15.69:0/1656975143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07604e20 0x560d0760f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1faaba9740 1 --2- 172.21.15.69:0/1656975143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761f740 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1faaba9740 1 -- 172.21.15.69:0/1656975143 >> 172.21.15.69:0/1656975143 conn(0x560d07600b30 msgr2=0x560d0760f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1faaba9740 1 -- 172.21.15.69:0/1656975143 shutdown_connections 2024-04-23T10:28:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.752+0000 7f1faaba9740 1 -- 172.21.15.69:0/1656975143 wait complete. 2024-04-23T10:28:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 -- start start 2024-04-23T10:28:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 Processor -- start 2024-04-23T10:28:17.755 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604e20 0x560d0761bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07613c10 0x560d07616d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa01ace50 con 0x560d07604500 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa01ac780 con 0x560d07604e20 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa01a99e0 con 0x560d07613c10 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 10 client.0 _ll_register_callbacks cb 0x7f1f980128e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa5c2d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa5c2d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59586/0 (socket says 172.21.15.69:59586) 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/3186903779 learned_addr learned my addr 172.21.15.69:0/3186903779 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa642e640 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07613c10 0x560d07616d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa542c640 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604e20 0x560d0761bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/3186903779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07613c10 msgr2=0x560d07616d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07613c10 0x560d07616d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/3186903779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604e20 msgr2=0x560d0761bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604e20 0x560d0761bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa5c2d640 1 -- 172.21.15.69:0/3186903779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d076174b0 con 0x560d07604500 2024-04-23T10:28:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa542c640 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604e20 0x560d0761bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1fa5c2d640 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761b8b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c000c00 tx=0x7f1f9c00bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189c8692361c38bf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1f897fa640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:17.758 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1f897fa640 1 -- 172.21.15.69:0/3186903779 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c034030 con 0x560d07604500 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1f897fa640 1 -- 172.21.15.69:0/3186903779 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8469+0+0 (secure 0 0 0) 0x7f1f9c027680 con 0x560d07604500 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 -- 172.21.15.69:0/3186903779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f9c02c070 con 0x560d07604500 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1f897fa640 1 -- 172.21.15.69:0/3186903779 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1f9c027880 con 0x560d07604500 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 10 client.15825 fetch_fsmap learned FSMap version 28 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 -- 172.21.15.69:0/3186903779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d07689e00 con 0x560d07604500 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1f897fa640 1 -- 172.21.15.69:0/3186903779 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f9c02c070 con 0x560d07604500 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1f897fa640 1 -- 172.21.15.69:0/3186903779 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1f9c03b4e0 con 0x560d07604500 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 10 client.15825 fetch_fsmap finished waiting for FSMap version 28 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 20 client.15825 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560d0768a3b0 0x560d0768c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 4 client.15825 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:28:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.753+0000 7f1faaba9740 1 -- 172.21.15.69:0/3186903779 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d07571200 con 0x560d0768a3b0 2024-04-23T10:28:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.754+0000 7f1fa542c640 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560d0768a3b0 0x560d0768c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:17.761 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-04-23T10:28:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.754+0000 7f1f897fa640 10 client.15825 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.754+0000 7f1fa542c640 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560d0768a3b0 0x560d0768c7d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a893bed4555e5f63 server_cookie=668303caacd1696e in_seq=0 out_seq=0 2024-04-23T10:28:17.762 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-04-23T10:28:17.762 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-04-23T10:28:17.762 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-04-23T10:28:17.762 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-04-23T10:28:17.762 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-04-23T10:28:17.762 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-04-23T10:28:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.760+0000 7f1f897fa640 1 -- 172.21.15.69:0/3186903779 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d07571200 con 0x560d0768a3b0 2024-04-23T10:28:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.760+0000 7f1f897fa640 10 client.15825 handle_command_reply: tid=0 2024-04-23T10:28:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.760+0000 7f1faaba9740 1 client.15825 shutdown 2024-04-23T10:28:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1faaba9740 1 -- 172.21.15.69:0/3186903779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 msgr2=0x560d0761b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761b8b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c000c00 tx=0x7f1f9c00bbd0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1faaba9740 1 -- 172.21.15.69:0/3186903779 shutdown_connections 2024-04-23T10:28:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560d0768a3b0 0x560d0768c7d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d07613c10 0x560d07616d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560d07604e20 0x560d0761bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1f897fa640 0 client.15825 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1faaba9740 1 --2- 172.21.15.69:0/3186903779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d07604500 0x560d0761b8b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1faaba9740 1 -- 172.21.15.69:0/3186903779 >> 172.21.15.69:0/3186903779 conn(0x560d07600b30 msgr2=0x560d0760b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:17.764 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-04-23T10:28:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1faaba9740 1 -- 172.21.15.69:0/3186903779 shutdown_connections 2024-04-23T10:28:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1faaba9740 1 -- 172.21.15.69:0/3186903779 wait complete. 2024-04-23T10:28:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1faaba9740 20 client.15825 trim_cache size 0 max 16384 2024-04-23T10:28:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:28:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:28:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:28:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:28:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1fa7e91640 1 -- 172.21.15.69:0/4170967559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1f8c0a3ee0 msgr2=0x7f1f8c0a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1fa7e91640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1f8c0a3ee0 0x7f1f8c0a63a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1f980099e0 tx=0x7f1f98004a40 comp rx=0 tx=0).stop 2024-04-23T10:28:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1fa7e91640 1 -- 172.21.15.69:0/4170967559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fa0106170 msgr2=0x7f1fa0199b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1fa7e91640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fa0106170 0x7f1fa0199b20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1f90004770 tx=0x7f1f90003bb0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1fa7e91640 1 -- 172.21.15.69:0/4170967559 shutdown_connections 2024-04-23T10:28:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.761+0000 7f1fa7e91640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1f8c0a3ee0 0x7f1f8c0a63a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.762+0000 7f1fa7e91640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fa0106170 0x7f1fa0199b20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.762+0000 7f1fa7e91640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fa019a0b0 0x7f1fa01a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.762+0000 7f1fa7e91640 1 --2- 172.21.15.69:0/4170967559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa01010f0 0x7f1fa01995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.762+0000 7f1fa7e91640 1 -- 172.21.15.69:0/4170967559 >> 172.21.15.69:0/4170967559 conn(0x7f1fa0077fd0 msgr2=0x7f1fa00fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.762+0000 7f1fa7e91640 1 -- 172.21.15.69:0/4170967559 shutdown_connections 2024-04-23T10:28:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:17.762+0000 7f1fa7e91640 1 -- 172.21.15.69:0/4170967559 wait complete. 2024-04-23T10:28:17.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-04-23T10:28:17.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-04-23T10:28:17.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-04-23T10:28:17.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-04-23T10:28:17.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-04-23T10:28:17.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-04-23T10:28:17.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-04-23T10:28:17.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-04-23T10:28:17.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-04-23T10:28:17.769 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-04-23T10:28:17.770 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-04-23T10:28:17.770 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-04-23T10:28:17.772 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-04-23T10:28:17.772 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-04-23T10:28:17.773 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-04-23T10:28:17.774 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-04-23T10:28:17.775 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-04-23T10:28:17.776 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-04-23T10:28:17.777 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-04-23T10:28:17.778 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-04-23T10:28:17.779 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-04-23T10:28:17.780 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-04-23T10:28:17.781 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-04-23T10:28:17.782 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-04-23T10:28:17.783 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-04-23T10:28:17.784 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-04-23T10:28:17.785 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-04-23T10:28:17.786 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-04-23T10:28:17.787 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-04-23T10:28:17.787 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-04-23T10:28:17.788 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-04-23T10:28:17.789 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-04-23T10:28:17.790 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-04-23T10:28:17.792 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-04-23T10:28:17.793 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-04-23T10:28:17.794 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-04-23T10:28:17.795 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-04-23T10:28:17.796 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-04-23T10:28:17.797 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-04-23T10:28:17.798 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-04-23T10:28:17.798 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-04-23T10:28:17.800 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-04-23T10:28:17.800 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-04-23T10:28:17.801 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-04-23T10:28:17.802 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-04-23T10:28:17.803 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-04-23T10:28:17.804 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-04-23T10:28:17.805 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-04-23T10:28:17.806 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-04-23T10:28:17.807 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-04-23T10:28:17.808 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-04-23T10:28:17.809 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-04-23T10:28:17.810 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/ 2024-04-23T10:28:17.811 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-04-23T10:28:17.812 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-04-23T10:28:17.813 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-04-23T10:28:17.814 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-04-23T10:28:17.814 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-04-23T10:28:17.815 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-04-23T10:28:17.816 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-04-23T10:28:17.817 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-04-23T10:28:17.818 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-04-23T10:28:17.819 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-04-23T10:28:17.820 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-04-23T10:28:17.821 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-04-23T10:28:17.822 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-04-23T10:28:17.823 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-04-23T10:28:17.824 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-04-23T10:28:17.825 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-04-23T10:28:17.826 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-04-23T10:28:17.827 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-04-23T10:28:17.828 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-04-23T10:28:17.829 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-04-23T10:28:17.830 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-04-23T10:28:17.831 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-04-23T10:28:17.832 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-04-23T10:28:17.833 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-04-23T10:28:17.834 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-04-23T10:28:17.835 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-04-23T10:28:17.836 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-04-23T10:28:17.837 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-04-23T10:28:17.838 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-04-23T10:28:17.839 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-04-23T10:28:17.840 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-04-23T10:28:17.841 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-04-23T10:28:17.842 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/summary 2024-04-23T10:28:17.843 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-04-23T10:28:17.844 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-04-23T10:28:17.845 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-04-23T10:28:17.846 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2o/ 2024-04-23T10:28:17.847 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2o/README 2024-04-23T10:28:17.848 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-04-23T10:28:17.849 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/ 2024-04-23T10:28:17.850 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-04-23T10:28:17.851 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-04-23T10:28:17.852 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-04-23T10:28:17.853 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/README 2024-04-23T10:28:17.854 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-04-23T10:28:17.857 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-04-23T10:28:18.051 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-04-23T10:28:18.051 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-04-23T10:28:18.053 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-04-23T10:28:18.054 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-04-23T10:28:18.055 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-04-23T10:28:18.056 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-04-23T10:28:18.057 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ide/ 2024-04-23T10:28:18.059 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-04-23T10:28:18.060 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-04-23T10:28:18.061 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-04-23T10:28:18.062 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-04-23T10:28:18.063 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-04-23T10:28:18.063 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-04-23T10:28:18.065 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-04-23T10:28:18.065 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/infiniband/ 2024-04-23T10:28:18.066 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-04-23T10:28:18.067 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-04-23T10:28:18.069 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-04-23T10:28:18.070 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-04-23T10:28:18.071 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-04-23T10:28:18.072 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/init.txt 2024-04-23T10:28:18.073 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/initrd.txt 2024-04-23T10:28:18.074 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/ 2024-04-23T10:28:18.075 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-04-23T10:28:18.076 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-04-23T10:28:18.077 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-04-23T10:28:18.078 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-04-23T10:28:18.079 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-04-23T10:28:18.080 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-04-23T10:28:18.081 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-04-23T10:28:18.082 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-04-23T10:28:18.083 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-04-23T10:28:18.084 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-04-23T10:28:18.085 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-04-23T10:28:18.086 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-04-23T10:28:18.087 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-04-23T10:28:18.089 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-04-23T10:28:18.090 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-04-23T10:28:18.091 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-04-23T10:28:18.092 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-04-23T10:28:18.093 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/input.txt 2024-04-23T10:28:18.094 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-04-23T10:28:18.095 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-04-23T10:28:18.096 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-04-23T10:28:18.097 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-04-23T10:28:18.098 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-04-23T10:28:18.099 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-04-23T10:28:18.100 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-04-23T10:28:18.101 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-04-23T10:28:18.102 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-04-23T10:28:18.103 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-04-23T10:28:18.104 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-04-23T10:28:18.105 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-04-23T10:28:18.106 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-04-23T10:28:18.107 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-04-23T10:28:18.108 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-04-23T10:28:18.109 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-04-23T10:28:18.110 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ioctl/ 2024-04-23T10:28:18.111 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-04-23T10:28:18.112 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-04-23T10:28:18.114 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-04-23T10:28:18.114 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-04-23T10:28:18.115 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-04-23T10:28:18.117 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-04-23T10:28:18.118 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/iostats.txt 2024-04-23T10:28:18.120 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-04-23T10:28:18.121 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-04-23T10:28:18.122 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/ 2024-04-23T10:28:18.123 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-04-23T10:28:18.124 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-04-23T10:28:18.126 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-04-23T10:28:18.127 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-04-23T10:28:18.128 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-04-23T10:28:18.130 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-04-23T10:28:18.131 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README 2024-04-23T10:28:18.132 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-04-23T10:28:18.134 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-04-23T10:28:18.135 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-04-23T10:28:18.137 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-04-23T10:28:18.138 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-04-23T10:28:18.139 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-04-23T10:28:18.140 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-04-23T10:28:18.141 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-04-23T10:28:18.142 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-04-23T10:28:18.142 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-04-23T10:28:18.143 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-04-23T10:28:18.144 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-04-23T10:28:18.145 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-04-23T10:28:18.146 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-04-23T10:28:18.147 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-04-23T10:28:18.148 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-04-23T10:28:18.149 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-04-23T10:28:18.150 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-04-23T10:28:18.151 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-04-23T10:28:18.152 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-04-23T10:28:18.153 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-04-23T10:28:18.154 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-04-23T10:28:18.155 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-04-23T10:28:18.156 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-04-23T10:28:18.157 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/java.txt 2024-04-23T10:28:18.159 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kasan.txt 2024-04-23T10:28:18.160 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kbuild/ 2024-04-23T10:28:18.161 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-04-23T10:28:18.162 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-04-23T10:28:18.163 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-04-23T10:28:18.164 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-04-23T10:28:18.165 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-04-23T10:28:18.166 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-04-23T10:28:18.167 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-04-23T10:28:18.168 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kdump/ 2024-04-23T10:28:18.169 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-04-23T10:28:18.170 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-04-23T10:28:18.171 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-04-23T10:28:18.172 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-04-23T10:28:18.173 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-04-23T10:28:18.178 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-04-23T10:28:18.178 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-04-23T10:28:18.178 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-04-23T10:28:18.178 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-04-23T10:28:18.179 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-04-23T10:28:18.180 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-04-23T10:28:18.181 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kobject.txt 2024-04-23T10:28:18.182 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-04-23T10:28:18.183 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kref.txt 2024-04-23T10:28:18.184 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-04-23T10:28:18.186 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/ 2024-04-23T10:28:18.186 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-04-23T10:28:18.187 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-04-23T10:28:18.188 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-04-23T10:28:18.189 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-04-23T10:28:18.190 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-04-23T10:28:18.191 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-04-23T10:28:18.192 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-04-23T10:28:18.193 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-04-23T10:28:18.194 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-04-23T10:28:18.195 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-04-23T10:28:18.196 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-04-23T10:28:18.197 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-04-23T10:28:18.198 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ldm.txt 2024-04-23T10:28:18.199 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/ 2024-04-23T10:28:18.200 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-04-23T10:28:18.201 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-04-23T10:28:18.202 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-04-23T10:28:18.203 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-04-23T10:28:18.204 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-04-23T10:28:18.205 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-04-23T10:28:18.206 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-04-23T10:28:18.207 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-04-23T10:28:18.209 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-04-23T10:28:18.209 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-04-23T10:28:18.210 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-04-23T10:28:18.211 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-04-23T10:28:18.212 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/locking/ 2024-04-23T10:28:18.213 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-04-23T10:28:18.214 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-04-23T10:28:18.215 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-04-23T10:28:18.216 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-04-23T10:28:18.217 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-04-23T10:28:18.218 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-04-23T10:28:18.219 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-04-23T10:28:18.221 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-04-23T10:28:18.222 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-04-23T10:28:18.223 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-04-23T10:28:18.223 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-04-23T10:28:18.224 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/logo.gif 2024-04-23T10:28:18.226 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/logo.txt 2024-04-23T10:28:18.227 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/lzo.txt 2024-04-23T10:28:18.228 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/m68k/ 2024-04-23T10:28:18.229 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-04-23T10:28:18.230 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-04-23T10:28:18.231 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-04-23T10:28:18.232 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-04-23T10:28:18.233 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-04-23T10:28:18.234 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/md.txt 2024-04-23T10:28:18.235 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-04-23T10:28:18.236 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-04-23T10:28:18.321 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-04-23T10:28:18.322 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-04-23T10:28:18.322 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-04-23T10:28:18.324 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/metag/ 2024-04-23T10:28:18.324 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-04-23T10:28:18.326 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-04-23T10:28:18.326 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mic/ 2024-04-23T10:28:18.327 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-04-23T10:28:18.328 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-04-23T10:28:18.329 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-04-23T10:28:18.329 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-04-23T10:28:18.330 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-04-23T10:28:18.331 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-04-23T10:28:18.332 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-04-23T10:28:18.333 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-04-23T10:28:18.334 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-04-23T10:28:18.335 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-04-23T10:28:18.336 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mips/ 2024-04-23T10:28:18.336 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-04-23T10:28:18.337 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-04-23T10:28:18.338 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-04-23T10:28:18.339 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-04-23T10:28:18.339 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-04-23T10:28:18.341 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-04-23T10:28:18.341 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-04-23T10:28:18.342 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-04-23T10:28:18.343 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-04-23T10:28:18.344 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-04-23T10:28:18.345 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-04-23T10:28:18.345 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-04-23T10:28:18.347 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-04-23T10:28:18.347 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-04-23T10:28:18.348 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-04-23T10:28:18.349 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-04-23T10:28:18.350 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-04-23T10:28:18.351 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-04-23T10:28:18.352 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-04-23T10:28:18.353 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-04-23T10:28:18.355 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-04-23T10:28:18.356 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mmc/ 2024-04-23T10:28:18.358 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-04-23T10:28:18.359 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-04-23T10:28:18.361 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-04-23T10:28:18.362 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-04-23T10:28:18.364 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mn10300/ 2024-04-23T10:28:18.365 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-04-23T10:28:18.366 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-04-23T10:28:18.368 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-04-23T10:28:18.369 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mono.txt 2024-04-23T10:28:18.371 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mtd/ 2024-04-23T10:28:18.372 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-04-23T10:28:18.373 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-04-23T10:28:18.375 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-04-23T10:28:18.376 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-04-23T10:28:18.378 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/namespaces/ 2024-04-23T10:28:18.379 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-04-23T10:28:18.380 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-04-23T10:28:18.382 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/netlabel/ 2024-04-23T10:28:18.385 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-04-23T10:28:18.385 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-04-23T10:28:18.386 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-04-23T10:28:18.388 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-04-23T10:28:18.389 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-04-23T10:28:18.390 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ 2024-04-23T10:28:18.391 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-04-23T10:28:18.392 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-04-23T10:28:18.393 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-04-23T10:28:18.394 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-04-23T10:28:18.395 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-04-23T10:28:18.396 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-04-23T10:28:18.397 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-04-23T10:28:18.398 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-04-23T10:28:18.400 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-04-23T10:28:18.401 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-04-23T10:28:18.401 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-04-23T10:28:18.402 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-04-23T10:28:18.404 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-04-23T10:28:18.404 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-04-23T10:28:18.406 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-04-23T10:28:18.407 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-04-23T10:28:18.407 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-04-23T10:28:18.408 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-04-23T10:28:18.409 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-04-23T10:28:18.410 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-04-23T10:28:18.411 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-04-23T10:28:18.412 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-04-23T10:28:18.413 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-04-23T10:28:18.414 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-04-23T10:28:18.415 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-04-23T10:28:18.415 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-04-23T10:28:18.417 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-04-23T10:28:18.417 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-04-23T10:28:18.419 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-04-23T10:28:18.419 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-04-23T10:28:18.420 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-04-23T10:28:18.421 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-04-23T10:28:18.422 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-04-23T10:28:18.423 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-04-23T10:28:18.424 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-04-23T10:28:18.425 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-04-23T10:28:18.426 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-04-23T10:28:18.427 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-04-23T10:28:18.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:18 smithi146 ceph-mon[32800]: daemon mds.f restarted 2024-04-23T10:28:18.428 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-04-23T10:28:18.429 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-04-23T10:28:18.430 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-04-23T10:28:18.431 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-04-23T10:28:18.432 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-04-23T10:28:18.433 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-04-23T10:28:18.434 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-04-23T10:28:18.435 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-04-23T10:28:18.437 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-04-23T10:28:18.438 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-04-23T10:28:18.439 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-04-23T10:28:18.440 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-04-23T10:28:18.441 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-04-23T10:28:18.442 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-04-23T10:28:18.443 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-04-23T10:28:18.443 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-04-23T10:28:18.444 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-04-23T10:28:18.445 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-04-23T10:28:18.446 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-04-23T10:28:18.447 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-04-23T10:28:18.448 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-04-23T10:28:18.449 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-04-23T10:28:18.450 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-04-23T10:28:18.450 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-04-23T10:28:18.451 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-04-23T10:28:18.452 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-04-23T10:28:18.453 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-04-23T10:28:18.454 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-04-23T10:28:18.455 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-04-23T10:28:18.456 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-04-23T10:28:18.457 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-04-23T10:28:18.458 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-04-23T10:28:18.459 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-04-23T10:28:18.460 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-04-23T10:28:18.461 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-04-23T10:28:18.462 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-04-23T10:28:18.463 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-04-23T10:28:18.464 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-04-23T10:28:18.465 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-04-23T10:28:18.466 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-04-23T10:28:18.467 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-04-23T10:28:18.467 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-04-23T10:28:18.468 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-04-23T10:28:18.469 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-04-23T10:28:18.470 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-04-23T10:28:18.471 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-04-23T10:28:18.472 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-04-23T10:28:18.473 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-04-23T10:28:18.474 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-04-23T10:28:18.475 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-04-23T10:28:18.475 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-04-23T10:28:18.476 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-04-23T10:28:18.477 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-04-23T10:28:18.478 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-04-23T10:28:18.479 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-04-23T10:28:18.480 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-04-23T10:28:18.481 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-04-23T10:28:18.482 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-04-23T10:28:18.483 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-04-23T10:28:18.484 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-04-23T10:28:18.484 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-04-23T10:28:18.485 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-04-23T10:28:18.486 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-04-23T10:28:18.487 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-04-23T10:28:18.488 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-04-23T10:28:18.488 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-04-23T10:28:18.490 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-04-23T10:28:18.490 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-04-23T10:28:18.491 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-04-23T10:28:18.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:18 smithi069 ceph-mon[29593]: daemon mds.f restarted 2024-04-23T10:28:18.492 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-04-23T10:28:18.493 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-04-23T10:28:18.494 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-04-23T10:28:18.495 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-04-23T10:28:18.496 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-04-23T10:28:18.496 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-04-23T10:28:18.497 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-04-23T10:28:18.498 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-04-23T10:28:18.499 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-04-23T10:28:18.500 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-04-23T10:28:18.500 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-04-23T10:28:18.501 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-04-23T10:28:18.502 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-04-23T10:28:18.503 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-04-23T10:28:18.504 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-04-23T10:28:18.505 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-04-23T10:28:18.506 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-04-23T10:28:18.507 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-04-23T10:28:18.508 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-04-23T10:28:18.509 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-04-23T10:28:18.509 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-04-23T10:28:18.510 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-04-23T10:28:18.511 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-04-23T10:28:18.512 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-04-23T10:28:18.513 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-04-23T10:28:18.514 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-04-23T10:28:18.515 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-04-23T10:28:18.516 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-04-23T10:28:18.517 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/nfc/ 2024-04-23T10:28:18.518 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-04-23T10:28:18.519 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-04-23T10:28:18.520 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/nios2/ 2024-04-23T10:28:18.521 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/nios2/README 2024-04-23T10:28:18.522 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-04-23T10:28:18.523 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/numastat.txt 2024-04-23T10:28:18.524 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-04-23T10:28:18.525 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/padata.txt 2024-04-23T10:28:18.526 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/parisc/ 2024-04-23T10:28:18.527 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-04-23T10:28:18.528 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-04-23T10:28:18.529 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/parisc/registers 2024-04-23T10:28:18.530 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-04-23T10:28:18.531 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/parport.txt 2024-04-23T10:28:18.532 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-04-23T10:28:18.534 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-04-23T10:28:18.535 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-04-23T10:28:18.536 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-04-23T10:28:18.537 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-04-23T10:28:18.538 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-04-23T10:28:18.539 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-04-23T10:28:18.540 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-04-23T10:28:18.541 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-04-23T10:28:18.542 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/phy.txt 2024-04-23T10:28:18.543 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/phy/ 2024-04-23T10:28:18.544 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-04-23T10:28:18.545 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-04-23T10:28:18.546 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-04-23T10:28:18.547 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/platform/ 2024-04-23T10:28:18.548 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-04-23T10:28:18.549 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pnp.txt 2024-04-23T10:28:18.550 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/ 2024-04-23T10:28:18.551 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-04-23T10:28:18.552 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-04-23T10:28:18.553 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-04-23T10:28:18.554 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-04-23T10:28:18.555 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-04-23T10:28:18.556 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-04-23T10:28:18.557 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-04-23T10:28:18.558 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-04-23T10:28:18.559 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-04-23T10:28:18.560 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-04-23T10:28:18.561 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-04-23T10:28:18.562 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-04-23T10:28:18.563 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-04-23T10:28:18.564 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-04-23T10:28:18.565 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-04-23T10:28:18.566 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-04-23T10:28:18.567 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-04-23T10:28:18.568 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-04-23T10:28:18.569 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-04-23T10:28:18.570 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-04-23T10:28:18.571 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-04-23T10:28:18.572 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-04-23T10:28:18.573 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-04-23T10:28:18.574 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/states.txt 2024-04-23T10:28:18.575 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-04-23T10:28:18.576 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-04-23T10:28:18.577 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-04-23T10:28:18.578 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-04-23T10:28:18.579 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-04-23T10:28:18.580 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-04-23T10:28:18.581 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-04-23T10:28:18.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:18 smithi167 ceph-mon[32940]: daemon mds.f restarted 2024-04-23T10:28:18.582 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/power/video.txt 2024-04-23T10:28:18.583 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/ 2024-04-23T10:28:18.584 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-04-23T10:28:18.585 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-04-23T10:28:18.586 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-04-23T10:28:18.587 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-04-23T10:28:18.588 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-04-23T10:28:18.588 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-04-23T10:28:18.589 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-04-23T10:28:18.590 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-04-23T10:28:18.591 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-04-23T10:28:18.592 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-04-23T10:28:18.593 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-04-23T10:28:18.594 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-04-23T10:28:18.595 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-04-23T10:28:18.596 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pps/ 2024-04-23T10:28:18.597 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-04-23T10:28:18.598 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/prctl/ 2024-04-23T10:28:18.599 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-04-23T10:28:18.600 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-04-23T10:28:18.601 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-04-23T10:28:18.602 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-04-23T10:28:18.603 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-04-23T10:28:18.604 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-04-23T10:28:18.605 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-04-23T10:28:18.606 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-04-23T10:28:18.607 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-04-23T10:28:18.608 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pti/ 2024-04-23T10:28:18.609 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-04-23T10:28:18.610 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ptp/ 2024-04-23T10:28:18.611 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-04-23T10:28:18.612 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-04-23T10:28:18.613 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-04-23T10:28:18.614 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-04-23T10:28:18.615 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-04-23T10:28:18.616 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/pwm.txt 2024-04-23T10:28:18.617 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-04-23T10:28:18.618 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/rapidio/ 2024-04-23T10:28:18.619 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-04-23T10:28:18.620 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-04-23T10:28:18.621 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-04-23T10:28:18.622 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-04-23T10:28:18.623 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-04-23T10:28:18.624 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-04-23T10:28:18.625 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-04-23T10:28:18.626 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-04-23T10:28:18.627 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-04-23T10:28:18.628 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/rtc.txt 2024-04-23T10:28:18.629 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/ 2024-04-23T10:28:18.630 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-04-23T10:28:18.631 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-04-23T10:28:18.632 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-04-23T10:28:18.633 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-04-23T10:28:18.634 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/DASD 2024-04-23T10:28:18.635 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-04-23T10:28:18.636 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-04-23T10:28:18.638 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-04-23T10:28:18.639 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-04-23T10:28:18.640 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-04-23T10:28:18.641 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-04-23T10:28:18.642 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-04-23T10:28:18.643 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-04-23T10:28:18.644 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-04-23T10:28:18.645 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scheduler/ 2024-04-23T10:28:18.646 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-04-23T10:28:18.647 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-04-23T10:28:18.647 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-04-23T10:28:18.648 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-04-23T10:28:18.650 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-04-23T10:28:18.651 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-04-23T10:28:18.652 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-04-23T10:28:18.653 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-04-23T10:28:18.654 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-04-23T10:28:18.655 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-04-23T10:28:18.656 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ 2024-04-23T10:28:18.657 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-04-23T10:28:18.657 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-04-23T10:28:18.658 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-04-23T10:28:18.659 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-04-23T10:28:18.660 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-04-23T10:28:18.661 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-04-23T10:28:18.662 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-04-23T10:28:18.663 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-04-23T10:28:18.664 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-04-23T10:28:18.666 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-04-23T10:28:18.666 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-04-23T10:28:18.667 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-04-23T10:28:18.668 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-04-23T10:28:18.670 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-04-23T10:28:18.671 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-04-23T10:28:18.672 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-04-23T10:28:18.673 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-04-23T10:28:18.674 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-04-23T10:28:18.675 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-04-23T10:28:18.676 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-04-23T10:28:18.676 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-04-23T10:28:18.677 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-04-23T10:28:18.678 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-04-23T10:28:18.679 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-04-23T10:28:18.680 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-04-23T10:28:18.681 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-04-23T10:28:18.682 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-04-23T10:28:18.683 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-04-23T10:28:18.684 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-04-23T10:28:18.685 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-04-23T10:28:18.686 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-04-23T10:28:18.687 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-04-23T10:28:18.688 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-04-23T10:28:18.689 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-04-23T10:28:18.690 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-04-23T10:28:18.691 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-04-23T10:28:18.692 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-04-23T10:28:18.693 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-04-23T10:28:18.694 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-04-23T10:28:18.695 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-04-23T10:28:18.696 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-04-23T10:28:18.697 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-04-23T10:28:18.698 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-04-23T10:28:18.699 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-04-23T10:28:18.700 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-04-23T10:28:18.701 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-04-23T10:28:18.702 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-04-23T10:28:18.703 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-04-23T10:28:18.704 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-04-23T10:28:18.705 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-04-23T10:28:18.706 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-04-23T10:28:18.707 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-04-23T10:28:18.707 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-04-23T10:28:18.709 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-04-23T10:28:18.709 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-04-23T10:28:18.710 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-04-23T10:28:18.711 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-04-23T10:28:18.712 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-04-23T10:28:18.713 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-04-23T10:28:18.714 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/ 2024-04-23T10:28:18.715 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-04-23T10:28:18.716 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-04-23T10:28:18.717 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-04-23T10:28:18.718 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-04-23T10:28:18.719 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-04-23T10:28:18.720 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-04-23T10:28:18.721 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-04-23T10:28:18.722 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-04-23T10:28:18.723 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-04-23T10:28:18.724 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-04-23T10:28:18.725 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-04-23T10:28:18.726 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-04-23T10:28:18.727 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-04-23T10:28:18.727 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-04-23T10:28:18.729 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/serial/ 2024-04-23T10:28:18.729 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-04-23T10:28:18.730 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-04-23T10:28:18.731 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/serial/driver 2024-04-23T10:28:18.732 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-04-23T10:28:18.733 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-04-23T10:28:18.734 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-04-23T10:28:18.735 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-04-23T10:28:18.736 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-04-23T10:28:18.737 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-04-23T10:28:18.738 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sh/ 2024-04-23T10:28:18.739 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-04-23T10:28:18.740 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-04-23T10:28:18.741 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-04-23T10:28:18.742 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/ 2024-04-23T10:28:18.743 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-04-23T10:28:18.744 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-04-23T10:28:18.745 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-04-23T10:28:18.746 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-04-23T10:28:18.747 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-04-23T10:28:18.749 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-04-23T10:28:18.749 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-04-23T10:28:18.750 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-04-23T10:28:18.751 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-04-23T10:28:18.752 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-04-23T10:28:18.753 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-04-23T10:28:18.754 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-04-23T10:28:18.755 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-04-23T10:28:18.756 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-04-23T10:28:18.757 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-04-23T10:28:18.758 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-04-23T10:28:18.759 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-04-23T10:28:18.760 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-04-23T10:28:18.761 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-04-23T10:28:18.762 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-04-23T10:28:18.763 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-04-23T10:28:18.763 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-04-23T10:28:18.765 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-04-23T10:28:18.765 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-04-23T10:28:18.766 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-04-23T10:28:18.767 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-04-23T10:28:18.768 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-04-23T10:28:18.769 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-04-23T10:28:18.770 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-04-23T10:28:18.771 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-04-23T10:28:18.772 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-04-23T10:28:18.773 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-04-23T10:28:18.774 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-04-23T10:28:18.775 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-04-23T10:28:18.775 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-04-23T10:28:18.776 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-04-23T10:28:18.777 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-04-23T10:28:18.778 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-04-23T10:28:18.779 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-04-23T10:28:18.780 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-04-23T10:28:18.781 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-04-23T10:28:18.782 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-04-23T10:28:18.783 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-04-23T10:28:18.784 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-04-23T10:28:18.785 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-04-23T10:28:18.786 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-04-23T10:28:18.787 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-04-23T10:28:18.788 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-04-23T10:28:18.789 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-04-23T10:28:18.789 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-04-23T10:28:18.790 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-04-23T10:28:18.794 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-04-23T10:28:18.794 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-04-23T10:28:18.794 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-04-23T10:28:18.794 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-04-23T10:28:18.795 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-04-23T10:28:18.796 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-04-23T10:28:18.797 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-04-23T10:28:18.798 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-04-23T10:28:18.799 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-04-23T10:28:18.800 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-04-23T10:28:18.801 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-04-23T10:28:18.802 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sparse.txt 2024-04-23T10:28:18.803 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/ 2024-04-23T10:28:18.804 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-04-23T10:28:18.805 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-04-23T10:28:18.806 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-04-23T10:28:18.807 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-04-23T10:28:18.808 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-04-23T10:28:18.809 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-04-23T10:28:18.810 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-04-23T10:28:18.811 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-04-23T10:28:18.813 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-04-23T10:28:18.813 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/spidev 2024-04-23T10:28:18.815 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-04-23T10:28:18.815 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-04-23T10:28:18.816 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-04-23T10:28:18.817 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-04-23T10:28:18.818 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-04-23T10:28:18.819 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/svga.txt 2024-04-23T10:28:18.820 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sysctl/ 2024-04-23T10:28:18.821 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-04-23T10:28:18.822 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sysctl/README 2024-04-23T10:28:18.823 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-04-23T10:28:18.824 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-04-23T10:28:18.825 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-04-23T10:28:18.826 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-04-23T10:28:18.827 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-04-23T10:28:18.828 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-04-23T10:28:18.829 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-04-23T10:28:18.830 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-04-23T10:28:18.831 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/target/ 2024-04-23T10:28:18.832 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-04-23T10:28:18.833 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-04-23T10:28:18.834 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-04-23T10:28:18.835 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/thermal/ 2024-04-23T10:28:18.836 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-04-23T10:28:18.837 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-04-23T10:28:18.838 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-04-23T10:28:18.839 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-04-23T10:28:18.839 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-04-23T10:28:18.840 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-04-23T10:28:18.841 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-04-23T10:28:18.842 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-04-23T10:28:18.843 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/ 2024-04-23T10:28:18.844 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-04-23T10:28:18.845 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-04-23T10:28:18.846 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-04-23T10:28:18.847 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-04-23T10:28:18.848 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-04-23T10:28:18.849 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-04-23T10:28:18.850 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-04-23T10:28:18.851 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-04-23T10:28:18.852 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-04-23T10:28:18.853 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-04-23T10:28:18.854 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-04-23T10:28:18.855 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/tpm/ 2024-04-23T10:28:18.856 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-04-23T10:28:18.857 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/ 2024-04-23T10:28:18.858 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-04-23T10:28:18.859 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-04-23T10:28:18.862 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-04-23T10:28:18.863 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-04-23T10:28:18.864 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-04-23T10:28:18.865 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-04-23T10:28:18.866 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-04-23T10:28:18.868 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-04-23T10:28:18.869 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-04-23T10:28:18.871 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-04-23T10:28:18.872 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-04-23T10:28:18.873 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-04-23T10:28:18.875 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-04-23T10:28:18.877 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-04-23T10:28:18.878 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-04-23T10:28:18.880 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-04-23T10:28:18.881 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-04-23T10:28:18.882 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-04-23T10:28:18.884 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/unicode.txt 2024-04-23T10:28:18.885 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/unshare.txt 2024-04-23T10:28:18.887 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/ 2024-04-23T10:28:18.888 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-04-23T10:28:18.889 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-04-23T10:28:18.890 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-04-23T10:28:18.891 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-04-23T10:28:18.893 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-04-23T10:28:18.894 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-04-23T10:28:18.895 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-04-23T10:28:18.896 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-04-23T10:28:18.897 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-04-23T10:28:18.898 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-04-23T10:28:18.900 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-04-23T10:28:18.901 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-04-23T10:28:18.902 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-04-23T10:28:18.903 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-04-23T10:28:18.904 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-04-23T10:28:18.905 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-04-23T10:28:18.907 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-04-23T10:28:18.908 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-04-23T10:28:18.909 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-04-23T10:28:18.910 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-04-23T10:28:18.911 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-04-23T10:28:18.913 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-04-23T10:28:18.914 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-04-23T10:28:18.915 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-04-23T10:28:18.916 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-04-23T10:28:18.917 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-04-23T10:28:18.918 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-04-23T10:28:18.919 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-04-23T10:28:18.921 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-04-23T10:28:18.922 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-04-23T10:28:18.923 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-04-23T10:28:18.924 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-04-23T10:28:18.925 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-04-23T10:28:18.927 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-04-23T10:28:18.928 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-04-23T10:28:18.930 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-04-23T10:28:18.931 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vDSO/ 2024-04-23T10:28:18.932 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-04-23T10:28:18.933 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-04-23T10:28:18.934 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-04-23T10:28:18.936 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-04-23T10:28:18.936 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-04-23T10:28:18.938 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vfio.txt 2024-04-23T10:28:18.939 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-04-23T10:28:18.940 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video-output.txt 2024-04-23T10:28:18.942 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/ 2024-04-23T10:28:18.943 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-04-23T10:28:18.944 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-04-23T10:28:18.945 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-04-23T10:28:18.946 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-04-23T10:28:18.947 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-04-23T10:28:18.948 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-04-23T10:28:18.949 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-04-23T10:28:18.951 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-04-23T10:28:18.952 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-04-23T10:28:18.953 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-04-23T10:28:18.954 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-04-23T10:28:18.956 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-04-23T10:28:18.957 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-04-23T10:28:18.958 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-04-23T10:28:18.959 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-04-23T10:28:18.960 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-04-23T10:28:18.961 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-04-23T10:28:18.963 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-04-23T10:28:18.964 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-04-23T10:28:18.965 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-04-23T10:28:18.966 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-04-23T10:28:18.967 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-04-23T10:28:18.969 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-04-23T10:28:18.970 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-04-23T10:28:18.971 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-04-23T10:28:18.972 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-04-23T10:28:18.973 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-04-23T10:28:18.974 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-04-23T10:28:18.975 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-04-23T10:28:18.976 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-04-23T10:28:18.978 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-04-23T10:28:18.979 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-04-23T10:28:18.980 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-04-23T10:28:18.981 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-04-23T10:28:18.982 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-04-23T10:28:18.983 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-04-23T10:28:18.984 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-04-23T10:28:18.985 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-04-23T10:28:18.987 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-04-23T10:28:18.988 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-04-23T10:28:18.989 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-04-23T10:28:18.990 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-04-23T10:28:18.991 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-04-23T10:28:18.993 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-04-23T10:28:18.994 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-04-23T10:28:18.995 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-04-23T10:28:18.996 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-04-23T10:28:18.997 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-04-23T10:28:18.999 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-04-23T10:28:19.000 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-04-23T10:28:19.001 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-04-23T10:28:19.002 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-04-23T10:28:19.003 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-04-23T10:28:19.004 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-04-23T10:28:19.005 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-04-23T10:28:19.006 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-04-23T10:28:19.008 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-04-23T10:28:19.008 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-04-23T10:28:19.010 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-04-23T10:28:19.011 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-04-23T10:28:19.012 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-04-23T10:28:19.013 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-04-23T10:28:19.014 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-04-23T10:28:19.016 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-04-23T10:28:19.017 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-04-23T10:28:19.018 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-04-23T10:28:19.019 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-04-23T10:28:19.020 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-04-23T10:28:19.022 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-04-23T10:28:19.023 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-04-23T10:28:19.024 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-04-23T10:28:19.025 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-04-23T10:28:19.026 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-04-23T10:28:19.028 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-04-23T10:28:19.029 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-04-23T10:28:19.030 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-04-23T10:28:19.031 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-04-23T10:28:19.032 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-04-23T10:28:19.033 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/ 2024-04-23T10:28:19.035 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-04-23T10:28:19.036 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-04-23T10:28:19.037 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-04-23T10:28:19.038 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-04-23T10:28:19.039 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-04-23T10:28:19.041 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-04-23T10:28:19.042 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-04-23T10:28:19.043 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-04-23T10:28:19.044 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-04-23T10:28:19.045 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-04-23T10:28:19.047 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-04-23T10:28:19.048 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-04-23T10:28:19.049 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-04-23T10:28:19.050 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-04-23T10:28:19.052 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-04-23T10:28:19.053 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-04-23T10:28:19.054 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-04-23T10:28:19.056 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-04-23T10:28:19.057 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-04-23T10:28:19.058 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-04-23T10:28:19.059 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-04-23T10:28:19.060 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-04-23T10:28:19.061 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-04-23T10:28:19.062 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-04-23T10:28:19.063 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-04-23T10:28:19.065 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/ 2024-04-23T10:28:19.066 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-04-23T10:28:19.067 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-04-23T10:28:19.069 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-04-23T10:28:19.070 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/balance 2024-04-23T10:28:19.071 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-04-23T10:28:19.072 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-04-23T10:28:19.073 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-04-23T10:28:19.074 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-04-23T10:28:19.076 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-04-23T10:28:19.077 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-04-23T10:28:19.078 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/numa 2024-04-23T10:28:19.080 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-04-23T10:28:19.080 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-04-23T10:28:19.082 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-04-23T10:28:19.083 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-04-23T10:28:19.084 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-04-23T10:28:19.086 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-04-23T10:28:19.087 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-04-23T10:28:19.088 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-04-23T10:28:19.089 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-04-23T10:28:19.090 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-04-23T10:28:19.091 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-04-23T10:28:19.092 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-04-23T10:28:19.093 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-04-23T10:28:19.095 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-04-23T10:28:19.096 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/ 2024-04-23T10:28:19.097 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-04-23T10:28:19.098 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-04-23T10:28:19.099 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-04-23T10:28:19.100 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-04-23T10:28:19.102 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-04-23T10:28:19.103 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-04-23T10:28:19.104 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-04-23T10:28:19.105 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-04-23T10:28:19.106 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-04-23T10:28:19.107 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-04-23T10:28:19.108 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-04-23T10:28:19.109 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-04-23T10:28:19.110 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-04-23T10:28:19.111 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-04-23T10:28:19.113 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-04-23T10:28:19.114 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-04-23T10:28:19.115 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/ 2024-04-23T10:28:19.116 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-04-23T10:28:19.117 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-04-23T10:28:19.119 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-04-23T10:28:19.120 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-04-23T10:28:19.121 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-04-23T10:28:19.122 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-04-23T10:28:19.123 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-04-23T10:28:19.124 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-04-23T10:28:19.125 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-04-23T10:28:19.126 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-04-23T10:28:19.127 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-04-23T10:28:19.128 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-04-23T10:28:19.130 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-04-23T10:28:19.131 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/wimax/ 2024-04-23T10:28:19.132 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-04-23T10:28:19.133 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-04-23T10:28:19.135 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-04-23T10:28:19.136 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/ 2024-04-23T10:28:19.138 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-04-23T10:28:19.139 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-04-23T10:28:19.140 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-04-23T10:28:19.141 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-04-23T10:28:19.142 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-04-23T10:28:19.143 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-04-23T10:28:19.144 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-04-23T10:28:19.145 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-04-23T10:28:19.149 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-04-23T10:28:19.150 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-04-23T10:28:19.151 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-04-23T10:28:19.153 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-04-23T10:28:19.155 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-04-23T10:28:19.156 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-04-23T10:28:19.157 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-04-23T10:28:19.159 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-04-23T10:28:19.160 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-04-23T10:28:19.161 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-04-23T10:28:19.162 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-04-23T10:28:19.163 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-04-23T10:28:19.165 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-04-23T10:28:19.166 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-04-23T10:28:19.167 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-04-23T10:28:19.168 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-04-23T10:28:19.391 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/xtensa/ 2024-04-23T10:28:19.392 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-04-23T10:28:19.393 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-04-23T10:28:19.394 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/xz.txt 2024-04-23T10:28:19.395 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-04-23T10:28:19.396 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-04-23T10:28:19.397 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-04-23T10:28:19.398 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-04-23T10:28:19.399 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-04-23T10:28:19.400 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-04-23T10:28:19.401 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-04-23T10:28:19.402 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-04-23T10:28:19.403 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-04-23T10:28:19.404 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-04-23T10:28:19.405 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-04-23T10:28:19.406 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-04-23T10:28:19.407 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-04-23T10:28:19.409 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-04-23T10:28:19.409 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-04-23T10:28:19.410 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-04-23T10:28:19.411 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-04-23T10:28:19.412 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-04-23T10:28:19.413 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-04-23T10:28:19.414 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-04-23T10:28:19.415 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-04-23T10:28:19.416 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-04-23T10:28:19.417 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-04-23T10:28:19.418 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-04-23T10:28:19.419 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-04-23T10:28:19.420 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-04-23T10:28:19.421 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-04-23T10:28:19.422 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-04-23T10:28:19.423 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-04-23T10:28:19.424 INFO:tasks.workunit.client.0.smithi069.stdout:linux-4.0.5/Documentation/zorro.txt 2024-04-23T10:28:19.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:19 smithi146 ceph-mon[32800]: pgmap v45: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 6.7 MiB/s wr, 30 op/s 2024-04-23T10:28:19.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:19 smithi146 ceph-mon[32800]: osdmap e90: 12 total, 12 up, 12 in 2024-04-23T10:28:19.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:19 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6834/1216686871,v1:172.21.15.167:6835/1216686871] up:boot 2024-04-23T10:28:19.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:19 smithi146 ceph-mon[32800]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-23T10:28:19.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:19 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:28:19.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:19 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:28:19.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:19 smithi069 ceph-mon[29593]: pgmap v45: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 6.7 MiB/s wr, 30 op/s 2024-04-23T10:28:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:19 smithi069 ceph-mon[29593]: osdmap e90: 12 total, 12 up, 12 in 2024-04-23T10:28:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:19 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6834/1216686871,v1:172.21.15.167:6835/1216686871] up:boot 2024-04-23T10:28:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:19 smithi069 ceph-mon[29593]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-23T10:28:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:19 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:28:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:19 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:28:19.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:19 smithi167 ceph-mon[32940]: pgmap v45: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 6.7 MiB/s wr, 30 op/s 2024-04-23T10:28:19.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:19 smithi167 ceph-mon[32940]: osdmap e90: 12 total, 12 up, 12 in 2024-04-23T10:28:19.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:19 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6834/1216686871,v1:172.21.15.167:6835/1216686871] up:boot 2024-04-23T10:28:19.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:19 smithi167 ceph-mon[32940]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-23T10:28:19.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:19 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:28:19.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:19 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:28:21.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:21 smithi146 ceph-mon[32800]: pgmap v47: 97 pgs: 97 active+clean; 89 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 8.8 MiB/s wr, 42 op/s 2024-04-23T10:28:21.441 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.7 2024-04-23T10:28:21.441 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:28:21.462 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:21 smithi069 ceph-mon[29593]: pgmap v47: 97 pgs: 97 active+clean; 89 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 8.8 MiB/s wr, 42 op/s 2024-04-23T10:28:21.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.546+0000 7f81f967b640 1 -- 172.21.15.69:0/2972431038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81f41010a0 msgr2=0x7f81f4101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:21.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.546+0000 7f81f967b640 1 --2- 172.21.15.69:0/2972431038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81f41010a0 0x7f81f4101480 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009900 tx=0x7f81e402a410 comp rx=0 tx=0).stop 2024-04-23T10:28:21.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.546+0000 7f81f967b640 1 -- 172.21.15.69:0/2972431038 shutdown_connections 2024-04-23T10:28:21.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.546+0000 7f81f967b640 1 --2- 172.21.15.69:0/2972431038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f4106170 0x7f81f410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.546+0000 7f81f967b640 1 --2- 172.21.15.69:0/2972431038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4101a50 0x7f81f4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.546+0000 7f81f967b640 1 --2- 172.21.15.69:0/2972431038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81f41010a0 0x7f81f4101480 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.546+0000 7f81f967b640 1 -- 172.21.15.69:0/2972431038 >> 172.21.15.69:0/2972431038 conn(0x7f81f4077f50 msgr2=0x7f81f4078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:21.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.546+0000 7f81f967b640 1 -- 172.21.15.69:0/2972431038 shutdown_connections 2024-04-23T10:28:21.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.546+0000 7f81f967b640 1 -- 172.21.15.69:0/2972431038 wait complete. 2024-04-23T10:28:21.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.546+0000 7f81f967b640 1 Processor -- start 2024-04-23T10:28:21.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.546+0000 7f81f967b640 1 -- start start 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f967b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81f41010a0 0x7f81f41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f967b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4106170 0x7f81f4199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f967b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f419a2a0 0x7f81f41a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f967b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f81f41112f0 con 0x7f81f41010a0 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f967b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4111170 con 0x7f81f4106170 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f967b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4111470 con 0x7f81f419a2a0 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f2ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81f41010a0 0x7f81f41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f2ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81f41010a0 0x7f81f41997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52454/0 (socket says 172.21.15.69:52454) 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f2ffd640 1 -- 172.21.15.69:0/1940661843 learned_addr learned my addr 172.21.15.69:0/1940661843 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f27fc640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4106170 0x7f81f4199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f37fe640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f419a2a0 0x7f81f41a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f2ffd640 1 -- 172.21.15.69:0/1940661843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f419a2a0 msgr2=0x7f81f41a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f2ffd640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f419a2a0 0x7f81f41a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f2ffd640 1 -- 172.21.15.69:0/1940661843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4106170 msgr2=0x7f81f4199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f2ffd640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4106170 0x7f81f4199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f2ffd640 1 -- 172.21.15.69:0/1940661843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f41a5020 con 0x7f81f41010a0 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f37fe640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f419a2a0 0x7f81f41a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81f2ffd640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81f41010a0 0x7f81f41997d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f81e4006010 tx=0x7f81e4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.547+0000 7f81dbfff640 1 -- 172.21.15.69:0/1940661843 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e403f070 con 0x7f81f41010a0 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.548+0000 7f81f967b640 1 -- 172.21.15.69:0/1940661843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f41a52b0 con 0x7f81f41010a0 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.548+0000 7f81dbfff640 1 -- 172.21.15.69:0/1940661843 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81e4003ac0 con 0x7f81f41010a0 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.548+0000 7f81dbfff640 1 -- 172.21.15.69:0/1940661843 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4035030 con 0x7f81f41010a0 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.548+0000 7f81f967b640 1 -- 172.21.15.69:0/1940661843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f41a57f0 con 0x7f81f41010a0 2024-04-23T10:28:21.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.549+0000 7f81f967b640 1 -- 172.21.15.69:0/1940661843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f4068d70 con 0x7f81f41010a0 2024-04-23T10:28:21.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.550+0000 7f81dbfff640 1 -- 172.21.15.69:0/1940661843 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f81e4042070 con 0x7f81f41010a0 2024-04-23T10:28:21.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.551+0000 7f81dbfff640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81dc0a3e40 0x7f81dc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.551+0000 7f81f27fc640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81dc0a3e40 0x7f81dc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.551+0000 7f81dbfff640 1 -- 172.21.15.69:0/1940661843 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f81e40f1390 con 0x7f81f41010a0 2024-04-23T10:28:21.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.551+0000 7f81f27fc640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81dc0a3e40 0x7f81dc0a6300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81f4069c30 tx=0x7f81e8009110 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:21.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.556+0000 7f81dbfff640 1 -- 172.21.15.69:0/1940661843 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f81e40bd8e0 con 0x7f81f41010a0 2024-04-23T10:28:21.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:21 smithi167 ceph-mon[32940]: pgmap v47: 97 pgs: 97 active+clean; 89 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 8.8 MiB/s wr, 42 op/s 2024-04-23T10:28:21.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.778+0000 7f81f967b640 1 -- 172.21.15.69:0/1940661843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81f41093a0 con 0x7f81f41010a0 2024-04-23T10:28:21.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.779+0000 7f81dbfff640 1 -- 172.21.15.69:0/1940661843 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11937 (secure 0 0 0) 0x7f81e40bd1e0 con 0x7f81f41010a0 2024-04-23T10:28:21.778 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:28:21.778 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:28:18.128401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25297":{"gid":25297,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/1216686871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1216686871},{"type":"v1","addr":"172.21.15.167:6835","nonce":1216686871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24392,24416,24487,24463,24421]},"id":1}]} 2024-04-23T10:28:21.778 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 30 2024-04-23T10:28:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 -- 172.21.15.69:0/1940661843 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81dc0a3e40 msgr2=0x7f81dc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81dc0a3e40 0x7f81dc0a6300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81f4069c30 tx=0x7f81e8009110 comp rx=0 tx=0).stop 2024-04-23T10:28:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 -- 172.21.15.69:0/1940661843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81f41010a0 msgr2=0x7f81f41997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81f41010a0 0x7f81f41997d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f81e4006010 tx=0x7f81e4004430 comp rx=0 tx=0).stop 2024-04-23T10:28:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 -- 172.21.15.69:0/1940661843 shutdown_connections 2024-04-23T10:28:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f81dc0a3e40 0x7f81dc0a6300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f419a2a0 0x7f81f41a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4106170 0x7f81f4199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 --2- 172.21.15.69:0/1940661843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81f41010a0 0x7f81f41997d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 -- 172.21.15.69:0/1940661843 >> 172.21.15.69:0/1940661843 conn(0x7f81f4077f50 msgr2=0x7f81f40ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:21.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 -- 172.21.15.69:0/1940661843 shutdown_connections 2024-04-23T10:28:21.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.781+0000 7f81f967b640 1 -- 172.21.15.69:0/1940661843 wait complete. 2024-04-23T10:28:21.791 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 60 --expiration 90.7 --await-for 42.0' 2024-04-23T10:28:21.791 DEBUG:teuthology.orchestra.run.smithi069:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24487 quiesce db / --timeout 60 --expiration 90.7 --await-for 42.0 2024-04-23T10:28:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.944+0000 7f7aa0c20640 1 -- 172.21.15.69:0/3214196233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a9c1010a0 msgr2=0x7f7a9c101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.944+0000 7f7aa0c20640 1 --2- 172.21.15.69:0/3214196233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a9c1010a0 0x7f7a9c101480 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009900 tx=0x7f7a8c02a410 comp rx=0 tx=0).stop 2024-04-23T10:28:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.944+0000 7f7aa0c20640 1 -- 172.21.15.69:0/3214196233 shutdown_connections 2024-04-23T10:28:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.944+0000 7f7aa0c20640 1 --2- 172.21.15.69:0/3214196233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9c106170 0x7f7a9c10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.944+0000 7f7aa0c20640 1 --2- 172.21.15.69:0/3214196233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a9c101a50 0x7f7a9c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.944+0000 7f7aa0c20640 1 --2- 172.21.15.69:0/3214196233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a9c1010a0 0x7f7a9c101480 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.944+0000 7f7aa0c20640 1 -- 172.21.15.69:0/3214196233 >> 172.21.15.69:0/3214196233 conn(0x7f7a9c077f50 msgr2=0x7f7a9c078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.944+0000 7f7aa0c20640 1 -- 172.21.15.69:0/3214196233 shutdown_connections 2024-04-23T10:28:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.944+0000 7f7aa0c20640 1 -- 172.21.15.69:0/3214196233 wait complete. 2024-04-23T10:28:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.944+0000 7f7aa0c20640 1 Processor -- start 2024-04-23T10:28:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.944+0000 7f7aa0c20640 1 -- start start 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7aa0c20640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a9c1010a0 0x7f7a9c19d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7aa0c20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9c106170 0x7f7a9c19d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7aa0c20640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a9c197590 0x7f7a9c197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7aa0c20640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c111210 con 0x7f7a9c1010a0 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7aa0c20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c111090 con 0x7f7a9c106170 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7aa0c20640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c111390 con 0x7f7a9c197590 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a9a59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a9c1010a0 0x7f7a9c19d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a9a59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a9c1010a0 0x7f7a9c19d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52468/0 (socket says 172.21.15.69:52468) 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a9a59c640 1 -- 172.21.15.69:0/2215634438 learned_addr learned my addr 172.21.15.69:0/2215634438 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a93fff640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9c106170 0x7f7a9c19d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a9ad9d640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a9c197590 0x7f7a9c197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a9a59c640 1 -- 172.21.15.69:0/2215634438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a9c197590 msgr2=0x7f7a9c197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a9a59c640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a9c197590 0x7f7a9c197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a9a59c640 1 -- 172.21.15.69:0/2215634438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9c106170 msgr2=0x7f7a9c19d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a9a59c640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9c106170 0x7f7a9c19d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a9a59c640 1 -- 172.21.15.69:0/2215634438 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c1980b0 con 0x7f7a9c1010a0 2024-04-23T10:28:21.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a9ad9d640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a9c197590 0x7f7a9c197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:21.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a9a59c640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a9c1010a0 0x7f7a9c19d3e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c005ab0 tx=0x7f7a8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:21.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a937fe640 1 -- 172.21.15.69:0/2215634438 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c03f030 con 0x7f7a9c1010a0 2024-04-23T10:28:21.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a937fe640 1 -- 172.21.15.69:0/2215634438 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a8c003cd0 con 0x7f7a9c1010a0 2024-04-23T10:28:21.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7aa0c20640 1 -- 172.21.15.69:0/2215634438 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9c198340 con 0x7f7a9c1010a0 2024-04-23T10:28:21.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.945+0000 7f7a937fe640 1 -- 172.21.15.69:0/2215634438 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c035070 con 0x7f7a9c1010a0 2024-04-23T10:28:21.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.946+0000 7f7aa0c20640 1 -- 172.21.15.69:0/2215634438 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9c069370 con 0x7f7a9c1010a0 2024-04-23T10:28:21.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.948+0000 7f7a937fe640 1 -- 172.21.15.69:0/2215634438 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f7a8c042030 con 0x7f7a9c1010a0 2024-04-23T10:28:21.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.948+0000 7f7a937fe640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7a880a3e40 0x7f7a880a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.948+0000 7f7a93fff640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7a880a3e40 0x7f7a880a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.948+0000 7f7a937fe640 1 -- 172.21.15.69:0/2215634438 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f7a8c0f1250 con 0x7f7a9c1010a0 2024-04-23T10:28:21.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7a93fff640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7a880a3e40 0x7f7a880a6300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c1009e0 tx=0x7f7a84005f90 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:21.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7aa3a0f740 1 Processor -- start 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7aa3a0f740 1 -- start start 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da233a0a0 0x560da233a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2344b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da2345090 0x560da2347480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560da229f370 con 0x560da233a9c0 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560da223c2e0 con 0x560da2345090 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560da229b330 con 0x560da233a0a0 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7a93fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2344b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7a93fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2344b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52478/0 (socket says 172.21.15.69:52478) 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7a9a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da233a0a0 0x560da233a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.949+0000 7f7a93fff640 1 -- 172.21.15.69:0/2676588788 learned_addr learned my addr 172.21.15.69:0/2676588788 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.950+0000 7f7a9ad9d640 1 --2- 172.21.15.69:0/2676588788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da2345090 0x560da2347480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.950+0000 7f7a93fff640 1 -- 172.21.15.69:0/2676588788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da233a0a0 msgr2=0x560da233a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:21.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.950+0000 7f7a93fff640 1 --2- 172.21.15.69:0/2676588788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da233a0a0 0x560da233a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.950+0000 7f7a93fff640 1 -- 172.21.15.69:0/2676588788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da2345090 msgr2=0x560da2347480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:21.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.950+0000 7f7a93fff640 1 --2- 172.21.15.69:0/2676588788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da2345090 0x560da2347480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.950+0000 7f7a93fff640 1 -- 172.21.15.69:0/2676588788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560da207dd80 con 0x560da233a9c0 2024-04-23T10:28:21.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.950+0000 7f7a9ad9d640 1 --2- 172.21.15.69:0/2676588788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da2345090 0x560da2347480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:21.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.950+0000 7f7a93fff640 1 --2- 172.21.15.69:0/2676588788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2344b50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7a84011f20 tx=0x7f7a84014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788061ac07190391 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:21.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.950+0000 7f7a90ff9640 1 -- 172.21.15.69:0/2676588788 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8401f620 con 0x560da233a9c0 2024-04-23T10:28:21.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.950+0000 7f7a90ff9640 1 -- 172.21.15.69:0/2676588788 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a8401fc90 con 0x560da233a9c0 2024-04-23T10:28:21.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.950+0000 7f7a90ff9640 1 -- 172.21.15.69:0/2676588788 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84027c20 con 0x560da233a9c0 2024-04-23T10:28:21.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.951+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/2676588788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 msgr2=0x560da2344b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:21.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.951+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/2676588788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2344b50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7a84011f20 tx=0x7f7a84014000 comp rx=0 tx=0).stop 2024-04-23T10:28:21.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.951+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/2676588788 shutdown_connections 2024-04-23T10:28:21.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.951+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/2676588788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2344b50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.951+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/2676588788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da2345090 0x560da2347480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.951+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/2676588788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da233a0a0 0x560da233a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.951+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/2676588788 >> 172.21.15.69:0/2676588788 conn(0x560da23363c0 msgr2=0x560da23367a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:21.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.951+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/2676588788 shutdown_connections 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.951+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/2676588788 wait complete. 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.951+0000 7f7aa3a0f740 1 -- start start 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7aa3a0f740 1 Processor -- start 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da233a0a0 0x560da2342090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da23425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da2345090 0x560da2342b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560da2347e80 con 0x560da233a9c0 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560da2239fb0 con 0x560da233a0a0 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560da2348000 con 0x560da2345090 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7aa3a0f740 10 client.0 _ll_register_callbacks cb 0x560da22399a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a93fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da23425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a93fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da23425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52494/0 (socket says 172.21.15.69:52494) 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a93fff640 1 -- 172.21.15.69:0/1015952227 learned_addr learned my addr 172.21.15.69:0/1015952227 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a9a59c640 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da233a0a0 0x560da2342090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a93fff640 1 -- 172.21.15.69:0/1015952227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da2345090 msgr2=0x560da2342b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:21.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a93fff640 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da2345090 0x560da2342b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a93fff640 1 -- 172.21.15.69:0/1015952227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da233a0a0 msgr2=0x560da2342090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a93fff640 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da233a0a0 0x560da2342090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a93fff640 1 -- 172.21.15.69:0/1015952227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560da20de510 con 0x560da233a9c0 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a93fff640 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da23425d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7a84012010 tx=0x7f7a84028ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f472ac875821e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.952+0000 7f7a81ffb640 1 -- 172.21.15.69:0/1015952227 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84037060 con 0x560da233a9c0 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7a81ffb640 1 -- 172.21.15.69:0/1015952227 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f7a84004050 con 0x560da233a9c0 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/1015952227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a8401fc90 con 0x560da233a9c0 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7a81ffb640 1 -- 172.21.15.69:0/1015952227 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7a84020ed0 con 0x560da233a9c0 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7aa3a0f740 10 client.15843 fetch_fsmap learned FSMap version 30 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/1015952227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560da1f71670 con 0x560da233a9c0 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7a81ffb640 1 -- 172.21.15.69:0/1015952227 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a8401fc90 con 0x560da233a9c0 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7a81ffb640 1 -- 172.21.15.69:0/1015952227 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f7a8401f6e0 con 0x560da233a9c0 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7aa3a0f740 10 client.15843 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7aa3a0f740 10 client.15843 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7aa3a0f740 20 client.15843 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:21.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560da2355440 0x560da2357830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7aa3a0f740 4 client.15843 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/1015952227 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560da22acd90 con 0x560da2355440 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.953+0000 7f7a9a59c640 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560da2355440 0x560da2357830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.954+0000 7f7a9a59c640 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560da2355440 0x560da2357830 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24bc0c81d8c28ae9 server_cookie=1b19e43d1547cfbb in_seq=0 out_seq=0 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.954+0000 7f7a81ffb640 10 client.15843 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7a81ffb640 1 -- 172.21.15.69:0/1015952227 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560da22acd90 con 0x560da2355440 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7a81ffb640 10 client.15843 handle_command_reply: tid=0 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 1 client.15843 shutdown 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/1015952227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 msgr2=0x560da23425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da23425d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7a84012010 tx=0x7f7a84028ea0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/1015952227 shutdown_connections 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560da2355440 0x560da2357830 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da23425d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7a81ffb640 0 client.15843 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:21.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da2345090 0x560da2342b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/1015952227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da233a0a0 0x560da2342090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/1015952227 >> 172.21.15.69:0/1015952227 conn(0x560da23363c0 msgr2=0x560da2335600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:21.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/1015952227 shutdown_connections 2024-04-23T10:28:21.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/1015952227 wait complete. 2024-04-23T10:28:21.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.955+0000 7f7aa3a0f740 20 client.15843 trim_cache size 0 max 16384 2024-04-23T10:28:21.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7aa3a0f740 1 Processor -- start 2024-04-23T10:28:21.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7aa3a0f740 1 -- start start 2024-04-23T10:28:21.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da233a0a0 0x560da2350d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da235cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da2345090 0x560da235d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c1adcb0 con 0x560da233a9c0 2024-04-23T10:28:21.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c1af8b0 con 0x560da2345090 2024-04-23T10:28:21.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c1ae380 con 0x560da233a0a0 2024-04-23T10:28:21.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7a93fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da235cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7a93fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da235cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52500/0 (socket says 172.21.15.69:52500) 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7a93fff640 1 -- 172.21.15.69:0/2753407279 learned_addr learned my addr 172.21.15.69:0/2753407279 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.972+0000 7f7a9ad9d640 1 --2- 172.21.15.69:0/2753407279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da2345090 0x560da235d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.973+0000 7f7a9a59c640 1 --2- 172.21.15.69:0/2753407279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da233a0a0 0x560da2350d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.973+0000 7f7a93fff640 1 -- 172.21.15.69:0/2753407279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da233a0a0 msgr2=0x560da2350d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.973+0000 7f7a93fff640 1 --2- 172.21.15.69:0/2753407279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da233a0a0 0x560da2350d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.973+0000 7f7a93fff640 1 -- 172.21.15.69:0/2753407279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da2345090 msgr2=0x560da235d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.973+0000 7f7a93fff640 1 --2- 172.21.15.69:0/2753407279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da2345090 0x560da235d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.973+0000 7f7a93fff640 1 -- 172.21.15.69:0/2753407279 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560da233a7f0 con 0x560da233a9c0 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.973+0000 7f7a93fff640 1 --2- 172.21.15.69:0/2753407279 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da235cee0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7a84011820 tx=0x7f7a84005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68af01ea5092ff43 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.973+0000 7f7a83fff640 1 -- 172.21.15.69:0/2753407279 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84037070 con 0x560da233a9c0 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.973+0000 7f7a83fff640 1 -- 172.21.15.69:0/2753407279 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a84004890 con 0x560da233a9c0 2024-04-23T10:28:21.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.973+0000 7f7a83fff640 1 -- 172.21.15.69:0/2753407279 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84005400 con 0x560da233a9c0 2024-04-23T10:28:21.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.974+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/2753407279 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 msgr2=0x560da235cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.974+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/2753407279 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da235cee0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7a84011820 tx=0x7f7a84005990 comp rx=0 tx=0).stop 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.974+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/2753407279 shutdown_connections 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.974+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/2753407279 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da235cee0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.974+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/2753407279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da2345090 0x560da235d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.974+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/2753407279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da233a0a0 0x560da2350d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.974+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/2753407279 >> 172.21.15.69:0/2753407279 conn(0x560da23363c0 msgr2=0x560da233d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.974+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/2753407279 shutdown_connections 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.974+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/2753407279 wait complete. 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.974+0000 7f7aa3a0f740 1 -- start start 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.974+0000 7f7aa3a0f740 1 Processor -- start 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da233a0a0 0x560da2348e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2349360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7aa3a0f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da2345090 0x560da23498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c1af1e0 con 0x560da233a9c0 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c1aea50 con 0x560da233a0a0 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7aa3a0f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c1abc90 con 0x560da2345090 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7aa3a0f740 10 client.0 _ll_register_callbacks cb 0x7f7a84028d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a93fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2349360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a93fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2349360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52514/0 (socket says 172.21.15.69:52514) 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a9a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da233a0a0 0x560da2348e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a93fff640 1 -- 172.21.15.69:0/3541872309 learned_addr learned my addr 172.21.15.69:0/3541872309 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a9ad9d640 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da2345090 0x560da23498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a93fff640 1 -- 172.21.15.69:0/3541872309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da2345090 msgr2=0x560da23498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a93fff640 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da2345090 0x560da23498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a93fff640 1 -- 172.21.15.69:0/3541872309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da233a0a0 msgr2=0x560da2348e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a93fff640 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da233a0a0 0x560da2348e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a93fff640 1 -- 172.21.15.69:0/3541872309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560da23ba900 con 0x560da233a9c0 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a93fff640 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2349360 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7a8401fc20 tx=0x7f7a8401f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d3c94abd3cf760 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:21.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a81ffb640 1 -- 172.21.15.69:0/3541872309 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84049020 con 0x560da233a9c0 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a81ffb640 1 -- 172.21.15.69:0/3541872309 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f7a84005140 con 0x560da233a9c0 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/3541872309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a84004890 con 0x560da233a9c0 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7a81ffb640 1 -- 172.21.15.69:0/3541872309 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7a84054050 con 0x560da233a9c0 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7aa3a0f740 10 client.15849 fetch_fsmap learned FSMap version 30 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.975+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/3541872309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560da23bbba0 con 0x560da233a9c0 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.976+0000 7f7a81ffb640 1 -- 172.21.15.69:0/3541872309 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a84004890 con 0x560da233a9c0 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.976+0000 7f7a81ffb640 1 -- 172.21.15.69:0/3541872309 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f7a84028040 con 0x560da233a9c0 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.976+0000 7f7aa3a0f740 10 client.15849 fetch_fsmap finished waiting for FSMap version 30 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.976+0000 7f7aa3a0f740 10 client.15849 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.976+0000 7f7aa3a0f740 20 client.15849 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.976+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560da23bc380 0x560da23be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.976+0000 7f7aa3a0f740 4 client.15849 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.7, "await_for": 42.0}] 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.976+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/3541872309 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.7, "await_for": 42.0}) -- 0x560da22a6c00 con 0x560da23bc380 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.976+0000 7f7a9a59c640 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560da23bc380 0x560da23be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.976+0000 7f7a81ffb640 10 client.15849 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:21.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:21.976+0000 7f7a9a59c640 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560da23bc380 0x560da23be7a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afb193aa27e76e8c server_cookie=5b186f56d60b1830 in_seq=0 out_seq=0 2024-04-23T10:28:22.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:22 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1940661843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:28:22.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:22 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1940661843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:28:22.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:22 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1940661843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:28:23.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:23 smithi146 ceph-mon[32800]: pgmap v48: 97 pgs: 97 active+clean; 89 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 8.8 MiB/s wr, 42 op/s 2024-04-23T10:28:23.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:23 smithi069 ceph-mon[29593]: pgmap v48: 97 pgs: 97 active+clean; 89 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 8.8 MiB/s wr, 42 op/s 2024-04-23T10:28:23.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:23 smithi167 ceph-mon[32940]: pgmap v48: 97 pgs: 97 active+clean; 89 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 8.8 MiB/s wr, 42 op/s 2024-04-23T10:28:25.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:25 smithi146 ceph-mon[32800]: pgmap v49: 97 pgs: 97 active+clean; 89 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 8.8 MiB/s wr, 42 op/s 2024-04-23T10:28:25.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:25 smithi069 ceph-mon[29593]: pgmap v49: 97 pgs: 97 active+clean; 89 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 8.8 MiB/s wr, 42 op/s 2024-04-23T10:28:25.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:25 smithi167 ceph-mon[32940]: pgmap v49: 97 pgs: 97 active+clean; 89 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 8.8 MiB/s wr, 42 op/s 2024-04-23T10:28:26.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:26.146+0000 7f7a937fe640 1 -- 172.21.15.69:0/2215634438 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f7a8c0b9710 con 0x7f7a9c1010a0 2024-04-23T10:28:27.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:27 smithi146 ceph-mon[32800]: pgmap v50: 97 pgs: 97 active+clean; 95 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 202 op/s 2024-04-23T10:28:27.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:27 smithi146 ceph-mon[32800]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-04-23T10:28:27.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:27 smithi069 ceph-mon[29593]: pgmap v50: 97 pgs: 97 active+clean; 95 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 202 op/s 2024-04-23T10:28:27.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:27 smithi069 ceph-mon[29593]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-04-23T10:28:27.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:27 smithi167 ceph-mon[32940]: pgmap v50: 97 pgs: 97 active+clean; 95 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 202 op/s 2024-04-23T10:28:27.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:27 smithi167 ceph-mon[32940]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-04-23T10:28:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7a81ffb640 1 -- 172.21.15.69:0/3541872309 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x560da22a6c00 con 0x560da23bc380 2024-04-23T10:28:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7a81ffb640 10 client.15849 handle_command_reply: tid=0 2024-04-23T10:28:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7aa3a0f740 1 client.15849 shutdown 2024-04-23T10:28:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/3541872309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 msgr2=0x560da2349360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2349360 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7a8401fc20 tx=0x7f7a8401f650 comp rx=0 tx=0).stop 2024-04-23T10:28:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/3541872309 shutdown_connections 2024-04-23T10:28:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560da23bc380 0x560da23be7a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560da233a9c0 0x560da2349360 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560da2345090 0x560da23498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7a81ffb640 0 client.15849 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7aa3a0f740 1 --2- 172.21.15.69:0/3541872309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560da233a0a0 0x560da2348e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:29.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/3541872309 >> 172.21.15.69:0/3541872309 conn(0x560da23363c0 msgr2=0x560da23438c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:29.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/3541872309 shutdown_connections 2024-04-23T10:28:29.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.413+0000 7f7aa3a0f740 1 -- 172.21.15.69:0/3541872309 wait complete. 2024-04-23T10:28:29.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa3a0f740 20 client.15849 trim_cache size 0 max 16384 2024-04-23T10:28:29.414 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:28:29.414 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 30, 2024-04-23T10:28:29.414 INFO:teuthology.orchestra.run.smithi069.stdout: "leader": 24487, 2024-04-23T10:28:29.414 INFO:teuthology.orchestra.run.smithi069.stdout: "set_version": 6, 2024-04-23T10:28:29.414 INFO:teuthology.orchestra.run.smithi069.stdout: "sets": { 2024-04-23T10:28:29.414 INFO:teuthology.orchestra.run.smithi069.stdout: "410ff32d": { 2024-04-23T10:28:29.414 INFO:teuthology.orchestra.run.smithi069.stdout: "version": 6, 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "age_ref": 0.0, 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "QUIESCED", 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "timeout": 60.0, 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "expiration": 90.7, 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "members": { 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "file:/": { 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "excluded": false, 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "QUIESCED", 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:28:29.415 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:28:29.416 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:28:29.416 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:28:29.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 -- 172.21.15.69:0/2215634438 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7a880a3e40 msgr2=0x7f7a880a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:29.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7a880a3e40 0x7f7a880a6300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c1009e0 tx=0x7f7a84005f90 comp rx=0 tx=0).stop 2024-04-23T10:28:29.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 -- 172.21.15.69:0/2215634438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a9c1010a0 msgr2=0x7f7a9c19d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:29.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a9c1010a0 0x7f7a9c19d3e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c005ab0 tx=0x7f7a8c0042f0 comp rx=0 tx=0).stop 2024-04-23T10:28:29.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 -- 172.21.15.69:0/2215634438 shutdown_connections 2024-04-23T10:28:29.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7a880a3e40 0x7f7a880a6300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:29.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a9c197590 0x7f7a9c197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:29.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9c106170 0x7f7a9c19d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:29.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 --2- 172.21.15.69:0/2215634438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a9c1010a0 0x7f7a9c19d3e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:29.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 -- 172.21.15.69:0/2215634438 >> 172.21.15.69:0/2215634438 conn(0x7f7a9c077f50 msgr2=0x7f7a9c0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:29.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 -- 172.21.15.69:0/2215634438 shutdown_connections 2024-04-23T10:28:29.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:28:29.414+0000 7f7aa0c20640 1 -- 172.21.15.69:0/2215634438 wait complete. 2024-04-23T10:28:29.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:29 smithi069 ceph-mon[29593]: pgmap v51: 97 pgs: 97 active+clean; 95 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 202 op/s 2024-04-23T10:28:29.426 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '410ff32d', quiesce took 8.0 seconds. Will release after: 30.7 2024-04-23T10:28:29.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:29 smithi146 ceph-mon[32800]: pgmap v51: 97 pgs: 97 active+clean; 95 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 202 op/s 2024-04-23T10:28:29.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:29 smithi167 ceph-mon[32940]: pgmap v51: 97 pgs: 97 active+clean; 95 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 202 op/s 2024-04-23T10:28:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.859+0000 7f46a7407640 1 -- 172.21.15.69:0/4206008497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46a0102b70 msgr2=0x7f46a0106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.859+0000 7f46a7407640 1 --2- 172.21.15.69:0/4206008497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46a0102b70 0x7f46a0106bb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4690009900 tx=0x7f469002a410 comp rx=0 tx=0).stop 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.859+0000 7f46a7407640 1 -- 172.21.15.69:0/4206008497 shutdown_connections 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.859+0000 7f46a7407640 1 --2- 172.21.15.69:0/4206008497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46a0102b70 0x7f46a0106bb0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.859+0000 7f46a7407640 1 --2- 172.21.15.69:0/4206008497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46a0107290 0x7f46a010ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.859+0000 7f46a7407640 1 --2- 172.21.15.69:0/4206008497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a01021c0 0x7f46a01025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.859+0000 7f46a7407640 1 -- 172.21.15.69:0/4206008497 >> 172.21.15.69:0/4206008497 conn(0x7f46a00fda20 msgr2=0x7f46a00ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.859+0000 7f46a7407640 1 -- 172.21.15.69:0/4206008497 shutdown_connections 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.859+0000 7f46a7407640 1 -- 172.21.15.69:0/4206008497 wait complete. 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a7407640 1 Processor -- start 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a7407640 1 -- start start 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a7407640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46a01021c0 0x7f46a019e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a7407640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46a0107290 0x7f46a019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a7407640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a01985d0 0x7f46a0198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a7407640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0112310 con 0x7f46a01021c0 2024-04-23T10:28:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a7407640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0112190 con 0x7f46a0107290 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a7407640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0112490 con 0x7f46a01985d0 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a51a3640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46a01021c0 0x7f46a019e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a51a3640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46a01021c0 0x7f46a019e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43372/0 (socket says 172.21.15.69:43372) 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a51a3640 1 -- 172.21.15.69:0/422308270 learned_addr learned my addr 172.21.15.69:0/422308270 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a59a4640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a01985d0 0x7f46a0198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.860+0000 7f46a49a2640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46a0107290 0x7f46a019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.861+0000 7f46a51a3640 1 -- 172.21.15.69:0/422308270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a01985d0 msgr2=0x7f46a0198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.861+0000 7f46a51a3640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a01985d0 0x7f46a0198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.861+0000 7f46a51a3640 1 -- 172.21.15.69:0/422308270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46a0107290 msgr2=0x7f46a019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.861+0000 7f46a51a3640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46a0107290 0x7f46a019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.861+0000 7f46a51a3640 1 -- 172.21.15.69:0/422308270 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a01990f0 con 0x7f46a01021c0 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.861+0000 7f46a51a3640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46a01021c0 0x7f46a019e420 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f469c00d770 tx=0x7f469c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.861+0000 7f46967fc640 1 -- 172.21.15.69:0/422308270 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c017070 con 0x7f46a01021c0 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.861+0000 7f46967fc640 1 -- 172.21.15.69:0/422308270 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f469c0054f0 con 0x7f46a01021c0 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.861+0000 7f46967fc640 1 -- 172.21.15.69:0/422308270 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c004de0 con 0x7f46a01021c0 2024-04-23T10:28:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.861+0000 7f46a7407640 1 -- 172.21.15.69:0/422308270 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a01993e0 con 0x7f46a01021c0 2024-04-23T10:28:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.861+0000 7f46a7407640 1 -- 172.21.15.69:0/422308270 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a01a55e0 con 0x7f46a01021c0 2024-04-23T10:28:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.863+0000 7f46967fc640 1 -- 172.21.15.69:0/422308270 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f469c004f80 con 0x7f46a01021c0 2024-04-23T10:28:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.864+0000 7f46aa1f0740 1 Processor -- start 2024-04-23T10:28:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.864+0000 7f46aa1f0740 1 -- start start 2024-04-23T10:28:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.864+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08f620 0x55575f08fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.864+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08ff40 0x55575f09a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.864+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f09a800 0x55575f09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.864+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55575eff4970 con 0x55575f08f620 2024-04-23T10:28:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.864+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55575ef914a0 con 0x55575f08ff40 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.864+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55575eff0930 con 0x55575f09a800 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.864+0000 7f46967fc640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f468c0a3dc0 0x7f468c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.864+0000 7f46a59a4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08f620 0x55575f08fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a49a2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f09a800 0x55575f09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a49a2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f09a800 0x55575f09cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.69:35334/0 (socket says 172.21.15.69:35334) 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a49a2640 1 -- 172.21.15.69:0/1583625102 learned_addr learned my addr 172.21.15.69:0/1583625102 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a51a3640 1 --2- 172.21.15.69:0/1583625102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08ff40 0x55575f09a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a59a4640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f468c0a3dc0 0x7f468c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46967fc640 1 -- 172.21.15.69:0/422308270 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f469c0d0290 con 0x7f46a01021c0 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a59a4640 1 -- 172.21.15.69:0/1583625102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f09a800 msgr2=0x55575f09cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a59a4640 1 --2- 172.21.15.69:0/1583625102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f09a800 0x55575f09cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a59a4640 1 -- 172.21.15.69:0/1583625102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08ff40 msgr2=0x55575f09a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a59a4640 1 --2- 172.21.15.69:0/1583625102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08ff40 0x55575f09a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a59a4640 1 -- 172.21.15.69:0/1583625102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55575ed07210 con 0x55575f08f620 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a51a3640 1 --2- 172.21.15.69:0/1583625102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08ff40 0x55575f09a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a59a4640 1 --2- 172.21.15.69:0/1583625102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08f620 0x55575f08fa00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4698013cc0 tx=0x7f46980117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6972f44c4e7137e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f46a59a4640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f468c0a3dc0 0x7f468c0a6280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4698011cb0 tx=0x7f469801e000 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f468b7fe640 1 -- 172.21.15.69:0/1583625102 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469800ec40 con 0x55575f08f620 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f468b7fe640 1 -- 172.21.15.69:0/1583625102 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f469800ede0 con 0x55575f08f620 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.865+0000 7f468b7fe640 1 -- 172.21.15.69:0/1583625102 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980263a0 con 0x55575f08f620 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.866+0000 7f46aa1f0740 1 -- 172.21.15.69:0/1583625102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08f620 msgr2=0x55575f08fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.866+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/1583625102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08f620 0x55575f08fa00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4698013cc0 tx=0x7f46980117b0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.866+0000 7f46aa1f0740 1 -- 172.21.15.69:0/1583625102 shutdown_connections 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.866+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/1583625102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f09a800 0x55575f09cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.866+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/1583625102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08ff40 0x55575f09a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.866+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/1583625102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08f620 0x55575f08fa00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.866+0000 7f46aa1f0740 1 -- 172.21.15.69:0/1583625102 >> 172.21.15.69:0/1583625102 conn(0x55575f08bb30 msgr2=0x55575f08bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.866+0000 7f46aa1f0740 1 -- 172.21.15.69:0/1583625102 shutdown_connections 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.866+0000 7f46aa1f0740 1 -- 172.21.15.69:0/1583625102 wait complete. 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.866+0000 7f46aa1f0740 1 -- start start 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46aa1f0740 1 Processor -- start 2024-04-23T10:28:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08f620 0x55575f09a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08ff40 0x55575f097520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f097c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55575f09d3d0 con 0x55575f09a800 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55575ef8f0b0 con 0x55575f08f620 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55575f09d550 con 0x55575f08ff40 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46aa1f0740 10 client.0 _ll_register_callbacks cb 0x55575ef7cd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46a59a4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f097c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46a59a4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f097c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43376/0 (socket says 172.21.15.69:43376) 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46a59a4640 1 -- 172.21.15.69:0/4078544812 learned_addr learned my addr 172.21.15.69:0/4078544812 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46a51a3640 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08f620 0x55575f09a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46a49a2640 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08ff40 0x55575f097520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46a59a4640 1 -- 172.21.15.69:0/4078544812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08ff40 msgr2=0x55575f097520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46a59a4640 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08ff40 0x55575f097520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46a59a4640 1 -- 172.21.15.69:0/4078544812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08f620 msgr2=0x55575f09a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46a59a4640 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08f620 0x55575f09a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46a59a4640 1 -- 172.21.15.69:0/4078544812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55575edd3620 con 0x55575f09a800 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.867+0000 7f46a49a2640 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08ff40 0x55575f097520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f46a59a4640 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f097c60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f469800efd0 tx=0x7f4698009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5963d42decacc6a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f4688ff9640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f4688ff9640 1 -- 172.21.15.69:0/4078544812 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698004c10 con 0x55575f09a800 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f4688ff9640 1 -- 172.21.15.69:0/4078544812 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f4698004db0 con 0x55575f09a800 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4078544812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f469800ede0 con 0x55575f09a800 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f4688ff9640 1 -- 172.21.15.69:0/4078544812 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4698013020 con 0x55575f09a800 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f46aa1f0740 10 client.15861 fetch_fsmap learned FSMap version 31 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4078544812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55575f0a93b0 con 0x55575f09a800 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f4688ff9640 1 -- 172.21.15.69:0/4078544812 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f469800ede0 con 0x55575f09a800 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f4688ff9640 1 -- 172.21.15.69:0/4078544812 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f469802e030 con 0x55575f09a800 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f46aa1f0740 10 client.15861 fetch_fsmap finished waiting for FSMap version 31 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f46aa1f0740 10 client.15861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f46aa1f0740 20 client.15861 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55575f0aa870 0x55575f0acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f46aa1f0740 4 client.15861 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:28:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.868+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4078544812 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55575f002390 con 0x55575f0aa870 2024-04-23T10:28:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.869+0000 7f46a51a3640 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55575f0aa870 0x55575f0acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.869+0000 7f46a51a3640 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55575f0aa870 0x55575f0acc60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=220e7c77c1e1c746 server_cookie=9e928748d197e44d in_seq=0 out_seq=0 2024-04-23T10:28:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.869+0000 7f4688ff9640 10 client.15861 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f4688ff9640 1 -- 172.21.15.69:0/4078544812 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55575f002390 con 0x55575f0aa870 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f4688ff9640 10 client.15861 handle_command_reply: tid=0 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 1 client.15861 shutdown 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4078544812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 msgr2=0x55575f097c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f097c60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f469800efd0 tx=0x7f4698009480 comp rx=0 tx=0).stop 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4078544812 shutdown_connections 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55575f0aa870 0x55575f0acc60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f097c60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08ff40 0x55575f097520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f4688ff9640 0 client.15861 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4078544812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08f620 0x55575f09a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4078544812 >> 172.21.15.69:0/4078544812 conn(0x55575f08bb30 msgr2=0x55575f091860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4078544812 shutdown_connections 2024-04-23T10:28:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4078544812 wait complete. 2024-04-23T10:28:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.870+0000 7f46aa1f0740 20 client.15861 trim_cache size 0 max 16384 2024-04-23T10:28:30.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46aa1f0740 1 Processor -- start 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46aa1f0740 1 -- start start 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08f620 0x55575f08b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08ff40 0x55575f099d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f09a800 0x55575f09a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01adae0 con 0x55575f08ff40 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01af740 con 0x55575f09a800 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01ae1b0 con 0x55575f08f620 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46a49a2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08ff40 0x55575f099d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46a49a2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08ff40 0x55575f099d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43392/0 (socket says 172.21.15.69:43392) 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46a49a2640 1 -- 172.21.15.69:0/1006963608 learned_addr learned my addr 172.21.15.69:0/1006963608 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46a51a3640 1 --2- 172.21.15.69:0/1006963608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08f620 0x55575f08b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46a59a4640 1 --2- 172.21.15.69:0/1006963608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f09a800 0x55575f09a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46a49a2640 1 -- 172.21.15.69:0/1006963608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08f620 msgr2=0x55575f08b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46a49a2640 1 --2- 172.21.15.69:0/1006963608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08f620 0x55575f08b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46a49a2640 1 -- 172.21.15.69:0/1006963608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f09a800 msgr2=0x55575f09a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46a49a2640 1 --2- 172.21.15.69:0/1006963608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f09a800 0x55575f09a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.885+0000 7f46a49a2640 1 -- 172.21.15.69:0/1006963608 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55575f09cf60 con 0x55575f08ff40 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f46a59a4640 1 --2- 172.21.15.69:0/1006963608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f09a800 0x55575f09a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f46a49a2640 1 --2- 172.21.15.69:0/1006963608 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08ff40 0x55575f099d60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4690005940 tx=0x7f4690032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307a65e4a5875ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f468affd640 1 -- 172.21.15.69:0/1006963608 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690035040 con 0x55575f08ff40 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f468affd640 1 -- 172.21.15.69:0/1006963608 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4690031710 con 0x55575f08ff40 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f468affd640 1 -- 172.21.15.69:0/1006963608 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690004780 con 0x55575f08ff40 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f46aa1f0740 1 -- 172.21.15.69:0/1006963608 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08ff40 msgr2=0x55575f099d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/1006963608 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08ff40 0x55575f099d60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4690005940 tx=0x7f4690032c90 comp rx=0 tx=0).stop 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f46aa1f0740 1 -- 172.21.15.69:0/1006963608 shutdown_connections 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/1006963608 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f08ff40 0x55575f099d60 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/1006963608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f09a800 0x55575f09a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/1006963608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08f620 0x55575f08b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.886+0000 7f46aa1f0740 1 -- 172.21.15.69:0/1006963608 >> 172.21.15.69:0/1006963608 conn(0x55575f08bb30 msgr2=0x55575f091860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46aa1f0740 1 -- 172.21.15.69:0/1006963608 shutdown_connections 2024-04-23T10:28:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46aa1f0740 1 -- 172.21.15.69:0/1006963608 wait complete. 2024-04-23T10:28:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46aa1f0740 1 -- start start 2024-04-23T10:28:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46aa1f0740 1 Processor -- start 2024-04-23T10:28:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08f620 0x55575f0a2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08ff40 0x55575f09dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46aa1f0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f09e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01af070 con 0x55575f09a800 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01ae8e0 con 0x55575f08f620 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46aa1f0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01abac0 con 0x55575f08ff40 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46aa1f0740 10 client.0 _ll_register_callbacks cb 0x7f46980138f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46a59a4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f09e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46a59a4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f09e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43406/0 (socket says 172.21.15.69:43406) 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46a59a4640 1 -- 172.21.15.69:0/4091944014 learned_addr learned my addr 172.21.15.69:0/4091944014 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.887+0000 7f46a49a2640 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08ff40 0x55575f09dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46a51a3640 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08f620 0x55575f0a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46a59a4640 1 -- 172.21.15.69:0/4091944014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08ff40 msgr2=0x55575f09dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46a59a4640 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08ff40 0x55575f09dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46a59a4640 1 -- 172.21.15.69:0/4091944014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08f620 msgr2=0x55575f0a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46a59a4640 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08f620 0x55575f0a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46a59a4640 1 -- 172.21.15.69:0/4091944014 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55575f09e860 con 0x55575f09a800 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46a59a4640 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f09e2a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f46980117f0 tx=0x7f4698011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a108a1d5f751ba95 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f4688ff9640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f4688ff9640 1 -- 172.21.15.69:0/4091944014 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469803c030 con 0x55575f09a800 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f4688ff9640 1 -- 172.21.15.69:0/4091944014 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f4698002030 con 0x55575f09a800 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4091944014 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4690031710 con 0x55575f09a800 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f4688ff9640 1 -- 172.21.15.69:0/4091944014 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4698045050 con 0x55575f09a800 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46aa1f0740 10 client.15867 fetch_fsmap learned FSMap version 31 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4091944014 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55575f110ad0 con 0x55575f09a800 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f4688ff9640 1 -- 172.21.15.69:0/4091944014 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4690031710 con 0x55575f09a800 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f4688ff9640 1 -- 172.21.15.69:0/4091944014 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f469802e040 con 0x55575f09a800 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46aa1f0740 10 client.15867 fetch_fsmap finished waiting for FSMap version 31 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46aa1f0740 10 client.15867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.888+0000 7f46aa1f0740 20 client.15867 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.889+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55575f111250 0x55575f113670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.889+0000 7f46aa1f0740 4 client.15867 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.889+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4091944014 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55575effc200 con 0x55575f111250 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.889+0000 7f46a51a3640 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55575f111250 0x55575f113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.889+0000 7f46a51a3640 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55575f111250 0x55575f113670 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddc7b42b4cefcb0e server_cookie=fc9d06ea5ff1d48a in_seq=0 out_seq=0 2024-04-23T10:28:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.889+0000 7f4688ff9640 10 client.15867 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f4688ff9640 1 -- 172.21.15.69:0/4091944014 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55575effc200 con 0x55575f111250 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f4688ff9640 10 client.15867 handle_command_reply: tid=0 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 1 client.15867 shutdown 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4091944014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 msgr2=0x55575f09e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f09e2a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f46980117f0 tx=0x7f4698011d70 comp rx=0 tx=0).stop 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4091944014 shutdown_connections 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55575f111250 0x55575f113670 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55575f09a800 0x55575f09e2a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55575f08ff40 0x55575f09dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f4688ff9640 0 client.15867 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 1 --2- 172.21.15.69:0/4091944014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55575f08f620 0x55575f0a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4091944014 >> 172.21.15.69:0/4091944014 conn(0x55575f08bb30 msgr2=0x55575f08a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4091944014 shutdown_connections 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 1 -- 172.21.15.69:0/4091944014 wait complete. 2024-04-23T10:28:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.896+0000 7f46aa1f0740 20 client.15867 trim_cache size 0 max 16384 2024-04-23T10:28:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:28:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:28:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:28:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 -- 172.21.15.69:0/422308270 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f468c0a3dc0 msgr2=0x7f468c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f468c0a3dc0 0x7f468c0a6280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4698011cb0 tx=0x7f469801e000 comp rx=0 tx=0).stop 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 -- 172.21.15.69:0/422308270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46a01021c0 msgr2=0x7f46a019e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46a01021c0 0x7f46a019e420 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f469c00d770 tx=0x7f469c00dc30 comp rx=0 tx=0).stop 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 -- 172.21.15.69:0/422308270 shutdown_connections 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f468c0a3dc0 0x7f468c0a6280 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a01985d0 0x7f46a0198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46a0107290 0x7f46a019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 --2- 172.21.15.69:0/422308270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46a01021c0 0x7f46a019e420 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 -- 172.21.15.69:0/422308270 >> 172.21.15.69:0/422308270 conn(0x7f46a00fda20 msgr2=0x7f46a00fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 -- 172.21.15.69:0/422308270 shutdown_connections 2024-04-23T10:28:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:30.897+0000 7f46a7407640 1 -- 172.21.15.69:0/422308270 wait complete. 2024-04-23T10:28:31.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:31 smithi146 ceph-mon[32800]: pgmap v52: 97 pgs: 97 active+clean; 112 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 597 op/s 2024-04-23T10:28:31.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:31 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:28:31.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:31 smithi069 ceph-mon[29593]: pgmap v52: 97 pgs: 97 active+clean; 112 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 597 op/s 2024-04-23T10:28:31.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:31 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:28:31.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:31 smithi167 ceph-mon[32940]: pgmap v52: 97 pgs: 97 active+clean; 112 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 597 op/s 2024-04-23T10:28:31.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:31 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:28:33.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:33 smithi146 ceph-mon[32800]: pgmap v53: 97 pgs: 97 active+clean; 112 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 2.3 MiB/s wr, 547 op/s 2024-04-23T10:28:33.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:33 smithi069 ceph-mon[29593]: pgmap v53: 97 pgs: 97 active+clean; 112 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 2.3 MiB/s wr, 547 op/s 2024-04-23T10:28:33.594 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:33 smithi167 ceph-mon[32940]: pgmap v53: 97 pgs: 97 active+clean; 112 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 2.3 MiB/s wr, 547 op/s 2024-04-23T10:28:35.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:35 smithi146 ceph-mon[32800]: pgmap v54: 97 pgs: 97 active+clean; 112 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 2.3 MiB/s wr, 547 op/s 2024-04-23T10:28:35.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:35 smithi069 ceph-mon[29593]: pgmap v54: 97 pgs: 97 active+clean; 112 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 2.3 MiB/s wr, 547 op/s 2024-04-23T10:28:35.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:35 smithi167 ceph-mon[32940]: pgmap v54: 97 pgs: 97 active+clean; 112 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 2.3 MiB/s wr, 547 op/s 2024-04-23T10:28:37.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:37 smithi146 ceph-mon[32800]: pgmap v55: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 560 op/s 2024-04-23T10:28:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:37 smithi069 ceph-mon[29593]: pgmap v55: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 560 op/s 2024-04-23T10:28:37.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:37 smithi167 ceph-mon[32940]: pgmap v55: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 560 op/s 2024-04-23T10:28:39.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:39 smithi146 ceph-mon[32800]: pgmap v56: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.7 MiB/s wr, 401 op/s 2024-04-23T10:28:39.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:39 smithi069 ceph-mon[29593]: pgmap v56: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.7 MiB/s wr, 401 op/s 2024-04-23T10:28:39.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:39 smithi167 ceph-mon[32940]: pgmap v56: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.7 MiB/s wr, 401 op/s 2024-04-23T10:28:41.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:41 smithi146 ceph-mon[32800]: pgmap v57: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.7 MiB/s wr, 408 op/s 2024-04-23T10:28:41.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:41 smithi069 ceph-mon[29593]: pgmap v57: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.7 MiB/s wr, 408 op/s 2024-04-23T10:28:41.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:41 smithi167 ceph-mon[32940]: pgmap v57: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.7 MiB/s wr, 408 op/s 2024-04-23T10:28:43.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:43 smithi146 ceph-mon[32800]: pgmap v58: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 42 KiB/s wr, 19 op/s 2024-04-23T10:28:43.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:43 smithi069 ceph-mon[29593]: pgmap v58: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 42 KiB/s wr, 19 op/s 2024-04-23T10:28:43.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:43 smithi167 ceph-mon[32940]: pgmap v58: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 42 KiB/s wr, 19 op/s 2024-04-23T10:28:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.993+0000 7f7c06cd0640 1 -- 172.21.15.69:0/758341375 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c00107270 msgr2=0x7f7c0010ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.993+0000 7f7c06cd0640 1 --2- 172.21.15.69:0/758341375 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c00107270 0x7f7c0010ee40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009ca0 tx=0x7f7bf802a8c0 comp rx=0 tx=0).stop 2024-04-23T10:28:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.993+0000 7f7c06cd0640 1 -- 172.21.15.69:0/758341375 shutdown_connections 2024-04-23T10:28:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.993+0000 7f7c06cd0640 1 --2- 172.21.15.69:0/758341375 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c00107270 0x7f7c0010ee40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.993+0000 7f7c06cd0640 1 --2- 172.21.15.69:0/758341375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c00102b50 0x7f7c00106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.993+0000 7f7c06cd0640 1 --2- 172.21.15.69:0/758341375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c001021a0 0x7f7c00102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.993+0000 7f7c06cd0640 1 -- 172.21.15.69:0/758341375 >> 172.21.15.69:0/758341375 conn(0x7f7c000fda00 msgr2=0x7f7c000ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.993+0000 7f7c06cd0640 1 -- 172.21.15.69:0/758341375 shutdown_connections 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.993+0000 7f7c06cd0640 1 -- 172.21.15.69:0/758341375 wait complete. 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.993+0000 7f7c06cd0640 1 Processor -- start 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.993+0000 7f7c06cd0640 1 -- start start 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7c06cd0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c001021a0 0x7f7c00198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7c06cd0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c00107270 0x7f7c00198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7c06cd0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c0019cf30 0x7f7c0019d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7c06cd0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7c001122f0 con 0x7f7c00107270 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7c06cd0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00112170 con 0x7f7c0019cf30 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7c06cd0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00112470 con 0x7f7c001021a0 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c00107270 0x7f7c00198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c00107270 0x7f7c00198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57824/0 (socket says 172.21.15.69:57824) 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfffff640 1 -- 172.21.15.69:0/408562240 learned_addr learned my addr 172.21.15.69:0/408562240 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c001021a0 0x7f7c00198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7c0526d640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c0019cf30 0x7f7c0019d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfffff640 1 -- 172.21.15.69:0/408562240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c001021a0 msgr2=0x7f7c00198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfffff640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c001021a0 0x7f7c00198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfffff640 1 -- 172.21.15.69:0/408562240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c0019cf30 msgr2=0x7f7c0019d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfffff640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c0019cf30 0x7f7c0019d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfffff640 1 -- 172.21.15.69:0/408562240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0019da20 con 0x7f7c00107270 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7c0526d640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c0019cf30 0x7f7c0019d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfffff640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c00107270 0x7f7c00198bb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400e9c0 tx=0x7f7bf400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfdffb640 1 -- 172.21.15.69:0/408562240 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400ccc0 con 0x7f7c00107270 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7c06cd0640 1 -- 172.21.15.69:0/408562240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0019dd10 con 0x7f7c00107270 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfdffb640 1 -- 172.21.15.69:0/408562240 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7bf40054f0 con 0x7f7c00107270 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.994+0000 7f7bfdffb640 1 -- 172.21.15.69:0/408562240 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4010430 con 0x7f7c00107270 2024-04-23T10:28:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.995+0000 7f7c06cd0640 1 -- 172.21.15.69:0/408562240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c001a5500 con 0x7f7c00107270 2024-04-23T10:28:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.997+0000 7f7bfdffb640 1 -- 172.21.15.69:0/408562240 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f7bf40046c0 con 0x7f7c00107270 2024-04-23T10:28:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c099dd740 1 Processor -- start 2024-04-23T10:28:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c099dd740 1 -- start start 2024-04-23T10:28:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8500 0x5636a82c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 0x5636a82da000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c099dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5636a822d970 con 0x5636a82c8e20 2024-04-23T10:28:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c099dd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5636a81ca4a0 con 0x5636a82d7c10 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c099dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5636a8229930 con 0x5636a82c8500 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7bfdffb640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7be80a3dc0 0x7f7be80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c04a6c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c04a6c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57834/0 (socket says 172.21.15.69:57834) 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c04a6c640 1 -- 172.21.15.69:0/437792438 learned_addr learned my addr 172.21.15.69:0/437792438 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c0526d640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7be80a3dc0 0x7f7be80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7c0526d640 1 --2- 172.21.15.69:0/437792438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8500 0x5636a82c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7bfdffb640 1 -- 172.21.15.69:0/408562240 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f7bf40d0b90 con 0x7f7c00107270 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.998+0000 7f7bfffff640 1 --2- 172.21.15.69:0/437792438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 0x5636a82da000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7c04a6c640 1 -- 172.21.15.69:0/437792438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8500 msgr2=0x5636a82c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/437792438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8500 0x5636a82c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7c04a6c640 1 -- 172.21.15.69:0/437792438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 msgr2=0x5636a82da000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/437792438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 0x5636a82da000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7c04a6c640 1 -- 172.21.15.69:0/437792438 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a7f40210 con 0x5636a82c8e20 2024-04-23T10:28:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7c0526d640 1 --2- 172.21.15.69:0/437792438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8500 0x5636a82c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7bfffff640 1 --2- 172.21.15.69:0/437792438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 0x5636a82da000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/437792438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d76d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000ad30 tx=0x7f7bf000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39651a9fd3da506c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7c0526d640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7be80a3dc0 0x7f7be80a6280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009a60 tx=0x7f7bf8005da0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7be6ffd640 1 -- 172.21.15.69:0/437792438 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0010840 con 0x5636a82c8e20 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7be6ffd640 1 -- 172.21.15.69:0/437792438 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7bf0014070 con 0x5636a82c8e20 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:43.999+0000 7f7be6ffd640 1 -- 172.21.15.69:0/437792438 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0018b30 con 0x5636a82c8e20 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.000+0000 7f7c099dd740 1 -- 172.21.15.69:0/437792438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 msgr2=0x5636a82d76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.000+0000 7f7c099dd740 1 --2- 172.21.15.69:0/437792438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d76d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000ad30 tx=0x7f7bf000f790 comp rx=0 tx=0).stop 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.000+0000 7f7c099dd740 1 -- 172.21.15.69:0/437792438 shutdown_connections 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.000+0000 7f7c099dd740 1 --2- 172.21.15.69:0/437792438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d76d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.000+0000 7f7c099dd740 1 --2- 172.21.15.69:0/437792438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 0x5636a82da000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.000+0000 7f7c099dd740 1 --2- 172.21.15.69:0/437792438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8500 0x5636a82c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.000+0000 7f7c099dd740 1 -- 172.21.15.69:0/437792438 >> 172.21.15.69:0/437792438 conn(0x5636a82c4b30 msgr2=0x5636a82c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.000+0000 7f7c099dd740 1 -- 172.21.15.69:0/437792438 shutdown_connections 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.000+0000 7f7c099dd740 1 -- 172.21.15.69:0/437792438 wait complete. 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.000+0000 7f7c099dd740 1 -- start start 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.000+0000 7f7c099dd740 1 Processor -- start 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8500 0x5636a82d7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8e20 0x5636a82d4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 0x5636a82d4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c099dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5636a82da840 con 0x5636a82c8500 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c099dd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5636a81c80b0 con 0x5636a82d7c10 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c099dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5636a82da9c0 con 0x5636a82c8e20 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c099dd740 10 client.0 _ll_register_callbacks cb 0x5636a81b5d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c04a6c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8500 0x5636a82d7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c04a6c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8500 0x5636a82d7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57836/0 (socket says 172.21.15.69:57836) 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c04a6c640 1 -- 172.21.15.69:0/744467989 learned_addr learned my addr 172.21.15.69:0/744467989 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7bfffff640 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8e20 0x5636a82d4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c0526d640 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 0x5636a82d4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c04a6c640 1 -- 172.21.15.69:0/744467989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8e20 msgr2=0x5636a82d4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8e20 0x5636a82d4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c04a6c640 1 -- 172.21.15.69:0/744467989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 msgr2=0x5636a82d4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 0x5636a82d4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c04a6c640 1 -- 172.21.15.69:0/744467989 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636a800c620 con 0x5636a82c8500 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c0526d640 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 0x5636a82d4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7bfffff640 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8e20 0x5636a82d4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8500 0x5636a82d7530 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0018710 tx=0x7f7bf000a820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f801186abfd3a075 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7bdffff640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7bdffff640 1 -- 172.21.15.69:0/744467989 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0005450 con 0x5636a82c8500 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7bdffff640 1 -- 172.21.15.69:0/744467989 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f7bf00055f0 con 0x5636a82c8500 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.001+0000 7f7c099dd740 1 -- 172.21.15.69:0/744467989 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bf0014070 con 0x5636a82c8500 2024-04-23T10:28:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7bdffff640 1 -- 172.21.15.69:0/744467989 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7bf00046c0 con 0x5636a82c8500 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7c099dd740 10 client.15879 fetch_fsmap learned FSMap version 31 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7c099dd740 1 -- 172.21.15.69:0/744467989 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5636a82e67a0 con 0x5636a82c8500 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7bdffff640 1 -- 172.21.15.69:0/744467989 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7bf0014070 con 0x5636a82c8500 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7bdffff640 1 -- 172.21.15.69:0/744467989 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f7bf0010980 con 0x5636a82c8500 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7c099dd740 10 client.15879 fetch_fsmap finished waiting for FSMap version 31 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7c099dd740 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7c099dd740 20 client.15879 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7c099dd740 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5636a82e7c60 0x5636a82ea050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7c099dd740 4 client.15879 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7c099dd740 1 -- 172.21.15.69:0/744467989 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636a823b390 con 0x5636a82e7c60 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.002+0000 7f7bfffff640 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5636a82e7c60 0x5636a82ea050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.003+0000 7f7bdffff640 10 client.15879 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.003+0000 7f7bfffff640 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5636a82e7c60 0x5636a82ea050 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bb2b22012cf93f7 server_cookie=56346441ba74201a in_seq=0 out_seq=0 2024-04-23T10:28:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7bdffff640 1 -- 172.21.15.69:0/744467989 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5636a823b390 con 0x5636a82e7c60 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7bdffff640 10 client.15879 handle_command_reply: tid=0 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 1 client.15879 shutdown 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 1 -- 172.21.15.69:0/744467989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8500 msgr2=0x5636a82d7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8500 0x5636a82d7530 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0018710 tx=0x7f7bf000a820 comp rx=0 tx=0).stop 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 1 -- 172.21.15.69:0/744467989 shutdown_connections 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5636a82e7c60 0x5636a82ea050 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82d7c10 0x5636a82d4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82c8e20 0x5636a82d4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 1 --2- 172.21.15.69:0/744467989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8500 0x5636a82d7530 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 1 -- 172.21.15.69:0/744467989 >> 172.21.15.69:0/744467989 conn(0x5636a82c4b30 msgr2=0x5636a82ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7bdffff640 0 client.15879 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 1 -- 172.21.15.69:0/744467989 shutdown_connections 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 1 -- 172.21.15.69:0/744467989 wait complete. 2024-04-23T10:28:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.004+0000 7f7c099dd740 20 client.15879 trim_cache size 0 max 16384 2024-04-23T10:28:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.019+0000 7f7c099dd740 1 Processor -- start 2024-04-23T10:28:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.019+0000 7f7c099dd740 1 -- start start 2024-04-23T10:28:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.019+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 0x5636a82e3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.019+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.019+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82d7c10 0x5636a82cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.019+0000 7f7c099dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7c001ab8f0 con 0x5636a82c8e20 2024-04-23T10:28:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.019+0000 7f7c099dd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c001ad550 con 0x5636a82c8500 2024-04-23T10:28:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.019+0000 7f7c099dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c001abfc0 con 0x5636a82d7c10 2024-04-23T10:28:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.019+0000 7f7bfffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.019+0000 7f7bfffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57840/0 (socket says 172.21.15.69:57840) 2024-04-23T10:28:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.019+0000 7f7bfffff640 1 -- 172.21.15.69:0/340594170 learned_addr learned my addr 172.21.15.69:0/340594170 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7c0526d640 1 --2- 172.21.15.69:0/340594170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82d7c10 0x5636a82cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/340594170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 0x5636a82e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7bfffff640 1 -- 172.21.15.69:0/340594170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82d7c10 msgr2=0x5636a82cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7bfffff640 1 --2- 172.21.15.69:0/340594170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82d7c10 0x5636a82cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7bfffff640 1 -- 172.21.15.69:0/340594170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 msgr2=0x5636a82e3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7bfffff640 1 --2- 172.21.15.69:0/340594170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 0x5636a82e3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7bfffff640 1 -- 172.21.15.69:0/340594170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a82da9b0 con 0x5636a82c8e20 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/340594170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 0x5636a82e3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7c0526d640 1 --2- 172.21.15.69:0/340594170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82d7c10 0x5636a82cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7bfffff640 1 --2- 172.21.15.69:0/340594170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d39a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400c6a0 tx=0x7f7bf406e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c893a84f89d585e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7be67fc640 1 -- 172.21.15.69:0/340594170 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf409cb60 con 0x5636a82c8e20 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7be67fc640 1 -- 172.21.15.69:0/340594170 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7bf40a0f10 con 0x5636a82c8e20 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.020+0000 7f7be67fc640 1 -- 172.21.15.69:0/340594170 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40ce590 con 0x5636a82c8e20 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 -- 172.21.15.69:0/340594170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 msgr2=0x5636a82d39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 --2- 172.21.15.69:0/340594170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d39a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400c6a0 tx=0x7f7bf406e5a0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 -- 172.21.15.69:0/340594170 shutdown_connections 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 --2- 172.21.15.69:0/340594170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82d39a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 --2- 172.21.15.69:0/340594170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82d7c10 0x5636a82cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 --2- 172.21.15.69:0/340594170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 0x5636a82e3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 -- 172.21.15.69:0/340594170 >> 172.21.15.69:0/340594170 conn(0x5636a82c4b30 msgr2=0x5636a82cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 -- 172.21.15.69:0/340594170 shutdown_connections 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 -- 172.21.15.69:0/340594170 wait complete. 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 -- start start 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 Processor -- start 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 0x5636a82dfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82e0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82d7c10 0x5636a82d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7c001ace80 con 0x5636a82c8e20 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c001ac6f0 con 0x5636a82c8500 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.021+0000 7f7c099dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c001a98d0 con 0x5636a82d7c10 2024-04-23T10:28:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7c099dd740 10 client.0 _ll_register_callbacks cb 0x7f7bf0018d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bfffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82e0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bfffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82e0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57850/0 (socket says 172.21.15.69:57850) 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bfffff640 1 -- 172.21.15.69:0/1066920314 learned_addr learned my addr 172.21.15.69:0/1066920314 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7c0526d640 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82d7c10 0x5636a82d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 0x5636a82dfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bfffff640 1 -- 172.21.15.69:0/1066920314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82d7c10 msgr2=0x5636a82d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bfffff640 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82d7c10 0x5636a82d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bfffff640 1 -- 172.21.15.69:0/1066920314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 msgr2=0x5636a82dfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bfffff640 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 0x5636a82dfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bfffff640 1 -- 172.21.15.69:0/1066920314 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636a82c4960 con 0x5636a82c8e20 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 0x5636a82dfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bfffff640 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82e0190 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400c6a0 tx=0x7f7bf40ce2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e2d55314bdd536 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bdffff640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bdffff640 1 -- 172.21.15.69:0/1066920314 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4016df0 con 0x5636a82c8e20 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bdffff640 1 -- 172.21.15.69:0/1066920314 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f7bf40ce590 con 0x5636a82c8e20 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7c099dd740 1 -- 172.21.15.69:0/1066920314 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bf40a0f10 con 0x5636a82c8e20 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bdffff640 1 -- 172.21.15.69:0/1066920314 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7bf409cb60 con 0x5636a82c8e20 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7c099dd740 10 client.15885 fetch_fsmap learned FSMap version 31 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7c099dd740 1 -- 172.21.15.69:0/1066920314 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5636a834d520 con 0x5636a82c8e20 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.022+0000 7f7bdffff640 1 -- 172.21.15.69:0/1066920314 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7bf40a0f10 con 0x5636a82c8e20 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.023+0000 7f7bdffff640 1 -- 172.21.15.69:0/1066920314 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f7bf40a5340 con 0x5636a82c8e20 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.023+0000 7f7c099dd740 10 client.15885 fetch_fsmap finished waiting for FSMap version 31 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.023+0000 7f7c099dd740 10 client.15885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.023+0000 7f7c099dd740 20 client.15885 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.023+0000 7f7c099dd740 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5636a834dc50 0x5636a8350070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.023+0000 7f7c099dd740 4 client.15885 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.023+0000 7f7c099dd740 1 -- 172.21.15.69:0/1066920314 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5636a8235200 con 0x5636a834dc50 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.023+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5636a834dc50 0x5636a8350070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.023+0000 7f7bdffff640 10 client.15885 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.023+0000 7f7c04a6c640 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5636a834dc50 0x5636a8350070 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59298026829420af server_cookie=b385ac21cbbbed2a in_seq=0 out_seq=0 2024-04-23T10:28:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7bdffff640 1 -- 172.21.15.69:0/1066920314 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5636a8235200 con 0x5636a834dc50 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7bdffff640 10 client.15885 handle_command_reply: tid=0 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 1 client.15885 shutdown 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 1 -- 172.21.15.69:0/1066920314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 msgr2=0x5636a82e0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82e0190 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400c6a0 tx=0x7f7bf40ce2b0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 1 -- 172.21.15.69:0/1066920314 shutdown_connections 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5636a834dc50 0x5636a8350070 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5636a82c8e20 0x5636a82e0190 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636a82d7c10 0x5636a82d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 1 --2- 172.21.15.69:0/1066920314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5636a82c8500 0x5636a82dfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7bdffff640 0 client.15885 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 1 -- 172.21.15.69:0/1066920314 >> 172.21.15.69:0/1066920314 conn(0x5636a82c4b30 msgr2=0x5636a82cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 1 -- 172.21.15.69:0/1066920314 shutdown_connections 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 1 -- 172.21.15.69:0/1066920314 wait complete. 2024-04-23T10:28:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.030+0000 7f7c099dd740 20 client.15885 trim_cache size 0 max 16384 2024-04-23T10:28:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:28:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:28:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:28:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:28:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 -- 172.21.15.69:0/408562240 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7be80a3dc0 msgr2=0x7f7be80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7be80a3dc0 0x7f7be80a6280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009a60 tx=0x7f7bf8005da0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 -- 172.21.15.69:0/408562240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c00107270 msgr2=0x7f7c00198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c00107270 0x7f7c00198bb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400e9c0 tx=0x7f7bf400edc0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 -- 172.21.15.69:0/408562240 shutdown_connections 2024-04-23T10:28:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7be80a3dc0 0x7f7be80a6280 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c00107270 0x7f7c00198bb0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c0019cf30 0x7f7c0019d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 --2- 172.21.15.69:0/408562240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c001021a0 0x7f7c00198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 -- 172.21.15.69:0/408562240 >> 172.21.15.69:0/408562240 conn(0x7f7c000fda00 msgr2=0x7f7c000fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 -- 172.21.15.69:0/408562240 shutdown_connections 2024-04-23T10:28:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:44.031+0000 7f7c06cd0640 1 -- 172.21.15.69:0/408562240 wait complete. 2024-04-23T10:28:45.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:45 smithi146 ceph-mon[32800]: pgmap v59: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 42 KiB/s wr, 19 op/s 2024-04-23T10:28:45.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:45 smithi069 ceph-mon[29593]: pgmap v59: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 42 KiB/s wr, 19 op/s 2024-04-23T10:28:45.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:45 smithi167 ceph-mon[32940]: pgmap v59: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 42 KiB/s wr, 19 op/s 2024-04-23T10:28:47.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:47 smithi146 ceph-mon[32800]: pgmap v60: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-23T10:28:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:47 smithi069 ceph-mon[29593]: pgmap v60: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-23T10:28:47.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:47 smithi167 ceph-mon[32940]: pgmap v60: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-23T10:28:49.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:49 smithi069 ceph-mon[29593]: pgmap v61: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-04-23T10:28:49.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:49 smithi167 ceph-mon[32940]: pgmap v61: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-04-23T10:28:49.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:49 smithi146 ceph-mon[32800]: pgmap v61: 97 pgs: 97 active+clean; 112 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-04-23T10:28:51.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:51 smithi069 ceph-mon[29593]: pgmap v62: 97 pgs: 97 active+clean; 124 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-04-23T10:28:51.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:51 smithi167 ceph-mon[32940]: pgmap v62: 97 pgs: 97 active+clean; 124 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-04-23T10:28:51.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:51 smithi146 ceph-mon[32800]: pgmap v62: 97 pgs: 97 active+clean; 124 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-04-23T10:28:53.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:53 smithi069 ceph-mon[29593]: pgmap v63: 97 pgs: 97 active+clean; 124 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-04-23T10:28:53.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:53 smithi167 ceph-mon[32940]: pgmap v63: 97 pgs: 97 active+clean; 124 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-04-23T10:28:53.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:53 smithi146 ceph-mon[32800]: pgmap v63: 97 pgs: 97 active+clean; 124 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-04-23T10:28:55.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:55 smithi069 ceph-mon[29593]: pgmap v64: 97 pgs: 97 active+clean; 124 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-04-23T10:28:55.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:55 smithi167 ceph-mon[32940]: pgmap v64: 97 pgs: 97 active+clean; 124 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-04-23T10:28:55.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:55 smithi146 ceph-mon[32800]: pgmap v64: 97 pgs: 97 active+clean; 124 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-04-23T10:28:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.127+0000 7f03386e8640 1 -- 172.21.15.69:0/3733425499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f033010c5d0 msgr2=0x7f033010ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.127+0000 7f03386e8640 1 --2- 172.21.15.69:0/3733425499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f033010c5d0 0x7f033010ea00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0328009ca0 tx=0x7f032802a950 comp rx=0 tx=0).stop 2024-04-23T10:28:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 -- 172.21.15.69:0/3733425499 shutdown_connections 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 --2- 172.21.15.69:0/3733425499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f033010c5d0 0x7f033010ea00 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 --2- 172.21.15.69:0/3733425499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0330103b20 0x7f033010c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 --2- 172.21.15.69:0/3733425499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0330103200 0x7f03301035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 -- 172.21.15.69:0/3733425499 >> 172.21.15.69:0/3733425499 conn(0x7f03300771d0 msgr2=0x7f03300775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 -- 172.21.15.69:0/3733425499 shutdown_connections 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 -- 172.21.15.69:0/3733425499 wait complete. 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 Processor -- start 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 -- start start 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0330103200 0x7f033019e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0330103b20 0x7f033019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f033010c5d0 0x7f03301985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.128+0000 7f03386e8640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0330112390 con 0x7f0330103200 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f03386e8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0330112210 con 0x7f0330103b20 2024-04-23T10:28:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f03386e8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0330112510 con 0x7f033010c5d0 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f0336484640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0330103200 0x7f033019e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f0336484640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0330103200 0x7f033019e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37028/0 (socket says 172.21.15.69:37028) 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f0336484640 1 -- 172.21.15.69:0/3857378292 learned_addr learned my addr 172.21.15.69:0/3857378292 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f0336484640 1 -- 172.21.15.69:0/3857378292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f033010c5d0 msgr2=0x7f03301985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f0336484640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f033010c5d0 0x7f03301985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f0336484640 1 -- 172.21.15.69:0/3857378292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0330103b20 msgr2=0x7f033019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f0335c83640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0330103b20 0x7f033019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f0336484640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0330103b20 0x7f033019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f0336484640 1 -- 172.21.15.69:0/3857378292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0330198d50 con 0x7f0330103200 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f0335c83640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0330103b20 0x7f033019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f0336484640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0330103200 0x7f033019e420 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f032c00d950 tx=0x7f032c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f03277fe640 1 -- 172.21.15.69:0/3857378292 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c017030 con 0x7f0330103200 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f03277fe640 1 -- 172.21.15.69:0/3857378292 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f032c004020 con 0x7f0330103200 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f03386e8640 1 -- 172.21.15.69:0/3857378292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0330199040 con 0x7f0330103200 2024-04-23T10:28:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f03277fe640 1 -- 172.21.15.69:0/3857378292 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0047a0 con 0x7f0330103200 2024-04-23T10:28:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.129+0000 7f03386e8640 1 -- 172.21.15.69:0/3857378292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03301a52e0 con 0x7f0330103200 2024-04-23T10:28:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f03277fe640 1 -- 172.21.15.69:0/3857378292 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f032c0041d0 con 0x7f0330103200 2024-04-23T10:28:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f033b400740 1 Processor -- start 2024-04-23T10:28:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f033b400740 1 -- start start 2024-04-23T10:28:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f033b400740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9620 0x560f9cff9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f033b400740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9cff9f40 0x560f9d0042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f033b400740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9d006bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f033b400740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560f9cf5e970 con 0x560f9d004800 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f033b400740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560f9cefb4a0 con 0x560f9cff9620 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f033b400740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560f9cf5a930 con 0x560f9cff9f40 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f0335c83640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9d006bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f0335c83640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9d006bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37030/0 (socket says 172.21.15.69:37030) 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f0335c83640 1 -- 172.21.15.69:0/1292116952 learned_addr learned my addr 172.21.15.69:0/1292116952 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f0336c85640 1 --2- 172.21.15.69:0/1292116952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9620 0x560f9cff9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f0336484640 1 --2- 172.21.15.69:0/1292116952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9cff9f40 0x560f9d0042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.132+0000 7f03277fe640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f031c0a3dc0 0x7f031c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f0336c85640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f031c0a3dc0 0x7f031c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f0335c83640 1 -- 172.21.15.69:0/1292116952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9cff9f40 msgr2=0x560f9d0042c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f0335c83640 1 --2- 172.21.15.69:0/1292116952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9cff9f40 0x560f9d0042c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f0335c83640 1 -- 172.21.15.69:0/1292116952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9620 msgr2=0x560f9cff9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f0335c83640 1 --2- 172.21.15.69:0/1292116952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9620 0x560f9cff9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f0335c83640 1 -- 172.21.15.69:0/1292116952 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f9cc71210 con 0x560f9d004800 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f03277fe640 1 -- 172.21.15.69:0/3857378292 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f032c0d0280 con 0x7f0330103200 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f0335c83640 1 --2- 172.21.15.69:0/1292116952 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9d006bf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f032000a9a0 tx=0x7f032000ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fb29b1bef18553 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f0336c85640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f031c0a3dc0 0x7f031c0a6280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0328030040 tx=0x7f03280095c0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f0324ff9640 1 -- 172.21.15.69:0/1292116952 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0320015070 con 0x560f9d004800 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f0324ff9640 1 -- 172.21.15.69:0/1292116952 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f032000cc00 con 0x560f9d004800 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.133+0000 7f0324ff9640 1 -- 172.21.15.69:0/1292116952 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03200185c0 con 0x560f9d004800 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.134+0000 7f033b400740 1 -- 172.21.15.69:0/1292116952 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 msgr2=0x560f9d006bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.134+0000 7f033b400740 1 --2- 172.21.15.69:0/1292116952 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9d006bf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f032000a9a0 tx=0x7f032000ae60 comp rx=0 tx=0).stop 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.134+0000 7f033b400740 1 -- 172.21.15.69:0/1292116952 shutdown_connections 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.134+0000 7f033b400740 1 --2- 172.21.15.69:0/1292116952 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9d006bf0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.134+0000 7f033b400740 1 --2- 172.21.15.69:0/1292116952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9cff9f40 0x560f9d0042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.134+0000 7f033b400740 1 --2- 172.21.15.69:0/1292116952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9620 0x560f9cff9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.134+0000 7f033b400740 1 -- 172.21.15.69:0/1292116952 >> 172.21.15.69:0/1292116952 conn(0x560f9cff5b30 msgr2=0x560f9cff5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.134+0000 7f033b400740 1 -- 172.21.15.69:0/1292116952 shutdown_connections 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.134+0000 7f033b400740 1 -- 172.21.15.69:0/1292116952 wait complete. 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.134+0000 7f033b400740 1 -- start start 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.134+0000 7f033b400740 1 Processor -- start 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f033b400740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f033b400740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 0x560f9d0013c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f033b400740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9d004800 0x560f9d001900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f033b400740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560f9d007430 con 0x560f9cff9620 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f033b400740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560f9cef90b0 con 0x560f9cff9f40 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f033b400740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560f9d0075b0 con 0x560f9d004800 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f033b400740 10 client.0 _ll_register_callbacks cb 0x560f9cee6d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0336484640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0336484640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0040d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37046/0 (socket says 172.21.15.69:37046) 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0336484640 1 -- 172.21.15.69:0/9660188 learned_addr learned my addr 172.21.15.69:0/9660188 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:57.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0335c83640 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 0x560f9d0013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0336484640 1 -- 172.21.15.69:0/9660188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9d004800 msgr2=0x560f9d001900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0336484640 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9d004800 0x560f9d001900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0336484640 1 -- 172.21.15.69:0/9660188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 msgr2=0x560f9d0013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0336484640 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 0x560f9d0013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0336484640 1 -- 172.21.15.69:0/9660188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f9cd3d620 con 0x560f9cff9620 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0335c83640 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 0x560f9d0013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0336484640 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0040d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f032c0986b0 tx=0x7f032c0d3900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cb79bbd81dc0e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0319ffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.135+0000 7f0319ffb640 1 -- 172.21.15.69:0/9660188 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c09bd90 con 0x560f9cff9620 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f0319ffb640 1 -- 172.21.15.69:0/9660188 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f032c0a4c30 con 0x560f9cff9620 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f033b400740 1 -- 172.21.15.69:0/9660188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f032000cc00 con 0x560f9cff9620 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f0319ffb640 1 -- 172.21.15.69:0/9660188 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f032c09bbb0 con 0x560f9cff9620 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f033b400740 10 client.15897 fetch_fsmap learned FSMap version 31 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f033b400740 1 -- 172.21.15.69:0/9660188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560f9d013370 con 0x560f9cff9620 2024-04-23T10:28:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f0319ffb640 1 -- 172.21.15.69:0/9660188 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f032000cc00 con 0x560f9cff9620 2024-04-23T10:28:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f0319ffb640 1 -- 172.21.15.69:0/9660188 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f032c0a0120 con 0x560f9cff9620 2024-04-23T10:28:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f033b400740 10 client.15897 fetch_fsmap finished waiting for FSMap version 31 2024-04-23T10:28:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f033b400740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:28:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f033b400740 20 client.15897 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f033b400740 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560f9d0148a0 0x560f9d016d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f033b400740 4 client.15897 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:28:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f033b400740 1 -- 172.21.15.69:0/9660188 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f9cf6c390 con 0x560f9d0148a0 2024-04-23T10:28:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.136+0000 7f0335c83640 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560f9d0148a0 0x560f9d016d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.137+0000 7f0319ffb640 10 client.15897 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.137+0000 7f0335c83640 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560f9d0148a0 0x560f9d016d30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fd35815992c83b9 server_cookie=d2c850d4ef47c545 in_seq=0 out_seq=0 2024-04-23T10:28:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f0319ffb640 1 -- 172.21.15.69:0/9660188 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560f9cf6c390 con 0x560f9d0148a0 2024-04-23T10:28:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f0319ffb640 10 client.15897 handle_command_reply: tid=0 2024-04-23T10:28:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 1 client.15897 shutdown 2024-04-23T10:28:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 1 -- 172.21.15.69:0/9660188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 msgr2=0x560f9d0040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0040d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f032c0986b0 tx=0x7f032c0d3900 comp rx=0 tx=0).stop 2024-04-23T10:28:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 1 -- 172.21.15.69:0/9660188 shutdown_connections 2024-04-23T10:28:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560f9d0148a0 0x560f9d016d30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9d004800 0x560f9d001900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 0x560f9d0013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f0319ffb640 0 client.15897 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 1 --2- 172.21.15.69:0/9660188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0040d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 1 -- 172.21.15.69:0/9660188 >> 172.21.15.69:0/9660188 conn(0x560f9cff5b30 msgr2=0x560f9cffb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 1 -- 172.21.15.69:0/9660188 shutdown_connections 2024-04-23T10:28:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 1 -- 172.21.15.69:0/9660188 wait complete. 2024-04-23T10:28:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.138+0000 7f033b400740 20 client.15897 trim_cache size 0 max 16384 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.153+0000 7f033b400740 1 Processor -- start 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.153+0000 7f033b400740 1 -- start start 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.153+0000 7f033b400740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0102f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.153+0000 7f033b400740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 0x560f9d000560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.153+0000 7f033b400740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9d004800 0x560f9d003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.153+0000 7f033b400740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f03301adc00 con 0x560f9cff9620 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.153+0000 7f033b400740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f03301af860 con 0x560f9cff9f40 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.153+0000 7f033b400740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f03301ae2d0 con 0x560f9d004800 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.153+0000 7f0336484640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.153+0000 7f0336484640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0102f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37050/0 (socket says 172.21.15.69:37050) 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.153+0000 7f0336484640 1 -- 172.21.15.69:0/1305901380 learned_addr learned my addr 172.21.15.69:0/1305901380 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f0336c85640 1 --2- 172.21.15.69:0/1305901380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9d004800 0x560f9d003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f0336484640 1 -- 172.21.15.69:0/1305901380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9d004800 msgr2=0x560f9d003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f0336484640 1 --2- 172.21.15.69:0/1305901380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9d004800 0x560f9d003c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f0335c83640 1 --2- 172.21.15.69:0/1305901380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 0x560f9d000560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f0336484640 1 -- 172.21.15.69:0/1305901380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 msgr2=0x560f9d000560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f0336484640 1 --2- 172.21.15.69:0/1305901380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 0x560f9d000560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f0336484640 1 -- 172.21.15.69:0/1305901380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f9cff12e0 con 0x560f9cff9620 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f0336c85640 1 --2- 172.21.15.69:0/1305901380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9d004800 0x560f9d003c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f0335c83640 1 --2- 172.21.15.69:0/1305901380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 0x560f9d000560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f0336484640 1 --2- 172.21.15.69:0/1305901380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0102f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f032c097fa0 tx=0x7f032c098020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff031edacfb4d405 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f031bfff640 1 -- 172.21.15.69:0/1305901380 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c09bd90 con 0x560f9cff9620 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f031bfff640 1 -- 172.21.15.69:0/1305901380 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f032c09c950 con 0x560f9cff9620 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f031bfff640 1 -- 172.21.15.69:0/1305901380 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c098320 con 0x560f9cff9620 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f033b400740 1 -- 172.21.15.69:0/1305901380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 msgr2=0x560f9d0102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.154+0000 7f033b400740 1 --2- 172.21.15.69:0/1305901380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0102f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f032c097fa0 tx=0x7f032c098020 comp rx=0 tx=0).stop 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 -- 172.21.15.69:0/1305901380 shutdown_connections 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 --2- 172.21.15.69:0/1305901380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9d004800 0x560f9d003c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 --2- 172.21.15.69:0/1305901380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9f40 0x560f9d000560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 --2- 172.21.15.69:0/1305901380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9cff9620 0x560f9d0102f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 -- 172.21.15.69:0/1305901380 >> 172.21.15.69:0/1305901380 conn(0x560f9cff5b30 msgr2=0x560f9d000c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 -- 172.21.15.69:0/1305901380 shutdown_connections 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 -- 172.21.15.69:0/1305901380 wait complete. 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 -- start start 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 Processor -- start 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9620 0x560f9d0778d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9cff9f40 0x560f9d077e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9cffe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f03301af190 con 0x560f9d004800 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f03301aea00 con 0x560f9cff9620 2024-04-23T10:28:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f03301abbe0 con 0x560f9cff9f40 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f033b400740 10 client.0 _ll_register_callbacks cb 0x7f032c0050c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f0336c85640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9cffe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f0336c85640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9cffe5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37052/0 (socket says 172.21.15.69:37052) 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f0336c85640 1 -- 172.21.15.69:0/488911258 learned_addr learned my addr 172.21.15.69:0/488911258 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.155+0000 7f0335c83640 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9cff9f40 0x560f9d077e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0336484640 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9620 0x560f9d0778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0336c85640 1 -- 172.21.15.69:0/488911258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9cff9f40 msgr2=0x560f9d077e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0336c85640 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9cff9f40 0x560f9d077e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0336c85640 1 -- 172.21.15.69:0/488911258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9620 msgr2=0x560f9d0778d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0336c85640 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9620 0x560f9d0778d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0336c85640 1 -- 172.21.15.69:0/488911258 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f9cffecb0 con 0x560f9d004800 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0336484640 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9620 0x560f9d0778d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0336c85640 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9cffe5c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0328009ca0 tx=0x7f032802fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8518050d438970d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0319ffb640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:28:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0319ffb640 1 -- 172.21.15.69:0/488911258 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032804d030 con 0x560f9d004800 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f033b400740 1 -- 172.21.15.69:0/488911258 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f032c09c950 con 0x560f9d004800 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0319ffb640 1 -- 172.21.15.69:0/488911258 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f0328004040 con 0x560f9d004800 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0319ffb640 1 -- 172.21.15.69:0/488911258 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0328043040 con 0x560f9d004800 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f033b400740 10 client.15903 fetch_fsmap learned FSMap version 31 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f033b400740 1 -- 172.21.15.69:0/488911258 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560f9d07f080 con 0x560f9d004800 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0319ffb640 1 -- 172.21.15.69:0/488911258 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f032c09c950 con 0x560f9d004800 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f0319ffb640 1 -- 172.21.15.69:0/488911258 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f032803c980 con 0x560f9d004800 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f033b400740 10 client.15903 fetch_fsmap finished waiting for FSMap version 31 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f033b400740 10 client.15903 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f033b400740 20 client.15903 populate_metadata read hostname 'smithi069' 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f033b400740 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560f9d07f7b0 0x560f9d081bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f033b400740 4 client.15903 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.156+0000 7f033b400740 1 -- 172.21.15.69:0/488911258 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560f9cf66200 con 0x560f9d07f7b0 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.157+0000 7f0336484640 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560f9d07f7b0 0x560f9d081bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.157+0000 7f0319ffb640 10 client.15903 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.157+0000 7f0336484640 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560f9d07f7b0 0x560f9d081bd0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58fc848af0d45d0 server_cookie=ad39b46f9a05f59b in_seq=0 out_seq=0 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f0319ffb640 1 -- 172.21.15.69:0/488911258 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560f9cf66200 con 0x560f9d07f7b0 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f0319ffb640 10 client.15903 handle_command_reply: tid=0 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f033b400740 1 client.15903 shutdown 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f033b400740 1 -- 172.21.15.69:0/488911258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 msgr2=0x560f9cffe5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f033b400740 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9cffe5c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0328009ca0 tx=0x7f032802fe50 comp rx=0 tx=0).stop 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f033b400740 1 -- 172.21.15.69:0/488911258 shutdown_connections 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f033b400740 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560f9d07f7b0 0x560f9d081bd0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f033b400740 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560f9d004800 0x560f9cffe5c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f033b400740 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f9cff9f40 0x560f9d077e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f0319ffb640 0 client.15903 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f033b400740 1 --2- 172.21.15.69:0/488911258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f9cff9620 0x560f9d0778d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f033b400740 1 -- 172.21.15.69:0/488911258 >> 172.21.15.69:0/488911258 conn(0x560f9cff5b30 msgr2=0x560f9d0003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f033b400740 1 -- 172.21.15.69:0/488911258 shutdown_connections 2024-04-23T10:28:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.164+0000 7f033b400740 1 -- 172.21.15.69:0/488911258 wait complete. 2024-04-23T10:28:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f033b400740 20 client.15903 trim_cache size 0 max 16384 2024-04-23T10:28:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:28:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:28:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:28:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:28:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 -- 172.21.15.69:0/3857378292 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f031c0a3dc0 msgr2=0x7f031c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f031c0a3dc0 0x7f031c0a6280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0328030040 tx=0x7f03280095c0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 -- 172.21.15.69:0/3857378292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0330103200 msgr2=0x7f033019e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:28:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0330103200 0x7f033019e420 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f032c00d950 tx=0x7f032c00de10 comp rx=0 tx=0).stop 2024-04-23T10:28:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 -- 172.21.15.69:0/3857378292 shutdown_connections 2024-04-23T10:28:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f031c0a3dc0 0x7f031c0a6280 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f033010c5d0 0x7f03301985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0330103b20 0x7f033019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 --2- 172.21.15.69:0/3857378292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0330103200 0x7f033019e420 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:28:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 -- 172.21.15.69:0/3857378292 >> 172.21.15.69:0/3857378292 conn(0x7f03300771d0 msgr2=0x7f03300fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:28:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 -- 172.21.15.69:0/3857378292 shutdown_connections 2024-04-23T10:28:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:28:57.165+0000 7f03386e8640 1 -- 172.21.15.69:0/3857378292 wait complete. 2024-04-23T10:28:57.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:57 smithi069 ceph-mon[29593]: pgmap v65: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-04-23T10:28:57.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:57 smithi167 ceph-mon[32940]: pgmap v65: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-04-23T10:28:57.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:57 smithi146 ceph-mon[32800]: pgmap v65: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-04-23T10:28:59.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:28:59 smithi069 ceph-mon[29593]: pgmap v66: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-04-23T10:28:59.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:28:59 smithi167 ceph-mon[32940]: pgmap v66: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-04-23T10:28:59.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:28:59 smithi146 ceph-mon[32800]: pgmap v66: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-04-23T10:29:00.127 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:29:00.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.232+0000 7f465062a640 1 -- 172.21.15.69:0/2416927978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4648102b80 msgr2=0x7f4648106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.232+0000 7f465062a640 1 --2- 172.21.15.69:0/2416927978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4648102b80 0x7f4648106bc0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4638009900 tx=0x7f463802a410 comp rx=0 tx=0).stop 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.232+0000 7f465062a640 1 -- 172.21.15.69:0/2416927978 shutdown_connections 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.232+0000 7f465062a640 1 --2- 172.21.15.69:0/2416927978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4648102b80 0x7f4648106bc0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.232+0000 7f465062a640 1 --2- 172.21.15.69:0/2416927978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46481072a0 0x7f464810ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.232+0000 7f465062a640 1 --2- 172.21.15.69:0/2416927978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46481021d0 0x7f46481025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.232+0000 7f465062a640 1 -- 172.21.15.69:0/2416927978 >> 172.21.15.69:0/2416927978 conn(0x7f46480793e0 msgr2=0x7f46480797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.232+0000 7f465062a640 1 -- 172.21.15.69:0/2416927978 shutdown_connections 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.232+0000 7f465062a640 1 -- 172.21.15.69:0/2416927978 wait complete. 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.232+0000 7f465062a640 1 Processor -- start 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.232+0000 7f465062a640 1 -- start start 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f465062a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46481021d0 0x7f464819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f465062a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46481072a0 0x7f464819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f465062a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46481986a0 0x7f4648198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f465062a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4648112320 con 0x7f46481986a0 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f465062a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f46481121a0 con 0x7f46481021d0 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f465062a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46481124a0 con 0x7f46481072a0 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f464ebc7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46481986a0 0x7f4648198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f464ebc7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46481986a0 0x7f4648198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51374/0 (socket says 172.21.15.69:51374) 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f464ebc7640 1 -- 172.21.15.69:0/2158754173 learned_addr learned my addr 172.21.15.69:0/2158754173 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f464e3c6640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46481021d0 0x7f464819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f464dbc5640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46481072a0 0x7f464819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f464ebc7640 1 -- 172.21.15.69:0/2158754173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46481072a0 msgr2=0x7f464819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f464ebc7640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46481072a0 0x7f464819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f464ebc7640 1 -- 172.21.15.69:0/2158754173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46481021d0 msgr2=0x7f464819e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f464ebc7640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46481021d0 0x7f464819e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f464ebc7640 1 -- 172.21.15.69:0/2158754173 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46481992a0 con 0x7f46481986a0 2024-04-23T10:29:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f464ebc7640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46481986a0 0x7f4648198b20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f464400e940 tx=0x7f464400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f463f7fe640 1 -- 172.21.15.69:0/2158754173 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464400cd00 con 0x7f46481986a0 2024-04-23T10:29:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f463f7fe640 1 -- 172.21.15.69:0/2158754173 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f46440035f0 con 0x7f46481986a0 2024-04-23T10:29:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f465062a640 1 -- 172.21.15.69:0/2158754173 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46481a5380 con 0x7f46481986a0 2024-04-23T10:29:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f463f7fe640 1 -- 172.21.15.69:0/2158754173 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464400cea0 con 0x7f46481986a0 2024-04-23T10:29:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.233+0000 7f465062a640 1 -- 172.21.15.69:0/2158754173 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46481a5730 con 0x7f46481986a0 2024-04-23T10:29:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.234+0000 7f465062a640 1 -- 172.21.15.69:0/2158754173 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46481036a0 con 0x7f46481986a0 2024-04-23T10:29:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.236+0000 7f463f7fe640 1 -- 172.21.15.69:0/2158754173 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f4644003b30 con 0x7f46481986a0 2024-04-23T10:29:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.236+0000 7f463f7fe640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f46340a3d20 0x7f46340a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.236+0000 7f464e3c6640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f46340a3d20 0x7f46340a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.236+0000 7f463f7fe640 1 -- 172.21.15.69:0/2158754173 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f46440d0a90 con 0x7f46481986a0 2024-04-23T10:29:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.237+0000 7f464e3c6640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f46340a3d20 0x7f46340a61e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4640005fd0 tx=0x7f4640009500 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:00.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.240+0000 7f463f7fe640 1 -- 172.21.15.69:0/2158754173 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f464409d1f0 con 0x7f46481986a0 2024-04-23T10:29:00.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.470+0000 7f465062a640 1 -- 172.21.15.69:0/2158754173 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46480684e0 con 0x7f46481986a0 2024-04-23T10:29:00.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.471+0000 7f463f7fe640 1 -- 172.21.15.69:0/2158754173 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11940 (secure 0 0 0) 0x7f464409caf0 con 0x7f46481986a0 2024-04-23T10:29:00.471 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:29:00.471 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:28:29.153391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25297":{"gid":25297,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/1216686871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1216686871},{"type":"v1","addr":"172.21.15.167:6835","nonce":1216686871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24421,24463,24487,24392,24416]},"id":1}]} 2024-04-23T10:29:00.471 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 31 2024-04-23T10:29:00.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 -- 172.21.15.69:0/2158754173 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f46340a3d20 msgr2=0x7f46340a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f46340a3d20 0x7f46340a61e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4640005fd0 tx=0x7f4640009500 comp rx=0 tx=0).stop 2024-04-23T10:29:00.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 -- 172.21.15.69:0/2158754173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46481986a0 msgr2=0x7f4648198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46481986a0 0x7f4648198b20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f464400e940 tx=0x7f464400ee00 comp rx=0 tx=0).stop 2024-04-23T10:29:00.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 -- 172.21.15.69:0/2158754173 shutdown_connections 2024-04-23T10:29:00.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f46340a3d20 0x7f46340a61e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46481986a0 0x7f4648198b20 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46481072a0 0x7f464819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 --2- 172.21.15.69:0/2158754173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46481021d0 0x7f464819e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 -- 172.21.15.69:0/2158754173 >> 172.21.15.69:0/2158754173 conn(0x7f46480793e0 msgr2=0x7f4648100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:00.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 -- 172.21.15.69:0/2158754173 shutdown_connections 2024-04-23T10:29:00.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.473+0000 7f465062a640 1 -- 172.21.15.69:0/2158754173 wait complete. 2024-04-23T10:29:00.483 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:00 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:29:00.484 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id 410ff32d --release --await' 2024-04-23T10:29:00.484 DEBUG:teuthology.orchestra.run.smithi069:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24487 quiesce db --set-id 410ff32d --release --await 2024-04-23T10:29:00.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:00 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.590+0000 7f8f5967b640 1 -- 172.21.15.69:0/3401868668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f54101a30 msgr2=0x7f8f54105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.590+0000 7f8f5967b640 1 --2- 172.21.15.69:0/3401868668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f54101a30 0x7f8f54105a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009860 tx=0x7f8f3c02a340 comp rx=0 tx=0).stop 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.590+0000 7f8f5967b640 1 -- 172.21.15.69:0/3401868668 shutdown_connections 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.590+0000 7f8f5967b640 1 --2- 172.21.15.69:0/3401868668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f54106150 0x7f8f5410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.590+0000 7f8f5967b640 1 --2- 172.21.15.69:0/3401868668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f54101a30 0x7f8f54105a70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.590+0000 7f8f5967b640 1 --2- 172.21.15.69:0/3401868668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f54101080 0x7f8f54101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.590+0000 7f8f5967b640 1 -- 172.21.15.69:0/3401868668 >> 172.21.15.69:0/3401868668 conn(0x7f8f54077ef0 msgr2=0x7f8f54078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.590+0000 7f8f5967b640 1 -- 172.21.15.69:0/3401868668 shutdown_connections 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.590+0000 7f8f5967b640 1 -- 172.21.15.69:0/3401868668 wait complete. 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.590+0000 7f8f5967b640 1 Processor -- start 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.590+0000 7f8f5967b640 1 -- start start 2024-04-23T10:29:00.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f5967b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f54101080 0x7f8f54199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f5967b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f54106150 0x7f8f54199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f5967b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f5419a160 0x7f8f541a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f5967b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541111d0 con 0x7f8f54106150 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f5967b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8f54111050 con 0x7f8f54101080 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f5967b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f54111350 con 0x7f8f5419a160 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f4bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f54106150 0x7f8f54199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f4bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f54106150 0x7f8f54199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51390/0 (socket says 172.21.15.69:51390) 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f4bfff640 1 -- 172.21.15.69:0/1369385857 learned_addr learned my addr 172.21.15.69:0/1369385857 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f54101080 0x7f8f54199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f537fe640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f5419a160 0x7f8f541a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f4bfff640 1 -- 172.21.15.69:0/1369385857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f5419a160 msgr2=0x7f8f541a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f4bfff640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f5419a160 0x7f8f541a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f4bfff640 1 -- 172.21.15.69:0/1369385857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f54101080 msgr2=0x7f8f54199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f4bfff640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f54101080 0x7f8f54199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f4bfff640 1 -- 172.21.15.69:0/1369385857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f541a4f10 con 0x7f8f54106150 2024-04-23T10:29:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f4bfff640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f54106150 0x7f8f54199bd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c000c00 tx=0x7f8f3c02aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f50ff9640 1 -- 172.21.15.69:0/1369385857 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c03f020 con 0x7f8f54106150 2024-04-23T10:29:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f5967b640 1 -- 172.21.15.69:0/1369385857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f541a51a0 con 0x7f8f54106150 2024-04-23T10:29:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f50ff9640 1 -- 172.21.15.69:0/1369385857 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8f3c033dd0 con 0x7f8f54106150 2024-04-23T10:29:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f50ff9640 1 -- 172.21.15.69:0/1369385857 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c037040 con 0x7f8f54106150 2024-04-23T10:29:00.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.591+0000 7f8f5967b640 1 -- 172.21.15.69:0/1369385857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f541a56e0 con 0x7f8f54106150 2024-04-23T10:29:00.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.593+0000 7f8f50ff9640 1 -- 172.21.15.69:0/1369385857 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f8f3c042020 con 0x7f8f54106150 2024-04-23T10:29:00.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f5c38a740 1 Processor -- start 2024-04-23T10:29:00.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f5c38a740 1 -- start start 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfdf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f50ff9640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8f400a3d20 0x7f8f400a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfea480 0x5626ebfec870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5626ebf446d0 con 0x5626ebfdf490 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5626ebee11a0 con 0x5626ebfea480 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5626ebf40690 con 0x5626ebfdfdb0 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfdf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f4bfff640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8f400a3d20 0x7f8f400a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfdf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51404/0 (socket says 172.21.15.69:51404) 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f537fe640 1 -- 172.21.15.69:0/2159995679 learned_addr learned my addr 172.21.15.69:0/2159995679 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/2159995679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f537fe640 1 --2- 172.21.15.69:0/2159995679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfea480 0x5626ebfec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.594+0000 7f8f50ff9640 1 -- 172.21.15.69:0/1369385857 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f8f3c0f03f0 con 0x7f8f54106150 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.595+0000 7f8f52ffd640 1 -- 172.21.15.69:0/2159995679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfea480 msgr2=0x5626ebfec870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.595+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/2159995679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfea480 0x5626ebfec870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.595+0000 7f8f52ffd640 1 -- 172.21.15.69:0/2159995679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 msgr2=0x5626ebfdf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.595+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/2159995679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfdf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.595+0000 7f8f52ffd640 1 -- 172.21.15.69:0/2159995679 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ebeeb5b0 con 0x5626ebfdfdb0 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.595+0000 7f8f537fe640 1 --2- 172.21.15.69:0/2159995679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfdf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.595+0000 7f8f4bfff640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8f400a3d20 0x7f8f400a61e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0edd30 tx=0x7f8f3c0a7040 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.595+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/2159995679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe9f40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f44005fd0 tx=0x7f8f44011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39eb1c7c8d8ab032 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.595+0000 7f8f497fa640 1 -- 172.21.15.69:0/2159995679 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44004020 con 0x5626ebfdfdb0 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.595+0000 7f8f497fa640 1 -- 172.21.15.69:0/2159995679 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8f440041c0 con 0x5626ebfdfdb0 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.595+0000 7f8f497fa640 1 -- 172.21.15.69:0/2159995679 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440197a0 con 0x5626ebfdfdb0 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 -- 172.21.15.69:0/2159995679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 msgr2=0x5626ebfe9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/2159995679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe9f40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f44005fd0 tx=0x7f8f44011810 comp rx=0 tx=0).stop 2024-04-23T10:29:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 -- 172.21.15.69:0/2159995679 shutdown_connections 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/2159995679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfea480 0x5626ebfec870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/2159995679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe9f40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/2159995679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfdf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 -- 172.21.15.69:0/2159995679 >> 172.21.15.69:0/2159995679 conn(0x5626ebfdb7b0 msgr2=0x5626ebfdbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 -- 172.21.15.69:0/2159995679 shutdown_connections 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 -- 172.21.15.69:0/2159995679 wait complete. 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 -- start start 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 Processor -- start 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfea480 0x5626ebfe7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5626ebfed310 con 0x5626ebfdf490 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5626ebedeb20 con 0x5626ebfea480 2024-04-23T10:29:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.596+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5626ebfed490 con 0x5626ebfdfdb0 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f5c38a740 10 client.0 _ll_register_callbacks cb 0x5626ebede530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51418/0 (socket says 172.21.15.69:51418) 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f537fe640 1 -- 172.21.15.69:0/938541916 learned_addr learned my addr 172.21.15.69:0/938541916 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f537fe640 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfea480 0x5626ebfe7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f537fe640 1 -- 172.21.15.69:0/938541916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 msgr2=0x5626ebfe7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f537fe640 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f537fe640 1 -- 172.21.15.69:0/938541916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfea480 msgr2=0x5626ebfe7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f537fe640 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfea480 0x5626ebfe7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f537fe640 1 -- 172.21.15.69:0/938541916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626ebc56920 con 0x5626ebfdf490 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f537fe640 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe9f40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c013e90 tx=0x7f8f4c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7386cd516009ccce server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:29:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/938541916 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c003c40 con 0x5626ebfdf490 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/938541916 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f8f4c003de0 con 0x5626ebfdf490 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f5c38a740 1 -- 172.21.15.69:0/938541916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f440041c0 con 0x5626ebfdf490 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/938541916 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8f4c003fe0 con 0x5626ebfdf490 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f5c38a740 10 client.15921 fetch_fsmap learned FSMap version 31 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f5c38a740 1 -- 172.21.15.69:0/938541916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5626ebd22d30 con 0x5626ebfdf490 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.597+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/938541916 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8f440041c0 con 0x5626ebfdf490 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.598+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/938541916 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f8f4c025920 con 0x5626ebfdf490 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.598+0000 7f8f5c38a740 10 client.15921 fetch_fsmap finished waiting for FSMap version 31 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.598+0000 7f8f5c38a740 10 client.15921 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.598+0000 7f8f5c38a740 20 client.15921 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.598+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5626ebffa7a0 0x5626ebffcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.598+0000 7f8f5c38a740 4 client.15921 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.598+0000 7f8f5c38a740 1 -- 172.21.15.69:0/938541916 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626ebf02500 con 0x5626ebffa7a0 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.598+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5626ebffa7a0 0x5626ebffcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.598+0000 7f8f3a7fc640 10 client.15921 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.598+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5626ebffa7a0 0x5626ebffcbd0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5325364013c0424 server_cookie=6c9be9a72da3b6ec in_seq=0 out_seq=0 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/938541916 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5626ebf02500 con 0x5626ebffa7a0 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f3a7fc640 10 client.15921 handle_command_reply: tid=0 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 1 client.15921 shutdown 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 1 -- 172.21.15.69:0/938541916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 msgr2=0x5626ebfe9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe9f40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c013e90 tx=0x7f8f4c009500 comp rx=0 tx=0).stop 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 1 -- 172.21.15.69:0/938541916 shutdown_connections 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5626ebffa7a0 0x5626ebffcbd0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfea480 0x5626ebfe7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/938541916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe9f40 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f3a7fc640 0 client.15921 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 1 -- 172.21.15.69:0/938541916 >> 172.21.15.69:0/938541916 conn(0x5626ebfdb7b0 msgr2=0x5626ebfe15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 1 -- 172.21.15.69:0/938541916 shutdown_connections 2024-04-23T10:29:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 1 -- 172.21.15.69:0/938541916 wait complete. 2024-04-23T10:29:00.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.599+0000 7f8f5c38a740 20 client.15921 trim_cache size 0 max 16384 2024-04-23T10:29:00.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.616+0000 7f8f5c38a740 1 Processor -- start 2024-04-23T10:29:00.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.616+0000 7f8f5c38a740 1 -- start start 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.616+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfdb7b0 0x5626ebff61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.616+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.616+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.616+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541adc90 con 0x5626ebfdf490 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.616+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541af8f0 con 0x5626ebfdb7b0 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.616+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541ae360 con 0x5626ebfdfdb0 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f52ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f52ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51430/0 (socket says 172.21.15.69:51430) 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f52ffd640 1 -- 172.21.15.69:0/2216795641 learned_addr learned my addr 172.21.15.69:0/2216795641 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f537fe640 1 --2- 172.21.15.69:0/2216795641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfdb7b0 0x5626ebff61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f537fe640 1 --2- 172.21.15.69:0/2216795641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f52ffd640 1 -- 172.21.15.69:0/2216795641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 msgr2=0x5626ebfe9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/2216795641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f52ffd640 1 -- 172.21.15.69:0/2216795641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfdb7b0 msgr2=0x5626ebff61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/2216795641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfdb7b0 0x5626ebff61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f52ffd640 1 -- 172.21.15.69:0/2216795641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ebfdfbe0 con 0x5626ebfdf490 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/2216795641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe16c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8f44005fd0 tx=0x7f8f44009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0149c47720443f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f48ff9640 1 -- 172.21.15.69:0/2216795641 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4402f020 con 0x5626ebfdf490 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f48ff9640 1 -- 172.21.15.69:0/2216795641 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8f44005510 con 0x5626ebfdf490 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.617+0000 7f8f48ff9640 1 -- 172.21.15.69:0/2216795641 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4402b530 con 0x5626ebfdf490 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 -- 172.21.15.69:0/2216795641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 msgr2=0x5626ebfe16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/2216795641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe16c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8f44005fd0 tx=0x7f8f44009790 comp rx=0 tx=0).stop 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 -- 172.21.15.69:0/2216795641 shutdown_connections 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/2216795641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdf490 0x5626ebfe16c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/2216795641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdfdb0 0x5626ebfe9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/2216795641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfdb7b0 0x5626ebff61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 -- 172.21.15.69:0/2216795641 >> 172.21.15.69:0/2216795641 conn(0x5626ebfe2c00 msgr2=0x5626ebfe5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 -- 172.21.15.69:0/2216795641 shutdown_connections 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 -- 172.21.15.69:0/2216795641 wait complete. 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 -- start start 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 Processor -- start 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfdb7b0 0x5626ebfeb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdf490 0x5626ebfebac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdfdb0 0x5626ebfec040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541af220 con 0x5626ebfdfdb0 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541aea90 con 0x5626ebfdb7b0 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f541abc90 con 0x5626ebfdf490 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.618+0000 7f8f5c38a740 10 client.0 _ll_register_callbacks cb 0x7f8f4c013960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdfdb0 0x5626ebfec040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdfdb0 0x5626ebfec040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51432/0 (socket says 172.21.15.69:51432) 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f537fe640 1 -- 172.21.15.69:0/626065021 learned_addr learned my addr 172.21.15.69:0/626065021 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdf490 0x5626ebfebac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f537fe640 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfdb7b0 0x5626ebfeb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f537fe640 1 -- 172.21.15.69:0/626065021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdf490 msgr2=0x5626ebfebac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f537fe640 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdf490 0x5626ebfebac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f537fe640 1 -- 172.21.15.69:0/626065021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfdb7b0 msgr2=0x5626ebfeb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f537fe640 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfdb7b0 0x5626ebfeb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f537fe640 1 -- 172.21.15.69:0/626065021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626ebff0e70 con 0x5626ebfdfdb0 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f537fe640 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdfdb0 0x5626ebfec040 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c002230 tx=0x7f8f4c009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f857053a50fc2b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/626065021 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c025640 con 0x5626ebfdfdb0 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/626065021 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f8f4c002030 con 0x5626ebfdfdb0 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f5c38a740 1 -- 172.21.15.69:0/626065021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f44005510 con 0x5626ebfdfdb0 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/626065021 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8f4c043050 con 0x5626ebfdfdb0 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f5c38a740 10 client.15927 fetch_fsmap learned FSMap version 31 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f5c38a740 1 -- 172.21.15.69:0/626065021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5626ec061340 con 0x5626ebfdfdb0 2024-04-23T10:29:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.619+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/626065021 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8f44005510 con 0x5626ebfdfdb0 2024-04-23T10:29:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.620+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/626065021 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f8f4c0318b0 con 0x5626ebfdfdb0 2024-04-23T10:29:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.620+0000 7f8f5c38a740 10 client.15927 fetch_fsmap finished waiting for FSMap version 31 2024-04-23T10:29:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.620+0000 7f8f5c38a740 10 client.15927 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:29:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.620+0000 7f8f5c38a740 20 client.15927 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.620+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5626ebfea480 0x5626ec0639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.620+0000 7f8f5c38a740 4 client.15927 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "410ff32d", "release": true, "await": true}] 2024-04-23T10:29:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.620+0000 7f8f5c38a740 1 -- 172.21.15.69:0/626065021 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "quiesce db", "set_id": "410ff32d", "release": true, "await": true}) -- 0x5626ebf520f0 con 0x5626ebfea480 2024-04-23T10:29:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.620+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5626ebfea480 0x5626ec0639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.620+0000 7f8f3a7fc640 10 client.15927 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.620+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5626ebfea480 0x5626ec0639e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f668d3cbdeb26bdc server_cookie=3b623b7d6ed72afd in_seq=0 out_seq=0 2024-04-23T10:29:00.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f3a7fc640 1 -- 172.21.15.69:0/626065021 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5626ebf520f0 con 0x5626ebfea480 2024-04-23T10:29:00.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f3a7fc640 10 client.15927 handle_command_reply: tid=0 2024-04-23T10:29:00.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 1 client.15927 shutdown 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 1 -- 172.21.15.69:0/626065021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdfdb0 msgr2=0x5626ebfec040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdfdb0 0x5626ebfec040 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c002230 tx=0x7f8f4c009a70 comp rx=0 tx=0).stop 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 1 -- 172.21.15.69:0/626065021 shutdown_connections 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5626ebfea480 0x5626ec0639e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626ebfdfdb0 0x5626ebfec040 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ebfdf490 0x5626ebfebac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f3a7fc640 0 client.15927 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 1 --2- 172.21.15.69:0/626065021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626ebfdb7b0 0x5626ebfeb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 1 -- 172.21.15.69:0/626065021 >> 172.21.15.69:0/626065021 conn(0x5626ebfe2c00 msgr2=0x5626ebff51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 1 -- 172.21.15.69:0/626065021 shutdown_connections 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 1 -- 172.21.15.69:0/626065021 wait complete. 2024-04-23T10:29:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.622+0000 7f8f5c38a740 20 client.15927 trim_cache size 0 max 16384 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 31, 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "leader": 24487, 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "set_version": 8, 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "sets": { 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "410ff32d": { 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "version": 8, 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "age_ref": 0.0, 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RELEASED", 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "timeout": 60.0, 2024-04-23T10:29:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: "expiration": 90.7, 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout: "members": { 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout: "file:/": { 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout: "excluded": false, 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RELEASED", 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:29:00.629 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:29:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 -- 172.21.15.69:0/1369385857 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8f400a3d20 msgr2=0x7f8f400a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8f400a3d20 0x7f8f400a61e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0edd30 tx=0x7f8f3c0a7040 comp rx=0 tx=0).stop 2024-04-23T10:29:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 -- 172.21.15.69:0/1369385857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f54106150 msgr2=0x7f8f54199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f54106150 0x7f8f54199bd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c000c00 tx=0x7f8f3c02aea0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 -- 172.21.15.69:0/1369385857 shutdown_connections 2024-04-23T10:29:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8f400a3d20 0x7f8f400a61e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f54106150 0x7f8f54199bd0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f5419a160 0x7f8f541a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 --2- 172.21.15.69:0/1369385857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f54101080 0x7f8f54199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 -- 172.21.15.69:0/1369385857 >> 172.21.15.69:0/1369385857 conn(0x7f8f54077ef0 msgr2=0x7f8f540ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 -- 172.21.15.69:0/1369385857 shutdown_connections 2024-04-23T10:29:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:00.623+0000 7f8f5967b640 1 -- 172.21.15.69:0/1369385857 wait complete. 2024-04-23T10:29:00.631 INFO:tasks.workunit.client.0.smithi069.stderr:+ tar cf doc.tar linux-4.0.5 2024-04-23T10:29:00.633 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '410ff32d', seconds elapsed: 39.2 2024-04-23T10:29:00.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:00 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:29:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:01 smithi069 ceph-mon[29593]: pgmap v67: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-04-23T10:29:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:01 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:01 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:01 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:01 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:01 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2158754173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:29:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:01 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:29:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:01 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:29:01.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:01 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:01 smithi167 ceph-mon[32940]: pgmap v67: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-04-23T10:29:01.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:01 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:01 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:01 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:01 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:01 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2158754173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:29:01.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:01 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:29:01.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:01 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:29:01.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:01 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:01 smithi146 ceph-mon[32800]: pgmap v67: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-04-23T10:29:01.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:01 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:01 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:01 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:01 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:01.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:01 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2158754173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:29:01.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:01 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:29:01.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:01 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:29:01.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:01 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:29:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:03 smithi069 ceph-mon[29593]: pgmap v68: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 6.1 KiB/s wr, 11 op/s 2024-04-23T10:29:03.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:03 smithi167 ceph-mon[32940]: pgmap v68: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 6.1 KiB/s wr, 11 op/s 2024-04-23T10:29:03.591 INFO:tasks.workunit.client.0.smithi069.stderr:+ tar xf doc.tar 2024-04-23T10:29:03.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:03 smithi146 ceph-mon[32800]: pgmap v68: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 6.1 KiB/s wr, 11 op/s 2024-04-23T10:29:05.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:05 smithi069 ceph-mon[29593]: pgmap v69: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 6.1 KiB/s wr, 11 op/s 2024-04-23T10:29:05.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:05 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:05.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:05 smithi167 ceph-mon[32940]: pgmap v69: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 6.1 KiB/s wr, 11 op/s 2024-04-23T10:29:05.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:05 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:05.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:05 smithi146 ceph-mon[32800]: pgmap v69: 97 pgs: 97 active+clean; 124 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 6.1 KiB/s wr, 11 op/s 2024-04-23T10:29:05.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:05 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:07 smithi069 ceph-mon[29593]: pgmap v70: 97 pgs: 97 active+clean; 127 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 278 KiB/s wr, 351 op/s 2024-04-23T10:29:07.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:07 smithi167 ceph-mon[32940]: pgmap v70: 97 pgs: 97 active+clean; 127 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 278 KiB/s wr, 351 op/s 2024-04-23T10:29:07.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:07 smithi146 ceph-mon[32800]: pgmap v70: 97 pgs: 97 active+clean; 127 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 278 KiB/s wr, 351 op/s 2024-04-23T10:29:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:09 smithi069 ceph-mon[29593]: pgmap v71: 97 pgs: 97 active+clean; 127 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 275 KiB/s wr, 345 op/s 2024-04-23T10:29:09.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:09 smithi167 ceph-mon[32940]: pgmap v71: 97 pgs: 97 active+clean; 127 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 275 KiB/s wr, 345 op/s 2024-04-23T10:29:09.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:09 smithi146 ceph-mon[32800]: pgmap v71: 97 pgs: 97 active+clean; 127 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 275 KiB/s wr, 345 op/s 2024-04-23T10:29:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.287+0000 7f22933ba640 1 -- 172.21.15.69:0/47663633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c1043a0 msgr2=0x7f228c104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.287+0000 7f22933ba640 1 --2- 172.21.15.69:0/47663633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c1043a0 0x7f228c104780 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2288009900 tx=0x7f228802a410 comp rx=0 tx=0).stop 2024-04-23T10:29:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.287+0000 7f22933ba640 1 -- 172.21.15.69:0/47663633 shutdown_connections 2024-04-23T10:29:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.287+0000 7f22933ba640 1 --2- 172.21.15.69:0/47663633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f228c109470 0x7f228c111040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.287+0000 7f22933ba640 1 --2- 172.21.15.69:0/47663633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f228c104d50 0x7f228c108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.287+0000 7f22933ba640 1 --2- 172.21.15.69:0/47663633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c1043a0 0x7f228c104780 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.287+0000 7f22933ba640 1 -- 172.21.15.69:0/47663633 >> 172.21.15.69:0/47663633 conn(0x7f228c0ffbe0 msgr2=0x7f228c102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.287+0000 7f22933ba640 1 -- 172.21.15.69:0/47663633 shutdown_connections 2024-04-23T10:29:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.287+0000 7f22933ba640 1 -- 172.21.15.69:0/47663633 wait complete. 2024-04-23T10:29:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f22933ba640 1 Processor -- start 2024-04-23T10:29:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f22933ba640 1 -- start start 2024-04-23T10:29:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f22933ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f228c1043a0 0x7f228c1a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f22933ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f228c109470 0x7f228c1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f22933ba640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c19a810 0x7f228c19acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f22933ba640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1144f0 con 0x7f228c19a810 2024-04-23T10:29:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f22933ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f228c114370 con 0x7f228c109470 2024-04-23T10:29:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f22933ba640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f228c114670 con 0x7f228c1043a0 2024-04-23T10:29:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f2291957640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c19a810 0x7f228c19acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f2290955640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f228c109470 0x7f228c1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f2290955640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f228c109470 0x7f228c1a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.69:44772/0 (socket says 172.21.15.69:44772) 2024-04-23T10:29:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f2291957640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c19a810 0x7f228c19acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49164/0 (socket says 172.21.15.69:49164) 2024-04-23T10:29:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f2290955640 1 -- 172.21.15.69:0/4277624672 learned_addr learned my addr 172.21.15.69:0/4277624672 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.288+0000 7f2291156640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f228c1043a0 0x7f228c1a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.289+0000 7f2291957640 1 -- 172.21.15.69:0/4277624672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f228c1043a0 msgr2=0x7f228c1a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.289+0000 7f2291957640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f228c1043a0 0x7f228c1a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.289+0000 7f2291957640 1 -- 172.21.15.69:0/4277624672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f228c109470 msgr2=0x7f228c1a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.289+0000 7f2291957640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f228c109470 0x7f228c1a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.289+0000 7f2291957640 1 -- 172.21.15.69:0/4277624672 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c19b3a0 con 0x7f228c19a810 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.289+0000 7f2291156640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f228c1043a0 0x7f228c1a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.289+0000 7f2290955640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f228c109470 0x7f228c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.289+0000 7f2291957640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c19a810 0x7f228c19acc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2284009fd0 tx=0x7f228400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.289+0000 7f22827fc640 1 -- 172.21.15.69:0/4277624672 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228400ce20 con 0x7f228c19a810 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.290+0000 7f22827fc640 1 -- 172.21.15.69:0/4277624672 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2284005020 con 0x7f228c19a810 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.290+0000 7f22933ba640 1 -- 172.21.15.69:0/4277624672 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c19b690 con 0x7f228c19a810 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.290+0000 7f22827fc640 1 -- 172.21.15.69:0/4277624672 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284010720 con 0x7f228c19a810 2024-04-23T10:29:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.290+0000 7f22933ba640 1 -- 172.21.15.69:0/4277624672 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c1a7820 con 0x7f228c19a810 2024-04-23T10:29:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.293+0000 7f22827fc640 1 -- 172.21.15.69:0/4277624672 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f2284005560 con 0x7f228c19a810 2024-04-23T10:29:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.293+0000 7f22961a8740 1 Processor -- start 2024-04-23T10:29:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.293+0000 7f22961a8740 1 -- start start 2024-04-23T10:29:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f22961a8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 0x563338246210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f22961a8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338246750 0x563338250ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f22961a8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338251010 0x563338253400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f22961a8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5633381a2970 con 0x563338246750 2024-04-23T10:29:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f22961a8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56333813f4a0 con 0x563338245e30 2024-04-23T10:29:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f22961a8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56333819e930 con 0x563338251010 2024-04-23T10:29:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f22827fc640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f22780a3e40 0x7f22780a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2290955640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 0x563338246210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2290955640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338251010 0x563338253400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2290955640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 0x563338246210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.69:44788/0 (socket says 172.21.15.69:44788) 2024-04-23T10:29:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2290955640 1 -- 172.21.15.69:0/1076748072 learned_addr learned my addr 172.21.15.69:0/1076748072 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f22827fc640 1 -- 172.21.15.69:0/4277624672 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f22840d0e20 con 0x7f228c19a810 2024-04-23T10:29:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2291957640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f22780a3e40 0x7f22780a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2291156640 1 --2- 172.21.15.69:0/1076748072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338246750 0x563338250ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2290955640 1 -- 172.21.15.69:0/1076748072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338251010 msgr2=0x563338253400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2290955640 1 --2- 172.21.15.69:0/1076748072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338251010 0x563338253400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2290955640 1 -- 172.21.15.69:0/1076748072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338246750 msgr2=0x563338250ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2290955640 1 --2- 172.21.15.69:0/1076748072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338246750 0x563338250ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2290955640 1 -- 172.21.15.69:0/1076748072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563337eb5210 con 0x563338245e30 2024-04-23T10:29:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2291957640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f22780a3e40 0x7f22780a6300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f228401a040 tx=0x7f22840054d0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.294+0000 7f2290955640 1 --2- 172.21.15.69:0/1076748072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 0x563338246210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f227c013c10 tx=0x7f227c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=180a797e4f333461 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.295+0000 7f22777fe640 1 -- 172.21.15.69:0/1076748072 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c013110 con 0x563338245e30 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.295+0000 7f22777fe640 1 -- 172.21.15.69:0/1076748072 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f227c0132b0 con 0x563338245e30 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.295+0000 7f22777fe640 1 -- 172.21.15.69:0/1076748072 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c005590 con 0x563338245e30 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.295+0000 7f22961a8740 1 -- 172.21.15.69:0/1076748072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 msgr2=0x563338246210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.295+0000 7f22961a8740 1 --2- 172.21.15.69:0/1076748072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 0x563338246210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f227c013c10 tx=0x7f227c009780 comp rx=0 tx=0).stop 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.295+0000 7f22961a8740 1 -- 172.21.15.69:0/1076748072 shutdown_connections 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.295+0000 7f22961a8740 1 --2- 172.21.15.69:0/1076748072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338246750 0x563338250ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.295+0000 7f22961a8740 1 --2- 172.21.15.69:0/1076748072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338251010 0x563338253400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.295+0000 7f22961a8740 1 --2- 172.21.15.69:0/1076748072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 0x563338246210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.295+0000 7f22961a8740 1 -- 172.21.15.69:0/1076748072 >> 172.21.15.69:0/1076748072 conn(0x563338242340 msgr2=0x563338242720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.295+0000 7f22961a8740 1 -- 172.21.15.69:0/1076748072 shutdown_connections 2024-04-23T10:29:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f22961a8740 1 -- 172.21.15.69:0/1076748072 wait complete. 2024-04-23T10:29:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f22961a8740 1 -- start start 2024-04-23T10:29:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f22961a8740 1 Processor -- start 2024-04-23T10:29:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f22961a8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 0x563338250940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f22961a8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 0x56333824dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f22961a8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 0x56333824e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f22961a8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x563338253be0 con 0x563338251010 2024-04-23T10:29:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f22961a8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56333813d0b0 con 0x563338245e30 2024-04-23T10:29:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f22961a8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563338253d60 con 0x563338246750 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f2290955640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 0x563338250940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f2291156640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 0x56333824dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f2290955640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 0x56333824e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f2291156640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 0x56333824dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.69:60784/0 (socket says 172.21.15.69:60784) 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2291156640 1 -- 172.21.15.69:0/666552329 learned_addr learned my addr 172.21.15.69:0/666552329 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.296+0000 7f22961a8740 10 client.0 _ll_register_callbacks cb 0x56333812ad30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2291156640 1 -- 172.21.15.69:0/666552329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 msgr2=0x563338250940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2291156640 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 0x563338250940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2291156640 1 -- 172.21.15.69:0/666552329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 msgr2=0x56333824e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2291156640 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 0x56333824e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2291156640 1 -- 172.21.15.69:0/666552329 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563337f81620 con 0x563338246750 2024-04-23T10:29:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2290955640 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 0x563338250940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2291156640 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 0x56333824dc30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2288009900 tx=0x7f2288031740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba6d2521bd8fee3f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2274ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-04-23T10:29:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2274ff9640 1 -- 172.21.15.69:0/666552329 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288035040 con 0x563338246750 2024-04-23T10:29:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f22961a8740 1 -- 172.21.15.69:0/666552329 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f227c0132b0 con 0x563338246750 2024-04-23T10:29:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2274ff9640 1 -- 172.21.15.69:0/666552329 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f2288004450 con 0x563338246750 2024-04-23T10:29:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f2274ff9640 1 -- 172.21.15.69:0/666552329 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2288005020 con 0x563338246750 2024-04-23T10:29:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f22961a8740 10 client.25396 fetch_fsmap learned FSMap version 34 2024-04-23T10:29:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.297+0000 7f22961a8740 1 -- 172.21.15.69:0/666552329 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56333825faf0 con 0x563338246750 2024-04-23T10:29:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.298+0000 7f2274ff9640 1 -- 172.21.15.69:0/666552329 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f227c0132b0 con 0x563338246750 2024-04-23T10:29:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.298+0000 7f2274ff9640 1 -- 172.21.15.69:0/666552329 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f22880035f0 con 0x563338246750 2024-04-23T10:29:10.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.298+0000 7f22961a8740 10 client.25396 fetch_fsmap finished waiting for FSMap version 34 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.298+0000 7f22961a8740 10 client.25396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.298+0000 7f22961a8740 20 client.25396 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.298+0000 7f22961a8740 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563338260fb0 0x5633382633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.298+0000 7f22961a8740 4 client.25396 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.298+0000 7f22961a8740 1 -- 172.21.15.69:0/666552329 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633381b0390 con 0x563338260fb0 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.298+0000 7f2290955640 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563338260fb0 0x5633382633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.298+0000 7f2290955640 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563338260fb0 0x5633382633c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=877dcc5c09f27d1e server_cookie=7a89cf77f10226a0 in_seq=0 out_seq=0 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.298+0000 7f2274ff9640 10 client.25396 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f2274ff9640 1 -- 172.21.15.69:0/666552329 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5633381b0390 con 0x563338260fb0 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f2274ff9640 10 client.25396 handle_command_reply: tid=0 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 1 client.25396 shutdown 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 1 -- 172.21.15.69:0/666552329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 msgr2=0x56333824dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 0x56333824dc30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2288009900 tx=0x7f2288031740 comp rx=0 tx=0).stop 2024-04-23T10:29:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 1 -- 172.21.15.69:0/666552329 shutdown_connections 2024-04-23T10:29:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563338260fb0 0x5633382633c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 0x56333824e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f2274ff9640 0 client.25396 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 0x56333824dc30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 1 --2- 172.21.15.69:0/666552329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338245e30 0x563338250940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 1 -- 172.21.15.69:0/666552329 >> 172.21.15.69:0/666552329 conn(0x563338242340 msgr2=0x563338238cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 1 -- 172.21.15.69:0/666552329 shutdown_connections 2024-04-23T10:29:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 1 -- 172.21.15.69:0/666552329 wait complete. 2024-04-23T10:29:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.301+0000 7f22961a8740 20 client.25396 trim_cache size 0 max 16384 2024-04-23T10:29:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f22961a8740 1 Processor -- start 2024-04-23T10:29:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f22961a8740 1 -- start start 2024-04-23T10:29:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f22961a8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338245e30 0x56333825caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f22961a8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 0x563338249180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f22961a8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338251010 0x563338250470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f22961a8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1ab960 con 0x563338245e30 2024-04-23T10:29:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f22961a8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1ad590 con 0x563338251010 2024-04-23T10:29:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f22961a8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1ac030 con 0x563338246750 2024-04-23T10:29:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f2290955640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338245e30 0x56333825caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f2290955640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338245e30 0x56333825caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49184/0 (socket says 172.21.15.69:49184) 2024-04-23T10:29:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f2290955640 1 -- 172.21.15.69:0/3298251813 learned_addr learned my addr 172.21.15.69:0/3298251813 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f2291156640 1 --2- 172.21.15.69:0/3298251813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 0x563338249180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.316+0000 7f2290955640 1 --2- 172.21.15.69:0/3298251813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338251010 0x563338250470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f2290955640 1 -- 172.21.15.69:0/3298251813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 msgr2=0x563338249180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f2290955640 1 --2- 172.21.15.69:0/3298251813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 0x563338249180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f2290955640 1 -- 172.21.15.69:0/3298251813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338251010 msgr2=0x563338250470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f2290955640 1 --2- 172.21.15.69:0/3298251813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338251010 0x563338250470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f2290955640 1 -- 172.21.15.69:0/3298251813 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633382496c0 con 0x563338245e30 2024-04-23T10:29:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f2290955640 1 --2- 172.21.15.69:0/3298251813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338245e30 0x56333825caa0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f227c013a10 tx=0x7f227c01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d68993086a28686 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f2276ffd640 1 -- 172.21.15.69:0/3298251813 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0132b0 con 0x563338245e30 2024-04-23T10:29:10.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f2276ffd640 1 -- 172.21.15.69:0/3298251813 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f227c013450 con 0x563338245e30 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f2276ffd640 1 -- 172.21.15.69:0/3298251813 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c004c20 con 0x563338245e30 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f22961a8740 1 -- 172.21.15.69:0/3298251813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338245e30 msgr2=0x56333825caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f22961a8740 1 --2- 172.21.15.69:0/3298251813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338245e30 0x56333825caa0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f227c013a10 tx=0x7f227c01c040 comp rx=0 tx=0).stop 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.317+0000 7f22961a8740 1 -- 172.21.15.69:0/3298251813 shutdown_connections 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 --2- 172.21.15.69:0/3298251813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338251010 0x563338250470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 --2- 172.21.15.69:0/3298251813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338246750 0x563338249180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 --2- 172.21.15.69:0/3298251813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338245e30 0x56333825caa0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 -- 172.21.15.69:0/3298251813 >> 172.21.15.69:0/3298251813 conn(0x563338242340 msgr2=0x563338248a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 -- 172.21.15.69:0/3298251813 shutdown_connections 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 -- 172.21.15.69:0/3298251813 wait complete. 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 -- start start 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 Processor -- start 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338245e30 0x563338258c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338246750 0x563338259150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 0x5633382540d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1acec0 con 0x563338251010 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1ac7c0 con 0x563338246750 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1a9940 con 0x563338245e30 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f22961a8740 10 client.0 _ll_register_callbacks cb 0x7f2288005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f2290955640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 0x5633382540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f2290955640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 0x5633382540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49192/0 (socket says 172.21.15.69:49192) 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f2290955640 1 -- 172.21.15.69:0/1091217292 learned_addr learned my addr 172.21.15.69:0/1091217292 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.318+0000 7f2291156640 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338246750 0x563338259150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2290955640 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338245e30 0x563338258c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2290955640 1 -- 172.21.15.69:0/1091217292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338245e30 msgr2=0x563338258c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2290955640 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338245e30 0x563338258c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2290955640 1 -- 172.21.15.69:0/1091217292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338246750 msgr2=0x563338259150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2290955640 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338246750 0x563338259150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2290955640 1 -- 172.21.15.69:0/1091217292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563338254810 con 0x563338251010 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2291156640 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338246750 0x563338259150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2290955640 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 0x5633382540d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f227c004650 tx=0x7f227c004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c9fa3be76fc3d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2274ff9640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2274ff9640 1 -- 172.21.15.69:0/1091217292 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c004770 con 0x563338251010 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2274ff9640 1 -- 172.21.15.69:0/1091217292 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f227c004ba0 con 0x563338251010 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f22961a8740 1 -- 172.21.15.69:0/1091217292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f227c013450 con 0x563338251010 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2274ff9640 1 -- 172.21.15.69:0/1091217292 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f227c004da0 con 0x563338251010 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f22961a8740 10 client.15945 fetch_fsmap learned FSMap version 34 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f22961a8740 1 -- 172.21.15.69:0/1091217292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5633382c6f50 con 0x563338251010 2024-04-23T10:29:10.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.319+0000 7f2274ff9640 1 -- 172.21.15.69:0/1091217292 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f227c013450 con 0x563338251010 2024-04-23T10:29:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.320+0000 7f2274ff9640 1 -- 172.21.15.69:0/1091217292 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f227c02fce0 con 0x563338251010 2024-04-23T10:29:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.320+0000 7f22961a8740 10 client.15945 fetch_fsmap finished waiting for FSMap version 34 2024-04-23T10:29:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.320+0000 7f22961a8740 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:29:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.320+0000 7f22961a8740 20 client.15945 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.320+0000 7f22961a8740 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563338260fb0 0x5633382c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.320+0000 7f22961a8740 4 client.15945 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:29:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.320+0000 7f22961a8740 1 -- 172.21.15.69:0/1091217292 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5633381aa200 con 0x563338260fb0 2024-04-23T10:29:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.320+0000 7f2291156640 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563338260fb0 0x5633382c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.320+0000 7f2274ff9640 10 client.15945 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:10.320+0000 7f2291156640 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563338260fb0 0x5633382c9430 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a1837f1efa15e5f server_cookie=4b094feb7497f024 in_seq=0 out_seq=0 2024-04-23T10:29:10.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:10 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:10.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:10 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:10.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:10 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:11 smithi069 ceph-mon[29593]: pgmap v72: 97 pgs: 97 active+clean; 140 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 427 op/s 2024-04-23T10:29:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:11 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:11.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:11 smithi167 ceph-mon[32940]: pgmap v72: 97 pgs: 97 active+clean; 140 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 427 op/s 2024-04-23T10:29:11.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:11 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:11.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:11 smithi146 ceph-mon[32800]: pgmap v72: 97 pgs: 97 active+clean; 140 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 427 op/s 2024-04-23T10:29:11.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:11 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f2274ff9640 1 -- 172.21.15.69:0/1091217292 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5633381aa200 con 0x563338260fb0 2024-04-23T10:29:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f2274ff9640 10 client.15945 handle_command_reply: tid=0 2024-04-23T10:29:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f22961a8740 1 client.15945 shutdown 2024-04-23T10:29:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f22961a8740 1 -- 172.21.15.69:0/1091217292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 msgr2=0x5633382540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f22961a8740 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 0x5633382540d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f227c004650 tx=0x7f227c004a00 comp rx=0 tx=0).stop 2024-04-23T10:29:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f22961a8740 1 -- 172.21.15.69:0/1091217292 shutdown_connections 2024-04-23T10:29:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f22961a8740 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x563338260fb0 0x5633382c9430 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f2274ff9640 0 client.15945 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f22961a8740 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563338251010 0x5633382540d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f22961a8740 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563338246750 0x563338259150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f22961a8740 1 --2- 172.21.15.69:0/1091217292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563338245e30 0x563338258c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f22961a8740 1 -- 172.21.15.69:0/1091217292 >> 172.21.15.69:0/1091217292 conn(0x563338242340 msgr2=0x5633382477e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.105+0000 7f22961a8740 1 -- 172.21.15.69:0/1091217292 shutdown_connections 2024-04-23T10:29:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.106+0000 7f22961a8740 1 -- 172.21.15.69:0/1091217292 wait complete. 2024-04-23T10:29:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.106+0000 7f22961a8740 20 client.15945 trim_cache size 0 max 16384 2024-04-23T10:29:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:29:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:29:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:29:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:29:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.106+0000 7f22933ba640 1 -- 172.21.15.69:0/4277624672 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f22780a3e40 msgr2=0x7f22780a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.106+0000 7f22933ba640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f22780a3e40 0x7f22780a6300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f228401a040 tx=0x7f22840054d0 comp rx=0 tx=0).stop 2024-04-23T10:29:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.106+0000 7f22933ba640 1 -- 172.21.15.69:0/4277624672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c19a810 msgr2=0x7f228c19acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.106+0000 7f22933ba640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c19a810 0x7f228c19acc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2284009fd0 tx=0x7f228400ef10 comp rx=0 tx=0).stop 2024-04-23T10:29:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.107+0000 7f22933ba640 1 -- 172.21.15.69:0/4277624672 shutdown_connections 2024-04-23T10:29:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.107+0000 7f22933ba640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f22780a3e40 0x7f22780a6300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.107+0000 7f22933ba640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f228c19a810 0x7f228c19acc0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.107+0000 7f22933ba640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f228c109470 0x7f228c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.107+0000 7f22933ba640 1 --2- 172.21.15.69:0/4277624672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f228c1043a0 0x7f228c1a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.107+0000 7f22933ba640 1 -- 172.21.15.69:0/4277624672 >> 172.21.15.69:0/4277624672 conn(0x7f228c0ffbe0 msgr2=0x7f228c101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.107+0000 7f22933ba640 1 -- 172.21.15.69:0/4277624672 shutdown_connections 2024-04-23T10:29:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:13.107+0000 7f22933ba640 1 -- 172.21.15.69:0/4277624672 wait complete. 2024-04-23T10:29:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:13 smithi069 ceph-mon[29593]: pgmap v73: 97 pgs: 97 active+clean; 140 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 422 op/s 2024-04-23T10:29:13.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:13 smithi167 ceph-mon[32940]: pgmap v73: 97 pgs: 97 active+clean; 140 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 422 op/s 2024-04-23T10:29:13.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:13 smithi146 ceph-mon[32800]: pgmap v73: 97 pgs: 97 active+clean; 140 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 422 op/s 2024-04-23T10:29:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:15 smithi069 ceph-mon[29593]: pgmap v74: 97 pgs: 97 active+clean; 140 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 422 op/s 2024-04-23T10:29:15.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:15 smithi167 ceph-mon[32940]: pgmap v74: 97 pgs: 97 active+clean; 140 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 422 op/s 2024-04-23T10:29:15.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:15 smithi146 ceph-mon[32800]: pgmap v74: 97 pgs: 97 active+clean; 140 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 422 op/s 2024-04-23T10:29:17.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:17 smithi069 ceph-mon[29593]: pgmap v75: 97 pgs: 97 active+clean; 168 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 1.19k op/s 2024-04-23T10:29:17.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:17 smithi167 ceph-mon[32940]: pgmap v75: 97 pgs: 97 active+clean; 168 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 1.19k op/s 2024-04-23T10:29:17.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:17 smithi146 ceph-mon[32800]: pgmap v75: 97 pgs: 97 active+clean; 168 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 1.19k op/s 2024-04-23T10:29:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:19 smithi069 ceph-mon[29593]: pgmap v76: 97 pgs: 97 active+clean; 168 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 846 op/s 2024-04-23T10:29:19.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:19 smithi167 ceph-mon[32940]: pgmap v76: 97 pgs: 97 active+clean; 168 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 846 op/s 2024-04-23T10:29:19.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:19 smithi146 ceph-mon[32800]: pgmap v76: 97 pgs: 97 active+clean; 168 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 846 op/s 2024-04-23T10:29:20.645 INFO:tasks.workunit.client.0.smithi069.stderr:+ sync 2024-04-23T10:29:21.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:21 smithi069 ceph-mon[29593]: pgmap v77: 97 pgs: 97 active+clean; 178 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.7 MiB/s wr, 938 op/s 2024-04-23T10:29:21.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:21 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:21.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:21 smithi167 ceph-mon[32940]: pgmap v77: 97 pgs: 97 active+clean; 178 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.7 MiB/s wr, 938 op/s 2024-04-23T10:29:21.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:21 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:21.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:21 smithi146 ceph-mon[32800]: pgmap v77: 97 pgs: 97 active+clean; 178 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.7 MiB/s wr, 938 op/s 2024-04-23T10:29:21.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:21 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:22.435 INFO:tasks.workunit.client.0.smithi069.stderr:+ tar c linux-4.0.5 2024-04-23T10:29:22.945 INFO:tasks.workunit.client.0.smithi069.stderr:+ rm -rf linux-4.0.5 2024-04-23T10:29:23.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:23 smithi167 ceph-mon[32940]: pgmap v78: 97 pgs: 97 active+clean; 178 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 856 op/s 2024-04-23T10:29:23.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:23 smithi146 ceph-mon[32800]: pgmap v78: 97 pgs: 97 active+clean; 178 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 856 op/s 2024-04-23T10:29:23.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:23 smithi069 ceph-mon[29593]: pgmap v78: 97 pgs: 97 active+clean; 178 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 856 op/s 2024-04-23T10:29:25.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:25 smithi167 ceph-mon[32940]: pgmap v79: 97 pgs: 97 active+clean; 178 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 856 op/s 2024-04-23T10:29:25.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:25 smithi146 ceph-mon[32800]: pgmap v79: 97 pgs: 97 active+clean; 178 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 856 op/s 2024-04-23T10:29:25.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:25 smithi069 ceph-mon[29593]: pgmap v79: 97 pgs: 97 active+clean; 178 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 856 op/s 2024-04-23T10:29:26.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.199+0000 7f694d9c6640 1 -- 172.21.15.69:0/3950516736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f694810c520 msgr2=0x7f694810e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:26.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.199+0000 7f694d9c6640 1 --2- 172.21.15.69:0/3950516736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f694810c520 0x7f694810e9c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6940009ca0 tx=0x7f694002a9e0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.199+0000 7f694d9c6640 1 -- 172.21.15.69:0/3950516736 shutdown_connections 2024-04-23T10:29:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.199+0000 7f694d9c6640 1 --2- 172.21.15.69:0/3950516736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f694810c520 0x7f694810e9c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.199+0000 7f694d9c6640 1 --2- 172.21.15.69:0/3950516736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6948103b00 0x7f694810bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.199+0000 7f694d9c6640 1 --2- 172.21.15.69:0/3950516736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69481031e0 0x7f69481035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.199+0000 7f694d9c6640 1 -- 172.21.15.69:0/3950516736 >> 172.21.15.69:0/3950516736 conn(0x7f6948077fd0 msgr2=0x7f69480783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.199+0000 7f694d9c6640 1 -- 172.21.15.69:0/3950516736 shutdown_connections 2024-04-23T10:29:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.199+0000 7f694d9c6640 1 -- 172.21.15.69:0/3950516736 wait complete. 2024-04-23T10:29:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f694d9c6640 1 Processor -- start 2024-04-23T10:29:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f694d9c6640 1 -- start start 2024-04-23T10:29:26.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f694d9c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69481031e0 0x7f694819e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f694d9c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6948103b00 0x7f694819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f694d9c6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f694810c520 0x7f6948198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f694d9c6640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f69481122f0 con 0x7f694810c520 2024-04-23T10:29:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f694d9c6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6948112170 con 0x7f6948103b00 2024-04-23T10:29:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f694d9c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6948112470 con 0x7f69481031e0 2024-04-23T10:29:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f69477fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f694810c520 0x7f6948198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f69477fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f694810c520 0x7f6948198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42898/0 (socket says 172.21.15.69:42898) 2024-04-23T10:29:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f693ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6948103b00 0x7f694819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f69477fe640 1 -- 172.21.15.69:0/160818944 learned_addr learned my addr 172.21.15.69:0/160818944 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:26.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.200+0000 7f6946ffd640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69481031e0 0x7f694819e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f693ffff640 1 -- 172.21.15.69:0/160818944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69481031e0 msgr2=0x7f694819e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:26.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f693ffff640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69481031e0 0x7f694819e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f693ffff640 1 -- 172.21.15.69:0/160818944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f694810c520 msgr2=0x7f6948198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:26.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f693ffff640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f694810c520 0x7f6948198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f693ffff640 1 -- 172.21.15.69:0/160818944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6948198f30 con 0x7f6948103b00 2024-04-23T10:29:26.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f69477fe640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f694810c520 0x7f6948198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:26.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f693ffff640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6948103b00 0x7f694819eaf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f693000e9f0 tx=0x7f693000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:26.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f694c9c4640 1 -- 172.21.15.69:0/160818944 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693000ccc0 con 0x7f6948103b00 2024-04-23T10:29:26.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f694d9c6640 1 -- 172.21.15.69:0/160818944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6948199220 con 0x7f6948103b00 2024-04-23T10:29:26.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f694c9c4640 1 -- 172.21.15.69:0/160818944 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6930010900 con 0x7f6948103b00 2024-04-23T10:29:26.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f694c9c4640 1 -- 172.21.15.69:0/160818944 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930018920 con 0x7f6948103b00 2024-04-23T10:29:26.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.201+0000 7f694d9c6640 1 -- 172.21.15.69:0/160818944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69481a5530 con 0x7f6948103b00 2024-04-23T10:29:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.203+0000 7f694c9c4640 1 -- 172.21.15.69:0/160818944 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f6930010ab0 con 0x7f6948103b00 2024-04-23T10:29:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.203+0000 7f69507bc740 1 Processor -- start 2024-04-23T10:29:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f69507bc740 1 -- start start 2024-04-23T10:29:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f694c9c4640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69340a3dc0 0x7f69340a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f69507bc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88620 0x560938d88a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f69507bc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d932c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f69507bc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d93800 0x560938d95bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f69507bc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560938ced970 con 0x560938d88f40 2024-04-23T10:29:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f69507bc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560938c8a4a0 con 0x560938d93800 2024-04-23T10:29:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f69507bc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560938ce9930 con 0x560938d88620 2024-04-23T10:29:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f694c9c4640 1 -- 172.21.15.69:0/160818944 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f69300d0b30 con 0x7f6948103b00 2024-04-23T10:29:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f69477fe640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69340a3dc0 0x7f69340a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f693ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d932c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f693ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d932c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42914/0 (socket says 172.21.15.69:42914) 2024-04-23T10:29:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f693ffff640 1 -- 172.21.15.69:0/4029287893 learned_addr learned my addr 172.21.15.69:0/4029287893 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f6946ffd640 1 --2- 172.21.15.69:0/4029287893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88620 0x560938d88a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f69477fe640 1 --2- 172.21.15.69:0/4029287893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d93800 0x560938d95bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f693ffff640 1 -- 172.21.15.69:0/4029287893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88620 msgr2=0x560938d88a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f693ffff640 1 --2- 172.21.15.69:0/4029287893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88620 0x560938d88a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f693ffff640 1 -- 172.21.15.69:0/4029287893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d93800 msgr2=0x560938d95bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f693ffff640 1 --2- 172.21.15.69:0/4029287893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d93800 0x560938d95bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f693ffff640 1 -- 172.21.15.69:0/4029287893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560938a00210 con 0x560938d88f40 2024-04-23T10:29:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f6946ffd640 1 --2- 172.21.15.69:0/4029287893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88620 0x560938d88a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:29:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f69477fe640 1 --2- 172.21.15.69:0/4029287893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d93800 0x560938d95bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:29:26.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f69477fe640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69340a3dc0 0x7f69340a6280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f694002f040 tx=0x7f69400363e0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f693ffff640 1 --2- 172.21.15.69:0/4029287893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d932c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f69300a51e0 tx=0x7f693009c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e25a72d3b7b6c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.204+0000 7f693dffb640 1 -- 172.21.15.69:0/4029287893 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69300a5710 con 0x560938d88f40 2024-04-23T10:29:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f693dffb640 1 -- 172.21.15.69:0/4029287893 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f693009ada0 con 0x560938d88f40 2024-04-23T10:29:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f693dffb640 1 -- 172.21.15.69:0/4029287893 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69300987f0 con 0x560938d88f40 2024-04-23T10:29:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f69507bc740 1 -- 172.21.15.69:0/4029287893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 msgr2=0x560938d932c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f69507bc740 1 --2- 172.21.15.69:0/4029287893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d932c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f69300a51e0 tx=0x7f693009c500 comp rx=0 tx=0).stop 2024-04-23T10:29:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f69507bc740 1 -- 172.21.15.69:0/4029287893 shutdown_connections 2024-04-23T10:29:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f69507bc740 1 --2- 172.21.15.69:0/4029287893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d932c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f69507bc740 1 --2- 172.21.15.69:0/4029287893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d93800 0x560938d95bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f69507bc740 1 --2- 172.21.15.69:0/4029287893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88620 0x560938d88a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f69507bc740 1 -- 172.21.15.69:0/4029287893 >> 172.21.15.69:0/4029287893 conn(0x560938d84b30 msgr2=0x560938d84f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f69507bc740 1 -- 172.21.15.69:0/4029287893 shutdown_connections 2024-04-23T10:29:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f69507bc740 1 -- 172.21.15.69:0/4029287893 wait complete. 2024-04-23T10:29:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.205+0000 7f69507bc740 1 -- start start 2024-04-23T10:29:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69507bc740 1 Processor -- start 2024-04-23T10:29:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69507bc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d93200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69507bc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88f40 0x560938d904f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69507bc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d90b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69507bc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560938d96370 con 0x560938d93800 2024-04-23T10:29:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69507bc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560938c880b0 con 0x560938d88620 2024-04-23T10:29:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69507bc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560938d964f0 con 0x560938d88f40 2024-04-23T10:29:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69507bc740 10 client.0 _ll_register_callbacks cb 0x560938c75d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69477fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d90b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f6946ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d93200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69477fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d90b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42920/0 (socket says 172.21.15.69:42920) 2024-04-23T10:29:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69477fe640 1 -- 172.21.15.69:0/1254968579 learned_addr learned my addr 172.21.15.69:0/1254968579 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f693ffff640 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88f40 0x560938d904f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f6946ffd640 1 -- 172.21.15.69:0/1254968579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88f40 msgr2=0x560938d904f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f6946ffd640 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88f40 0x560938d904f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f6946ffd640 1 -- 172.21.15.69:0/1254968579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 msgr2=0x560938d90b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f6946ffd640 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d90b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f6946ffd640 1 -- 172.21.15.69:0/1254968579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560938acc620 con 0x560938d88620 2024-04-23T10:29:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f69477fe640 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d90b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.206+0000 7f693ffff640 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88f40 0x560938d904f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f6946ffd640 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d93200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6938013560 tx=0x7f6938013a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ce13519775f9b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f6926ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-04-23T10:29:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f6926ffd640 1 -- 172.21.15.69:0/1254968579 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938004230 con 0x560938d88620 2024-04-23T10:29:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f6926ffd640 1 -- 172.21.15.69:0/1254968579 <== mon.2 v2:172.21.15.146:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f69380043d0 con 0x560938d88620 2024-04-23T10:29:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f69507bc740 1 -- 172.21.15.69:0/1254968579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f693009ada0 con 0x560938d88620 2024-04-23T10:29:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f6926ffd640 1 -- 172.21.15.69:0/1254968579 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6938011870 con 0x560938d88620 2024-04-23T10:29:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f69507bc740 10 client.25283 fetch_fsmap learned FSMap version 36 2024-04-23T10:29:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f69507bc740 1 -- 172.21.15.69:0/1254968579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x560938da22f0 con 0x560938d88620 2024-04-23T10:29:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f6926ffd640 1 -- 172.21.15.69:0/1254968579 <== mon.2 v2:172.21.15.146:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f693009ada0 con 0x560938d88620 2024-04-23T10:29:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f6926ffd640 1 -- 172.21.15.69:0/1254968579 <== mon.2 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f693801d440 con 0x560938d88620 2024-04-23T10:29:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f69507bc740 10 client.25283 fetch_fsmap finished waiting for FSMap version 36 2024-04-23T10:29:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f69507bc740 10 client.25283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:29:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f69507bc740 20 client.25283 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f69507bc740 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560938da3820 0x560938da5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f69507bc740 4 client.25283 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:29:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.207+0000 7f69507bc740 1 -- 172.21.15.69:0/1254968579 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560938cfb390 con 0x560938da3820 2024-04-23T10:29:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.208+0000 7f693ffff640 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560938da3820 0x560938da5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.208+0000 7f693ffff640 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560938da3820 0x560938da5c80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3f1bdaf17f416f1 server_cookie=c8117ae1c6f24764 in_seq=0 out_seq=0 2024-04-23T10:29:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.208+0000 7f6926ffd640 10 client.25283 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.208+0000 7f6926ffd640 1 -- 172.21.15.69:0/1254968579 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560938cfb390 con 0x560938da3820 2024-04-23T10:29:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.208+0000 7f6926ffd640 10 client.25283 handle_command_reply: tid=0 2024-04-23T10:29:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 1 client.25283 shutdown 2024-04-23T10:29:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 1 -- 172.21.15.69:0/1254968579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 msgr2=0x560938d93200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d93200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6938013560 tx=0x7f6938013a20 comp rx=0 tx=0).stop 2024-04-23T10:29:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 1 -- 172.21.15.69:0/1254968579 shutdown_connections 2024-04-23T10:29:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560938da3820 0x560938da5c80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d90b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88f40 0x560938d904f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 1 --2- 172.21.15.69:0/1254968579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d93200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f6926ffd640 0 client.25283 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 1 -- 172.21.15.69:0/1254968579 >> 172.21.15.69:0/1254968579 conn(0x560938d84b30 msgr2=0x560938d8a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:26.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 1 -- 172.21.15.69:0/1254968579 shutdown_connections 2024-04-23T10:29:26.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 1 -- 172.21.15.69:0/1254968579 wait complete. 2024-04-23T10:29:26.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.209+0000 7f69507bc740 20 client.25283 trim_cache size 0 max 16384 2024-04-23T10:29:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69507bc740 1 Processor -- start 2024-04-23T10:29:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69507bc740 1 -- start start 2024-04-23T10:29:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69507bc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d9f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69507bc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88f40 0x560938d8f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69507bc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d83b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69507bc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f69481adc30 con 0x560938d93800 2024-04-23T10:29:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69507bc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69481af8f0 con 0x560938d88620 2024-04-23T10:29:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69507bc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69481ae300 con 0x560938d88f40 2024-04-23T10:29:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69477fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d83b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69477fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d83b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42926/0 (socket says 172.21.15.69:42926) 2024-04-23T10:29:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69477fe640 1 -- 172.21.15.69:0/3558528212 learned_addr learned my addr 172.21.15.69:0/3558528212 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f6946ffd640 1 --2- 172.21.15.69:0/3558528212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d9f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f693ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88f40 0x560938d8f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69477fe640 1 -- 172.21.15.69:0/3558528212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88f40 msgr2=0x560938d8f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:26.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69477fe640 1 --2- 172.21.15.69:0/3558528212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88f40 0x560938d8f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69477fe640 1 -- 172.21.15.69:0/3558528212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 msgr2=0x560938d9f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69477fe640 1 --2- 172.21.15.69:0/3558528212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d9f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69477fe640 1 -- 172.21.15.69:0/3558528212 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560938da0470 con 0x560938d93800 2024-04-23T10:29:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f69477fe640 1 --2- 172.21.15.69:0/3558528212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d83b30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f69400099a0 tx=0x7f694003a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d126f681e56b2e9b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.224+0000 7f693d7fa640 1 -- 172.21.15.69:0/3558528212 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940033050 con 0x560938d93800 2024-04-23T10:29:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f693d7fa640 1 -- 172.21.15.69:0/3558528212 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f694002e860 con 0x560938d93800 2024-04-23T10:29:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f693d7fa640 1 -- 172.21.15.69:0/3558528212 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940004030 con 0x560938d93800 2024-04-23T10:29:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f69507bc740 1 -- 172.21.15.69:0/3558528212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 msgr2=0x560938d83b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f69507bc740 1 --2- 172.21.15.69:0/3558528212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d83b30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f69400099a0 tx=0x7f694003a040 comp rx=0 tx=0).stop 2024-04-23T10:29:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f69507bc740 1 -- 172.21.15.69:0/3558528212 shutdown_connections 2024-04-23T10:29:26.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f69507bc740 1 --2- 172.21.15.69:0/3558528212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d93800 0x560938d83b30 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f69507bc740 1 --2- 172.21.15.69:0/3558528212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d88f40 0x560938d8f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f69507bc740 1 --2- 172.21.15.69:0/3558528212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d9f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f69507bc740 1 -- 172.21.15.69:0/3558528212 >> 172.21.15.69:0/3558528212 conn(0x560938d84b30 msgr2=0x560938d83420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f69507bc740 1 -- 172.21.15.69:0/3558528212 shutdown_connections 2024-04-23T10:29:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f69507bc740 1 -- 172.21.15.69:0/3558528212 wait complete. 2024-04-23T10:29:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.225+0000 7f69507bc740 1 -- start start 2024-04-23T10:29:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f69507bc740 1 Processor -- start 2024-04-23T10:29:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f69507bc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d9b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f69507bc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d98d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f69507bc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d93800 0x560938d99250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f69507bc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f69481af220 con 0x560938d88f40 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f69507bc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69481aea90 con 0x560938d88620 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f69507bc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69481abc10 con 0x560938d93800 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f69507bc740 10 client.0 _ll_register_callbacks cb 0x7f6938009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f693ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d98d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f693ffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d98d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42936/0 (socket says 172.21.15.69:42936) 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f693ffff640 1 -- 172.21.15.69:0/168986250 learned_addr learned my addr 172.21.15.69:0/168986250 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f6946ffd640 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d9b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f69477fe640 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d93800 0x560938d99250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f693ffff640 1 -- 172.21.15.69:0/168986250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d93800 msgr2=0x560938d99250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f693ffff640 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d93800 0x560938d99250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f693ffff640 1 -- 172.21.15.69:0/168986250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 msgr2=0x560938d9b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:26.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f693ffff640 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d9b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f693ffff640 1 -- 172.21.15.69:0/168986250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560938d997e0 con 0x560938d88f40 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f693ffff640 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d98d10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f693009c4d0 tx=0x7f693009cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f38a58303144fbb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.226+0000 7f6926ffd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f6926ffd640 1 -- 172.21.15.69:0/168986250 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930010550 con 0x560938d88f40 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f6926ffd640 1 -- 172.21.15.69:0/168986250 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f69300106f0 con 0x560938d88f40 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f69507bc740 1 -- 172.21.15.69:0/168986250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f694002e860 con 0x560938d88f40 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f6926ffd640 1 -- 172.21.15.69:0/168986250 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f693009bef0 con 0x560938d88f40 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f69507bc740 10 client.15963 fetch_fsmap learned FSMap version 36 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f69507bc740 1 -- 172.21.15.69:0/168986250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x560938e09bf0 con 0x560938d88f40 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f6926ffd640 1 -- 172.21.15.69:0/168986250 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f694002e860 con 0x560938d88f40 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f6926ffd640 1 -- 172.21.15.69:0/168986250 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f693009b960 con 0x560938d88f40 2024-04-23T10:29:26.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f69507bc740 10 client.15963 fetch_fsmap finished waiting for FSMap version 36 2024-04-23T10:29:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f69507bc740 10 client.15963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:29:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f69507bc740 20 client.15963 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f69507bc740 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560938e0a040 0x560938e0c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f69507bc740 4 client.15963 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:29:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f69507bc740 1 -- 172.21.15.69:0/168986250 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560938cf5200 con 0x560938e0a040 2024-04-23T10:29:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.227+0000 7f6946ffd640 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560938e0a040 0x560938e0c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.228+0000 7f6946ffd640 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560938e0a040 0x560938e0c430 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d08b649d9cceed3 server_cookie=7755beb55f61c39e in_seq=0 out_seq=0 2024-04-23T10:29:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.228+0000 7f6926ffd640 10 client.15963 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.439+0000 7f6926ffd640 1 -- 172.21.15.69:0/168986250 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560938cf5200 con 0x560938e0a040 2024-04-23T10:29:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.439+0000 7f6926ffd640 10 client.15963 handle_command_reply: tid=0 2024-04-23T10:29:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.439+0000 7f69507bc740 1 client.15963 shutdown 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f69507bc740 1 -- 172.21.15.69:0/168986250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 msgr2=0x560938d98d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f69507bc740 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d98d10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f693009c4d0 tx=0x7f693009cc20 comp rx=0 tx=0).stop 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f69507bc740 1 -- 172.21.15.69:0/168986250 shutdown_connections 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f69507bc740 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x560938e0a040 0x560938e0c430 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f6926ffd640 0 client.15963 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f69507bc740 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560938d88f40 0x560938d98d10 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f69507bc740 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560938d93800 0x560938d99250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f69507bc740 1 --2- 172.21.15.69:0/168986250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560938d88620 0x560938d9b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f69507bc740 1 -- 172.21.15.69:0/168986250 >> 172.21.15.69:0/168986250 conn(0x560938d84b30 msgr2=0x560938d83cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f69507bc740 1 -- 172.21.15.69:0/168986250 shutdown_connections 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f69507bc740 1 -- 172.21.15.69:0/168986250 wait complete. 2024-04-23T10:29:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.440+0000 7f69507bc740 20 client.15963 trim_cache size 0 max 16384 2024-04-23T10:29:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:29:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:29:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:29:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:29:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 -- 172.21.15.69:0/160818944 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69340a3dc0 msgr2=0x7f69340a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69340a3dc0 0x7f69340a6280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f694002f040 tx=0x7f69400363e0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 -- 172.21.15.69:0/160818944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6948103b00 msgr2=0x7f694819eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6948103b00 0x7f694819eaf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f693000e9f0 tx=0x7f693000eeb0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 -- 172.21.15.69:0/160818944 shutdown_connections 2024-04-23T10:29:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f69340a3dc0 0x7f69340a6280 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f694810c520 0x7f6948198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6948103b00 0x7f694819eaf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 --2- 172.21.15.69:0/160818944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69481031e0 0x7f694819e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 -- 172.21.15.69:0/160818944 >> 172.21.15.69:0/160818944 conn(0x7f6948077fd0 msgr2=0x7f69480ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 -- 172.21.15.69:0/160818944 shutdown_connections 2024-04-23T10:29:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:26.441+0000 7f694d9c6640 1 -- 172.21.15.69:0/160818944 wait complete. 2024-04-23T10:29:26.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:26 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:26.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:26 smithi167 ceph-mon[32940]: pgmap v80: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 1.11k op/s 2024-04-23T10:29:26.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:26 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:26.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:26 smithi146 ceph-mon[32800]: pgmap v80: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 1.11k op/s 2024-04-23T10:29:26.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:26 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:26.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:26 smithi069 ceph-mon[29593]: pgmap v80: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 1.11k op/s 2024-04-23T10:29:28.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:28 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:28.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:28 smithi167 ceph-mon[32940]: pgmap v81: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 341 op/s 2024-04-23T10:29:28.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:28 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:28.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:28 smithi146 ceph-mon[32800]: pgmap v81: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 341 op/s 2024-04-23T10:29:28.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:28 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:28.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:28 smithi069 ceph-mon[29593]: pgmap v81: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 341 op/s 2024-04-23T10:29:30.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:30 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:30.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:30 smithi167 ceph-mon[32940]: pgmap v82: 97 pgs: 97 active+clean; 188 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 640 op/s 2024-04-23T10:29:30.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:30 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:30.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:30 smithi146 ceph-mon[32800]: pgmap v82: 97 pgs: 97 active+clean; 188 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 640 op/s 2024-04-23T10:29:30.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:30 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:30.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:30 smithi069 ceph-mon[29593]: pgmap v82: 97 pgs: 97 active+clean; 188 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 640 op/s 2024-04-23T10:29:32.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:32 smithi146 ceph-mon[32800]: pgmap v83: 97 pgs: 97 active+clean; 188 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 548 op/s 2024-04-23T10:29:32.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:32 smithi069 ceph-mon[29593]: pgmap v83: 97 pgs: 97 active+clean; 188 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 548 op/s 2024-04-23T10:29:32.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:32 smithi167 ceph-mon[32940]: pgmap v83: 97 pgs: 97 active+clean; 188 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 548 op/s 2024-04-23T10:29:33.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:33 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:33.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:33 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:33.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:33 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:34.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:34 smithi146 ceph-mon[32800]: pgmap v84: 97 pgs: 97 active+clean; 188 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 548 op/s 2024-04-23T10:29:34.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:34 smithi069 ceph-mon[29593]: pgmap v84: 97 pgs: 97 active+clean; 188 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 548 op/s 2024-04-23T10:29:34.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:34 smithi167 ceph-mon[32940]: pgmap v84: 97 pgs: 97 active+clean; 188 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 548 op/s 2024-04-23T10:29:35.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:35 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:35.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:35 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:35.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:35 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:29:36.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:36 smithi146 ceph-mon[32800]: pgmap v85: 97 pgs: 97 active+clean; 189 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 701 op/s 2024-04-23T10:29:36.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:36 smithi069 ceph-mon[29593]: pgmap v85: 97 pgs: 97 active+clean; 189 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 701 op/s 2024-04-23T10:29:36.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:36 smithi167 ceph-mon[32940]: pgmap v85: 97 pgs: 97 active+clean; 189 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 701 op/s 2024-04-23T10:29:37.059 INFO:tasks.workunit.client.0.smithi069.stderr:+ tar xf doc.tar 2024-04-23T10:29:38.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:38 smithi146 ceph-mon[32800]: pgmap v86: 97 pgs: 97 active+clean; 189 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 451 op/s 2024-04-23T10:29:38.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:38 smithi069 ceph-mon[29593]: pgmap v86: 97 pgs: 97 active+clean; 189 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 451 op/s 2024-04-23T10:29:38.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:38 smithi167 ceph-mon[32940]: pgmap v86: 97 pgs: 97 active+clean; 189 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 451 op/s 2024-04-23T10:29:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.529+0000 7f1cf114a640 1 -- 172.21.15.69:0/2940304061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cec1010f0 msgr2=0x7f1cec1014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.529+0000 7f1cf114a640 1 --2- 172.21.15.69:0/2940304061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cec1010f0 0x7f1cec1014d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009900 tx=0x7f1cdc02a410 comp rx=0 tx=0).stop 2024-04-23T10:29:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.529+0000 7f1cf114a640 1 -- 172.21.15.69:0/2940304061 shutdown_connections 2024-04-23T10:29:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.529+0000 7f1cf114a640 1 --2- 172.21.15.69:0/2940304061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cec106170 0x7f1cec10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.529+0000 7f1cf114a640 1 --2- 172.21.15.69:0/2940304061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cec101aa0 0x7f1cec105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.529+0000 7f1cf114a640 1 --2- 172.21.15.69:0/2940304061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cec1010f0 0x7f1cec1014d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.529+0000 7f1cf114a640 1 -- 172.21.15.69:0/2940304061 >> 172.21.15.69:0/2940304061 conn(0x7f1cec077fd0 msgr2=0x7f1cec0783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.529+0000 7f1cf114a640 1 -- 172.21.15.69:0/2940304061 shutdown_connections 2024-04-23T10:29:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.529+0000 7f1cf114a640 1 -- 172.21.15.69:0/2940304061 wait complete. 2024-04-23T10:29:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cf114a640 1 Processor -- start 2024-04-23T10:29:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cf114a640 1 -- start start 2024-04-23T10:29:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cf114a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cec1010f0 0x7f1cec19e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cf114a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cec106170 0x7f1cec19eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cf114a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cec198640 0x7f1cec198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cf114a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec112360 con 0x7f1cec198640 2024-04-23T10:29:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cf114a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1121e0 con 0x7f1cec1010f0 2024-04-23T10:29:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cf114a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1124e0 con 0x7f1cec106170 2024-04-23T10:29:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1ceb59e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cec198640 0x7f1cec198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cea59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cec106170 0x7f1cec19eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1ceb59e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cec198640 0x7f1cec198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60260/0 (socket says 172.21.15.69:60260) 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1ceb59e640 1 -- 172.21.15.69:0/110833968 learned_addr learned my addr 172.21.15.69:0/110833968 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cead9d640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cec1010f0 0x7f1cec19e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cea59c640 1 -- 172.21.15.69:0/110833968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cec1010f0 msgr2=0x7f1cec19e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.530+0000 7f1cea59c640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cec1010f0 0x7f1cec19e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.531+0000 7f1cea59c640 1 -- 172.21.15.69:0/110833968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cec198640 msgr2=0x7f1cec198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.531+0000 7f1cea59c640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cec198640 0x7f1cec198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.531+0000 7f1cea59c640 1 -- 172.21.15.69:0/110833968 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cec199240 con 0x7f1cec106170 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.531+0000 7f1ceb59e640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cec198640 0x7f1cec198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.531+0000 7f1cea59c640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cec106170 0x7f1cec19eac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000e9c0 tx=0x7f1ce000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.531+0000 7f1cd3fff640 1 -- 172.21.15.69:0/110833968 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000ccc0 con 0x7f1cec106170 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.531+0000 7f1cf114a640 1 -- 172.21.15.69:0/110833968 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cec1a5320 con 0x7f1cec106170 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.531+0000 7f1cd3fff640 1 -- 172.21.15.69:0/110833968 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1ce0005020 con 0x7f1cec106170 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.531+0000 7f1cd3fff640 1 -- 172.21.15.69:0/110833968 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0004a00 con 0x7f1cec106170 2024-04-23T10:29:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.531+0000 7f1cf114a640 1 -- 172.21.15.69:0/110833968 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cec1a5720 con 0x7f1cec106170 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.533+0000 7f1cd3fff640 1 -- 172.21.15.69:0/110833968 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f1ce00051d0 con 0x7f1cec106170 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.533+0000 7f1cf3e5c740 1 Processor -- start 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.533+0000 7f1cf3e5c740 1 -- start start 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f53a30 0x55dee7f53e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f5ec10 0x55dee7f61000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dee7eb4970 con 0x55dee7f54350 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dee7e514a0 con 0x55dee7f5ec10 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dee7eb0930 con 0x55dee7f53a30 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cead9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cd3fff640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1cd40a3dc0 0x7f1cd40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cead9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60274/0 (socket says 172.21.15.69:60274) 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1ceb59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f53a30 0x55dee7f53e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cead9d640 1 -- 172.21.15.69:0/2001547875 learned_addr learned my addr 172.21.15.69:0/2001547875 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cea59c640 1 --2- 172.21.15.69:0/2001547875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f5ec10 0x55dee7f61000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1ceb59e640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1cd40a3dc0 0x7f1cd40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cead9d640 1 -- 172.21.15.69:0/2001547875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f53a30 msgr2=0x55dee7f53e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cead9d640 1 --2- 172.21.15.69:0/2001547875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f53a30 0x55dee7f53e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cead9d640 1 -- 172.21.15.69:0/2001547875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f5ec10 msgr2=0x55dee7f61000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cead9d640 1 --2- 172.21.15.69:0/2001547875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f5ec10 0x55dee7f61000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cead9d640 1 -- 172.21.15.69:0/2001547875 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dee7bc7210 con 0x55dee7f54350 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cd3fff640 1 -- 172.21.15.69:0/110833968 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f1ce00d0850 con 0x7f1cec106170 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cead9d640 1 --2- 172.21.15.69:0/2001547875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5e6d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009900 tx=0x7f1cdc004150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda982ab10e057d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1ceb59e640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1cd40a3dc0 0x7f1cd40a6280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4007c50 tx=0x7f1ce4004ab0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.534+0000 7f1cd17fa640 1 -- 172.21.15.69:0/2001547875 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc035030 con 0x55dee7f54350 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.535+0000 7f1cd17fa640 1 -- 172.21.15.69:0/2001547875 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1cdc005510 con 0x55dee7f54350 2024-04-23T10:29:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.535+0000 7f1cd17fa640 1 -- 172.21.15.69:0/2001547875 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0035f0 con 0x55dee7f54350 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.535+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/2001547875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 msgr2=0x55dee7f5e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.535+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/2001547875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5e6d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009900 tx=0x7f1cdc004150 comp rx=0 tx=0).stop 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.535+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/2001547875 shutdown_connections 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.535+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/2001547875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5e6d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.535+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/2001547875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f5ec10 0x55dee7f61000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.535+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/2001547875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f53a30 0x55dee7f53e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.535+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/2001547875 >> 172.21.15.69:0/2001547875 conn(0x55dee7f4ff40 msgr2=0x55dee7f50320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.535+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/2001547875 shutdown_connections 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.535+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/2001547875 wait complete. 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cf3e5c740 1 -- start start 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cf3e5c740 1 Processor -- start 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f53a30 0x55dee7f5e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f5ec10 0x55dee7f5bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dee7f617e0 con 0x55dee7f54350 2024-04-23T10:29:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dee7e4f0b0 con 0x55dee7f5ec10 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dee7f61960 con 0x55dee7f53a30 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cf3e5c740 10 client.0 _ll_register_callbacks cb 0x55dee7e3cd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cea59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cea59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60286/0 (socket says 172.21.15.69:60286) 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cea59c640 1 -- 172.21.15.69:0/906465458 learned_addr learned my addr 172.21.15.69:0/906465458 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cead9d640 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f53a30 0x55dee7f5e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1ceb59e640 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f5ec10 0x55dee7f5bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cea59c640 1 -- 172.21.15.69:0/906465458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f53a30 msgr2=0x55dee7f5e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cea59c640 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f53a30 0x55dee7f5e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cea59c640 1 -- 172.21.15.69:0/906465458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f5ec10 msgr2=0x55dee7f5bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cea59c640 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f5ec10 0x55dee7f5bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.536+0000 7f1cea59c640 1 -- 172.21.15.69:0/906465458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dee7c93620 con 0x55dee7f54350 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cea59c640 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5b860 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0098c80 tx=0x7f1ce006e260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190956e28429604e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cceff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:29:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cceff5640 1 -- 172.21.15.69:0/906465458 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce006d070 con 0x55dee7f54350 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/906465458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cdc005510 con 0x55dee7f54350 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cceff5640 1 -- 172.21.15.69:0/906465458 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f1ce0098e90 con 0x55dee7f54350 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cceff5640 1 -- 172.21.15.69:0/906465458 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f1ce001c030 con 0x55dee7f54350 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cf3e5c740 10 client.15975 fetch_fsmap learned FSMap version 40 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/906465458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55dee7f6d7c0 con 0x55dee7f54350 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cceff5640 1 -- 172.21.15.69:0/906465458 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1cdc005510 con 0x55dee7f54350 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cceff5640 1 -- 172.21.15.69:0/906465458 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f1ce00a5090 con 0x55dee7f54350 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cf3e5c740 10 client.15975 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cf3e5c740 10 client.15975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cf3e5c740 20 client.15975 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dee7f6ec80 0x55dee7f710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cf3e5c740 4 client.15975 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/906465458 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dee7ec2390 con 0x55dee7f6ec80 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.537+0000 7f1cead9d640 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dee7f6ec80 0x55dee7f710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.538+0000 7f1cceff5640 10 client.15975 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.538+0000 7f1cead9d640 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dee7f6ec80 0x55dee7f710d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=315bc8d03c4b73b3 server_cookie=3385d6bd6193c36d in_seq=0 out_seq=0 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cceff5640 1 -- 172.21.15.69:0/906465458 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dee7ec2390 con 0x55dee7f6ec80 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cceff5640 10 client.15975 handle_command_reply: tid=0 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 1 client.15975 shutdown 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/906465458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 msgr2=0x55dee7f5b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5b860 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0098c80 tx=0x7f1ce006e260 comp rx=0 tx=0).stop 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/906465458 shutdown_connections 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dee7f6ec80 0x55dee7f710d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f54350 0x55dee7f5b860 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f5ec10 0x55dee7f5bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cceff5640 0 client.15975 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/906465458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f53a30 0x55dee7f5e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/906465458 >> 172.21.15.69:0/906465458 conn(0x55dee7f4ff40 msgr2=0x55dee7f4acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/906465458 shutdown_connections 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/906465458 wait complete. 2024-04-23T10:29:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.539+0000 7f1cf3e5c740 20 client.15975 trim_cache size 0 max 16384 2024-04-23T10:29:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.554+0000 7f1cf3e5c740 1 Processor -- start 2024-04-23T10:29:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cf3e5c740 1 -- start start 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f6a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f54350 0x55dee7f5e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f5ec10 0x55dee7f769a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1ab980 con 0x55dee7f53a30 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1ad700 con 0x55dee7f54350 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1ac110 con 0x55dee7f5ec10 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cead9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f6a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cead9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f6a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60290/0 (socket says 172.21.15.69:60290) 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cead9d640 1 -- 172.21.15.69:0/4116997654 learned_addr learned my addr 172.21.15.69:0/4116997654 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1ceb59e640 1 --2- 172.21.15.69:0/4116997654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f5ec10 0x55dee7f769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cead9d640 1 -- 172.21.15.69:0/4116997654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f5ec10 msgr2=0x55dee7f769a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cead9d640 1 --2- 172.21.15.69:0/4116997654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f5ec10 0x55dee7f769a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cead9d640 1 -- 172.21.15.69:0/4116997654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f54350 msgr2=0x55dee7f5e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cea59c640 1 --2- 172.21.15.69:0/4116997654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f54350 0x55dee7f5e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cead9d640 1 --2- 172.21.15.69:0/4116997654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f54350 0x55dee7f5e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cead9d640 1 -- 172.21.15.69:0/4116997654 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dee7f50b10 con 0x55dee7f53a30 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1ceb59e640 1 --2- 172.21.15.69:0/4116997654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f5ec10 0x55dee7f769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cea59c640 1 --2- 172.21.15.69:0/4116997654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f54350 0x55dee7f5e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cead9d640 1 --2- 172.21.15.69:0/4116997654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f6a6a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc004b70 tx=0x7f1cdc004ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26f033fc2c322a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cd0ff9640 1 -- 172.21.15.69:0/4116997654 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc035040 con 0x55dee7f53a30 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cd0ff9640 1 -- 172.21.15.69:0/4116997654 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1cdc0048c0 con 0x55dee7f53a30 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.555+0000 7f1cd0ff9640 1 -- 172.21.15.69:0/4116997654 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0503e0 con 0x55dee7f53a30 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.556+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/4116997654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 msgr2=0x55dee7f6a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.556+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/4116997654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f6a6a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc004b70 tx=0x7f1cdc004ba0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.556+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/4116997654 shutdown_connections 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.556+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/4116997654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f5ec10 0x55dee7f769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.556+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/4116997654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f54350 0x55dee7f5e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.556+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/4116997654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f6a6a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.556+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/4116997654 >> 172.21.15.69:0/4116997654 conn(0x55dee7f4ff40 msgr2=0x55dee7f56f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.556+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/4116997654 shutdown_connections 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.556+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/4116997654 wait complete. 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.556+0000 7f1cf3e5c740 1 -- start start 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.556+0000 7f1cf3e5c740 1 Processor -- start 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f62c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f54350 0x55dee7f63160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cf3e5c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f5ec10 0x55dee7fd4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1ad030 con 0x55dee7f53a30 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1ac8a0 con 0x55dee7f54350 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cf3e5c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1a98c0 con 0x55dee7f5ec10 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cf3e5c740 10 client.0 _ll_register_callbacks cb 0x7f1ce009c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cead9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f62c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cead9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f62c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60304/0 (socket says 172.21.15.69:60304) 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cead9d640 1 -- 172.21.15.69:0/3875015359 learned_addr learned my addr 172.21.15.69:0/3875015359 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cea59c640 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f54350 0x55dee7f63160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1ceb59e640 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f5ec10 0x55dee7fd4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cead9d640 1 -- 172.21.15.69:0/3875015359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f5ec10 msgr2=0x55dee7fd4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cead9d640 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f5ec10 0x55dee7fd4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cead9d640 1 -- 172.21.15.69:0/3875015359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f54350 msgr2=0x55dee7f63160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cead9d640 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f54350 0x55dee7f63160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.557+0000 7f1cead9d640 1 -- 172.21.15.69:0/3875015359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dee7fd4750 con 0x55dee7f53a30 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cead9d640 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f62c20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc000c00 tx=0x7f1cdc004150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e959f2527c785f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cceff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cceff5640 1 -- 172.21.15.69:0/3875015359 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc035070 con 0x55dee7f53a30 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cceff5640 1 -- 172.21.15.69:0/3875015359 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f1cdc050370 con 0x55dee7f53a30 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/3875015359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cdc0048c0 con 0x55dee7f53a30 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cceff5640 1 -- 172.21.15.69:0/3875015359 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f1cdc050570 con 0x55dee7f53a30 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cf3e5c740 10 client.15981 fetch_fsmap learned FSMap version 40 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/3875015359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55dee7fd5900 con 0x55dee7f53a30 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cceff5640 1 -- 172.21.15.69:0/3875015359 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1cdc0048c0 con 0x55dee7f53a30 2024-04-23T10:29:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cceff5640 1 -- 172.21.15.69:0/3875015359 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f1cdc004d30 con 0x55dee7f53a30 2024-04-23T10:29:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cf3e5c740 10 client.15981 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:29:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cf3e5c740 10 client.15981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:29:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cf3e5c740 20 client.15981 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dee7fd5b80 0x55dee7fd7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cf3e5c740 4 client.15981 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:29:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/3875015359 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dee7ebc200 con 0x55dee7fd5b80 2024-04-23T10:29:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.558+0000 7f1cea59c640 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dee7fd5b80 0x55dee7fd7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.559+0000 7f1cceff5640 10 client.15981 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:39.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.559+0000 7f1cea59c640 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dee7fd5b80 0x55dee7fd7fa0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a616918f8f053989 server_cookie=31d6d57457550799 in_seq=0 out_seq=0 2024-04-23T10:29:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cceff5640 1 -- 172.21.15.69:0/3875015359 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dee7ebc200 con 0x55dee7fd5b80 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cceff5640 10 client.15981 handle_command_reply: tid=0 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cf3e5c740 1 client.15981 shutdown 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/3875015359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 msgr2=0x55dee7f62c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f62c20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc000c00 tx=0x7f1cdc004150 comp rx=0 tx=0).stop 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/3875015359 shutdown_connections 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dee7fd5b80 0x55dee7fd7fa0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dee7f5ec10 0x55dee7fd4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cceff5640 0 client.15981 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dee7f54350 0x55dee7f63160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cf3e5c740 1 --2- 172.21.15.69:0/3875015359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dee7f53a30 0x55dee7f62c20 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/3875015359 >> 172.21.15.69:0/3875015359 conn(0x55dee7f4ff40 msgr2=0x55dee7f4a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/3875015359 shutdown_connections 2024-04-23T10:29:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.672+0000 7f1cf3e5c740 1 -- 172.21.15.69:0/3875015359 wait complete. 2024-04-23T10:29:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf3e5c740 20 client.15981 trim_cache size 0 max 16384 2024-04-23T10:29:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:29:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:29:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:29:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 -- 172.21.15.69:0/110833968 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1cd40a3dc0 msgr2=0x7f1cd40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1cd40a3dc0 0x7f1cd40a6280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4007c50 tx=0x7f1ce4004ab0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 -- 172.21.15.69:0/110833968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cec106170 msgr2=0x7f1cec19eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cec106170 0x7f1cec19eac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000e9c0 tx=0x7f1ce000ee80 comp rx=0 tx=0).stop 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 -- 172.21.15.69:0/110833968 shutdown_connections 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1cd40a3dc0 0x7f1cd40a6280 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cec198640 0x7f1cec198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cec106170 0x7f1cec19eac0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 --2- 172.21.15.69:0/110833968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cec1010f0 0x7f1cec19e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 -- 172.21.15.69:0/110833968 >> 172.21.15.69:0/110833968 conn(0x7f1cec077fd0 msgr2=0x7f1cec0fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 -- 172.21.15.69:0/110833968 shutdown_connections 2024-04-23T10:29:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:39.673+0000 7f1cf114a640 1 -- 172.21.15.69:0/110833968 wait complete. 2024-04-23T10:29:40.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:40 smithi146 ceph-mon[32800]: pgmap v87: 97 pgs: 97 active+clean; 188 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 604 op/s 2024-04-23T10:29:40.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:40 smithi069 ceph-mon[29593]: pgmap v87: 97 pgs: 97 active+clean; 188 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 604 op/s 2024-04-23T10:29:40.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:40 smithi167 ceph-mon[32940]: pgmap v87: 97 pgs: 97 active+clean; 188 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 604 op/s 2024-04-23T10:29:42.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:42 smithi146 ceph-mon[32800]: pgmap v88: 97 pgs: 97 active+clean; 188 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 305 op/s 2024-04-23T10:29:42.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:42 smithi069 ceph-mon[29593]: pgmap v88: 97 pgs: 97 active+clean; 188 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 305 op/s 2024-04-23T10:29:42.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:42 smithi167 ceph-mon[32940]: pgmap v88: 97 pgs: 97 active+clean; 188 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 305 op/s 2024-04-23T10:29:44.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:44 smithi146 ceph-mon[32800]: pgmap v89: 97 pgs: 97 active+clean; 188 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 305 op/s 2024-04-23T10:29:44.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:44 smithi069 ceph-mon[29593]: pgmap v89: 97 pgs: 97 active+clean; 188 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 305 op/s 2024-04-23T10:29:44.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:44 smithi167 ceph-mon[32940]: pgmap v89: 97 pgs: 97 active+clean; 188 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 305 op/s 2024-04-23T10:29:44.854 INFO:tasks.workunit.client.0.smithi069.stderr:+ sync 2024-04-23T10:29:46.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:46 smithi146 ceph-mon[32800]: pgmap v90: 97 pgs: 97 active+clean; 188 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 375 op/s 2024-04-23T10:29:46.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:46 smithi069 ceph-mon[29593]: pgmap v90: 97 pgs: 97 active+clean; 188 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 375 op/s 2024-04-23T10:29:46.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:46 smithi167 ceph-mon[32940]: pgmap v90: 97 pgs: 97 active+clean; 188 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 375 op/s 2024-04-23T10:29:48.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:48 smithi146 ceph-mon[32800]: pgmap v91: 97 pgs: 97 active+clean; 188 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 222 op/s 2024-04-23T10:29:48.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:48 smithi069 ceph-mon[29593]: pgmap v91: 97 pgs: 97 active+clean; 188 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 222 op/s 2024-04-23T10:29:48.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:48 smithi167 ceph-mon[32940]: pgmap v91: 97 pgs: 97 active+clean; 188 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 222 op/s 2024-04-23T10:29:49.188 INFO:tasks.workunit.client.0.smithi069.stderr:+ tar c linux-4.0.5 2024-04-23T10:29:49.669 INFO:tasks.workunit.client.0.smithi069.stdout:Ok 2024-04-23T10:29:49.670 INFO:tasks.workunit.client.0.smithi069.stderr:+ echo Ok 2024-04-23T10:29:49.670 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-23T10:29:49.671 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-23T10:29:50.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:50 smithi146 ceph-mon[32800]: pgmap v92: 97 pgs: 97 active+clean; 216 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 547 op/s 2024-04-23T10:29:50.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:50 smithi069 ceph-mon[29593]: pgmap v92: 97 pgs: 97 active+clean; 216 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 547 op/s 2024-04-23T10:29:50.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:50 smithi167 ceph-mon[32940]: pgmap v92: 97 pgs: 97 active+clean; 216 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 547 op/s 2024-04-23T10:29:52.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:52 smithi146 ceph-mon[32800]: pgmap v93: 97 pgs: 97 active+clean; 216 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 394 op/s 2024-04-23T10:29:52.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:52 smithi069 ceph-mon[29593]: pgmap v93: 97 pgs: 97 active+clean; 216 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 394 op/s 2024-04-23T10:29:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.763+0000 7f6741c74640 1 -- 172.21.15.69:0/895635611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f673c106170 msgr2=0x7f673c10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.763+0000 7f6741c74640 1 --2- 172.21.15.69:0/895635611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f673c106170 0x7f673c10dd40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6734009ca0 tx=0x7f673402a8c0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.763+0000 7f6741c74640 1 -- 172.21.15.69:0/895635611 shutdown_connections 2024-04-23T10:29:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.763+0000 7f6741c74640 1 --2- 172.21.15.69:0/895635611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f673c106170 0x7f673c10dd40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.763+0000 7f6741c74640 1 --2- 172.21.15.69:0/895635611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f673c101aa0 0x7f673c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.763+0000 7f6741c74640 1 --2- 172.21.15.69:0/895635611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f673c1010f0 0x7f673c1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.763+0000 7f6741c74640 1 -- 172.21.15.69:0/895635611 >> 172.21.15.69:0/895635611 conn(0x7f673c077fd0 msgr2=0x7f673c0783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.763+0000 7f6741c74640 1 -- 172.21.15.69:0/895635611 shutdown_connections 2024-04-23T10:29:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.763+0000 7f6741c74640 1 -- 172.21.15.69:0/895635611 wait complete. 2024-04-23T10:29:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f6741c74640 1 Processor -- start 2024-04-23T10:29:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f6741c74640 1 -- start start 2024-04-23T10:29:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f6741c74640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f673c1010f0 0x7f673c198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f6741c74640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f673c106170 0x7f673c198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f6741c74640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f673c19cfc0 0x7f673c19d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f6741c74640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f673c111210 con 0x7f673c1010f0 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f6741c74640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f673c111090 con 0x7f673c19cfc0 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f6741c74640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f673c111390 con 0x7f673c106170 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f673b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f673c1010f0 0x7f673c198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f673b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f673c1010f0 0x7f673c198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35548/0 (socket says 172.21.15.69:35548) 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f673b7fe640 1 -- 172.21.15.69:0/3523964486 learned_addr learned my addr 172.21.15.69:0/3523964486 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f673affd640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f673c106170 0x7f673c198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f673bfff640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f673c19cfc0 0x7f673c19d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f673b7fe640 1 -- 172.21.15.69:0/3523964486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f673c106170 msgr2=0x7f673c198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f673b7fe640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f673c106170 0x7f673c198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f673b7fe640 1 -- 172.21.15.69:0/3523964486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f673c19cfc0 msgr2=0x7f673c19d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f673b7fe640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f673c19cfc0 0x7f673c19d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.764+0000 7f673b7fe640 1 -- 172.21.15.69:0/3523964486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673c19dab0 con 0x7f673c1010f0 2024-04-23T10:29:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.765+0000 7f673b7fe640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f673c1010f0 0x7f673c198700 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f672c00e9f0 tx=0x7f672c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.765+0000 7f6738ff9640 1 -- 172.21.15.69:0/3523964486 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c00cd80 con 0x7f673c1010f0 2024-04-23T10:29:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.765+0000 7f6738ff9640 1 -- 172.21.15.69:0/3523964486 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f672c0054f0 con 0x7f673c1010f0 2024-04-23T10:29:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.765+0000 7f6738ff9640 1 -- 172.21.15.69:0/3523964486 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c010690 con 0x7f673c1010f0 2024-04-23T10:29:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.765+0000 7f6741c74640 1 -- 172.21.15.69:0/3523964486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673c19dda0 con 0x7f673c1010f0 2024-04-23T10:29:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.765+0000 7f6741c74640 1 -- 172.21.15.69:0/3523964486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f673c1a5590 con 0x7f673c1010f0 2024-04-23T10:29:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.767+0000 7f6738ff9640 1 -- 172.21.15.69:0/3523964486 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f672c0046c0 con 0x7f673c1010f0 2024-04-23T10:29:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.767+0000 7f6744982740 1 Processor -- start 2024-04-23T10:29:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.767+0000 7f6744982740 1 -- start start 2024-04-23T10:29:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.767+0000 7f6744982740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e89a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.767+0000 7f6744982740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e942c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.767+0000 7f6744982740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e96bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.767+0000 7f6744982740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5633b7dee970 con 0x5633b7e94800 2024-04-23T10:29:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.767+0000 7f6744982740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5633b7d8b4a0 con 0x5633b7e89620 2024-04-23T10:29:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f6744982740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5633b7dea930 con 0x5633b7e89f40 2024-04-23T10:29:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f6738ff9640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f67240a3e40 0x7f67240a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e96bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e96bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35556/0 (socket says 172.21.15.69:35556) 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673affd640 1 -- 172.21.15.69:0/960202018 learned_addr learned my addr 172.21.15.69:0/960202018 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673bfff640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f67240a3e40 0x7f67240a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f6738ff9640 1 -- 172.21.15.69:0/3523964486 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f672c0d0ad0 con 0x7f673c1010f0 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673b7fe640 1 --2- 172.21.15.69:0/960202018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e942c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673bfff640 1 --2- 172.21.15.69:0/960202018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e89a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673affd640 1 -- 172.21.15.69:0/960202018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 msgr2=0x5633b7e942c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673affd640 1 --2- 172.21.15.69:0/960202018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e942c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673affd640 1 -- 172.21.15.69:0/960202018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 msgr2=0x5633b7e89a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673affd640 1 --2- 172.21.15.69:0/960202018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e89a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673affd640 1 -- 172.21.15.69:0/960202018 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b7b01210 con 0x5633b7e94800 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673affd640 1 --2- 172.21.15.69:0/960202018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e96bf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f673000bbd0 tx=0x7f67300107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c019c8a839254e19 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f673bfff640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f67240a3e40 0x7f67240a6300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f673402f500 tx=0x7f673402f310 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f6721ffb640 1 -- 172.21.15.69:0/960202018 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673001c480 con 0x5633b7e94800 2024-04-23T10:29:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f6721ffb640 1 -- 172.21.15.69:0/960202018 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6730011910 con 0x5633b7e94800 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.768+0000 7f6721ffb640 1 -- 172.21.15.69:0/960202018 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673001a8a0 con 0x5633b7e94800 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.769+0000 7f6744982740 1 -- 172.21.15.69:0/960202018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 msgr2=0x5633b7e96bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.769+0000 7f6744982740 1 --2- 172.21.15.69:0/960202018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e96bf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f673000bbd0 tx=0x7f67300107a0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.769+0000 7f6744982740 1 -- 172.21.15.69:0/960202018 shutdown_connections 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.769+0000 7f6744982740 1 --2- 172.21.15.69:0/960202018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e96bf0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.769+0000 7f6744982740 1 --2- 172.21.15.69:0/960202018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e942c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.769+0000 7f6744982740 1 --2- 172.21.15.69:0/960202018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e89a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.769+0000 7f6744982740 1 -- 172.21.15.69:0/960202018 >> 172.21.15.69:0/960202018 conn(0x5633b7e85b30 msgr2=0x5633b7e85f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.769+0000 7f6744982740 1 -- 172.21.15.69:0/960202018 shutdown_connections 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.769+0000 7f6744982740 1 -- 172.21.15.69:0/960202018 wait complete. 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.769+0000 7f6744982740 1 -- start start 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f6744982740 1 Processor -- start 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f6744982740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e94130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f6744982740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e91420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f6744982740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e91960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f6744982740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5633b7e97430 con 0x5633b7e94800 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f6744982740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5633b7d890b0 con 0x5633b7e89620 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f6744982740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5633b7e975b0 con 0x5633b7e89f40 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f6744982740 10 client.0 _ll_register_callbacks cb 0x5633b7d76d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f673bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e91960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f673bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e91960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35570/0 (socket says 172.21.15.69:35570) 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f673bfff640 1 -- 172.21.15.69:0/1967943566 learned_addr learned my addr 172.21.15.69:0/1967943566 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f673b7fe640 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e94130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f673affd640 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e91420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f673bfff640 1 -- 172.21.15.69:0/1967943566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 msgr2=0x5633b7e91420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f673bfff640 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e91420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f673bfff640 1 -- 172.21.15.69:0/1967943566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 msgr2=0x5633b7e94130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f673bfff640 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e94130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.770+0000 7f673bfff640 1 -- 172.21.15.69:0/1967943566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b7bcd620 con 0x5633b7e94800 2024-04-23T10:29:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f673bfff640 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e91960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6734035000 tx=0x7f673402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1645878004ab405 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f671affd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f671affd640 1 -- 172.21.15.69:0/1967943566 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734051070 con 0x5633b7e94800 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f671affd640 1 -- 172.21.15.69:0/1967943566 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f6734031660 con 0x5633b7e94800 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f6744982740 1 -- 172.21.15.69:0/1967943566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6730011910 con 0x5633b7e94800 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f671affd640 1 -- 172.21.15.69:0/1967943566 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f673405d050 con 0x5633b7e94800 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f6744982740 10 client.15993 fetch_fsmap learned FSMap version 40 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f6744982740 1 -- 172.21.15.69:0/1967943566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5633b7ea3340 con 0x5633b7e94800 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f671affd640 1 -- 172.21.15.69:0/1967943566 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6730011910 con 0x5633b7e94800 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f671affd640 1 -- 172.21.15.69:0/1967943566 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f673402f660 con 0x5633b7e94800 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f6744982740 10 client.15993 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f6744982740 10 client.15993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f6744982740 20 client.15993 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f6744982740 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5633b7ea48c0 0x5633b7ea6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f6744982740 4 client.15993 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f6744982740 1 -- 172.21.15.69:0/1967943566 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633b7dfc390 con 0x5633b7ea48c0 2024-04-23T10:29:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.771+0000 7f673b7fe640 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5633b7ea48c0 0x5633b7ea6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.772+0000 7f673b7fe640 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5633b7ea48c0 0x5633b7ea6d40 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc8255d9afa496d server_cookie=a32d071f35aba087 in_seq=0 out_seq=0 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.772+0000 7f671affd640 10 client.15993 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.772+0000 7f671affd640 1 -- 172.21.15.69:0/1967943566 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5633b7dfc390 con 0x5633b7ea48c0 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.772+0000 7f671affd640 10 client.15993 handle_command_reply: tid=0 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.772+0000 7f6744982740 1 client.15993 shutdown 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f6744982740 1 -- 172.21.15.69:0/1967943566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 msgr2=0x5633b7e91960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f6744982740 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e91960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6734035000 tx=0x7f673402a8c0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f6744982740 1 -- 172.21.15.69:0/1967943566 shutdown_connections 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f6744982740 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5633b7ea48c0 0x5633b7ea6d40 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f6744982740 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7e91960 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f6744982740 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e91420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f6744982740 1 --2- 172.21.15.69:0/1967943566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e94130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f671affd640 0 client.15993 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f6744982740 1 -- 172.21.15.69:0/1967943566 >> 172.21.15.69:0/1967943566 conn(0x5633b7e85b30 msgr2=0x5633b7e8b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f6744982740 1 -- 172.21.15.69:0/1967943566 shutdown_connections 2024-04-23T10:29:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f6744982740 1 -- 172.21.15.69:0/1967943566 wait complete. 2024-04-23T10:29:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.773+0000 7f6744982740 20 client.15993 trim_cache size 0 max 16384 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.787+0000 7f6744982740 1 Processor -- start 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f6744982740 1 -- start start 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f6744982740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7ea02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f6744982740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e905a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f6744982740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7eac650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f6744982740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f673c1adb60 con 0x5633b7e94800 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f6744982740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f673c1af8e0 con 0x5633b7e89620 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f6744982740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f673c1ae2f0 con 0x5633b7e89f40 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f673bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7eac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f673bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7eac650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35582/0 (socket says 172.21.15.69:35582) 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f673bfff640 1 -- 172.21.15.69:0/2253492781 learned_addr learned my addr 172.21.15.69:0/2253492781 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f673b7fe640 1 --2- 172.21.15.69:0/2253492781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7ea02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f673affd640 1 --2- 172.21.15.69:0/2253492781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e905a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f673bfff640 1 -- 172.21.15.69:0/2253492781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 msgr2=0x5633b7e905a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f673bfff640 1 --2- 172.21.15.69:0/2253492781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e905a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f673bfff640 1 -- 172.21.15.69:0/2253492781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 msgr2=0x5633b7ea02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f673bfff640 1 --2- 172.21.15.69:0/2253492781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7ea02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f673bfff640 1 -- 172.21.15.69:0/2253492781 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b7e8f990 con 0x5633b7e94800 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f673bfff640 1 --2- 172.21.15.69:0/2253492781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7eac650 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f673402fa30 tx=0x7f6734009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80b065477706f9c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f67217fa640 1 -- 172.21.15.69:0/2253492781 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734066070 con 0x5633b7e94800 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f67217fa640 1 -- 172.21.15.69:0/2253492781 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f673405a070 con 0x5633b7e94800 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.788+0000 7f67217fa640 1 -- 172.21.15.69:0/2253492781 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734051040 con 0x5633b7e94800 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.789+0000 7f6744982740 1 -- 172.21.15.69:0/2253492781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 msgr2=0x5633b7eac650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.789+0000 7f6744982740 1 --2- 172.21.15.69:0/2253492781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7eac650 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f673402fa30 tx=0x7f6734009360 comp rx=0 tx=0).stop 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.789+0000 7f6744982740 1 -- 172.21.15.69:0/2253492781 shutdown_connections 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.789+0000 7f6744982740 1 --2- 172.21.15.69:0/2253492781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7eac650 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.789+0000 7f6744982740 1 --2- 172.21.15.69:0/2253492781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e905a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.789+0000 7f6744982740 1 --2- 172.21.15.69:0/2253492781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7ea02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.789+0000 7f6744982740 1 -- 172.21.15.69:0/2253492781 >> 172.21.15.69:0/2253492781 conn(0x5633b7e85b30 msgr2=0x5633b7e84420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.789+0000 7f6744982740 1 -- 172.21.15.69:0/2253492781 shutdown_connections 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.789+0000 7f6744982740 1 -- 172.21.15.69:0/2253492781 wait complete. 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.789+0000 7f6744982740 1 -- start start 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.789+0000 7f6744982740 1 Processor -- start 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f6744982740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e99dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f6744982740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e9a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f6744982740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7f01e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f6744982740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f673c1af210 con 0x5633b7e94800 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f6744982740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f673c1aea80 con 0x5633b7e89620 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f6744982740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f673c1abaa0 con 0x5633b7e89f40 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f6744982740 10 client.0 _ll_register_callbacks cb 0x7f6734032e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7f01e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e99dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7f01e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35588/0 (socket says 172.21.15.69:35588) 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673bfff640 1 -- 172.21.15.69:0/1572528836 learned_addr learned my addr 172.21.15.69:0/1572528836 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673affd640 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e9a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673bfff640 1 -- 172.21.15.69:0/1572528836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 msgr2=0x5633b7e9a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673bfff640 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e9a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673bfff640 1 -- 172.21.15.69:0/1572528836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 msgr2=0x5633b7e99dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673bfff640 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e99dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673bfff640 1 -- 172.21.15.69:0/1572528836 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b7f024c0 con 0x5633b7e94800 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673b7fe640 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e99dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f673bfff640 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7f01e80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f673402f900 tx=0x7f6734003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87eb4cbb324a3604 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f671affd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f671affd640 1 -- 172.21.15.69:0/1572528836 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734066020 con 0x5633b7e94800 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.790+0000 7f671affd640 1 -- 172.21.15.69:0/1572528836 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f6734031660 con 0x5633b7e94800 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f6744982740 1 -- 172.21.15.69:0/1572528836 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f673405a070 con 0x5633b7e94800 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f671affd640 1 -- 172.21.15.69:0/1572528836 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6734071050 con 0x5633b7e94800 2024-04-23T10:29:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f6744982740 10 client.15999 fetch_fsmap learned FSMap version 40 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f6744982740 1 -- 172.21.15.69:0/1572528836 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5633b7f0aa80 con 0x5633b7e94800 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f671affd640 1 -- 172.21.15.69:0/1572528836 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f673405a070 con 0x5633b7e94800 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f671affd640 1 -- 172.21.15.69:0/1572528836 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f67340305e0 con 0x5633b7e94800 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f6744982740 10 client.15999 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f6744982740 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f6744982740 20 client.15999 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f6744982740 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5633b7f0b160 0x5633b7f0d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f6744982740 4 client.15999 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f6744982740 1 -- 172.21.15.69:0/1572528836 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5633b7df6200 con 0x5633b7f0b160 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.791+0000 7f673b7fe640 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5633b7f0b160 0x5633b7f0d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.792+0000 7f671affd640 10 client.15999 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.792+0000 7f673b7fe640 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5633b7f0b160 0x5633b7f0d580 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d887c0760ed1735 server_cookie=47477cbd2f801558 in_seq=0 out_seq=0 2024-04-23T10:29:52.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:52 smithi167 ceph-mon[32940]: pgmap v93: 97 pgs: 97 active+clean; 216 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 394 op/s 2024-04-23T10:29:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f671affd640 1 -- 172.21.15.69:0/1572528836 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5633b7df6200 con 0x5633b7f0b160 2024-04-23T10:29:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f671affd640 10 client.15999 handle_command_reply: tid=0 2024-04-23T10:29:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 1 client.15999 shutdown 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 1 -- 172.21.15.69:0/1572528836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 msgr2=0x5633b7f01e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7f01e80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f673402f900 tx=0x7f6734003d40 comp rx=0 tx=0).stop 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 1 -- 172.21.15.69:0/1572528836 shutdown_connections 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5633b7f0b160 0x5633b7f0d580 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633b7e94800 0x5633b7f01e80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633b7e89f40 0x5633b7e9a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 1 --2- 172.21.15.69:0/1572528836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5633b7e89620 0x5633b7e99dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f671affd640 0 client.15999 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 1 -- 172.21.15.69:0/1572528836 >> 172.21.15.69:0/1572528836 conn(0x5633b7e85b30 msgr2=0x5633b7e84cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 1 -- 172.21.15.69:0/1572528836 shutdown_connections 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 1 -- 172.21.15.69:0/1572528836 wait complete. 2024-04-23T10:29:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.949+0000 7f6744982740 20 client.15999 trim_cache size 0 max 16384 2024-04-23T10:29:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:29:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:29:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:29:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 -- 172.21.15.69:0/3523964486 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f67240a3e40 msgr2=0x7f67240a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f67240a3e40 0x7f67240a6300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f673402f500 tx=0x7f673402f310 comp rx=0 tx=0).stop 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 -- 172.21.15.69:0/3523964486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f673c1010f0 msgr2=0x7f673c198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f673c1010f0 0x7f673c198700 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f672c00e9f0 tx=0x7f672c00edf0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 -- 172.21.15.69:0/3523964486 shutdown_connections 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f67240a3e40 0x7f67240a6300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f673c19cfc0 0x7f673c19d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f673c106170 0x7f673c198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 --2- 172.21.15.69:0/3523964486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f673c1010f0 0x7f673c198700 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 -- 172.21.15.69:0/3523964486 >> 172.21.15.69:0/3523964486 conn(0x7f673c077fd0 msgr2=0x7f673c069840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 -- 172.21.15.69:0/3523964486 shutdown_connections 2024-04-23T10:29:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:29:52.950+0000 7f6741c74640 1 -- 172.21.15.69:0/3523964486 wait complete. 2024-04-23T10:29:54.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:54 smithi146 ceph-mon[32800]: pgmap v94: 97 pgs: 97 active+clean; 216 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 394 op/s 2024-04-23T10:29:54.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:54 smithi069 ceph-mon[29593]: pgmap v94: 97 pgs: 97 active+clean; 216 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 394 op/s 2024-04-23T10:29:54.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:54 smithi167 ceph-mon[32940]: pgmap v94: 97 pgs: 97 active+clean; 216 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 394 op/s 2024-04-23T10:29:56.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:56 smithi146 ceph-mon[32800]: pgmap v95: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 631 op/s 2024-04-23T10:29:56.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:56 smithi069 ceph-mon[29593]: pgmap v95: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 631 op/s 2024-04-23T10:29:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:56 smithi167 ceph-mon[32940]: pgmap v95: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 631 op/s 2024-04-23T10:29:57.648 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-23T10:29:57.648 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-23T10:29:57.649 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:29:57.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.750+0000 7f329ef68640 1 -- 172.21.15.69:0/1990131801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32981031e0 msgr2=0x7f32981035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:57.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.750+0000 7f329ef68640 1 --2- 172.21.15.69:0/1990131801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32981031e0 0x7f32981035c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f328c009900 tx=0x7f328c02a510 comp rx=0 tx=0).stop 2024-04-23T10:29:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.750+0000 7f329ef68640 1 -- 172.21.15.69:0/1990131801 shutdown_connections 2024-04-23T10:29:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.750+0000 7f329ef68640 1 --2- 172.21.15.69:0/1990131801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f329810c520 0x7f329810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.750+0000 7f329ef68640 1 --2- 172.21.15.69:0/1990131801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3298103b00 0x7f329810bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.750+0000 7f329ef68640 1 --2- 172.21.15.69:0/1990131801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32981031e0 0x7f32981035c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.750+0000 7f329ef68640 1 -- 172.21.15.69:0/1990131801 >> 172.21.15.69:0/1990131801 conn(0x7f3298077f50 msgr2=0x7f3298078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.750+0000 7f329ef68640 1 -- 172.21.15.69:0/1990131801 shutdown_connections 2024-04-23T10:29:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.750+0000 7f329ef68640 1 -- 172.21.15.69:0/1990131801 wait complete. 2024-04-23T10:29:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329ef68640 1 Processor -- start 2024-04-23T10:29:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329ef68640 1 -- start start 2024-04-23T10:29:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329ef68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32981031e0 0x7f32981a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329ef68640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3298103b00 0x7f32981a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329ef68640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f329810c520 0x7f329819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329ef68640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f32981122f0 con 0x7f329810c520 2024-04-23T10:29:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329ef68640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3298112170 con 0x7f32981031e0 2024-04-23T10:29:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329ef68640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3298112470 con 0x7f3298103b00 2024-04-23T10:29:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329d505640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f329810c520 0x7f329819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329cd04640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32981031e0 0x7f32981a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329d505640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f329810c520 0x7f329819a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35610/0 (socket says 172.21.15.69:35610) 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f329d505640 1 -- 172.21.15.69:0/3088877749 learned_addr learned my addr 172.21.15.69:0/3088877749 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.751+0000 7f3297fff640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3298103b00 0x7f32981a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.752+0000 7f329d505640 1 -- 172.21.15.69:0/3088877749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3298103b00 msgr2=0x7f32981a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.752+0000 7f329d505640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3298103b00 0x7f32981a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.752+0000 7f329d505640 1 -- 172.21.15.69:0/3088877749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32981031e0 msgr2=0x7f32981a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.752+0000 7f329d505640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32981031e0 0x7f32981a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.752+0000 7f329d505640 1 -- 172.21.15.69:0/3088877749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329819b020 con 0x7f329810c520 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.752+0000 7f329d505640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f329810c520 0x7f329819a850 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f329000eb10 tx=0x7f329000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.752+0000 7f3295ffb640 1 -- 172.21.15.69:0/3088877749 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290004b20 con 0x7f329810c520 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.752+0000 7f3295ffb640 1 -- 172.21.15.69:0/3088877749 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3290004cc0 con 0x7f329810c520 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.752+0000 7f329ef68640 1 -- 172.21.15.69:0/3088877749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329819b310 con 0x7f329810c520 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.752+0000 7f3295ffb640 1 -- 172.21.15.69:0/3088877749 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290010720 con 0x7f329810c520 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.752+0000 7f329ef68640 1 -- 172.21.15.69:0/3088877749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32981a74e0 con 0x7f329810c520 2024-04-23T10:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.753+0000 7f329ef68640 1 -- 172.21.15.69:0/3088877749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32980698e0 con 0x7f329810c520 2024-04-23T10:29:57.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.754+0000 7f3295ffb640 1 -- 172.21.15.69:0/3088877749 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f3290005020 con 0x7f329810c520 2024-04-23T10:29:57.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.755+0000 7f3295ffb640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f32880a3d20 0x7f32880a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:57.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.755+0000 7f329cd04640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f32880a3d20 0x7f32880a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:57.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.755+0000 7f3295ffb640 1 -- 172.21.15.69:0/3088877749 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f32900d0c80 con 0x7f329810c520 2024-04-23T10:29:57.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.755+0000 7f329cd04640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f32880a3d20 0x7f32880a61e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f328c009230 tx=0x7f328c0058d0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:57.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.759+0000 7f3295ffb640 1 -- 172.21.15.69:0/3088877749 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f329009d350 con 0x7f329810c520 2024-04-23T10:29:57.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.989+0000 7f329ef68640 1 -- 172.21.15.69:0/3088877749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32981a7770 con 0x7f329810c520 2024-04-23T10:29:57.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.989+0000 7f3295ffb640 1 -- 172.21.15.69:0/3088877749 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11965 (secure 0 0 0) 0x7f329009cc50 con 0x7f329810c520 2024-04-23T10:29:57.988 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:29:57.988 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:29:33.510879+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25297":{"gid":25297,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/1216686871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1216686871},{"type":"v1","addr":"172.21.15.167:6835","nonce":1216686871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24416,24392,24487,24421,24463]},"id":1}]} 2024-04-23T10:29:57.989 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 40 2024-04-23T10:29:57.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.991+0000 7f329ef68640 1 -- 172.21.15.69:0/3088877749 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f32880a3d20 msgr2=0x7f32880a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:57.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.991+0000 7f329ef68640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f32880a3d20 0x7f32880a61e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f328c009230 tx=0x7f328c0058d0 comp rx=0 tx=0).stop 2024-04-23T10:29:57.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.991+0000 7f329ef68640 1 -- 172.21.15.69:0/3088877749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f329810c520 msgr2=0x7f329819a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:57.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.991+0000 7f329ef68640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f329810c520 0x7f329819a850 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f329000eb10 tx=0x7f329000c2d0 comp rx=0 tx=0).stop 2024-04-23T10:29:57.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.991+0000 7f329ef68640 1 -- 172.21.15.69:0/3088877749 shutdown_connections 2024-04-23T10:29:57.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.991+0000 7f329ef68640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f32880a3d20 0x7f32880a61e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:57.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.991+0000 7f329ef68640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f329810c520 0x7f329819a850 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:57.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.991+0000 7f329ef68640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3298103b00 0x7f32981a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:57.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.991+0000 7f329ef68640 1 --2- 172.21.15.69:0/3088877749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32981031e0 0x7f32981a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:57.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.991+0000 7f329ef68640 1 -- 172.21.15.69:0/3088877749 >> 172.21.15.69:0/3088877749 conn(0x7f3298077f50 msgr2=0x7f3298108430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:57.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.991+0000 7f329ef68640 1 -- 172.21.15.69:0/3088877749 shutdown_connections 2024-04-23T10:29:57.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:57.992+0000 7f329ef68640 1 -- 172.21.15.69:0/3088877749 wait complete. 2024-04-23T10:29:58.001 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-23T10:29:58.002 DEBUG:teuthology.orchestra.run.smithi069:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24487 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-23T10:29:58.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.116+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2303407752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b4101a50 msgr2=0x7ff8b4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:58.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.116+0000 7ff8b9e9a640 1 --2- 172.21.15.69:0/2303407752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b4101a50 0x7ff8b4105a90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009900 tx=0x7ff8a802a410 comp rx=0 tx=0).stop 2024-04-23T10:29:58.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.116+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2303407752 shutdown_connections 2024-04-23T10:29:58.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.116+0000 7ff8b9e9a640 1 --2- 172.21.15.69:0/2303407752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b4101a50 0x7ff8b4105a90 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.116+0000 7ff8b9e9a640 1 --2- 172.21.15.69:0/2303407752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b4106170 0x7ff8b410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.116+0000 7ff8b9e9a640 1 --2- 172.21.15.69:0/2303407752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b41010a0 0x7ff8b4101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.116+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2303407752 >> 172.21.15.69:0/2303407752 conn(0x7ff8b4077f50 msgr2=0x7ff8b4078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:58.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.116+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2303407752 shutdown_connections 2024-04-23T10:29:58.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.116+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2303407752 wait complete. 2024-04-23T10:29:58.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.116+0000 7ff8b9e9a640 1 Processor -- start 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b9e9a640 1 -- start start 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b9e9a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b41010a0 0x7ff8b4197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b9e9a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b4106170 0x7ff8b4197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b9e9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b419bff0 0x7ff8b419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b9e9a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41111f0 con 0x7ff8b4106170 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b9e9a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b4111070 con 0x7ff8b41010a0 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b9e9a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b4111370 con 0x7ff8b419bff0 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b4106170 0x7ff8b4197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b41010a0 0x7ff8b4197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b41010a0 0x7ff8b4197730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.69:38930/0 (socket says 172.21.15.69:38930) 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b37fe640 1 -- 172.21.15.69:0/2807319345 learned_addr learned my addr 172.21.15.69:0/2807319345 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b3fff640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b419bff0 0x7ff8b419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/2807319345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b419bff0 msgr2=0x7ff8b419c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b419bff0 0x7ff8b419c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/2807319345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b41010a0 msgr2=0x7ff8b4197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:58.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b41010a0 0x7ff8b4197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/2807319345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b419cae0 con 0x7ff8b4106170 2024-04-23T10:29:58.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b3fff640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b419bff0 0x7ff8b419c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:29:58.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b4106170 0x7ff8b4197c70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8006010 tx=0x7ff8a8005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:58.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b0ff9640 1 -- 172.21.15.69:0/2807319345 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8046070 con 0x7ff8b4106170 2024-04-23T10:29:58.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b0ff9640 1 -- 172.21.15.69:0/2807319345 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff8a80043d0 con 0x7ff8b4106170 2024-04-23T10:29:58.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.117+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2807319345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b419cd70 con 0x7ff8b4106170 2024-04-23T10:29:58.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.118+0000 7ff8b0ff9640 1 -- 172.21.15.69:0/2807319345 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8035050 con 0x7ff8b4106170 2024-04-23T10:29:58.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.118+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2807319345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b4069310 con 0x7ff8b4106170 2024-04-23T10:29:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8b0ff9640 1 -- 172.21.15.69:0/2807319345 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7ff8a8049070 con 0x7ff8b4106170 2024-04-23T10:29:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8bcbb5740 1 Processor -- start 2024-04-23T10:29:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8bcbb5740 1 -- start start 2024-04-23T10:29:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 0x5620367ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 0x5620367d8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 0x5620367db480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x562036733370 con 0x5620367d9090 2024-04-23T10:29:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5620366d02e0 con 0x5620367ce0a0 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56203672f330 con 0x5620367ce9c0 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 0x5620367db480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 0x5620367ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 0x5620367ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.69:38936/0 (socket says 172.21.15.69:38936) 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8b3fff640 1 -- 172.21.15.69:0/3527168257 learned_addr learned my addr 172.21.15.69:0/3527168257 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8b0ff9640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff89c0a3d20 0x7ff89c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8b37fe640 1 --2- 172.21.15.69:0/3527168257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 0x5620367d8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.120+0000 7ff8b3fff640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff89c0a3d20 0x7ff89c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff8b0ff9640 1 -- 172.21.15.69:0/2807319345 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7ff8a80f2100 con 0x7ff8b4106170 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/3527168257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 msgr2=0x5620367d8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/3527168257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 0x5620367d8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/3527168257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 msgr2=0x5620367ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/3527168257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 0x5620367ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/3527168257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562036511d80 con 0x5620367d9090 2024-04-23T10:29:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff8b3fff640 1 --2- 172.21.15.69:0/3527168257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 0x5620367ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff8b37fe640 1 --2- 172.21.15.69:0/3527168257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 0x5620367d8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/3527168257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 0x5620367db480 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80ef880 tx=0x7ff8a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bf01d2e527e837 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff8b3fff640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff89c0a3d20 0x7ff89c0a61e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac013b70 tx=0x7ff8ac004ab0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff899ffb640 1 -- 172.21.15.69:0/3527168257 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80bda30 con 0x5620367d9090 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff899ffb640 1 -- 172.21.15.69:0/3527168257 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff8a80be7d0 con 0x5620367d9090 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.121+0000 7ff899ffb640 1 -- 172.21.15.69:0/3527168257 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8003e20 con 0x5620367d9090 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/3527168257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 msgr2=0x5620367db480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/3527168257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 0x5620367db480 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80ef880 tx=0x7ff8a8000bc0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/3527168257 shutdown_connections 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/3527168257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 0x5620367db480 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/3527168257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 0x5620367d8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/3527168257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 0x5620367ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/3527168257 >> 172.21.15.69:0/3527168257 conn(0x5620367ca3c0 msgr2=0x5620367ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/3527168257 shutdown_connections 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/3527168257 wait complete. 2024-04-23T10:29:58.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 -- start start 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 Processor -- start 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce0a0 0x5620367d6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce9c0 0x5620367d6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367d9090 0x5620367d6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.122+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5620367dbc40 con 0x5620367ce0a0 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5620366cdfb0 con 0x5620367ce9c0 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5620367dbdc0 con 0x5620367d9090 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b37fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce0a0 0x5620367d6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8bcbb5740 10 client.0 _ll_register_callbacks cb 0x5620366cd9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b37fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce0a0 0x5620367d6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35642/0 (socket says 172.21.15.69:35642) 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b37fe640 1 -- 172.21.15.69:0/1916297374 learned_addr learned my addr 172.21.15.69:0/1916297374 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce9c0 0x5620367d6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b3fff640 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367d9090 0x5620367d6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b37fe640 1 -- 172.21.15.69:0/1916297374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367d9090 msgr2=0x5620367d6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b37fe640 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367d9090 0x5620367d6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b37fe640 1 -- 172.21.15.69:0/1916297374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce9c0 msgr2=0x5620367d6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b37fe640 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce9c0 0x5620367d6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b37fe640 1 -- 172.21.15.69:0/1916297374 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562036572510 con 0x5620367ce0a0 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b3fff640 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367d9090 0x5620367d6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8b37fe640 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce0a0 0x5620367d6010 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40126b0 tx=0x7ff8a4012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e088bb1adfee8a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff892ffd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff892ffd640 1 -- 172.21.15.69:0/1916297374 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400f920 con 0x5620367ce0a0 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff892ffd640 1 -- 172.21.15.69:0/1916297374 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7ff8a400fac0 con 0x5620367ce0a0 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/1916297374 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8a80be7d0 con 0x5620367ce0a0 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff892ffd640 1 -- 172.21.15.69:0/1916297374 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff8a400fcc0 con 0x5620367ce0a0 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8bcbb5740 10 client.16017 fetch_fsmap learned FSMap version 40 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.123+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/1916297374 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x562036405670 con 0x5620367ce0a0 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.124+0000 7ff892ffd640 1 -- 172.21.15.69:0/1916297374 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff8a80be7d0 con 0x5620367ce0a0 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.124+0000 7ff892ffd640 1 -- 172.21.15.69:0/1916297374 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7ff8a40254e0 con 0x5620367ce0a0 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.124+0000 7ff8bcbb5740 10 client.16017 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:29:58.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.124+0000 7ff8bcbb5740 10 client.16017 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.124+0000 7ff8bcbb5740 20 client.16017 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.124+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5620367e90c0 0x5620367eb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.124+0000 7ff8bcbb5740 4 client.16017 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.124+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/1916297374 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562036740d90 con 0x5620367e90c0 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.124+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5620367e90c0 0x5620367eb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5620367e90c0 0x5620367eb530 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f430f025a10fff1 server_cookie=75cdf7e8736763ca in_seq=0 out_seq=0 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff892ffd640 10 client.16017 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff892ffd640 1 -- 172.21.15.69:0/1916297374 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562036740d90 con 0x5620367e90c0 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff892ffd640 10 client.16017 handle_command_reply: tid=0 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff8bcbb5740 1 client.16017 shutdown 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/1916297374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce0a0 msgr2=0x5620367d6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce0a0 0x5620367d6010 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40126b0 tx=0x7ff8a4012b70 comp rx=0 tx=0).stop 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/1916297374 shutdown_connections 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5620367e90c0 0x5620367eb530 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367d9090 0x5620367d6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff892ffd640 0 client.16017 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:58.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce9c0 0x5620367d6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/1916297374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce0a0 0x5620367d6010 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/1916297374 >> 172.21.15.69:0/1916297374 conn(0x5620367ca3c0 msgr2=0x5620367d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:58.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.125+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/1916297374 shutdown_connections 2024-04-23T10:29:58.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.126+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/1916297374 wait complete. 2024-04-23T10:29:58.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.126+0000 7ff8bcbb5740 20 client.16017 trim_cache size 0 max 16384 2024-04-23T10:29:58.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8bcbb5740 1 Processor -- start 2024-04-23T10:29:58.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8bcbb5740 1 -- start start 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce0a0 0x5620367e4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce9c0 0x5620367d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367d9090 0x5620367f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41aba10 con 0x5620367ce9c0 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41ad790 con 0x5620367d9090 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41ac1a0 con 0x5620367ce0a0 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce9c0 0x5620367d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce9c0 0x5620367d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35654/0 (socket says 172.21.15.69:35654) 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/3035530057 learned_addr learned my addr 172.21.15.69:0/3035530057 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8b3fff640 1 --2- 172.21.15.69:0/3035530057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367d9090 0x5620367f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8b37fe640 1 --2- 172.21.15.69:0/3035530057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce0a0 0x5620367e4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/3035530057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce0a0 msgr2=0x5620367e4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/3035530057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce0a0 0x5620367e4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/3035530057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367d9090 msgr2=0x5620367f0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/3035530057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367d9090 0x5620367f0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.143+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/3035530057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620367cf560 con 0x5620367ce9c0 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/3035530057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce9c0 0x5620367d0910 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80be060 tx=0x7ff8a804d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c16a032f28528ad server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8997fa640 1 -- 172.21.15.69:0/3035530057 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80bda30 con 0x5620367ce9c0 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8997fa640 1 -- 172.21.15.69:0/3035530057 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff8a80be7d0 con 0x5620367ce9c0 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8997fa640 1 -- 172.21.15.69:0/3035530057 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80ba740 con 0x5620367ce9c0 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/3035530057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce9c0 msgr2=0x5620367d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/3035530057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce9c0 0x5620367d0910 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80be060 tx=0x7ff8a804d040 comp rx=0 tx=0).stop 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/3035530057 shutdown_connections 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/3035530057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367ce9c0 0x5620367d0910 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/3035530057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367d9090 0x5620367f0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/3035530057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce0a0 0x5620367e4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/3035530057 >> 172.21.15.69:0/3035530057 conn(0x5620367ca3c0 msgr2=0x5620367d7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/3035530057 shutdown_connections 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.144+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/3035530057 wait complete. 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8bcbb5740 1 -- start start 2024-04-23T10:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8bcbb5740 1 Processor -- start 2024-04-23T10:29:58.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 0x5620367e0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 0x5620367e11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8bcbb5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 0x5620367dd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41ad0c0 con 0x5620367d9090 2024-04-23T10:29:58.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41ac930 con 0x5620367ce0a0 2024-04-23T10:29:58.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8bcbb5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b41a9930 con 0x5620367ce9c0 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8bcbb5740 10 client.0 _ll_register_callbacks cb 0x7ff8a4009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8b3fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 0x5620367dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 0x5620367e11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 0x5620367e0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8b3fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 0x5620367dd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35656/0 (socket says 172.21.15.69:35656) 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.145+0000 7ff8b3fff640 1 -- 172.21.15.69:0/2664988422 learned_addr learned my addr 172.21.15.69:0/2664988422 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/2664988422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 msgr2=0x5620367e0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/2664988422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 0x5620367e0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/2664988422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 msgr2=0x5620367dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/2664988422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 0x5620367dd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff8b2ffd640 1 -- 172.21.15.69:0/2664988422 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620367dd8f0 con 0x5620367ce9c0 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff8b2ffd640 1 --2- 172.21.15.69:0/2664988422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 0x5620367e11d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80ef930 tx=0x7ff8a8009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34799b6de5b0f0ec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff892ffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff892ffd640 1 -- 172.21.15.69:0/2664988422 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80bda30 con 0x5620367ce9c0 2024-04-23T10:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff892ffd640 1 -- 172.21.15.69:0/2664988422 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7ff8a80c2130 con 0x5620367ce9c0 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/2664988422 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8a80be7d0 con 0x5620367ce9c0 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff892ffd640 1 -- 172.21.15.69:0/2664988422 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff8a80c2480 con 0x5620367ce9c0 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff8bcbb5740 10 client.25474 fetch_fsmap learned FSMap version 40 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/2664988422 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x562036850100 con 0x5620367ce9c0 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.146+0000 7ff892ffd640 1 -- 172.21.15.69:0/2664988422 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff8a80be7d0 con 0x5620367ce9c0 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.147+0000 7ff892ffd640 1 -- 172.21.15.69:0/2664988422 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7ff8a80d4c80 con 0x5620367ce9c0 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.147+0000 7ff8bcbb5740 10 client.25474 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.147+0000 7ff8bcbb5740 10 client.25474 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.147+0000 7ff8bcbb5740 20 client.25474 populate_metadata read hostname 'smithi069' 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.147+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/2664988422 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562036850580 0x5620368529a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.147+0000 7ff8bcbb5740 4 client.25474 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.147+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/2664988422 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x56203673ac00 con 0x562036850580 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.147+0000 7ff8b37fe640 1 --2- 172.21.15.69:0/2664988422 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562036850580 0x5620368529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.147+0000 7ff892ffd640 10 client.25474 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:29:58.147+0000 7ff8b37fe640 1 --2- 172.21.15.69:0/2664988422 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562036850580 0x5620368529a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4afaee8c149bebfa server_cookie=70298fadb08b0bf2 in_seq=0 out_seq=0 2024-04-23T10:29:58.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:58 smithi146 ceph-mon[32800]: pgmap v96: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 561 op/s 2024-04-23T10:29:58.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:29:58 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3088877749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:29:58.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:58 smithi069 ceph-mon[29593]: pgmap v96: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 561 op/s 2024-04-23T10:29:58.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:29:58 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3088877749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:29:58.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:58 smithi167 ceph-mon[32940]: pgmap v96: 97 pgs: 97 active+clean; 201 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 561 op/s 2024-04-23T10:29:58.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:29:58 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3088877749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:30:00.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff892ffd640 1 -- 172.21.15.69:0/2664988422 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x56203673ac00 con 0x562036850580 2024-04-23T10:30:00.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff892ffd640 10 client.25474 handle_command_reply: tid=0 2024-04-23T10:30:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 1 client.25474 shutdown 2024-04-23T10:30:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/2664988422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 msgr2=0x5620367e11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/2664988422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 0x5620367e11d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80ef930 tx=0x7ff8a8009560 comp rx=0 tx=0).stop 2024-04-23T10:30:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/2664988422 shutdown_connections 2024-04-23T10:30:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/2664988422 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562036850580 0x5620368529a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/2664988422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5620367d9090 0x5620367dd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/2664988422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5620367ce9c0 0x5620367e11d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 1 --2- 172.21.15.69:0/2664988422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5620367ce0a0 0x5620367e0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff892ffd640 0 client.25474 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/2664988422 >> 172.21.15.69:0/2664988422 conn(0x5620367ca3c0 msgr2=0x5620367d80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/2664988422 shutdown_connections 2024-04-23T10:30:00.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 1 -- 172.21.15.69:0/2664988422 wait complete. 2024-04-23T10:30:00.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.214+0000 7ff8bcbb5740 20 client.25474 trim_cache size 0 max 16384 2024-04-23T10:30:00.215 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:30:00.215 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 40, 2024-04-23T10:30:00.215 INFO:teuthology.orchestra.run.smithi069.stdout: "leader": 24487, 2024-04-23T10:30:00.215 INFO:teuthology.orchestra.run.smithi069.stdout: "set_version": 10, 2024-04-23T10:30:00.215 INFO:teuthology.orchestra.run.smithi069.stdout: "sets": { 2024-04-23T10:30:00.215 INFO:teuthology.orchestra.run.smithi069.stdout: "bf305144": { 2024-04-23T10:30:00.215 INFO:teuthology.orchestra.run.smithi069.stdout: "version": 10, 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "age_ref": 0.0, 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "QUIESCED", 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "timeout": 60.0, 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "expiration": 90.0, 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "members": { 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "file:/": { 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "excluded": false, 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "QUIESCED", 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:00.216 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:00.217 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:00.217 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:00.217 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:00.217 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:30:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2807319345 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff89c0a3d20 msgr2=0x7ff89c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff89c0a3d20 0x7ff89c0a61e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac013b70 tx=0x7ff8ac004ab0 comp rx=0 tx=0).stop 2024-04-23T10:30:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2807319345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b4106170 msgr2=0x7ff8b4197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b4106170 0x7ff8b4197c70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8006010 tx=0x7ff8a8005e70 comp rx=0 tx=0).stop 2024-04-23T10:30:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2807319345 shutdown_connections 2024-04-23T10:30:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7ff89c0a3d20 0x7ff89c0a61e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8b4106170 0x7ff8b4197c70 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b419bff0 0x7ff8b419c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 --2- 172.21.15.69:0/2807319345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b41010a0 0x7ff8b4197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2807319345 >> 172.21.15.69:0/2807319345 conn(0x7ff8b4077f50 msgr2=0x7ff8b40ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2807319345 shutdown_connections 2024-04-23T10:30:00.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:00.215+0000 7ff8b9e9a640 1 -- 172.21.15.69:0/2807319345 wait complete. 2024-04-23T10:30:00.230 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bf305144', quiesce took 2.6 seconds. Will release after: 30.0 2024-04-23T10:30:00.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:00 smithi069 ceph-mon[29593]: pgmap v97: 97 pgs: 97 active+clean; 206 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 818 op/s 2024-04-23T10:30:00.526 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:00 smithi069 ceph-mon[29593]: overall HEALTH_OK 2024-04-23T10:30:00.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:00 smithi146 ceph-mon[32800]: pgmap v97: 97 pgs: 97 active+clean; 206 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 818 op/s 2024-04-23T10:30:00.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:00 smithi146 ceph-mon[32800]: overall HEALTH_OK 2024-04-23T10:30:00.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:00 smithi167 ceph-mon[32940]: pgmap v97: 97 pgs: 97 active+clean; 206 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 818 op/s 2024-04-23T10:30:00.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:00 smithi167 ceph-mon[32940]: overall HEALTH_OK 2024-04-23T10:30:01.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:01 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:01 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:30:01.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:01 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:30:02.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:02 smithi146 ceph-mon[32800]: pgmap v98: 97 pgs: 97 active+clean; 206 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 493 op/s 2024-04-23T10:30:02.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:02 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:30:02.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:02 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:30:02.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:02 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:30:02.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:02 smithi069 ceph-mon[29593]: pgmap v98: 97 pgs: 97 active+clean; 206 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 493 op/s 2024-04-23T10:30:02.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:02 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:30:02.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:02 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:30:02.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:02 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:30:02.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:02 smithi167 ceph-mon[32940]: pgmap v98: 97 pgs: 97 active+clean; 206 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 493 op/s 2024-04-23T10:30:02.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:02 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:30:02.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:02 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:30:02.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:02 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:30:04.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:04 smithi069 ceph-mon[29593]: pgmap v99: 97 pgs: 97 active+clean; 206 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 493 op/s 2024-04-23T10:30:04.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:04 smithi167 ceph-mon[32940]: pgmap v99: 97 pgs: 97 active+clean; 206 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 493 op/s 2024-04-23T10:30:04.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:04 smithi146 ceph-mon[32800]: pgmap v99: 97 pgs: 97 active+clean; 206 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 493 op/s 2024-04-23T10:30:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.045+0000 7f8002736640 1 -- 172.21.15.69:0/1778302922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ffc103b20 msgr2=0x7f7ffc10c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.045+0000 7f8002736640 1 --2- 172.21.15.69:0/1778302922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ffc103b20 0x7f7ffc10c000 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009900 tx=0x7f7ff002a480 comp rx=0 tx=0).stop 2024-04-23T10:30:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.045+0000 7f8002736640 1 -- 172.21.15.69:0/1778302922 shutdown_connections 2024-04-23T10:30:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.045+0000 7f8002736640 1 --2- 172.21.15.69:0/1778302922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ffc103b20 0x7f7ffc10c000 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.045+0000 7f8002736640 1 --2- 172.21.15.69:0/1778302922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ffc10c5d0 0x7f7ffc10ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.045+0000 7f8002736640 1 --2- 172.21.15.69:0/1778302922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc103200 0x7f7ffc1035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.045+0000 7f8002736640 1 -- 172.21.15.69:0/1778302922 >> 172.21.15.69:0/1778302922 conn(0x7f7ffc0771d0 msgr2=0x7f7ffc0775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.045+0000 7f8002736640 1 -- 172.21.15.69:0/1778302922 shutdown_connections 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.045+0000 7f8002736640 1 -- 172.21.15.69:0/1778302922 wait complete. 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.045+0000 7f8002736640 1 Processor -- start 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.045+0000 7f8002736640 1 -- start start 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8002736640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc103200 0x7f7ffc19e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8002736640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ffc103b20 0x7f7ffc19e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8002736640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ffc10c5d0 0x7f7ffc198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8002736640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc112350 con 0x7f7ffc10c5d0 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8002736640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1121d0 con 0x7f7ffc103b20 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8002736640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1124d0 con 0x7f7ffc103200 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8000cd3640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ffc10c5d0 0x7f7ffc198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8000cd3640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ffc10c5d0 0x7f7ffc198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35678/0 (socket says 172.21.15.69:35678) 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8000cd3640 1 -- 172.21.15.69:0/8802993 learned_addr learned my addr 172.21.15.69:0/8802993 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc103200 0x7f7ffc19e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ffc103b20 0x7f7ffc19e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8000cd3640 1 -- 172.21.15.69:0/8802993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc103200 msgr2=0x7f7ffc19e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8000cd3640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc103200 0x7f7ffc19e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8000cd3640 1 -- 172.21.15.69:0/8802993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ffc103b20 msgr2=0x7f7ffc19e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8000cd3640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ffc103b20 0x7f7ffc19e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8000cd3640 1 -- 172.21.15.69:0/8802993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc198db0 con 0x7f7ffc10c5d0 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc103200 0x7f7ffc19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.046+0000 7f8000cd3640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ffc10c5d0 0x7f7ffc198630 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400dac0 tx=0x7f7ff400df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.047+0000 7f7ff97fa640 1 -- 172.21.15.69:0/8802993 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4017070 con 0x7f7ffc10c5d0 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.047+0000 7f8002736640 1 -- 172.21.15.69:0/8802993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ffc1990a0 con 0x7f7ffc10c5d0 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.047+0000 7f7ff97fa640 1 -- 172.21.15.69:0/8802993 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7ff4003e40 con 0x7f7ffc10c5d0 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.047+0000 7f7ff97fa640 1 -- 172.21.15.69:0/8802993 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40106c0 con 0x7f7ffc10c5d0 2024-04-23T10:30:06.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.047+0000 7f8002736640 1 -- 172.21.15.69:0/8802993 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ffc1a52f0 con 0x7f7ffc10c5d0 2024-04-23T10:30:06.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.049+0000 7f7ff97fa640 1 -- 172.21.15.69:0/8802993 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f7ff40041d0 con 0x7f7ffc10c5d0 2024-04-23T10:30:06.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.049+0000 7f8005451740 1 Processor -- start 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.049+0000 7f8005451740 1 -- start start 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.049+0000 7f8005451740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a527620 0x55fb2a527a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.049+0000 7f8005451740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a5322c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f8005451740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a532800 0x55fb2a534bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f8005451740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55fb2a48c970 con 0x55fb2a527f40 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f8005451740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fb2a4294a0 con 0x55fb2a527620 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f8005451740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fb2a488930 con 0x55fb2a532800 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ff97fa640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7fe40a3dc0 0x7f7fe40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a5322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a5322c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35692/0 (socket says 172.21.15.69:35692) 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ffbfff640 1 -- 172.21.15.69:0/370591796 learned_addr learned my addr 172.21.15.69:0/370591796 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/370591796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a527620 0x55fb2a527a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f8000cd3640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7fe40a3dc0 0x7f7fe40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/370591796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a532800 0x55fb2a534bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ff97fa640 1 -- 172.21.15.69:0/8802993 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f7ff40d0400 con 0x7f7ffc10c5d0 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ffbfff640 1 -- 172.21.15.69:0/370591796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a532800 msgr2=0x55fb2a534bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/370591796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a532800 0x55fb2a534bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ffbfff640 1 -- 172.21.15.69:0/370591796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a527620 msgr2=0x55fb2a527a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/370591796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a527620 0x55fb2a527a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ffbfff640 1 -- 172.21.15.69:0/370591796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2a19f210 con 0x55fb2a527f40 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/370591796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a5322c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7fec0115c0 tx=0x7f7fec011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c764f1aa4ec0d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f8000cd3640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7fe40a3dc0 0x7f7fe40a6280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ff409c120 tx=0x7f7ff406de60 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7fe27fc640 1 -- 172.21.15.69:0/370591796 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec00f640 con 0x55fb2a527f40 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7fe27fc640 1 -- 172.21.15.69:0/370591796 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7fec00fcb0 con 0x55fb2a527f40 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.050+0000 7f7fe27fc640 1 -- 172.21.15.69:0/370591796 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec019d10 con 0x55fb2a527f40 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.051+0000 7f8005451740 1 -- 172.21.15.69:0/370591796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 msgr2=0x55fb2a5322c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.051+0000 7f8005451740 1 --2- 172.21.15.69:0/370591796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a5322c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7fec0115c0 tx=0x7f7fec011a80 comp rx=0 tx=0).stop 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.051+0000 7f8005451740 1 -- 172.21.15.69:0/370591796 shutdown_connections 2024-04-23T10:30:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.051+0000 7f8005451740 1 --2- 172.21.15.69:0/370591796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a5322c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.051+0000 7f8005451740 1 --2- 172.21.15.69:0/370591796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a532800 0x55fb2a534bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.051+0000 7f8005451740 1 --2- 172.21.15.69:0/370591796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a527620 0x55fb2a527a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.051+0000 7f8005451740 1 -- 172.21.15.69:0/370591796 >> 172.21.15.69:0/370591796 conn(0x55fb2a523b30 msgr2=0x55fb2a523f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.051+0000 7f8005451740 1 -- 172.21.15.69:0/370591796 shutdown_connections 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.051+0000 7f8005451740 1 -- 172.21.15.69:0/370591796 wait complete. 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.051+0000 7f8005451740 1 -- start start 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f8005451740 1 Processor -- start 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f8005451740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527620 0x55fb2a5320f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f8005451740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a52f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f8005451740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a532800 0x55fb2a52f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f8005451740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55fb2a535430 con 0x55fb2a527f40 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f8005451740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fb2a4270b0 con 0x55fb2a532800 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f8005451740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fb2a5355b0 con 0x55fb2a527620 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f8005451740 10 client.0 _ll_register_callbacks cb 0x55fb2a414d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a52f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a52f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35708/0 (socket says 172.21.15.69:35708) 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f7ffbfff640 1 -- 172.21.15.69:0/1377373293 learned_addr learned my addr 172.21.15.69:0/1377373293 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527620 0x55fb2a5320f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f7ffbfff640 1 -- 172.21.15.69:0/1377373293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527620 msgr2=0x55fb2a5320f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527620 0x55fb2a5320f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f7ffbfff640 1 -- 172.21.15.69:0/1377373293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a532800 msgr2=0x55fb2a52f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a532800 0x55fb2a52f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f7ffbfff640 1 -- 172.21.15.69:0/1377373293 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2a26b620 con 0x55fb2a527f40 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527620 0x55fb2a5320f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.052+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a52f3e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7fec005890 tx=0x7f7fec019c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29a682603f1478f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f7fdb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/1377373293 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec019e60 con 0x55fb2a527f40 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/1377373293 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f7fec004250 con 0x55fb2a527f40 2024-04-23T10:30:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f8005451740 1 -- 172.21.15.69:0/1377373293 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fec00fcb0 con 0x55fb2a527f40 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/1377373293 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7fec030050 con 0x55fb2a527f40 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f8005451740 10 client.16035 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f8005451740 1 -- 172.21.15.69:0/1377373293 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55fb2a541300 con 0x55fb2a527f40 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/1377373293 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7fec00fcb0 con 0x55fb2a527f40 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/1377373293 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f7fec005300 con 0x55fb2a527f40 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f8005451740 10 client.16035 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f8005451740 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f8005451740 20 client.16035 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f8005451740 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55fb2a542700 0x55fb2a544af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f8005451740 4 client.16035 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.053+0000 7f8005451740 1 -- 172.21.15.69:0/1377373293 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb2a49a390 con 0x55fb2a542700 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.054+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55fb2a542700 0x55fb2a544af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.054+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55fb2a542700 0x55fb2a544af0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45415431f2f93a17 server_cookie=cb552acf5b89ef8a in_seq=0 out_seq=0 2024-04-23T10:30:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.054+0000 7f7fdb7fe640 10 client.16035 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/1377373293 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fb2a49a390 con 0x55fb2a542700 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f7fdb7fe640 10 client.16035 handle_command_reply: tid=0 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 1 client.16035 shutdown 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 1 -- 172.21.15.69:0/1377373293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 msgr2=0x55fb2a52f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a52f3e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7fec005890 tx=0x7f7fec019c40 comp rx=0 tx=0).stop 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 1 -- 172.21.15.69:0/1377373293 shutdown_connections 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55fb2a542700 0x55fb2a544af0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527f40 0x55fb2a52f3e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f7fdb7fe640 0 client.16035 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a532800 0x55fb2a52f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 1 --2- 172.21.15.69:0/1377373293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527620 0x55fb2a5320f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 1 -- 172.21.15.69:0/1377373293 >> 172.21.15.69:0/1377373293 conn(0x55fb2a523b30 msgr2=0x55fb2a5298b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 1 -- 172.21.15.69:0/1377373293 shutdown_connections 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 1 -- 172.21.15.69:0/1377373293 wait complete. 2024-04-23T10:30:06.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.055+0000 7f8005451740 20 client.16035 trim_cache size 0 max 16384 2024-04-23T10:30:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.070+0000 7f8005451740 1 Processor -- start 2024-04-23T10:30:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.070+0000 7f8005451740 1 -- start start 2024-04-23T10:30:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.070+0000 7f8005451740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a527620 0x55fb2a53abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.070+0000 7f8005451740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527f40 0x55fb2a531c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.070+0000 7f8005451740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a532800 0x55fb2a54a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.070+0000 7f8005451740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1adce0 con 0x55fb2a532800 2024-04-23T10:30:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.070+0000 7f8005451740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1afa60 con 0x55fb2a527620 2024-04-23T10:30:06.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.070+0000 7f8005451740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1ae470 con 0x55fb2a527f40 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.070+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a532800 0x55fb2a54a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a532800 0x55fb2a54a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35710/0 (socket says 172.21.15.69:35710) 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7ffb7fe640 1 -- 172.21.15.69:0/37000535 learned_addr learned my addr 172.21.15.69:0/37000535 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/37000535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a527620 0x55fb2a53abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/37000535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527f40 0x55fb2a531c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7ffb7fe640 1 -- 172.21.15.69:0/37000535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527f40 msgr2=0x55fb2a531c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/37000535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527f40 0x55fb2a531c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7ffb7fe640 1 -- 172.21.15.69:0/37000535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a527620 msgr2=0x55fb2a53abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/37000535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a527620 0x55fb2a53abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7ffb7fe640 1 -- 172.21.15.69:0/37000535 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2a528af0 con 0x55fb2a532800 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/37000535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a532800 0x55fb2a54a360 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0005ec0 tx=0x7f7ff002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901629a6fdbade9d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7fe1ffb640 1 -- 172.21.15.69:0/37000535 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff004f070 con 0x55fb2a532800 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7fe1ffb640 1 -- 172.21.15.69:0/37000535 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7ff0031900 con 0x55fb2a532800 2024-04-23T10:30:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.071+0000 7f7fe1ffb640 1 -- 172.21.15.69:0/37000535 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0035070 con 0x55fb2a532800 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.072+0000 7f8005451740 1 -- 172.21.15.69:0/37000535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a532800 msgr2=0x55fb2a54a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.072+0000 7f8005451740 1 --2- 172.21.15.69:0/37000535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a532800 0x55fb2a54a360 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0005ec0 tx=0x7f7ff002a480 comp rx=0 tx=0).stop 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.072+0000 7f8005451740 1 -- 172.21.15.69:0/37000535 shutdown_connections 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.072+0000 7f8005451740 1 --2- 172.21.15.69:0/37000535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a532800 0x55fb2a54a360 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.072+0000 7f8005451740 1 --2- 172.21.15.69:0/37000535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527f40 0x55fb2a531c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.072+0000 7f8005451740 1 --2- 172.21.15.69:0/37000535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a527620 0x55fb2a53abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.072+0000 7f8005451740 1 -- 172.21.15.69:0/37000535 >> 172.21.15.69:0/37000535 conn(0x55fb2a523b30 msgr2=0x55fb2a52f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.072+0000 7f8005451740 1 -- 172.21.15.69:0/37000535 shutdown_connections 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.072+0000 7f8005451740 1 -- 172.21.15.69:0/37000535 wait complete. 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.072+0000 7f8005451740 1 -- start start 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.072+0000 7f8005451740 1 Processor -- start 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f8005451740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527620 0x55fb2a5a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f8005451740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527f40 0x55fb2a5a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f8005451740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a532800 0x55fb2a59f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f8005451740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1af390 con 0x55fb2a527620 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f8005451740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1aec00 con 0x55fb2a532800 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f8005451740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1abc00 con 0x55fb2a527f40 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f8005451740 10 client.0 _ll_register_callbacks cb 0x7f7fec0197b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527620 0x55fb2a5a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527620 0x55fb2a5a5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35712/0 (socket says 172.21.15.69:35712) 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7ffb7fe640 1 -- 172.21.15.69:0/3562359613 learned_addr learned my addr 172.21.15.69:0/3562359613 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7ffb7fe640 1 -- 172.21.15.69:0/3562359613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527f40 msgr2=0x55fb2a5a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527f40 0x55fb2a5a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527f40 0x55fb2a5a58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7ffb7fe640 1 -- 172.21.15.69:0/3562359613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a532800 msgr2=0x55fb2a59f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a532800 0x55fb2a59f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7ffb7fe640 1 -- 172.21.15.69:0/3562359613 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2a59fe70 con 0x55fb2a527620 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7ffb7fe640 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527620 0x55fb2a5a5370 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0031b10 tx=0x7f7ff0009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78d1275bf3c8194 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7fdb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/3562359613 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff004f070 con 0x55fb2a527620 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/3562359613 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f7ff0048250 con 0x55fb2a527620 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f8005451740 1 -- 172.21.15.69:0/3562359613 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ff0031900 con 0x55fb2a527620 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.073+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/3562359613 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7ff0035070 con 0x55fb2a527620 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.074+0000 7f8005451740 10 client.16041 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.074+0000 7f8005451740 1 -- 172.21.15.69:0/3562359613 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55fb2a5acb80 con 0x55fb2a527620 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.074+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/3562359613 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7ff0031900 con 0x55fb2a527620 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.074+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/3562359613 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f7ff0047070 con 0x55fb2a527620 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.074+0000 7f8005451740 10 client.16041 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.074+0000 7f8005451740 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.074+0000 7f8005451740 20 client.16041 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.074+0000 7f8005451740 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55fb2a5ad180 0x55fb2a5af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.074+0000 7f8005451740 4 client.16041 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.074+0000 7f8005451740 1 -- 172.21.15.69:0/3562359613 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fb2a494200 con 0x55fb2a5ad180 2024-04-23T10:30:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.074+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55fb2a5ad180 0x55fb2a5af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.075+0000 7f7ffbfff640 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55fb2a5ad180 0x55fb2a5af5a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69ed89e6ac3c8507 server_cookie=fb833a8fdaea71c0 in_seq=0 out_seq=0 2024-04-23T10:30:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.075+0000 7f7fdb7fe640 10 client.16041 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f7fdb7fe640 1 -- 172.21.15.69:0/3562359613 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fb2a494200 con 0x55fb2a5ad180 2024-04-23T10:30:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f7fdb7fe640 10 client.16041 handle_command_reply: tid=0 2024-04-23T10:30:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 1 client.16041 shutdown 2024-04-23T10:30:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 1 -- 172.21.15.69:0/3562359613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527620 msgr2=0x55fb2a5a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527620 0x55fb2a5a5370 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0031b10 tx=0x7f7ff0009230 comp rx=0 tx=0).stop 2024-04-23T10:30:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 1 -- 172.21.15.69:0/3562359613 shutdown_connections 2024-04-23T10:30:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55fb2a5ad180 0x55fb2a5af5a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb2a532800 0x55fb2a59f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fb2a527f40 0x55fb2a5a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 1 --2- 172.21.15.69:0/3562359613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fb2a527620 0x55fb2a5a5370 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f7fdb7fe640 0 client.16041 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 1 -- 172.21.15.69:0/3562359613 >> 172.21.15.69:0/3562359613 conn(0x55fb2a523b30 msgr2=0x55fb2a522420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 1 -- 172.21.15.69:0/3562359613 shutdown_connections 2024-04-23T10:30:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 1 -- 172.21.15.69:0/3562359613 wait complete. 2024-04-23T10:30:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.118+0000 7f8005451740 20 client.16041 trim_cache size 0 max 16384 2024-04-23T10:30:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:30:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:30:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:30:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:30:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 -- 172.21.15.69:0/8802993 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7fe40a3dc0 msgr2=0x7f7fe40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7fe40a3dc0 0x7f7fe40a6280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ff409c120 tx=0x7f7ff406de60 comp rx=0 tx=0).stop 2024-04-23T10:30:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 -- 172.21.15.69:0/8802993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ffc10c5d0 msgr2=0x7f7ffc198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ffc10c5d0 0x7f7ffc198630 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400dac0 tx=0x7f7ff400df80 comp rx=0 tx=0).stop 2024-04-23T10:30:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 -- 172.21.15.69:0/8802993 shutdown_connections 2024-04-23T10:30:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f7fe40a3dc0 0x7f7fe40a6280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ffc10c5d0 0x7f7ffc198630 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ffc103b20 0x7f7ffc19e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 --2- 172.21.15.69:0/8802993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ffc103200 0x7f7ffc19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 -- 172.21.15.69:0/8802993 >> 172.21.15.69:0/8802993 conn(0x7f7ffc0771d0 msgr2=0x7f7ffc0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 -- 172.21.15.69:0/8802993 shutdown_connections 2024-04-23T10:30:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:06.119+0000 7f8002736640 1 -- 172.21.15.69:0/8802993 wait complete. 2024-04-23T10:30:06.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:06 smithi069 ceph-mon[29593]: pgmap v100: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-04-23T10:30:06.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:06 smithi167 ceph-mon[32940]: pgmap v100: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-04-23T10:30:06.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:06 smithi146 ceph-mon[32800]: pgmap v100: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 517 op/s 2024-04-23T10:30:08.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:08 smithi069 ceph-mon[29593]: pgmap v101: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 857 KiB/s wr, 281 op/s 2024-04-23T10:30:08.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:08 smithi167 ceph-mon[32940]: pgmap v101: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 857 KiB/s wr, 281 op/s 2024-04-23T10:30:08.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:08 smithi146 ceph-mon[32800]: pgmap v101: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 857 KiB/s wr, 281 op/s 2024-04-23T10:30:10.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:10 smithi069 ceph-mon[29593]: pgmap v102: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 907 KiB/s wr, 313 op/s 2024-04-23T10:30:10.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:10 smithi167 ceph-mon[32940]: pgmap v102: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 907 KiB/s wr, 313 op/s 2024-04-23T10:30:10.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:10 smithi146 ceph-mon[32800]: pgmap v102: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 907 KiB/s wr, 313 op/s 2024-04-23T10:30:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:12 smithi069 ceph-mon[29593]: pgmap v103: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 80 KiB/s wr, 56 op/s 2024-04-23T10:30:12.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:12 smithi167 ceph-mon[32940]: pgmap v103: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 80 KiB/s wr, 56 op/s 2024-04-23T10:30:12.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:12 smithi146 ceph-mon[32800]: pgmap v103: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 80 KiB/s wr, 56 op/s 2024-04-23T10:30:14.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:14 smithi069 ceph-mon[29593]: pgmap v104: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 80 KiB/s wr, 56 op/s 2024-04-23T10:30:14.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:14 smithi167 ceph-mon[32940]: pgmap v104: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 80 KiB/s wr, 56 op/s 2024-04-23T10:30:14.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:14 smithi146 ceph-mon[32800]: pgmap v104: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 80 KiB/s wr, 56 op/s 2024-04-23T10:30:16.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:16 smithi069 ceph-mon[29593]: pgmap v105: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 81 KiB/s wr, 62 op/s 2024-04-23T10:30:16.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:16 smithi167 ceph-mon[32940]: pgmap v105: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 81 KiB/s wr, 62 op/s 2024-04-23T10:30:16.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:16 smithi146 ceph-mon[32800]: pgmap v105: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 81 KiB/s wr, 62 op/s 2024-04-23T10:30:18.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:18 smithi069 ceph-mon[29593]: pgmap v106: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 51 KiB/s wr, 37 op/s 2024-04-23T10:30:18.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:18 smithi167 ceph-mon[32940]: pgmap v106: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 51 KiB/s wr, 37 op/s 2024-04-23T10:30:18.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:18 smithi146 ceph-mon[32800]: pgmap v106: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 51 KiB/s wr, 37 op/s 2024-04-23T10:30:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.215+0000 7f041b3a2640 1 -- 172.21.15.69:0/158087795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0414107290 msgr2=0x7f041410ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.215+0000 7f041b3a2640 1 --2- 172.21.15.69:0/158087795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0414107290 0x7f041410ee60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f040c009ca0 tx=0x7f040c02a8c0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.215+0000 7f041b3a2640 1 -- 172.21.15.69:0/158087795 shutdown_connections 2024-04-23T10:30:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.215+0000 7f041b3a2640 1 --2- 172.21.15.69:0/158087795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0414107290 0x7f041410ee60 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.215+0000 7f041b3a2640 1 --2- 172.21.15.69:0/158087795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0414102b70 0x7f0414106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.215+0000 7f041b3a2640 1 --2- 172.21.15.69:0/158087795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04141021c0 0x7f04141025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.215+0000 7f041b3a2640 1 -- 172.21.15.69:0/158087795 >> 172.21.15.69:0/158087795 conn(0x7f04140fda20 msgr2=0x7f04140ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.215+0000 7f041b3a2640 1 -- 172.21.15.69:0/158087795 shutdown_connections 2024-04-23T10:30:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.215+0000 7f041b3a2640 1 -- 172.21.15.69:0/158087795 wait complete. 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.215+0000 7f041b3a2640 1 Processor -- start 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.215+0000 7f041b3a2640 1 -- start start 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041b3a2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04141021c0 0x7f0414074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041b3a2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0414107290 0x7f0414074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041b3a2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0414074cd0 0x7f04141a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041b3a2640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0414112310 con 0x7f04141021c0 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041b3a2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0414112190 con 0x7f0414074cd0 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041b3a2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0414112490 con 0x7f0414107290 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041913e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04141021c0 0x7f0414074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041913e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04141021c0 0x7f0414074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44956/0 (socket says 172.21.15.69:44956) 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041913e640 1 -- 172.21.15.69:0/3790022429 learned_addr learned my addr 172.21.15.69:0/3790022429 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041993f640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0414074cd0 0x7f04141a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041893d640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0414107290 0x7f0414074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041913e640 1 -- 172.21.15.69:0/3790022429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0414107290 msgr2=0x7f0414074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041913e640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0414107290 0x7f0414074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041913e640 1 -- 172.21.15.69:0/3790022429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0414074cd0 msgr2=0x7f04141a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041913e640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0414074cd0 0x7f04141a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041913e640 1 -- 172.21.15.69:0/3790022429 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04141a6f60 con 0x7f04141021c0 2024-04-23T10:30:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f041913e640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04141021c0 0x7f0414074250 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f041000d950 tx=0x7f041000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.216+0000 7f040a7fc640 1 -- 172.21.15.69:0/3790022429 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410017070 con 0x7f04141021c0 2024-04-23T10:30:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.217+0000 7f040a7fc640 1 -- 172.21.15.69:0/3790022429 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0410009c30 con 0x7f04141021c0 2024-04-23T10:30:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.217+0000 7f041b3a2640 1 -- 172.21.15.69:0/3790022429 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04141a7250 con 0x7f04141021c0 2024-04-23T10:30:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.217+0000 7f040a7fc640 1 -- 172.21.15.69:0/3790022429 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041000f6b0 con 0x7f04141021c0 2024-04-23T10:30:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.217+0000 7f041b3a2640 1 -- 172.21.15.69:0/3790022429 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04141a77a0 con 0x7f04141021c0 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.219+0000 7f040a7fc640 1 -- 172.21.15.69:0/3790022429 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f04100109c0 con 0x7f04141021c0 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.219+0000 7f041e197740 1 Processor -- start 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.219+0000 7f041e197740 1 -- start start 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.219+0000 7f041e197740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170620 0x5621f3170a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.219+0000 7f041e197740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170f40 0x5621f317b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.219+0000 7f041e197740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f317dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041e197740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5621f30d5970 con 0x5621f317b800 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041e197740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5621f30724a0 con 0x5621f3170620 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041e197740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5621f30d1930 con 0x5621f3170f40 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f040a7fc640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f04000a3df0 0x7f04000a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041893d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f317dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041893d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f317dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44960/0 (socket says 172.21.15.69:44960) 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041893d640 1 -- 172.21.15.69:0/130792718 learned_addr learned my addr 172.21.15.69:0/130792718 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041993f640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f04000a3df0 0x7f04000a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041913e640 1 --2- 172.21.15.69:0/130792718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170f40 0x5621f317b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041993f640 1 --2- 172.21.15.69:0/130792718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170620 0x5621f3170a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f040a7fc640 1 -- 172.21.15.69:0/3790022429 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f04100d03f0 con 0x7f04141021c0 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041893d640 1 -- 172.21.15.69:0/130792718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170f40 msgr2=0x5621f317b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041893d640 1 --2- 172.21.15.69:0/130792718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170f40 0x5621f317b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041893d640 1 -- 172.21.15.69:0/130792718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170620 msgr2=0x5621f3170a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041893d640 1 --2- 172.21.15.69:0/130792718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170620 0x5621f3170a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041893d640 1 -- 172.21.15.69:0/130792718 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621f2de8210 con 0x5621f317b800 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041993f640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f04000a3df0 0x7f04000a62b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f040c006010 tx=0x7f040c02f310 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f041893d640 1 --2- 172.21.15.69:0/130792718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f317dbf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f040400cb90 tx=0x7f040400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee0ca7ef49aeda1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f03ff7fe640 1 -- 172.21.15.69:0/130792718 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404005220 con 0x5621f317b800 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.220+0000 7f03ff7fe640 1 -- 172.21.15.69:0/130792718 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0404004c70 con 0x5621f317b800 2024-04-23T10:30:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.221+0000 7f03ff7fe640 1 -- 172.21.15.69:0/130792718 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404010810 con 0x5621f317b800 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.221+0000 7f041e197740 1 -- 172.21.15.69:0/130792718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 msgr2=0x5621f317dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.221+0000 7f041e197740 1 --2- 172.21.15.69:0/130792718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f317dbf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f040400cb90 tx=0x7f040400e720 comp rx=0 tx=0).stop 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.221+0000 7f041e197740 1 -- 172.21.15.69:0/130792718 shutdown_connections 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.221+0000 7f041e197740 1 --2- 172.21.15.69:0/130792718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f317dbf0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.221+0000 7f041e197740 1 --2- 172.21.15.69:0/130792718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170f40 0x5621f317b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.221+0000 7f041e197740 1 --2- 172.21.15.69:0/130792718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170620 0x5621f3170a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.221+0000 7f041e197740 1 -- 172.21.15.69:0/130792718 >> 172.21.15.69:0/130792718 conn(0x5621f316cb30 msgr2=0x5621f316cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.221+0000 7f041e197740 1 -- 172.21.15.69:0/130792718 shutdown_connections 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.221+0000 7f041e197740 1 -- 172.21.15.69:0/130792718 wait complete. 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041e197740 1 -- start start 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041e197740 1 Processor -- start 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041e197740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170620 0x5621f317b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041e197740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170f40 0x5621f31783c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041e197740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f317b800 0x5621f3178900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041e197740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5621f317e430 con 0x5621f3170620 2024-04-23T10:30:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041e197740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5621f30700b0 con 0x5621f317b800 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041e197740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5621f317e5b0 con 0x5621f3170f40 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041e197740 10 client.0 _ll_register_callbacks cb 0x5621f305dd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041913e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170620 0x5621f317b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041913e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170620 0x5621f317b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44966/0 (socket says 172.21.15.69:44966) 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041913e640 1 -- 172.21.15.69:0/2960634160 learned_addr learned my addr 172.21.15.69:0/2960634160 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041893d640 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170f40 0x5621f31783c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.222+0000 7f041993f640 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f317b800 0x5621f3178900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041913e640 1 -- 172.21.15.69:0/2960634160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170f40 msgr2=0x5621f31783c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041913e640 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170f40 0x5621f31783c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041913e640 1 -- 172.21.15.69:0/2960634160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f317b800 msgr2=0x5621f3178900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041913e640 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f317b800 0x5621f3178900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041913e640 1 -- 172.21.15.69:0/2960634160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621f2eb4620 con 0x5621f3170620 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041893d640 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170f40 0x5621f31783c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041913e640 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170620 0x5621f317b0d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0410098d90 tx=0x7f0410000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c58cd58e2ebbce server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f03fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f03fcff9640 1 -- 172.21.15.69:0/2960634160 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04100b0e60 con 0x5621f3170620 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f03fcff9640 1 -- 172.21.15.69:0/2960634160 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f0410098a30 con 0x5621f3170620 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041e197740 1 -- 172.21.15.69:0/2960634160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0404004c70 con 0x5621f3170620 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f03fcff9640 1 -- 172.21.15.69:0/2960634160 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0410020040 con 0x5621f3170620 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041e197740 10 client.16053 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041e197740 1 -- 172.21.15.69:0/2960634160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5621f318a2d0 con 0x5621f3170620 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f03fcff9640 1 -- 172.21.15.69:0/2960634160 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0404004c70 con 0x5621f3170620 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f03fcff9640 1 -- 172.21.15.69:0/2960634160 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f0410010460 con 0x5621f3170620 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041e197740 10 client.16053 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041e197740 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.223+0000 7f041e197740 20 client.16053 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.224+0000 7f041e197740 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5621f318b7e0 0x5621f318dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.224+0000 7f041e197740 4 client.16053 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.224+0000 7f041e197740 1 -- 172.21.15.69:0/2960634160 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621f30e3390 con 0x5621f318b7e0 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.224+0000 7f041893d640 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5621f318b7e0 0x5621f318dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.224+0000 7f041893d640 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5621f318b7e0 0x5621f318dc70 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e8210b5e02864be server_cookie=fa218655757267ec in_seq=0 out_seq=0 2024-04-23T10:30:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.224+0000 7f03fcff9640 10 client.16053 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f03fcff9640 1 -- 172.21.15.69:0/2960634160 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5621f30e3390 con 0x5621f318b7e0 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f03fcff9640 10 client.16053 handle_command_reply: tid=0 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f041e197740 1 client.16053 shutdown 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f041e197740 1 -- 172.21.15.69:0/2960634160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170620 msgr2=0x5621f317b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f041e197740 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170620 0x5621f317b0d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0410098d90 tx=0x7f0410000bc0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f041e197740 1 -- 172.21.15.69:0/2960634160 shutdown_connections 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f041e197740 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5621f318b7e0 0x5621f318dc70 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f041e197740 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f317b800 0x5621f3178900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f041e197740 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170f40 0x5621f31783c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f03fcff9640 0 client.16053 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f041e197740 1 --2- 172.21.15.69:0/2960634160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170620 0x5621f317b0d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.225+0000 7f041e197740 1 -- 172.21.15.69:0/2960634160 >> 172.21.15.69:0/2960634160 conn(0x5621f316cb30 msgr2=0x5621f3172860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.226+0000 7f041e197740 1 -- 172.21.15.69:0/2960634160 shutdown_connections 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.226+0000 7f041e197740 1 -- 172.21.15.69:0/2960634160 wait complete. 2024-04-23T10:30:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.226+0000 7f041e197740 20 client.16053 trim_cache size 0 max 16384 2024-04-23T10:30:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.240+0000 7f041e197740 1 Processor -- start 2024-04-23T10:30:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.240+0000 7f041e197740 1 -- start start 2024-04-23T10:30:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.240+0000 7f041e197740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170620 0x5621f31872f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.240+0000 7f041e197740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170f40 0x5621f31788a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041e197740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f317b800 0x5621f316b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041e197740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f04141afdf0 con 0x5621f3170f40 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041e197740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f04141b1b70 con 0x5621f3170620 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041e197740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04141b0580 con 0x5621f317b800 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041893d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170f40 0x5621f31788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041893d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170f40 0x5621f31788a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44978/0 (socket says 172.21.15.69:44978) 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041893d640 1 -- 172.21.15.69:0/2317530649 learned_addr learned my addr 172.21.15.69:0/2317530649 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041913e640 1 --2- 172.21.15.69:0/2317530649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170620 0x5621f31872f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041893d640 1 -- 172.21.15.69:0/2317530649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f317b800 msgr2=0x5621f316b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041893d640 1 --2- 172.21.15.69:0/2317530649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f317b800 0x5621f316b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041893d640 1 -- 172.21.15.69:0/2317530649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170620 msgr2=0x5621f31872f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041893d640 1 --2- 172.21.15.69:0/2317530649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170620 0x5621f31872f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041893d640 1 -- 172.21.15.69:0/2317530649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621f3176910 con 0x5621f3170f40 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f041893d640 1 --2- 172.21.15.69:0/2317530649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170f40 0x5621f31788a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f040400d010 tx=0x7f040400c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e8f8998a8f1622 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f03feffd640 1 -- 172.21.15.69:0/2317530649 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404029320 con 0x5621f3170f40 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f03feffd640 1 -- 172.21.15.69:0/2317530649 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0404010430 con 0x5621f3170f40 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.241+0000 7f03feffd640 1 -- 172.21.15.69:0/2317530649 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040401a650 con 0x5621f3170f40 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.242+0000 7f041e197740 1 -- 172.21.15.69:0/2317530649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170f40 msgr2=0x5621f31788a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.242+0000 7f041e197740 1 --2- 172.21.15.69:0/2317530649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170f40 0x5621f31788a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f040400d010 tx=0x7f040400c480 comp rx=0 tx=0).stop 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.242+0000 7f041e197740 1 -- 172.21.15.69:0/2317530649 shutdown_connections 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.242+0000 7f041e197740 1 --2- 172.21.15.69:0/2317530649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f3170f40 0x5621f31788a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.242+0000 7f041e197740 1 --2- 172.21.15.69:0/2317530649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f317b800 0x5621f316b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.242+0000 7f041e197740 1 --2- 172.21.15.69:0/2317530649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170620 0x5621f31872f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.242+0000 7f041e197740 1 -- 172.21.15.69:0/2317530649 >> 172.21.15.69:0/2317530649 conn(0x5621f316cb30 msgr2=0x5621f3178190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.242+0000 7f041e197740 1 -- 172.21.15.69:0/2317530649 shutdown_connections 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.242+0000 7f041e197740 1 -- 172.21.15.69:0/2317530649 wait complete. 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.242+0000 7f041e197740 1 -- start start 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.242+0000 7f041e197740 1 Processor -- start 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041e197740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170620 0x5621f3183bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041e197740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170f40 0x5621f3180f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041e197740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f3181480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041e197740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f04141b14a0 con 0x5621f317b800 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041e197740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f04141b0d10 con 0x5621f3170f40 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041e197740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04141add10 con 0x5621f3170620 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041e197740 10 client.0 _ll_register_callbacks cb 0x7f041009bfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041993f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f3181480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041993f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f3181480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44988/0 (socket says 172.21.15.69:44988) 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041993f640 1 -- 172.21.15.69:0/2482566159 learned_addr learned my addr 172.21.15.69:0/2482566159 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041893d640 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170f40 0x5621f3180f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041913e640 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170620 0x5621f3183bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041993f640 1 -- 172.21.15.69:0/2482566159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170620 msgr2=0x5621f3183bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041993f640 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170620 0x5621f3183bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041993f640 1 -- 172.21.15.69:0/2482566159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170f40 msgr2=0x5621f3180f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041993f640 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170f40 0x5621f3180f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041993f640 1 -- 172.21.15.69:0/2482566159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621f3181cb0 con 0x5621f317b800 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041913e640 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170620 0x5621f3183bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041993f640 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f3181480 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f040c02ade0 tx=0x7f040c02f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5b01ec9a4d50d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f03fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f03fcff9640 1 -- 172.21.15.69:0/2482566159 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c031450 con 0x5621f317b800 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f041e197740 1 -- 172.21.15.69:0/2482566159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0404010430 con 0x5621f317b800 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.243+0000 7f03fcff9640 1 -- 172.21.15.69:0/2482566159 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f040c0315f0 con 0x5621f317b800 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f03fcff9640 1 -- 172.21.15.69:0/2482566159 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f040c031810 con 0x5621f317b800 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f041e197740 10 client.16059 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f041e197740 1 -- 172.21.15.69:0/2482566159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5621f31f1e00 con 0x5621f317b800 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f03fcff9640 1 -- 172.21.15.69:0/2482566159 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0404010430 con 0x5621f317b800 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f03fcff9640 1 -- 172.21.15.69:0/2482566159 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f040c02f930 con 0x5621f317b800 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f041e197740 10 client.16059 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f041e197740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:30:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f041e197740 20 client.16059 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f041e197740 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5621f31f25e0 0x5621f31f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f041e197740 4 client.16059 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:30:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f041e197740 1 -- 172.21.15.69:0/2482566159 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5621f30dd200 con 0x5621f31f25e0 2024-04-23T10:30:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.244+0000 7f041913e640 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5621f31f25e0 0x5621f31f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.245+0000 7f03fcff9640 10 client.16059 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.245+0000 7f041913e640 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5621f31f25e0 0x5621f31f4a00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e467272c4ee09323 server_cookie=f4bd199482c42f9a in_seq=0 out_seq=0 2024-04-23T10:30:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f03fcff9640 1 -- 172.21.15.69:0/2482566159 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5621f30dd200 con 0x5621f31f25e0 2024-04-23T10:30:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f03fcff9640 10 client.16059 handle_command_reply: tid=0 2024-04-23T10:30:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 1 client.16059 shutdown 2024-04-23T10:30:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 1 -- 172.21.15.69:0/2482566159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 msgr2=0x5621f3181480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f3181480 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f040c02ade0 tx=0x7f040c02f4c0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 1 -- 172.21.15.69:0/2482566159 shutdown_connections 2024-04-23T10:30:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5621f31f25e0 0x5621f31f4a00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621f317b800 0x5621f3181480 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621f3170f40 0x5621f3180f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 1 --2- 172.21.15.69:0/2482566159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5621f3170620 0x5621f3183bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f03fcff9640 0 client.16059 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 1 -- 172.21.15.69:0/2482566159 >> 172.21.15.69:0/2482566159 conn(0x5621f316cb30 msgr2=0x5621f31862e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 1 -- 172.21.15.69:0/2482566159 shutdown_connections 2024-04-23T10:30:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 1 -- 172.21.15.69:0/2482566159 wait complete. 2024-04-23T10:30:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.254+0000 7f041e197740 20 client.16059 trim_cache size 0 max 16384 2024-04-23T10:30:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:30:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:30:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:30:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 -- 172.21.15.69:0/3790022429 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f04000a3df0 msgr2=0x7f04000a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f04000a3df0 0x7f04000a62b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f040c006010 tx=0x7f040c02f310 comp rx=0 tx=0).stop 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 -- 172.21.15.69:0/3790022429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04141021c0 msgr2=0x7f0414074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04141021c0 0x7f0414074250 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f041000d950 tx=0x7f041000de10 comp rx=0 tx=0).stop 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 -- 172.21.15.69:0/3790022429 shutdown_connections 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f04000a3df0 0x7f04000a62b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0414074cd0 0x7f04141a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0414107290 0x7f0414074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 --2- 172.21.15.69:0/3790022429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04141021c0 0x7f0414074250 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 -- 172.21.15.69:0/3790022429 >> 172.21.15.69:0/3790022429 conn(0x7f04140fda20 msgr2=0x7f04140fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 -- 172.21.15.69:0/3790022429 shutdown_connections 2024-04-23T10:30:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:19.255+0000 7f041b3a2640 1 -- 172.21.15.69:0/3790022429 wait complete. 2024-04-23T10:30:20.730 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:20 smithi146 ceph-mon[32800]: pgmap v107: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 56 KiB/s wr, 44 op/s 2024-04-23T10:30:20.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:20 smithi069 ceph-mon[29593]: pgmap v107: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 56 KiB/s wr, 44 op/s 2024-04-23T10:30:20.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:20 smithi167 ceph-mon[32940]: pgmap v107: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 56 KiB/s wr, 44 op/s 2024-04-23T10:30:22.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:22 smithi069 ceph-mon[29593]: pgmap v108: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-04-23T10:30:22.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:22 smithi167 ceph-mon[32940]: pgmap v108: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-04-23T10:30:22.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:22 smithi146 ceph-mon[32800]: pgmap v108: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-04-23T10:30:24.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:24 smithi069 ceph-mon[29593]: pgmap v109: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-04-23T10:30:24.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:24 smithi167 ceph-mon[32940]: pgmap v109: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-04-23T10:30:24.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:24 smithi146 ceph-mon[32800]: pgmap v109: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-04-23T10:30:26.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:26 smithi069 ceph-mon[29593]: pgmap v110: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 16 op/s 2024-04-23T10:30:26.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:26 smithi167 ceph-mon[32940]: pgmap v110: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 16 op/s 2024-04-23T10:30:26.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:26 smithi146 ceph-mon[32800]: pgmap v110: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 16 op/s 2024-04-23T10:30:28.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:28 smithi069 ceph-mon[29593]: pgmap v111: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-04-23T10:30:28.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:28 smithi167 ceph-mon[32940]: pgmap v111: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-04-23T10:30:28.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:28 smithi146 ceph-mon[32800]: pgmap v111: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-04-23T10:30:30.231 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:30:30.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.346+0000 7fc4ce059640 1 -- 172.21.15.69:0/2846775860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c8107260 msgr2=0x7fc4c810ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.346+0000 7fc4ce059640 1 --2- 172.21.15.69:0/2846775860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c8107260 0x7fc4c810ee30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0009be0 tx=0x7fc4c002a6c0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.346+0000 7fc4ce059640 1 -- 172.21.15.69:0/2846775860 shutdown_connections 2024-04-23T10:30:30.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.346+0000 7fc4ce059640 1 --2- 172.21.15.69:0/2846775860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c8107260 0x7fc4c810ee30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.346+0000 7fc4ce059640 1 --2- 172.21.15.69:0/2846775860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8102b40 0x7fc4c8106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.346+0000 7fc4ce059640 1 --2- 172.21.15.69:0/2846775860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4c8102190 0x7fc4c8102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.346+0000 7fc4ce059640 1 -- 172.21.15.69:0/2846775860 >> 172.21.15.69:0/2846775860 conn(0x7fc4c8079310 msgr2=0x7fc4c8079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.346+0000 7fc4ce059640 1 -- 172.21.15.69:0/2846775860 shutdown_connections 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.346+0000 7fc4ce059640 1 -- 172.21.15.69:0/2846775860 wait complete. 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.346+0000 7fc4ce059640 1 Processor -- start 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.346+0000 7fc4ce059640 1 -- start start 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4ce059640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c8102190 0x7fc4c819e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4ce059640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8107260 0x7fc4c819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4ce059640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4c8198640 0x7fc4c8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4ce059640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c8112300 con 0x7fc4c8102190 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4ce059640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c8112180 con 0x7fc4c8107260 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4ce059640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c8112480 con 0x7fc4c8198640 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c77fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c8102190 0x7fc4c819e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c77fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c8102190 0x7fc4c819e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60458/0 (socket says 172.21.15.69:60458) 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c77fe640 1 -- 172.21.15.69:0/2864460360 learned_addr learned my addr 172.21.15.69:0/2864460360 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c7fff640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4c8198640 0x7fc4c8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4bffff640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8107260 0x7fc4c819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c77fe640 1 -- 172.21.15.69:0/2864460360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4c8198640 msgr2=0x7fc4c8198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c77fe640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4c8198640 0x7fc4c8198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c77fe640 1 -- 172.21.15.69:0/2864460360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8107260 msgr2=0x7fc4c819e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c77fe640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8107260 0x7fc4c819e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c77fe640 1 -- 172.21.15.69:0/2864460360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c8199160 con 0x7fc4c8102190 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c7fff640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4c8198640 0x7fc4c8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4bffff640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8107260 0x7fc4c819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c77fe640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c8102190 0x7fc4c819e440 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800e9f0 tx=0x7fc4b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c57fa640 1 -- 172.21.15.69:0/2864460360 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b800cd80 con 0x7fc4c8102190 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c57fa640 1 -- 172.21.15.69:0/2864460360 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc4b80054f0 con 0x7fc4c8102190 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4c57fa640 1 -- 172.21.15.69:0/2864460360 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8010690 con 0x7fc4c8102190 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.347+0000 7fc4ce059640 1 -- 172.21.15.69:0/2864460360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c8199450 con 0x7fc4c8102190 2024-04-23T10:30:30.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.348+0000 7fc4ce059640 1 -- 172.21.15.69:0/2864460360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c81a5600 con 0x7fc4c8102190 2024-04-23T10:30:30.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.349+0000 7fc4ce059640 1 -- 172.21.15.69:0/2864460360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c80691c0 con 0x7fc4c8102190 2024-04-23T10:30:30.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.350+0000 7fc4c57fa640 1 -- 172.21.15.69:0/2864460360 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fc4b80046c0 con 0x7fc4c8102190 2024-04-23T10:30:30.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.350+0000 7fc4c57fa640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fc4b40a3d20 0x7fc4b40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.350+0000 7fc4bffff640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fc4b40a3d20 0x7fc4b40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.350+0000 7fc4c57fa640 1 -- 172.21.15.69:0/2864460360 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7fc4b80d0ed0 con 0x7fc4c8102190 2024-04-23T10:30:30.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.351+0000 7fc4bffff640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fc4b40a3d20 0x7fc4b40a61e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00096c0 tx=0x7fc4b0009260 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:30.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.354+0000 7fc4c57fa640 1 -- 172.21.15.69:0/2864460360 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc4b8053ff0 con 0x7fc4c8102190 2024-04-23T10:30:30.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.572+0000 7fc4ce059640 1 -- 172.21.15.69:0/2864460360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4c8199b20 con 0x7fc4c8102190 2024-04-23T10:30:30.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.572+0000 7fc4c57fa640 1 -- 172.21.15.69:0/2864460360 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11965 (secure 0 0 0) 0x7fc4b801f340 con 0x7fc4c8102190 2024-04-23T10:30:30.571 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:30:30.572 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:29:33.510879+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25297":{"gid":25297,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/1216686871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1216686871},{"type":"v1","addr":"172.21.15.167:6835","nonce":1216686871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24416,24392,24487,24421,24463]},"id":1}]} 2024-04-23T10:30:30.572 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 40 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.574+0000 7fc4ce059640 1 -- 172.21.15.69:0/2864460360 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fc4b40a3d20 msgr2=0x7fc4b40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.574+0000 7fc4ce059640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fc4b40a3d20 0x7fc4b40a61e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00096c0 tx=0x7fc4b0009260 comp rx=0 tx=0).stop 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.574+0000 7fc4ce059640 1 -- 172.21.15.69:0/2864460360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c8102190 msgr2=0x7fc4c819e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.574+0000 7fc4ce059640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c8102190 0x7fc4c819e440 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800e9f0 tx=0x7fc4b800edf0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.575+0000 7fc4ce059640 1 -- 172.21.15.69:0/2864460360 shutdown_connections 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.575+0000 7fc4ce059640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fc4b40a3d20 0x7fc4b40a61e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.575+0000 7fc4ce059640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4c8198640 0x7fc4c8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.575+0000 7fc4ce059640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8107260 0x7fc4c819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.575+0000 7fc4ce059640 1 --2- 172.21.15.69:0/2864460360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c8102190 0x7fc4c819e440 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.575+0000 7fc4ce059640 1 -- 172.21.15.69:0/2864460360 >> 172.21.15.69:0/2864460360 conn(0x7fc4c8079310 msgr2=0x7fc4c8100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.575+0000 7fc4ce059640 1 -- 172.21.15.69:0/2864460360 shutdown_connections 2024-04-23T10:30:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.575+0000 7fc4ce059640 1 -- 172.21.15.69:0/2864460360 wait complete. 2024-04-23T10:30:30.583 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:30 smithi069 ceph-mon[29593]: pgmap v112: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.6 KiB/s wr, 15 op/s 2024-04-23T10:30:30.584 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id bf305144 --release --await' 2024-04-23T10:30:30.585 DEBUG:teuthology.orchestra.run.smithi069:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24487 quiesce db --set-id bf305144 --release --await 2024-04-23T10:30:30.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.691+0000 7f075339b640 1 -- 172.21.15.69:0/2778492462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f074c103af0 msgr2=0x7f074c10bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.691+0000 7f075339b640 1 --2- 172.21.15.69:0/2778492462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f074c103af0 0x7f074c10bfd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f073c009900 tx=0x7f073c02a510 comp rx=0 tx=0).stop 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.691+0000 7f075339b640 1 -- 172.21.15.69:0/2778492462 shutdown_connections 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.691+0000 7f075339b640 1 --2- 172.21.15.69:0/2778492462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f074c103af0 0x7f074c10bfd0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.691+0000 7f075339b640 1 --2- 172.21.15.69:0/2778492462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c10c510 0x7f074c10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.691+0000 7f075339b640 1 --2- 172.21.15.69:0/2778492462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f074c1031d0 0x7f074c1035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.691+0000 7f075339b640 1 -- 172.21.15.69:0/2778492462 >> 172.21.15.69:0/2778492462 conn(0x7f074c077f50 msgr2=0x7f074c078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.691+0000 7f075339b640 1 -- 172.21.15.69:0/2778492462 shutdown_connections 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.691+0000 7f075339b640 1 -- 172.21.15.69:0/2778492462 wait complete. 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.691+0000 7f075339b640 1 Processor -- start 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.691+0000 7f075339b640 1 -- start start 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f075339b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1031d0 0x7f074c19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f075339b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f074c103af0 0x7f074c19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f075339b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f074c10c510 0x7f074c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f075339b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f074c112330 con 0x7f074c103af0 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f075339b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f074c1121b0 con 0x7f074c1031d0 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f075339b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f074c1124b0 con 0x7f074c10c510 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f0750936640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f074c103af0 0x7f074c19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f0750936640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f074c103af0 0x7f074c19eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60468/0 (socket says 172.21.15.69:60468) 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f0750936640 1 -- 172.21.15.69:0/2979647751 learned_addr learned my addr 172.21.15.69:0/2979647751 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f0751137640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1031d0 0x7f074c19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f0751938640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f074c10c510 0x7f074c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f0750936640 1 -- 172.21.15.69:0/2979647751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f074c10c510 msgr2=0x7f074c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f0750936640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f074c10c510 0x7f074c198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f0750936640 1 -- 172.21.15.69:0/2979647751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1031d0 msgr2=0x7f074c19e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f0750936640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1031d0 0x7f074c19e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f0750936640 1 -- 172.21.15.69:0/2979647751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074c198f30 con 0x7f074c103af0 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f0750936640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f074c103af0 0x7f074c19eaf0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f073c0314b0 tx=0x7f073c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f07427fc640 1 -- 172.21.15.69:0/2979647751 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c03f070 con 0x7f074c103af0 2024-04-23T10:30:30.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f07427fc640 1 -- 172.21.15.69:0/2979647751 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f073c031bf0 con 0x7f074c103af0 2024-04-23T10:30:30.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f075339b640 1 -- 172.21.15.69:0/2979647751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074c1991c0 con 0x7f074c103af0 2024-04-23T10:30:30.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f07427fc640 1 -- 172.21.15.69:0/2979647751 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c035030 con 0x7f074c103af0 2024-04-23T10:30:30.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.692+0000 7f075339b640 1 -- 172.21.15.69:0/2979647751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f074c1a5350 con 0x7f074c103af0 2024-04-23T10:30:30.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.694+0000 7f07427fc640 1 -- 172.21.15.69:0/2979647751 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f073c042070 con 0x7f074c103af0 2024-04-23T10:30:30.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f075618c740 1 Processor -- start 2024-04-23T10:30:30.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f075618c740 1 -- start start 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f075618c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6490 0x558217fe6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f075618c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6db0 0x558217ff0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f075618c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217ff1480 0x558217ff3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f07427fc640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07380a3d20 0x7f07380a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f075618c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558217f4b6d0 con 0x558217fe6490 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f075618c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558217ee81a0 con 0x558217fe6db0 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f075618c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558217f47690 con 0x558217ff1480 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f0751938640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6490 0x558217fe6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f0750936640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07380a3d20 0x7f07380a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f0751938640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6490 0x558217fe6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60484/0 (socket says 172.21.15.69:60484) 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f0751938640 1 -- 172.21.15.69:0/1977356843 learned_addr learned my addr 172.21.15.69:0/1977356843 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f0751137640 1 --2- 172.21.15.69:0/1977356843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6db0 0x558217ff0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.695+0000 7f07427fc640 1 -- 172.21.15.69:0/2979647751 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f073c0f0f60 con 0x7f074c103af0 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f0751938640 1 --2- 172.21.15.69:0/1977356843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217ff1480 0x558217ff3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f0751938640 1 -- 172.21.15.69:0/1977356843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217ff1480 msgr2=0x558217ff3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f0751938640 1 --2- 172.21.15.69:0/1977356843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217ff1480 0x558217ff3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f0751938640 1 -- 172.21.15.69:0/1977356843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6db0 msgr2=0x558217ff0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f0751938640 1 --2- 172.21.15.69:0/1977356843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6db0 0x558217ff0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f0751938640 1 -- 172.21.15.69:0/1977356843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558217ef25b0 con 0x558217fe6490 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f0751137640 1 --2- 172.21.15.69:0/1977356843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6db0 0x558217ff0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f0750936640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07380a3d20 0x7f07380a61e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f073c0ee790 tx=0x7f073c087a80 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f0751938640 1 --2- 172.21.15.69:0/1977356843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6490 0x558217fe6870 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f07440144e0 tx=0x7f0744009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b455d0d40aad9f73 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f07377fe640 1 -- 172.21.15.69:0/1977356843 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07440126b0 con 0x558217fe6490 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f07377fe640 1 -- 172.21.15.69:0/1977356843 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0744018070 con 0x558217fe6490 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.696+0000 7f07377fe640 1 -- 172.21.15.69:0/1977356843 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744010bc0 con 0x558217fe6490 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 -- 172.21.15.69:0/1977356843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6490 msgr2=0x558217fe6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 --2- 172.21.15.69:0/1977356843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6490 0x558217fe6870 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f07440144e0 tx=0x7f0744009870 comp rx=0 tx=0).stop 2024-04-23T10:30:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 -- 172.21.15.69:0/1977356843 shutdown_connections 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 --2- 172.21.15.69:0/1977356843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217ff1480 0x558217ff3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 --2- 172.21.15.69:0/1977356843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6db0 0x558217ff0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 --2- 172.21.15.69:0/1977356843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6490 0x558217fe6870 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 -- 172.21.15.69:0/1977356843 >> 172.21.15.69:0/1977356843 conn(0x558217fe27b0 msgr2=0x558217fe2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 -- 172.21.15.69:0/1977356843 shutdown_connections 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 -- 172.21.15.69:0/1977356843 wait complete. 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 -- start start 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 Processor -- start 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6490 0x558217ff0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fee1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217ff1480 0x558217fee900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558217ff4310 con 0x558217fe6db0 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558217ee5b20 con 0x558217fe6490 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.697+0000 7f075618c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558217ff4490 con 0x558217ff1480 2024-04-23T10:30:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f075618c740 10 client.0 _ll_register_callbacks cb 0x558217ee5530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751137640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fee1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751137640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fee1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60492/0 (socket says 172.21.15.69:60492) 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751137640 1 -- 172.21.15.69:0/2782035109 learned_addr learned my addr 172.21.15.69:0/2782035109 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751938640 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6490 0x558217ff0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751938640 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217ff1480 0x558217fee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751137640 1 -- 172.21.15.69:0/2782035109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217ff1480 msgr2=0x558217fee900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751137640 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217ff1480 0x558217fee900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751137640 1 -- 172.21.15.69:0/2782035109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6490 msgr2=0x558217ff0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751137640 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6490 0x558217ff0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751137640 1 -- 172.21.15.69:0/2782035109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558217c5d920 con 0x558217fe6db0 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751938640 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6490 0x558217ff0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0751137640 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fee1c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f074800b9b0 tx=0x7f074800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928fb8fa693609ca server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0734ff9640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0734ff9640 1 -- 172.21.15.69:0/2782035109 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748003e20 con 0x558217fe6db0 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0734ff9640 1 -- 172.21.15.69:0/2782035109 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f0748011440 con 0x558217fe6db0 2024-04-23T10:30:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f075618c740 1 -- 172.21.15.69:0/2782035109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0744018070 con 0x558217fe6db0 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0734ff9640 1 -- 172.21.15.69:0/2782035109 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0748011680 con 0x558217fe6db0 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f075618c740 10 client.16077 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f075618c740 1 -- 172.21.15.69:0/2782035109 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558217d29d30 con 0x558217fe6db0 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.698+0000 7f0734ff9640 1 -- 172.21.15.69:0/2782035109 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0744018070 con 0x558217fe6db0 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.699+0000 7f0734ff9640 1 -- 172.21.15.69:0/2782035109 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f0748024b10 con 0x558217fe6db0 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.699+0000 7f075618c740 10 client.16077 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.699+0000 7f075618c740 10 client.16077 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.699+0000 7f075618c740 20 client.16077 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.699+0000 7f075618c740 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558218001720 0x558218003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.699+0000 7f075618c740 4 client.16077 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.699+0000 7f075618c740 1 -- 172.21.15.69:0/2782035109 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558217f09500 con 0x558218001720 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.699+0000 7f0751938640 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558218001720 0x558218003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.699+0000 7f0751938640 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558218001720 0x558218003b80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97ba49ebafaf8966 server_cookie=87812f9246b1ccbd in_seq=0 out_seq=0 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.699+0000 7f0734ff9640 10 client.16077 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.700+0000 7f0734ff9640 1 -- 172.21.15.69:0/2782035109 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558217f09500 con 0x558218001720 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.700+0000 7f0734ff9640 10 client.16077 handle_command_reply: tid=0 2024-04-23T10:30:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.700+0000 7f075618c740 1 client.16077 shutdown 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f075618c740 1 -- 172.21.15.69:0/2782035109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 msgr2=0x558217fee1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f075618c740 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fee1c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f074800b9b0 tx=0x7f074800be70 comp rx=0 tx=0).stop 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f075618c740 1 -- 172.21.15.69:0/2782035109 shutdown_connections 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f075618c740 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558218001720 0x558218003b80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f075618c740 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fee1c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f075618c740 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217ff1480 0x558217fee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f0734ff9640 0 client.16077 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f075618c740 1 --2- 172.21.15.69:0/2782035109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217fe6490 0x558217ff0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f075618c740 1 -- 172.21.15.69:0/2782035109 >> 172.21.15.69:0/2782035109 conn(0x558217fe27b0 msgr2=0x558217fe84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f075618c740 1 -- 172.21.15.69:0/2782035109 shutdown_connections 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f075618c740 1 -- 172.21.15.69:0/2782035109 wait complete. 2024-04-23T10:30:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.701+0000 7f075618c740 20 client.16077 trim_cache size 0 max 16384 2024-04-23T10:30:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f075618c740 1 Processor -- start 2024-04-23T10:30:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f075618c740 1 -- start start 2024-04-23T10:30:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f075618c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217fe6490 0x558217fe2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f075618c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fe8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f075618c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217ff1480 0x558218009490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f075618c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f074c1adcc0 con 0x558217fe6db0 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f075618c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f074c1afa40 con 0x558217ff1480 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f075618c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f074c1ae450 con 0x558217fe6490 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751137640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fe8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751137640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fe8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60494/0 (socket says 172.21.15.69:60494) 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751137640 1 -- 172.21.15.69:0/3397707489 learned_addr learned my addr 172.21.15.69:0/3397707489 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751938640 1 --2- 172.21.15.69:0/3397707489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217ff1480 0x558218009490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751938640 1 --2- 172.21.15.69:0/3397707489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217fe6490 0x558217fe2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751137640 1 -- 172.21.15.69:0/3397707489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217fe6490 msgr2=0x558217fe2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751137640 1 --2- 172.21.15.69:0/3397707489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217fe6490 0x558217fe2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751137640 1 -- 172.21.15.69:0/3397707489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217ff1480 msgr2=0x558218009490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751137640 1 --2- 172.21.15.69:0/3397707489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217ff1480 0x558218009490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751137640 1 -- 172.21.15.69:0/3397707489 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558217fec730 con 0x558217fe6db0 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751938640 1 --2- 172.21.15.69:0/3397707489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217ff1480 0x558218009490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:30:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0751137640 1 --2- 172.21.15.69:0/3397707489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fe8ae0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f074801b470 tx=0x7f074801b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61dc1c236c07b7bd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.718+0000 7f0736ffd640 1 -- 172.21.15.69:0/3397707489 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748011440 con 0x558217fe6db0 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f0736ffd640 1 -- 172.21.15.69:0/3397707489 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f074801be40 con 0x558217fe6db0 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f0736ffd640 1 -- 172.21.15.69:0/3397707489 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748005040 con 0x558217fe6db0 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f075618c740 1 -- 172.21.15.69:0/3397707489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 msgr2=0x558217fe8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f075618c740 1 --2- 172.21.15.69:0/3397707489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fe8ae0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f074801b470 tx=0x7f074801b7a0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f075618c740 1 -- 172.21.15.69:0/3397707489 shutdown_connections 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f075618c740 1 --2- 172.21.15.69:0/3397707489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217fe8ae0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f075618c740 1 --2- 172.21.15.69:0/3397707489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217ff1480 0x558218009490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f075618c740 1 --2- 172.21.15.69:0/3397707489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217fe6490 0x558217fe2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f075618c740 1 -- 172.21.15.69:0/3397707489 >> 172.21.15.69:0/3397707489 conn(0x558217fe27b0 msgr2=0x558217ffc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f075618c740 1 -- 172.21.15.69:0/3397707489 shutdown_connections 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f075618c740 1 -- 172.21.15.69:0/3397707489 wait complete. 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f075618c740 1 -- start start 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.719+0000 7f075618c740 1 Processor -- start 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f075618c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217fe6490 0x558217ff9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f075618c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217ff9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f075618c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217ff1480 0x558217fea450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f075618c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f074c1af370 con 0x558217fe6db0 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f075618c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f074c1aebe0 con 0x558217ff1480 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f075618c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f074c1abbe0 con 0x558217fe6490 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f075618c740 10 client.0 _ll_register_callbacks cb 0x558217ee5530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0751137640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217ff9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0751137640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217ff9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60504/0 (socket says 172.21.15.69:60504) 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0751137640 1 -- 172.21.15.69:0/2994170092 learned_addr learned my addr 172.21.15.69:0/2994170092 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0751938640 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217fe6490 0x558217ff9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0751137640 1 -- 172.21.15.69:0/2994170092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217fe6490 msgr2=0x558217ff9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0751137640 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217fe6490 0x558217ff9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0751137640 1 -- 172.21.15.69:0/2994170092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217ff1480 msgr2=0x558217fea450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0751137640 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217ff1480 0x558217fea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0751137640 1 -- 172.21.15.69:0/2994170092 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558217fea9c0 con 0x558217fe6db0 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0751137640 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217ff9c50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f074801b640 tx=0x7f0748003fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3c5005c663fb6a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0734ff9640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.720+0000 7f0734ff9640 1 -- 172.21.15.69:0/2994170092 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748011820 con 0x558217fe6db0 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f0734ff9640 1 -- 172.21.15.69:0/2994170092 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f0748017040 con 0x558217fe6db0 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f075618c740 1 -- 172.21.15.69:0/2994170092 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558217f590f0 con 0x558217fe6db0 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f0734ff9640 1 -- 172.21.15.69:0/2994170092 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f07480119c0 con 0x558217fe6db0 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f075618c740 10 client.16083 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f075618c740 1 -- 172.21.15.69:0/2994170092 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558218069590 con 0x558217fe6db0 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f0734ff9640 1 -- 172.21.15.69:0/2994170092 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x558217f590f0 con 0x558217fe6db0 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f0734ff9640 1 -- 172.21.15.69:0/2994170092 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f0748004680 con 0x558217fe6db0 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f075618c740 10 client.16083 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f075618c740 10 client.16083 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f075618c740 20 client.16083 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f075618c740 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558218069b90 0x55821806bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f075618c740 4 client.16083 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bf305144", "release": true, "await": true}] 2024-04-23T10:30:30.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f075618c740 1 -- 172.21.15.69:0/2994170092 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bf305144", "release": true, "await": true}) -- 0x558217f52f60 con 0x558218069b90 2024-04-23T10:30:30.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.721+0000 7f0751938640 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558218069b90 0x55821806bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.722+0000 7f0734ff9640 10 client.16083 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:30.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.722+0000 7f0751938640 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558218069b90 0x55821806bf80 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a36f86ac5029a68d server_cookie=22bb9d168b9e92ee in_seq=0 out_seq=0 2024-04-23T10:30:30.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f0734ff9640 1 -- 172.21.15.69:0/2994170092 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x558217f52f60 con 0x558218069b90 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f0734ff9640 10 client.16083 handle_command_reply: tid=0 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 1 client.16083 shutdown 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 1 -- 172.21.15.69:0/2994170092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 msgr2=0x558217ff9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217ff9c50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f074801b640 tx=0x7f0748003fb0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 1 -- 172.21.15.69:0/2994170092 shutdown_connections 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558218069b90 0x55821806bf80 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558217fe6db0 0x558217ff9c50 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558217ff1480 0x558217fea450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f0734ff9640 0 client.16083 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 1 --2- 172.21.15.69:0/2994170092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558217fe6490 0x558217ff9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 1 -- 172.21.15.69:0/2994170092 >> 172.21.15.69:0/2994170092 conn(0x558217fe27b0 msgr2=0x558217fe8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 1 -- 172.21.15.69:0/2994170092 shutdown_connections 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 1 -- 172.21.15.69:0/2994170092 wait complete. 2024-04-23T10:30:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.757+0000 7f075618c740 20 client.16083 trim_cache size 0 max 16384 2024-04-23T10:30:30.758 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:30:30.758 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 40, 2024-04-23T10:30:30.758 INFO:teuthology.orchestra.run.smithi069.stdout: "leader": 24487, 2024-04-23T10:30:30.758 INFO:teuthology.orchestra.run.smithi069.stdout: "set_version": 12, 2024-04-23T10:30:30.758 INFO:teuthology.orchestra.run.smithi069.stdout: "sets": { 2024-04-23T10:30:30.758 INFO:teuthology.orchestra.run.smithi069.stdout: "bf305144": { 2024-04-23T10:30:30.758 INFO:teuthology.orchestra.run.smithi069.stdout: "version": 12, 2024-04-23T10:30:30.758 INFO:teuthology.orchestra.run.smithi069.stdout: "age_ref": 0.0, 2024-04-23T10:30:30.758 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:30:30.758 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RELEASED", 2024-04-23T10:30:30.758 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: "timeout": 60.0, 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: "expiration": 90.0, 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: "members": { 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: "file:/": { 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: "excluded": false, 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RELEASED", 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:30.759 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:30.760 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:30:30.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 -- 172.21.15.69:0/2979647751 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07380a3d20 msgr2=0x7f07380a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07380a3d20 0x7f07380a61e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f073c0ee790 tx=0x7f073c087a80 comp rx=0 tx=0).stop 2024-04-23T10:30:30.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 -- 172.21.15.69:0/2979647751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f074c103af0 msgr2=0x7f074c19eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f074c103af0 0x7f074c19eaf0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f073c0314b0 tx=0x7f073c003c10 comp rx=0 tx=0).stop 2024-04-23T10:30:30.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 -- 172.21.15.69:0/2979647751 shutdown_connections 2024-04-23T10:30:30.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07380a3d20 0x7f07380a61e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f074c103af0 0x7f074c19eaf0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f074c10c510 0x7f074c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 --2- 172.21.15.69:0/2979647751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1031d0 0x7f074c19e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 -- 172.21.15.69:0/2979647751 >> 172.21.15.69:0/2979647751 conn(0x7f074c077f50 msgr2=0x7f074c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:30.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 -- 172.21.15.69:0/2979647751 shutdown_connections 2024-04-23T10:30:30.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.758+0000 7f075339b640 1 -- 172.21.15.69:0/2979647751 wait complete. 2024-04-23T10:30:30.767 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bf305144', seconds elapsed: 33.1 2024-04-23T10:30:30.767 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-23T10:30:30.768 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:30:30.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:30 smithi167 ceph-mon[32940]: pgmap v112: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.6 KiB/s wr, 15 op/s 2024-04-23T10:30:30.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.868+0000 7f1698e2a640 1 -- 172.21.15.69:0/585087533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694102180 msgr2=0x7f1694102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.868+0000 7f1698e2a640 1 --2- 172.21.15.69:0/585087533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694102180 0x7f1694102560 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1684009900 tx=0x7f168402a410 comp rx=0 tx=0).stop 2024-04-23T10:30:30.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.868+0000 7f1698e2a640 1 -- 172.21.15.69:0/585087533 shutdown_connections 2024-04-23T10:30:30.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.868+0000 7f1698e2a640 1 --2- 172.21.15.69:0/585087533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1694107250 0x7f169410ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.868+0000 7f1698e2a640 1 --2- 172.21.15.69:0/585087533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1694102b30 0x7f1694106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.868+0000 7f1698e2a640 1 --2- 172.21.15.69:0/585087533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694102180 0x7f1694102560 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.868+0000 7f1698e2a640 1 -- 172.21.15.69:0/585087533 >> 172.21.15.69:0/585087533 conn(0x7f1694079350 msgr2=0x7f1694079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:30.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.868+0000 7f1698e2a640 1 -- 172.21.15.69:0/585087533 shutdown_connections 2024-04-23T10:30:30.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.868+0000 7f1698e2a640 1 -- 172.21.15.69:0/585087533 wait complete. 2024-04-23T10:30:30.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f1698e2a640 1 Processor -- start 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f1698e2a640 1 -- start start 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f1698e2a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1694102180 0x7f169419e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f1698e2a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694107250 0x7f169419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f1698e2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16941986a0 0x7f1694198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f1698e2a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1694112320 con 0x7f1694107250 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f1698e2a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f16941121a0 con 0x7f1694102180 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f1698e2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f16941124a0 con 0x7f16941986a0 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f168bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694107250 0x7f169419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f168bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694107250 0x7f169419eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60520/0 (socket says 172.21.15.69:60520) 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f168bfff640 1 -- 172.21.15.69:0/1230730606 learned_addr learned my addr 172.21.15.69:0/1230730606 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f169259c640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1694102180 0x7f169419e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f1692d9d640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16941986a0 0x7f1694198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f168bfff640 1 -- 172.21.15.69:0/1230730606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16941986a0 msgr2=0x7f1694198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f168bfff640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16941986a0 0x7f1694198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f168bfff640 1 -- 172.21.15.69:0/1230730606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1694102180 msgr2=0x7f169419e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f168bfff640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1694102180 0x7f169419e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f168bfff640 1 -- 172.21.15.69:0/1230730606 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16941992a0 con 0x7f1694107250 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f168bfff640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694107250 0x7f169419eb20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f167c00d770 tx=0x7f167c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f168b7fe640 1 -- 172.21.15.69:0/1230730606 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c017070 con 0x7f1694107250 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.869+0000 7f168b7fe640 1 -- 172.21.15.69:0/1230730606 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f167c009c30 con 0x7f1694107250 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.870+0000 7f1698e2a640 1 -- 172.21.15.69:0/1230730606 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16941a5380 con 0x7f1694107250 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.870+0000 7f168b7fe640 1 -- 172.21.15.69:0/1230730606 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c00f620 con 0x7f1694107250 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.870+0000 7f1698e2a640 1 -- 172.21.15.69:0/1230730606 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16941a5780 con 0x7f1694107250 2024-04-23T10:30:30.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.870+0000 7f1698e2a640 1 -- 172.21.15.69:0/1230730606 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1694103650 con 0x7f1694107250 2024-04-23T10:30:30.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.871+0000 7f168b7fe640 1 -- 172.21.15.69:0/1230730606 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f167c01a070 con 0x7f1694107250 2024-04-23T10:30:30.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.872+0000 7f168b7fe640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f16800a3d20 0x7f16800a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:30.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.872+0000 7f169259c640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f16800a3d20 0x7f16800a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:30.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.872+0000 7f168b7fe640 1 -- 172.21.15.69:0/1230730606 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f167c0d01b0 con 0x7f1694107250 2024-04-23T10:30:30.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.873+0000 7f169259c640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f16800a3d20 0x7f16800a61e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1684006010 tx=0x7f1684000bc0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:30.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:30.876+0000 7f168b7fe640 1 -- 172.21.15.69:0/1230730606 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f167c009de0 con 0x7f1694107250 2024-04-23T10:30:30.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:30 smithi146 ceph-mon[32800]: pgmap v112: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.6 KiB/s wr, 15 op/s 2024-04-23T10:30:31.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.094+0000 7f1698e2a640 1 -- 172.21.15.69:0/1230730606 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f169410a480 con 0x7f1694107250 2024-04-23T10:30:31.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.094+0000 7f168b7fe640 1 -- 172.21.15.69:0/1230730606 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11965 (secure 0 0 0) 0x7f167c09c880 con 0x7f1694107250 2024-04-23T10:30:31.093 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:30:31.093 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:29:33.510879+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25297":{"gid":25297,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/1216686871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1216686871},{"type":"v1","addr":"172.21.15.167:6835","nonce":1216686871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24416,24392,24487,24421,24463]},"id":1}]} 2024-04-23T10:30:31.094 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 40 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 -- 172.21.15.69:0/1230730606 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f16800a3d20 msgr2=0x7f16800a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f16800a3d20 0x7f16800a61e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1684006010 tx=0x7f1684000bc0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 -- 172.21.15.69:0/1230730606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694107250 msgr2=0x7f169419eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694107250 0x7f169419eb20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f167c00d770 tx=0x7f167c00dc30 comp rx=0 tx=0).stop 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 -- 172.21.15.69:0/1230730606 shutdown_connections 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f16800a3d20 0x7f16800a61e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694107250 0x7f169419eb20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16941986a0 0x7f1694198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 --2- 172.21.15.69:0/1230730606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1694102180 0x7f169419e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 -- 172.21.15.69:0/1230730606 >> 172.21.15.69:0/1230730606 conn(0x7f1694079350 msgr2=0x7f16941000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 -- 172.21.15.69:0/1230730606 shutdown_connections 2024-04-23T10:30:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.097+0000 7f1698e2a640 1 -- 172.21.15.69:0/1230730606 wait complete. 2024-04-23T10:30:31.109 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-23T10:30:31.109 DEBUG:teuthology.orchestra.run.smithi069:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24487 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-23T10:30:31.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.218+0000 7f659d14f640 1 -- 172.21.15.69:0/2806441421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6598106170 msgr2=0x7f659810dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:31.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.218+0000 7f659d14f640 1 --2- 172.21.15.69:0/2806441421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6598106170 0x7f659810dd40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6590009ca0 tx=0x7f659002a8c0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.218+0000 7f659d14f640 1 -- 172.21.15.69:0/2806441421 shutdown_connections 2024-04-23T10:30:31.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.218+0000 7f659d14f640 1 --2- 172.21.15.69:0/2806441421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6598106170 0x7f659810dd40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.218+0000 7f659d14f640 1 --2- 172.21.15.69:0/2806441421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6598101a50 0x7f6598105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.218+0000 7f659d14f640 1 --2- 172.21.15.69:0/2806441421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65981010a0 0x7f6598101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.218+0000 7f659d14f640 1 -- 172.21.15.69:0/2806441421 >> 172.21.15.69:0/2806441421 conn(0x7f6598077f50 msgr2=0x7f6598078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:31.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.218+0000 7f659d14f640 1 -- 172.21.15.69:0/2806441421 shutdown_connections 2024-04-23T10:30:31.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.218+0000 7f659d14f640 1 -- 172.21.15.69:0/2806441421 wait complete. 2024-04-23T10:30:31.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.219+0000 7f659d14f640 1 Processor -- start 2024-04-23T10:30:31.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.219+0000 7f659d14f640 1 -- start start 2024-04-23T10:30:31.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.219+0000 7f659d14f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65981010a0 0x7f6598199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.219+0000 7f659d14f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6598106170 0x7f6598199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.219+0000 7f659d14f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f659819a160 0x7f65981a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.219+0000 7f659d14f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6598111210 con 0x7f65981010a0 2024-04-23T10:30:31.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.219+0000 7f659d14f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6598111090 con 0x7f659819a160 2024-04-23T10:30:31.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.219+0000 7f659d14f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6598111390 con 0x7f6598106170 2024-04-23T10:30:31.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65981010a0 0x7f6598199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65981010a0 0x7f6598199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60544/0 (socket says 172.21.15.69:60544) 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6596d9d640 1 -- 172.21.15.69:0/1245838306 learned_addr learned my addr 172.21.15.69:0/1245838306 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f658e59c640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6598106170 0x7f6598199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f659759e640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f659819a160 0x7f65981a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6596d9d640 1 -- 172.21.15.69:0/1245838306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6598106170 msgr2=0x7f6598199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6596d9d640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6598106170 0x7f6598199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6596d9d640 1 -- 172.21.15.69:0/1245838306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f659819a160 msgr2=0x7f65981a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6596d9d640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f659819a160 0x7f65981a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6596d9d640 1 -- 172.21.15.69:0/1245838306 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65981a4ee0 con 0x7f65981010a0 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6596d9d640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65981010a0 0x7f6598199690 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f658800c890 tx=0x7f658800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6594d99640 1 -- 172.21.15.69:0/1245838306 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588004220 con 0x7f65981010a0 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f659d14f640 1 -- 172.21.15.69:0/1245838306 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65981a51d0 con 0x7f65981010a0 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6594d99640 1 -- 172.21.15.69:0/1245838306 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f65880043c0 con 0x7f65981010a0 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f6594d99640 1 -- 172.21.15.69:0/1245838306 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658801d060 con 0x7f65981010a0 2024-04-23T10:30:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.220+0000 7f659d14f640 1 -- 172.21.15.69:0/1245838306 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65981a5720 con 0x7f65981010a0 2024-04-23T10:30:31.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.222+0000 7f6594d99640 1 -- 172.21.15.69:0/1245838306 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f6588005140 con 0x7f65981010a0 2024-04-23T10:30:31.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f659fe6b740 1 Processor -- start 2024-04-23T10:30:31.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f659fe6b740 1 -- start start 2024-04-23T10:30:31.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b50f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f9c0 0x556d0b519b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b51a090 0x556d0b51c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f659fe6b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556d0b474370 con 0x556d0b50f9c0 2024-04-23T10:30:31.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f659fe6b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556d0b4112e0 con 0x556d0b51a090 2024-04-23T10:30:31.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f659fe6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556d0b470330 con 0x556d0b50f0a0 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f6594d99640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f65840a3d20 0x7f65840a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f9c0 0x556d0b519b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f9c0 0x556d0b519b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60560/0 (socket says 172.21.15.69:60560) 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f6596d9d640 1 -- 172.21.15.69:0/1725657920 learned_addr learned my addr 172.21.15.69:0/1725657920 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f659759e640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f65840a3d20 0x7f65840a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f6594d99640 1 -- 172.21.15.69:0/1245838306 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f65880d0770 con 0x7f65981010a0 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f659759e640 1 --2- 172.21.15.69:0/1725657920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b50f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.223+0000 7f658e59c640 1 --2- 172.21.15.69:0/1725657920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b51a090 0x556d0b51c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.224+0000 7f6596d9d640 1 -- 172.21.15.69:0/1725657920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 msgr2=0x556d0b50f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.224+0000 7f6596d9d640 1 --2- 172.21.15.69:0/1725657920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b50f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.224+0000 7f6596d9d640 1 -- 172.21.15.69:0/1725657920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b51a090 msgr2=0x556d0b51c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.224+0000 7f6596d9d640 1 --2- 172.21.15.69:0/1725657920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b51a090 0x556d0b51c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.224+0000 7f6596d9d640 1 -- 172.21.15.69:0/1725657920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d0b252d80 con 0x556d0b50f9c0 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.224+0000 7f658e59c640 1 --2- 172.21.15.69:0/1725657920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b51a090 0x556d0b51c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.224+0000 7f6596d9d640 1 --2- 172.21.15.69:0/1725657920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f9c0 0x556d0b519b50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f65880991c0 tx=0x7f658806f2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00eafdb283f4c35 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.224+0000 7f659759e640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f65840a3d20 0x7f65840a61e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6590006010 tx=0x7f659002f380 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.224+0000 7f658d59a640 1 -- 172.21.15.69:0/1725657920 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658809adb0 con 0x556d0b50f9c0 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.224+0000 7f658d59a640 1 -- 172.21.15.69:0/1725657920 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f65880a0af0 con 0x556d0b50f9c0 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.224+0000 7f658d59a640 1 -- 172.21.15.69:0/1725657920 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65880a4d10 con 0x556d0b50f9c0 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 -- 172.21.15.69:0/1725657920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f9c0 msgr2=0x556d0b519b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 --2- 172.21.15.69:0/1725657920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f9c0 0x556d0b519b50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f65880991c0 tx=0x7f658806f2e0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 -- 172.21.15.69:0/1725657920 shutdown_connections 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 --2- 172.21.15.69:0/1725657920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f9c0 0x556d0b519b50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 --2- 172.21.15.69:0/1725657920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b51a090 0x556d0b51c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 --2- 172.21.15.69:0/1725657920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b50f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 -- 172.21.15.69:0/1725657920 >> 172.21.15.69:0/1725657920 conn(0x556d0b50b3c0 msgr2=0x556d0b50b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 -- 172.21.15.69:0/1725657920 shutdown_connections 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 -- 172.21.15.69:0/1725657920 wait complete. 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 -- start start 2024-04-23T10:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 Processor -- start 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b5170e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b50f9c0 0x556d0b517620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b517b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556d0b51ce20 con 0x556d0b51a090 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556d0b40efb0 con 0x556d0b50f9c0 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556d0b51cfa0 con 0x556d0b50f0a0 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659fe6b740 10 client.0 _ll_register_callbacks cb 0x556d0b40e9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659759e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b517b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659759e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b517b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60564/0 (socket says 172.21.15.69:60564) 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.225+0000 7f659759e640 1 -- 172.21.15.69:0/801429961 learned_addr learned my addr 172.21.15.69:0/801429961 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f6596d9d640 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b5170e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f658e59c640 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b50f9c0 0x556d0b517620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f659759e640 1 -- 172.21.15.69:0/801429961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 msgr2=0x556d0b5170e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f659759e640 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b5170e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f659759e640 1 -- 172.21.15.69:0/801429961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b50f9c0 msgr2=0x556d0b517620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f659759e640 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b50f9c0 0x556d0b517620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f659759e640 1 -- 172.21.15.69:0/801429961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d0b2b3510 con 0x556d0b51a090 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f659759e640 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b517b60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6590003a60 tx=0x7f6590047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1ef6656516dd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f657e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f657e7fc640 1 -- 172.21.15.69:0/801429961 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590031860 con 0x556d0b51a090 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f657e7fc640 1 -- 172.21.15.69:0/801429961 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f6590004040 con 0x556d0b51a090 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f659fe6b740 1 -- 172.21.15.69:0/801429961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65880a0af0 con 0x556d0b51a090 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f657e7fc640 1 -- 172.21.15.69:0/801429961 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6590004b40 con 0x556d0b51a090 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f659fe6b740 10 client.16101 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f659fe6b740 1 -- 172.21.15.69:0/801429961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x556d0b146670 con 0x556d0b51a090 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f657e7fc640 1 -- 172.21.15.69:0/801429961 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f65880a0af0 con 0x556d0b51a090 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.226+0000 7f657e7fc640 1 -- 172.21.15.69:0/801429961 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f659002f990 con 0x556d0b51a090 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.227+0000 7f659fe6b740 10 client.16101 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.227+0000 7f659fe6b740 10 client.16101 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.227+0000 7f659fe6b740 20 client.16101 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.227+0000 7f659fe6b740 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x556d0b52a480 0x556d0b52c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.227+0000 7f659fe6b740 4 client.16101 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.227+0000 7f659fe6b740 1 -- 172.21.15.69:0/801429961 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d0b481d90 con 0x556d0b52a480 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.227+0000 7f6596d9d640 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x556d0b52a480 0x556d0b52c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.227+0000 7f657e7fc640 10 client.16101 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.227+0000 7f6596d9d640 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x556d0b52a480 0x556d0b52c8c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50f326ba531bfb0b server_cookie=349effdd92e507cd in_seq=0 out_seq=0 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f657e7fc640 1 -- 172.21.15.69:0/801429961 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556d0b481d90 con 0x556d0b52a480 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f657e7fc640 10 client.16101 handle_command_reply: tid=0 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 1 client.16101 shutdown 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 1 -- 172.21.15.69:0/801429961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 msgr2=0x556d0b517b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b517b60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6590003a60 tx=0x7f6590047000 comp rx=0 tx=0).stop 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 1 -- 172.21.15.69:0/801429961 shutdown_connections 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x556d0b52a480 0x556d0b52c8c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b517b60 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b50f9c0 0x556d0b517620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f657e7fc640 0 client.16101 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:31.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 1 --2- 172.21.15.69:0/801429961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b5170e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 1 -- 172.21.15.69:0/801429961 >> 172.21.15.69:0/801429961 conn(0x556d0b50b3c0 msgr2=0x556d0b5111c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:31.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 1 -- 172.21.15.69:0/801429961 shutdown_connections 2024-04-23T10:30:31.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 1 -- 172.21.15.69:0/801429961 wait complete. 2024-04-23T10:30:31.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.228+0000 7f659fe6b740 20 client.16101 trim_cache size 0 max 16384 2024-04-23T10:30:31.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659fe6b740 1 Processor -- start 2024-04-23T10:30:31.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659fe6b740 1 -- start start 2024-04-23T10:30:31.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b525ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b50f9c0 0x556d0b511910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b50a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659fe6b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f65981adde0 con 0x556d0b51a090 2024-04-23T10:30:31.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659fe6b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f65981afb60 con 0x556d0b50f9c0 2024-04-23T10:30:31.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659fe6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65981ae570 con 0x556d0b50f0a0 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659759e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b50a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659759e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b50a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60570/0 (socket says 172.21.15.69:60570) 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659759e640 1 -- 172.21.15.69:0/2978446587 learned_addr learned my addr 172.21.15.69:0/2978446587 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f658e59c640 1 --2- 172.21.15.69:0/2978446587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b50f9c0 0x556d0b511910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f6596d9d640 1 --2- 172.21.15.69:0/2978446587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b525ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659759e640 1 -- 172.21.15.69:0/2978446587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 msgr2=0x556d0b525ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659759e640 1 --2- 172.21.15.69:0/2978446587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b525ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659759e640 1 -- 172.21.15.69:0/2978446587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b50f9c0 msgr2=0x556d0b511910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659759e640 1 --2- 172.21.15.69:0/2978446587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b50f9c0 0x556d0b511910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659759e640 1 -- 172.21.15.69:0/2978446587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d0b515630 con 0x556d0b51a090 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f6596d9d640 1 --2- 172.21.15.69:0/2978446587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b525ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.246+0000 7f659759e640 1 --2- 172.21.15.69:0/2978446587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b50a480 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f659002ade0 tx=0x7f6590004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8292d1bbdfc5e42d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f658cd99640 1 -- 172.21.15.69:0/2978446587 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590063030 con 0x556d0b51a090 2024-04-23T10:30:31.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f658cd99640 1 -- 172.21.15.69:0/2978446587 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6590032db0 con 0x556d0b51a090 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f658cd99640 1 -- 172.21.15.69:0/2978446587 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590030c10 con 0x556d0b51a090 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f659fe6b740 1 -- 172.21.15.69:0/2978446587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 msgr2=0x556d0b50a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f659fe6b740 1 --2- 172.21.15.69:0/2978446587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b50a480 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f659002ade0 tx=0x7f6590004a80 comp rx=0 tx=0).stop 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f659fe6b740 1 -- 172.21.15.69:0/2978446587 shutdown_connections 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f659fe6b740 1 --2- 172.21.15.69:0/2978446587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b51a090 0x556d0b50a480 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f659fe6b740 1 --2- 172.21.15.69:0/2978446587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b50f9c0 0x556d0b511910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f659fe6b740 1 --2- 172.21.15.69:0/2978446587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f0a0 0x556d0b525ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f659fe6b740 1 -- 172.21.15.69:0/2978446587 >> 172.21.15.69:0/2978446587 conn(0x556d0b50b3c0 msgr2=0x556d0b509d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f659fe6b740 1 -- 172.21.15.69:0/2978446587 shutdown_connections 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.247+0000 7f659fe6b740 1 -- 172.21.15.69:0/2978446587 wait complete. 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f659fe6b740 1 -- start start 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f659fe6b740 1 Processor -- start 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f0a0 0x556d0b514500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f9c0 0x556d0b514a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f659fe6b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b51a090 0x556d0b58fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f659fe6b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f65981af490 con 0x556d0b50f0a0 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f659fe6b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f65981aed00 con 0x556d0b51a090 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f659fe6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65981abd00 con 0x556d0b50f9c0 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f659fe6b740 10 client.0 _ll_register_callbacks cb 0x7f6590003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f0a0 0x556d0b514500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f0a0 0x556d0b514500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60576/0 (socket says 172.21.15.69:60576) 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f6596d9d640 1 -- 172.21.15.69:0/1549613058 learned_addr learned my addr 172.21.15.69:0/1549613058 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f659759e640 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b51a090 0x556d0b58fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f6596d9d640 1 -- 172.21.15.69:0/1549613058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f9c0 msgr2=0x556d0b514a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f6596d9d640 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f9c0 0x556d0b514a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f6596d9d640 1 -- 172.21.15.69:0/1549613058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b51a090 msgr2=0x556d0b58fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f6596d9d640 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b51a090 0x556d0b58fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f6596d9d640 1 -- 172.21.15.69:0/1549613058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d0b58ffd0 con 0x556d0b50f0a0 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f6596d9d640 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f0a0 0x556d0b514500 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f65880991c0 tx=0x7f65880054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2fc6de8c95b535 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f657e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:31.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f657e7fc640 1 -- 172.21.15.69:0/1549613058 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65880a4d10 con 0x556d0b50f0a0 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f657e7fc640 1 -- 172.21.15.69:0/1549613058 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f65880ce1e0 con 0x556d0b50f0a0 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.248+0000 7f659fe6b740 1 -- 172.21.15.69:0/1549613058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6590032db0 con 0x556d0b50f0a0 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f657e7fc640 1 -- 172.21.15.69:0/1549613058 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f658809adb0 con 0x556d0b50f0a0 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f659fe6b740 10 client.16107 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f659fe6b740 1 -- 172.21.15.69:0/1549613058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x556d0b591200 con 0x556d0b50f0a0 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f657e7fc640 1 -- 172.21.15.69:0/1549613058 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6590032db0 con 0x556d0b50f0a0 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f657e7fc640 1 -- 172.21.15.69:0/1549613058 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f65880b4070 con 0x556d0b50f0a0 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f659fe6b740 10 client.16107 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f659fe6b740 10 client.16107 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f659fe6b740 20 client.16107 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f659fe6b740 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x556d0b5916c0 0x556d0b593ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f659fe6b740 4 client.16107 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f659fe6b740 1 -- 172.21.15.69:0/1549613058 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x556d0b47bc00 con 0x556d0b5916c0 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.249+0000 7f658e59c640 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x556d0b5916c0 0x556d0b593ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.250+0000 7f658e59c640 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x556d0b5916c0 0x556d0b593ad0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e01007d6f8b1fad server_cookie=ae80a3dd450c3511 in_seq=0 out_seq=0 2024-04-23T10:30:31.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.250+0000 7f657e7fc640 10 client.16107 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:31.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:31 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2864460360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:30:31.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:31 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1230730606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:30:31.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:31 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2864460360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:30:31.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:31 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1230730606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:30:31.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.888+0000 7f657e7fc640 1 -- 172.21.15.69:0/1549613058 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x556d0b47bc00 con 0x556d0b5916c0 2024-04-23T10:30:31.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.888+0000 7f657e7fc640 10 client.16107 handle_command_reply: tid=0 2024-04-23T10:30:31.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.888+0000 7f659fe6b740 1 client.16107 shutdown 2024-04-23T10:30:31.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f659fe6b740 1 -- 172.21.15.69:0/1549613058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f0a0 msgr2=0x556d0b514500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:31.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f659fe6b740 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f0a0 0x556d0b514500 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f65880991c0 tx=0x7f65880054e0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f659fe6b740 1 -- 172.21.15.69:0/1549613058 shutdown_connections 2024-04-23T10:30:31.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f659fe6b740 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x556d0b5916c0 0x556d0b593ad0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f659fe6b740 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d0b51a090 0x556d0b58fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f659fe6b740 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d0b50f9c0 0x556d0b514a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f659fe6b740 1 --2- 172.21.15.69:0/1549613058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556d0b50f0a0 0x556d0b514500 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f657e7fc640 0 client.16107 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:31.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f659fe6b740 1 -- 172.21.15.69:0/1549613058 >> 172.21.15.69:0/1549613058 conn(0x556d0b50b3c0 msgr2=0x556d0b5191a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:31.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f659fe6b740 1 -- 172.21.15.69:0/1549613058 shutdown_connections 2024-04-23T10:30:31.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f659fe6b740 1 -- 172.21.15.69:0/1549613058 wait complete. 2024-04-23T10:30:31.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.889+0000 7f659fe6b740 20 client.16107 trim_cache size 0 max 16384 2024-04-23T10:30:31.889 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:30:31.889 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 40, 2024-04-23T10:30:31.889 INFO:teuthology.orchestra.run.smithi069.stdout: "leader": 24487, 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "set_version": 14, 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "sets": { 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "af2ef696": { 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "version": 14, 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "age_ref": 0.0, 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "QUIESCED", 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "timeout": 60.0, 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "expiration": 90.0, 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "members": { 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "file:/": { 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "excluded": false, 2024-04-23T10:30:31.890 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:30:31.891 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "QUIESCED", 2024-04-23T10:30:31.891 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:30:31.891 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:31.891 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:31.891 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:31.891 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:31.891 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:30:31.891 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:30:31.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 -- 172.21.15.69:0/1245838306 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f65840a3d20 msgr2=0x7f65840a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f65840a3d20 0x7f65840a61e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6590006010 tx=0x7f659002f380 comp rx=0 tx=0).stop 2024-04-23T10:30:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 -- 172.21.15.69:0/1245838306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65981010a0 msgr2=0x7f6598199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65981010a0 0x7f6598199690 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f658800c890 tx=0x7f658800cd50 comp rx=0 tx=0).stop 2024-04-23T10:30:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 -- 172.21.15.69:0/1245838306 shutdown_connections 2024-04-23T10:30:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f65840a3d20 0x7f65840a61e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f659819a160 0x7f65981a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6598106170 0x7f6598199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 --2- 172.21.15.69:0/1245838306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65981010a0 0x7f6598199690 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 -- 172.21.15.69:0/1245838306 >> 172.21.15.69:0/1245838306 conn(0x7f6598077f50 msgr2=0x7f65980fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 -- 172.21.15.69:0/1245838306 shutdown_connections 2024-04-23T10:30:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:30:31.890+0000 7f659d14f640 1 -- 172.21.15.69:0/1245838306 wait complete. 2024-04-23T10:30:31.902 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'af2ef696', quiesce took 1.1 seconds. Will release after: 30.0 2024-04-23T10:30:31.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:31 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2864460360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:30:31.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:31 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1230730606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:30:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.350+0000 7efde574a640 1 -- 172.21.15.69:0/615258274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde01011a0 msgr2=0x7efde0101600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.350+0000 7efde574a640 1 --2- 172.21.15.69:0/615258274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde01011a0 0x7efde0101600 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009900 tx=0x7efdc802a400 comp rx=0 tx=0).stop 2024-04-23T10:30:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.350+0000 7efde574a640 1 -- 172.21.15.69:0/615258274 shutdown_connections 2024-04-23T10:30:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.350+0000 7efde574a640 1 --2- 172.21.15.69:0/615258274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde01011a0 0x7efde0101600 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.350+0000 7efde574a640 1 --2- 172.21.15.69:0/615258274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde0101b40 0x7efde010dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.350+0000 7efde574a640 1 --2- 172.21.15.69:0/615258274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efde0105e20 0x7efde0106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.350+0000 7efde574a640 1 -- 172.21.15.69:0/615258274 >> 172.21.15.69:0/615258274 conn(0x7efde0076c50 msgr2=0x7efde0077060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.350+0000 7efde574a640 1 -- 172.21.15.69:0/615258274 shutdown_connections 2024-04-23T10:30:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.350+0000 7efde574a640 1 -- 172.21.15.69:0/615258274 wait complete. 2024-04-23T10:30:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efde574a640 1 Processor -- start 2024-04-23T10:30:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efde574a640 1 -- start start 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efde574a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde01011a0 0x7efde019e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efde574a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde0101b40 0x7efde019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efde574a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efde0105e20 0x7efde0198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efde574a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7efde01112f0 con 0x7efde01011a0 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efde574a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efde0111170 con 0x7efde0105e20 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efde574a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efde0111470 con 0x7efde0101b40 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efddeffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde01011a0 0x7efde019e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efddeffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde01011a0 0x7efde019e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60586/0 (socket says 172.21.15.69:60586) 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efddeffd640 1 -- 172.21.15.69:0/1295629961 learned_addr learned my addr 172.21.15.69:0/1295629961 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.351+0000 7efddf7fe640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efde0105e20 0x7efde0198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efdd7fff640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde0101b40 0x7efde019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efddeffd640 1 -- 172.21.15.69:0/1295629961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde0101b40 msgr2=0x7efde019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efddeffd640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde0101b40 0x7efde019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efddeffd640 1 -- 172.21.15.69:0/1295629961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efde0105e20 msgr2=0x7efde0198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efddeffd640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efde0105e20 0x7efde0198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efddeffd640 1 -- 172.21.15.69:0/1295629961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde0198da0 con 0x7efde01011a0 2024-04-23T10:30:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efdd7fff640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde0101b40 0x7efde019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:30:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efddeffd640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde01011a0 0x7efde019e420 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7efdd000d950 tx=0x7efdd000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efddcff9640 1 -- 172.21.15.69:0/1295629961 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0017070 con 0x7efde01011a0 2024-04-23T10:30:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efde574a640 1 -- 172.21.15.69:0/1295629961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde0199090 con 0x7efde01011a0 2024-04-23T10:30:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efddcff9640 1 -- 172.21.15.69:0/1295629961 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efdd0009c30 con 0x7efde01011a0 2024-04-23T10:30:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efddcff9640 1 -- 172.21.15.69:0/1295629961 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd000f6b0 con 0x7efde01011a0 2024-04-23T10:30:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.352+0000 7efde574a640 1 -- 172.21.15.69:0/1295629961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde01a52e0 con 0x7efde01011a0 2024-04-23T10:30:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.354+0000 7efddcff9640 1 -- 172.21.15.69:0/1295629961 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7efdd00109c0 con 0x7efde01011a0 2024-04-23T10:30:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efde845c740 1 Processor -- start 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efde845c740 1 -- start start 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efde845c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea859a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efddcff9640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efdcc0a3dc0 0x7efdcc0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efde845c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea8642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efde845c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea864800 0x5558ea866bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efde845c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5558ea7be970 con 0x5558ea859620 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efde845c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5558ea75b4a0 con 0x5558ea864800 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efde845c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5558ea7ba930 con 0x5558ea859f40 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efddf7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea859a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efddeffd640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efdcc0a3dc0 0x7efdcc0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efddf7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea859a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60592/0 (socket says 172.21.15.69:60592) 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efddf7fe640 1 -- 172.21.15.69:0/8619954 learned_addr learned my addr 172.21.15.69:0/8619954 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efddcff9640 1 -- 172.21.15.69:0/1295629961 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7efdd00d03c0 con 0x7efde01011a0 2024-04-23T10:30:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efddf7fe640 1 --2- 172.21.15.69:0/8619954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea864800 0x5558ea866bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efdd7fff640 1 --2- 172.21.15.69:0/8619954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea8642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.355+0000 7efddf7fe640 1 -- 172.21.15.69:0/8619954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 msgr2=0x5558ea8642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.356+0000 7efddf7fe640 1 --2- 172.21.15.69:0/8619954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea8642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.356+0000 7efddf7fe640 1 -- 172.21.15.69:0/8619954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea864800 msgr2=0x5558ea866bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.356+0000 7efddf7fe640 1 --2- 172.21.15.69:0/8619954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea864800 0x5558ea866bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.356+0000 7efddf7fe640 1 -- 172.21.15.69:0/8619954 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558ea4d1210 con 0x5558ea859620 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.356+0000 7efddeffd640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efdcc0a3dc0 0x7efdcc0a6280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efdd009b250 tx=0x7efdd0097f90 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.356+0000 7efddf7fe640 1 --2- 172.21.15.69:0/8619954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea859a00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7efdd8005c20 tx=0x7efdd8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9271e7959e70d379 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.356+0000 7efdd57fa640 1 -- 172.21.15.69:0/8619954 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8014050 con 0x5558ea859620 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.356+0000 7efdd57fa640 1 -- 172.21.15.69:0/8619954 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efdd80141f0 con 0x5558ea859620 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.356+0000 7efdd57fa640 1 -- 172.21.15.69:0/8619954 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd801c740 con 0x5558ea859620 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 -- 172.21.15.69:0/8619954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 msgr2=0x5558ea859a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 --2- 172.21.15.69:0/8619954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea859a00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7efdd8005c20 tx=0x7efdd8009b80 comp rx=0 tx=0).stop 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 -- 172.21.15.69:0/8619954 shutdown_connections 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 --2- 172.21.15.69:0/8619954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea864800 0x5558ea866bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 --2- 172.21.15.69:0/8619954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea8642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 --2- 172.21.15.69:0/8619954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea859a00 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 -- 172.21.15.69:0/8619954 >> 172.21.15.69:0/8619954 conn(0x5558ea855b30 msgr2=0x5558ea855f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 -- 172.21.15.69:0/8619954 shutdown_connections 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 -- 172.21.15.69:0/8619954 wait complete. 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 -- start start 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 Processor -- start 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.357+0000 7efde845c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea859620 0x5558ea8640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efde845c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea8613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efde845c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea864800 0x5558ea8618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efde845c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5558ea8673d0 con 0x5558ea864800 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efde845c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5558ea7590b0 con 0x5558ea859620 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efde845c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5558ea867550 con 0x5558ea859f40 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efde845c740 10 client.0 _ll_register_callbacks cb 0x5558ea746d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efddf7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea864800 0x5558ea8618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efddf7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea864800 0x5558ea8618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60606/0 (socket says 172.21.15.69:60606) 2024-04-23T10:30:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efddf7fe640 1 -- 172.21.15.69:0/781407130 learned_addr learned my addr 172.21.15.69:0/781407130 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efddf7fe640 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea859620 0x5558ea8640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efdd7fff640 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea8613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efddf7fe640 1 -- 172.21.15.69:0/781407130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 msgr2=0x5558ea8613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efddf7fe640 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea8613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efddf7fe640 1 -- 172.21.15.69:0/781407130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea859620 msgr2=0x5558ea8640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efddf7fe640 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea859620 0x5558ea8640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efddf7fe640 1 -- 172.21.15.69:0/781407130 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558ea59d620 con 0x5558ea864800 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efddf7fe640 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea864800 0x5558ea8618e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7efdd8012e50 tx=0x7efdd8012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0a75f5bf635a8d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efdc67fc640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efdc67fc640 1 -- 172.21.15.69:0/781407130 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8004c50 con 0x5558ea864800 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efdc67fc640 1 -- 172.21.15.69:0/781407130 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7efdd8004df0 con 0x5558ea864800 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efde845c740 1 -- 172.21.15.69:0/781407130 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdd80141f0 con 0x5558ea864800 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efdc67fc640 1 -- 172.21.15.69:0/781407130 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7efdd8003970 con 0x5558ea864800 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.358+0000 7efde845c740 10 client.16119 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.359+0000 7efde845c740 1 -- 172.21.15.69:0/781407130 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5558ea873280 con 0x5558ea864800 2024-04-23T10:30:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.359+0000 7efdc67fc640 1 -- 172.21.15.69:0/781407130 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efdd80141f0 con 0x5558ea864800 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.359+0000 7efdc67fc640 1 -- 172.21.15.69:0/781407130 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7efdd800f040 con 0x5558ea864800 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.359+0000 7efde845c740 10 client.16119 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.359+0000 7efde845c740 10 client.16119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.359+0000 7efde845c740 20 client.16119 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.359+0000 7efde845c740 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5558ea874740 0x5558ea876b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.359+0000 7efde845c740 4 client.16119 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.359+0000 7efde845c740 1 -- 172.21.15.69:0/781407130 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558ea7cc390 con 0x5558ea874740 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.359+0000 7efdd7fff640 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5558ea874740 0x5558ea876b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.360+0000 7efdd7fff640 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5558ea874740 0x5558ea876b30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc24031bd0030845 server_cookie=62d7f82e966f3693 in_seq=0 out_seq=0 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.360+0000 7efdc67fc640 10 client.16119 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.360+0000 7efdc67fc640 1 -- 172.21.15.69:0/781407130 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5558ea7cc390 con 0x5558ea874740 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.360+0000 7efdc67fc640 10 client.16119 handle_command_reply: tid=0 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.360+0000 7efde845c740 1 client.16119 shutdown 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efde845c740 1 -- 172.21.15.69:0/781407130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea864800 msgr2=0x5558ea8618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efde845c740 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea864800 0x5558ea8618e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7efdd8012e50 tx=0x7efdd8012d50 comp rx=0 tx=0).stop 2024-04-23T10:30:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efde845c740 1 -- 172.21.15.69:0/781407130 shutdown_connections 2024-04-23T10:30:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efde845c740 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5558ea874740 0x5558ea876b30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efde845c740 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea864800 0x5558ea8618e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efde845c740 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea8613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efdc67fc640 0 client.16119 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efde845c740 1 --2- 172.21.15.69:0/781407130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea859620 0x5558ea8640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efde845c740 1 -- 172.21.15.69:0/781407130 >> 172.21.15.69:0/781407130 conn(0x5558ea855b30 msgr2=0x5558ea85b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efde845c740 1 -- 172.21.15.69:0/781407130 shutdown_connections 2024-04-23T10:30:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efde845c740 1 -- 172.21.15.69:0/781407130 wait complete. 2024-04-23T10:30:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.361+0000 7efde845c740 20 client.16119 trim_cache size 0 max 16384 2024-04-23T10:30:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.376+0000 7efde845c740 1 Processor -- start 2024-04-23T10:30:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.376+0000 7efde845c740 1 -- start start 2024-04-23T10:30:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.376+0000 7efde845c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea870290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.376+0000 7efde845c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea860500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.376+0000 7efde845c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea864800 0x5558ea854b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.376+0000 7efde845c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7efde01aba10 con 0x5558ea859620 2024-04-23T10:30:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.376+0000 7efde845c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efde01ad790 con 0x5558ea864800 2024-04-23T10:30:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.376+0000 7efde845c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efde01ac1a0 con 0x5558ea859f40 2024-04-23T10:30:32.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.376+0000 7efddf7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea870290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.376+0000 7efddf7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea870290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60610/0 (socket says 172.21.15.69:60610) 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.376+0000 7efddf7fe640 1 -- 172.21.15.69:0/4069624068 learned_addr learned my addr 172.21.15.69:0/4069624068 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.377+0000 7efdd7fff640 1 --2- 172.21.15.69:0/4069624068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea860500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.377+0000 7efddf7fe640 1 -- 172.21.15.69:0/4069624068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 msgr2=0x5558ea860500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.377+0000 7efddf7fe640 1 --2- 172.21.15.69:0/4069624068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea860500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.377+0000 7efddf7fe640 1 -- 172.21.15.69:0/4069624068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea864800 msgr2=0x5558ea854b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.377+0000 7efddf7fe640 1 --2- 172.21.15.69:0/4069624068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea864800 0x5558ea854b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.377+0000 7efddf7fe640 1 -- 172.21.15.69:0/4069624068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558ea861ee0 con 0x5558ea859620 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.377+0000 7efddf7fe640 1 --2- 172.21.15.69:0/4069624068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea870290 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7efdd802a040 tx=0x7efdd8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96be334b673cdc7e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.377+0000 7efdd4ff9640 1 -- 172.21.15.69:0/4069624068 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd802c040 con 0x5558ea859620 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.377+0000 7efdd4ff9640 1 -- 172.21.15.69:0/4069624068 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efdd8012760 con 0x5558ea859620 2024-04-23T10:30:32.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.377+0000 7efdd4ff9640 1 -- 172.21.15.69:0/4069624068 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd801c850 con 0x5558ea859620 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.378+0000 7efde845c740 1 -- 172.21.15.69:0/4069624068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 msgr2=0x5558ea870290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.378+0000 7efde845c740 1 --2- 172.21.15.69:0/4069624068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea870290 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7efdd802a040 tx=0x7efdd8000f40 comp rx=0 tx=0).stop 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.378+0000 7efde845c740 1 -- 172.21.15.69:0/4069624068 shutdown_connections 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.378+0000 7efde845c740 1 --2- 172.21.15.69:0/4069624068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea864800 0x5558ea854b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.378+0000 7efde845c740 1 --2- 172.21.15.69:0/4069624068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea859f40 0x5558ea860500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.378+0000 7efde845c740 1 --2- 172.21.15.69:0/4069624068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859620 0x5558ea870290 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.378+0000 7efde845c740 1 -- 172.21.15.69:0/4069624068 >> 172.21.15.69:0/4069624068 conn(0x5558ea855b30 msgr2=0x5558ea854420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.378+0000 7efde845c740 1 -- 172.21.15.69:0/4069624068 shutdown_connections 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.378+0000 7efde845c740 1 -- 172.21.15.69:0/4069624068 wait complete. 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.378+0000 7efde845c740 1 -- start start 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.378+0000 7efde845c740 1 Processor -- start 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efde845c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea859620 0x5558ea865360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efde845c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859f40 0x5558ea8658a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efde845c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea864800 0x5558ea86b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efde845c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7efde01ad0c0 con 0x5558ea859f40 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efde845c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efde01ac930 con 0x5558ea859620 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efde845c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efde01a9930 con 0x5558ea864800 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efde845c740 10 client.0 _ll_register_callbacks cb 0x7efdd8012a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdd7fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859f40 0x5558ea8658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdd7fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859f40 0x5558ea8658a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60614/0 (socket says 172.21.15.69:60614) 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdd7fff640 1 -- 172.21.15.69:0/196238187 learned_addr learned my addr 172.21.15.69:0/196238187 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efddf7fe640 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea859620 0x5558ea865360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efddf7fe640 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea864800 0x5558ea86b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdd7fff640 1 -- 172.21.15.69:0/196238187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea864800 msgr2=0x5558ea86b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdd7fff640 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea864800 0x5558ea86b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdd7fff640 1 -- 172.21.15.69:0/196238187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea859620 msgr2=0x5558ea865360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdd7fff640 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea859620 0x5558ea865360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdd7fff640 1 -- 172.21.15.69:0/196238187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558ea8661a0 con 0x5558ea859f40 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efddf7fe640 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea859620 0x5558ea865360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdd7fff640 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859f40 0x5558ea8658a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009230 tx=0x7efdc8004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae09581d16e31ce server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdc67fc640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdc67fc640 1 -- 172.21.15.69:0/196238187 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8035040 con 0x5558ea859f40 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdc67fc640 1 -- 172.21.15.69:0/196238187 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7efdc8005040 con 0x5558ea859f40 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efde845c740 1 -- 172.21.15.69:0/196238187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdd8012760 con 0x5558ea859f40 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efdc67fc640 1 -- 172.21.15.69:0/196238187 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7efdc80044d0 con 0x5558ea859f40 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efde845c740 10 client.16125 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.379+0000 7efde845c740 1 -- 172.21.15.69:0/196238187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5558ea86cdf0 con 0x5558ea859f40 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.380+0000 7efdc67fc640 1 -- 172.21.15.69:0/196238187 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efdd8012760 con 0x5558ea859f40 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.380+0000 7efdc67fc640 1 -- 172.21.15.69:0/196238187 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7efdc80046c0 con 0x5558ea859f40 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.380+0000 7efde845c740 10 client.16125 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.380+0000 7efde845c740 10 client.16125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.380+0000 7efde845c740 20 client.16125 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.380+0000 7efde845c740 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5558ea8dadf0 0x5558ea8dd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.380+0000 7efde845c740 4 client.16125 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:30:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.380+0000 7efde845c740 1 -- 172.21.15.69:0/196238187 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5558ea7c6200 con 0x5558ea8dadf0 2024-04-23T10:30:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.380+0000 7efddf7fe640 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5558ea8dadf0 0x5558ea8dd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.381+0000 7efddf7fe640 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5558ea8dadf0 0x5558ea8dd210 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d11287e8eaeaeb4c server_cookie=79891de94bf2e6e8 in_seq=0 out_seq=0 2024-04-23T10:30:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.381+0000 7efdc67fc640 10 client.16125 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.388+0000 7efdc67fc640 1 -- 172.21.15.69:0/196238187 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5558ea7c6200 con 0x5558ea8dadf0 2024-04-23T10:30:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.388+0000 7efdc67fc640 10 client.16125 handle_command_reply: tid=0 2024-04-23T10:30:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 1 client.16125 shutdown 2024-04-23T10:30:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 1 -- 172.21.15.69:0/196238187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859f40 msgr2=0x5558ea8658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859f40 0x5558ea8658a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009230 tx=0x7efdc8004320 comp rx=0 tx=0).stop 2024-04-23T10:30:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 1 -- 172.21.15.69:0/196238187 shutdown_connections 2024-04-23T10:30:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x5558ea8dadf0 0x5558ea8dd210 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ea859f40 0x5558ea8658a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5558ea864800 0x5558ea86b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efdc67fc640 0 client.16125 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 1 --2- 172.21.15.69:0/196238187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5558ea859620 0x5558ea865360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 1 -- 172.21.15.69:0/196238187 >> 172.21.15.69:0/196238187 conn(0x5558ea855b30 msgr2=0x5558ea85b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 1 -- 172.21.15.69:0/196238187 shutdown_connections 2024-04-23T10:30:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 1 -- 172.21.15.69:0/196238187 wait complete. 2024-04-23T10:30:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde845c740 20 client.16125 trim_cache size 0 max 16384 2024-04-23T10:30:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:30:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:30:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:30:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:30:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde574a640 1 -- 172.21.15.69:0/1295629961 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efdcc0a3dc0 msgr2=0x7efdcc0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde574a640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efdcc0a3dc0 0x7efdcc0a6280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efdd009b250 tx=0x7efdd0097f90 comp rx=0 tx=0).stop 2024-04-23T10:30:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde574a640 1 -- 172.21.15.69:0/1295629961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde01011a0 msgr2=0x7efde019e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde574a640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde01011a0 0x7efde019e420 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7efdd000d950 tx=0x7efdd000de10 comp rx=0 tx=0).stop 2024-04-23T10:30:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde574a640 1 -- 172.21.15.69:0/1295629961 shutdown_connections 2024-04-23T10:30:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde574a640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efdcc0a3dc0 0x7efdcc0a6280 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde574a640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efde0105e20 0x7efde0198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde574a640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efde0101b40 0x7efde019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde574a640 1 --2- 172.21.15.69:0/1295629961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde01011a0 0x7efde019e420 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.389+0000 7efde574a640 1 -- 172.21.15.69:0/1295629961 >> 172.21.15.69:0/1295629961 conn(0x7efde0076c50 msgr2=0x7efde006a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.390+0000 7efde574a640 1 -- 172.21.15.69:0/1295629961 shutdown_connections 2024-04-23T10:30:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:32.390+0000 7efde574a640 1 -- 172.21.15.69:0/1295629961 wait complete. 2024-04-23T10:30:32.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:32 smithi069 ceph-mon[29593]: pgmap v113: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-04-23T10:30:32.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:32 smithi167 ceph-mon[32940]: pgmap v113: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-04-23T10:30:32.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:32 smithi146 ceph-mon[32800]: pgmap v113: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-04-23T10:30:34.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:34 smithi069 ceph-mon[29593]: pgmap v114: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-04-23T10:30:34.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:34 smithi167 ceph-mon[32940]: pgmap v114: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-04-23T10:30:34.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:34 smithi146 ceph-mon[32800]: pgmap v114: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-04-23T10:30:36.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:36 smithi069 ceph-mon[29593]: pgmap v115: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-04-23T10:30:36.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:36 smithi167 ceph-mon[32940]: pgmap v115: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-04-23T10:30:36.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:36 smithi146 ceph-mon[32800]: pgmap v115: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-04-23T10:30:38.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:38 smithi069 ceph-mon[29593]: pgmap v116: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-04-23T10:30:38.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:38 smithi167 ceph-mon[32940]: pgmap v116: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-04-23T10:30:38.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:38 smithi146 ceph-mon[32800]: pgmap v116: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-04-23T10:30:40.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:40 smithi069 ceph-mon[29593]: pgmap v117: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 19 op/s 2024-04-23T10:30:40.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:40 smithi167 ceph-mon[32940]: pgmap v117: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 19 op/s 2024-04-23T10:30:40.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:40 smithi146 ceph-mon[32800]: pgmap v117: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 19 op/s 2024-04-23T10:30:42.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:42 smithi069 ceph-mon[29593]: pgmap v118: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-04-23T10:30:42.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:42 smithi167 ceph-mon[32940]: pgmap v118: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-04-23T10:30:42.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:42 smithi146 ceph-mon[32800]: pgmap v118: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-04-23T10:30:44.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:44 smithi069 ceph-mon[29593]: pgmap v119: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-04-23T10:30:44.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:44 smithi167 ceph-mon[32940]: pgmap v119: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-04-23T10:30:44.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:44 smithi146 ceph-mon[32800]: pgmap v119: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-04-23T10:30:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.486+0000 7f8736b44640 1 -- 172.21.15.69:0/625496183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873006b120 msgr2=0x7f873010edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.486+0000 7f8736b44640 1 --2- 172.21.15.69:0/625496183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873006b120 0x7f873010edf0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8728009cd0 tx=0x7f872802a8e0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.486+0000 7f8736b44640 1 -- 172.21.15.69:0/625496183 shutdown_connections 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.486+0000 7f8736b44640 1 --2- 172.21.15.69:0/625496183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873006b120 0x7f873010edf0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.486+0000 7f8736b44640 1 --2- 172.21.15.69:0/625496183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f873006a780 0x7f873006abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.486+0000 7f8736b44640 1 --2- 172.21.15.69:0/625496183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8730107fe0 0x7f87301083c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.486+0000 7f8736b44640 1 -- 172.21.15.69:0/625496183 >> 172.21.15.69:0/625496183 conn(0x7f8730076c50 msgr2=0x7f8730077060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.486+0000 7f8736b44640 1 -- 172.21.15.69:0/625496183 shutdown_connections 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.486+0000 7f8736b44640 1 -- 172.21.15.69:0/625496183 wait complete. 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f8736b44640 1 Processor -- start 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f8736b44640 1 -- start start 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f8736b44640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873006a780 0x7f87301987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f8736b44640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f873006b120 0x7f8730198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f8736b44640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8730107fe0 0x7f873019d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f8736b44640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f87301122f0 con 0x7f873006a780 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f8736b44640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112170 con 0x7f8730107fe0 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f8736b44640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112470 con 0x7f873006b120 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f87348e0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873006a780 0x7f87301987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f87348e0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873006a780 0x7f87301987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60404/0 (socket says 172.21.15.69:60404) 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f87348e0640 1 -- 172.21.15.69:0/1236563875 learned_addr learned my addr 172.21.15.69:0/1236563875 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f87350e1640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8730107fe0 0x7f873019d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.487+0000 7f872ffff640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f873006b120 0x7f8730198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f87348e0640 1 -- 172.21.15.69:0/1236563875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f873006b120 msgr2=0x7f8730198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f87348e0640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f873006b120 0x7f8730198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f87348e0640 1 -- 172.21.15.69:0/1236563875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8730107fe0 msgr2=0x7f873019d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f87348e0640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8730107fe0 0x7f873019d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f87348e0640 1 -- 172.21.15.69:0/1236563875 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873019d750 con 0x7f873006a780 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f872ffff640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f873006b120 0x7f8730198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:30:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f87348e0640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873006a780 0x7f87301987b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f872400e9f0 tx=0x7f872400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f872dffb640 1 -- 172.21.15.69:0/1236563875 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872400cd80 con 0x7f873006a780 2024-04-23T10:30:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f872dffb640 1 -- 172.21.15.69:0/1236563875 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8724010900 con 0x7f873006a780 2024-04-23T10:30:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f8736b44640 1 -- 172.21.15.69:0/1236563875 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873019da40 con 0x7f873006a780 2024-04-23T10:30:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f872dffb640 1 -- 172.21.15.69:0/1236563875 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724018920 con 0x7f873006a780 2024-04-23T10:30:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.488+0000 7f8736b44640 1 -- 172.21.15.69:0/1236563875 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87301a52d0 con 0x7f873006a780 2024-04-23T10:30:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.490+0000 7f872dffb640 1 -- 172.21.15.69:0/1236563875 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f8724010ab0 con 0x7f873006a780 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f873985e740 1 Processor -- start 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f873985e740 1 -- start start 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f873985e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe87a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f873985e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f873985e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebe94bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f873985e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dbebdec970 con 0x55dbebe87620 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f873985e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dbebd894a0 con 0x55dbebe92800 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f873985e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dbebde8930 con 0x55dbebe87f40 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f872dffb640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f87200a3dc0 0x7f87200a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f87350e1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe87a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f87350e1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe87a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60418/0 (socket says 172.21.15.69:60418) 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f87350e1640 1 -- 172.21.15.69:0/2114725951 learned_addr learned my addr 172.21.15.69:0/2114725951 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f87350e1640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f87200a3dc0 0x7f87200a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f872dffb640 1 -- 172.21.15.69:0/1236563875 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f87240d0c10 con 0x7f873006a780 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f872ffff640 1 --2- 172.21.15.69:0/2114725951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebe94bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f87348e0640 1 --2- 172.21.15.69:0/2114725951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f87350e1640 1 -- 172.21.15.69:0/2114725951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 msgr2=0x55dbebe922c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f87350e1640 1 --2- 172.21.15.69:0/2114725951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe922c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f87350e1640 1 -- 172.21.15.69:0/2114725951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 msgr2=0x55dbebe94bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f87350e1640 1 --2- 172.21.15.69:0/2114725951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebe94bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f87350e1640 1 -- 172.21.15.69:0/2114725951 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbebaff210 con 0x55dbebe87620 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.491+0000 7f872ffff640 1 --2- 172.21.15.69:0/2114725951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebe94bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.492+0000 7f87350e1640 1 --2- 172.21.15.69:0/2114725951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe87a00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8728005fe0 tx=0x7f8728031b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a5c361bce8097a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.492+0000 7f87350e1640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f87200a3dc0 0x7f87200a6280 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8728009cd0 tx=0x7f8728036000 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.492+0000 7f871affd640 1 -- 172.21.15.69:0/2114725951 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872804e070 con 0x55dbebe87620 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.492+0000 7f871affd640 1 -- 172.21.15.69:0/2114725951 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8728036070 con 0x55dbebe87620 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.492+0000 7f871affd640 1 -- 172.21.15.69:0/2114725951 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728030ed0 con 0x55dbebe87620 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.493+0000 7f873985e740 1 -- 172.21.15.69:0/2114725951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 msgr2=0x55dbebe87a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.493+0000 7f873985e740 1 --2- 172.21.15.69:0/2114725951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe87a00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8728005fe0 tx=0x7f8728031b80 comp rx=0 tx=0).stop 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.493+0000 7f873985e740 1 -- 172.21.15.69:0/2114725951 shutdown_connections 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.493+0000 7f873985e740 1 --2- 172.21.15.69:0/2114725951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebe94bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.493+0000 7f873985e740 1 --2- 172.21.15.69:0/2114725951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe922c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.493+0000 7f873985e740 1 --2- 172.21.15.69:0/2114725951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe87a00 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.493+0000 7f873985e740 1 -- 172.21.15.69:0/2114725951 >> 172.21.15.69:0/2114725951 conn(0x55dbebe83b30 msgr2=0x55dbebe83f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.493+0000 7f873985e740 1 -- 172.21.15.69:0/2114725951 shutdown_connections 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.493+0000 7f873985e740 1 -- 172.21.15.69:0/2114725951 wait complete. 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.493+0000 7f873985e740 1 -- start start 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.493+0000 7f873985e740 1 Processor -- start 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f873985e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe87620 0x55dbebe92200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f873985e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe8f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f873985e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe92800 0x55dbebe8fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f873985e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dbebe953d0 con 0x55dbebe92800 2024-04-23T10:30:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f873985e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dbebd870b0 con 0x55dbebe87620 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f873985e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dbebe95550 con 0x55dbebe87f40 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f873985e740 10 client.0 _ll_register_callbacks cb 0x55dbebd74d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f87350e1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe92800 0x55dbebe8fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f87350e1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe92800 0x55dbebe8fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60434/0 (socket says 172.21.15.69:60434) 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f87350e1640 1 -- 172.21.15.69:0/7515830 learned_addr learned my addr 172.21.15.69:0/7515830 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f87348e0640 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe87620 0x55dbebe92200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f872ffff640 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe8f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f87350e1640 1 -- 172.21.15.69:0/7515830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 msgr2=0x55dbebe8f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f87350e1640 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe8f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f87350e1640 1 -- 172.21.15.69:0/7515830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe87620 msgr2=0x55dbebe92200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f87350e1640 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe87620 0x55dbebe92200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.494+0000 7f87350e1640 1 -- 172.21.15.69:0/7515830 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbebbcb620 con 0x55dbebe92800 2024-04-23T10:30:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.495+0000 7f87350e1640 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe92800 0x55dbebe8fb00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8728005e30 tx=0x7f87280095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51703e097a322561 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.495+0000 7f870ffff640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.496+0000 7f870ffff640 1 -- 172.21.15.69:0/7515830 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872804e040 con 0x55dbebe92800 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.496+0000 7f870ffff640 1 -- 172.21.15.69:0/7515830 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f872804a480 con 0x55dbebe92800 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.496+0000 7f873985e740 1 -- 172.21.15.69:0/7515830 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8728036070 con 0x55dbebe92800 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.496+0000 7f870ffff640 1 -- 172.21.15.69:0/7515830 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f8728061050 con 0x55dbebe92800 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.496+0000 7f873985e740 10 client.16137 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.496+0000 7f873985e740 1 -- 172.21.15.69:0/7515830 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55dbebea1380 con 0x55dbebe92800 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.496+0000 7f870ffff640 1 -- 172.21.15.69:0/7515830 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8728036070 con 0x55dbebe92800 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.496+0000 7f870ffff640 1 -- 172.21.15.69:0/7515830 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f8728030070 con 0x55dbebe92800 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.497+0000 7f873985e740 10 client.16137 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.497+0000 7f873985e740 10 client.16137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.497+0000 7f873985e740 20 client.16137 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.497+0000 7f873985e740 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dbebea26d0 0x55dbebea4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.497+0000 7f873985e740 4 client.16137 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.497+0000 7f873985e740 1 -- 172.21.15.69:0/7515830 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbebdfa390 con 0x55dbebea26d0 2024-04-23T10:30:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.497+0000 7f87348e0640 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dbebea26d0 0x55dbebea4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.497+0000 7f87348e0640 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dbebea26d0 0x55dbebea4ac0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b03e09fab11e026 server_cookie=64de29a1d7875ce4 in_seq=0 out_seq=0 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.497+0000 7f870ffff640 10 client.16137 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.498+0000 7f870ffff640 1 -- 172.21.15.69:0/7515830 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dbebdfa390 con 0x55dbebea26d0 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.498+0000 7f870ffff640 10 client.16137 handle_command_reply: tid=0 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.498+0000 7f873985e740 1 client.16137 shutdown 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.498+0000 7f873985e740 1 -- 172.21.15.69:0/7515830 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe92800 msgr2=0x55dbebe8fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.498+0000 7f873985e740 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe92800 0x55dbebe8fb00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8728005e30 tx=0x7f87280095c0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.498+0000 7f873985e740 1 -- 172.21.15.69:0/7515830 shutdown_connections 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.498+0000 7f873985e740 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dbebea26d0 0x55dbebea4ac0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.499+0000 7f873985e740 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe92800 0x55dbebe8fb00 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.499+0000 7f873985e740 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe8f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.499+0000 7f870ffff640 0 client.16137 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.499+0000 7f873985e740 1 --2- 172.21.15.69:0/7515830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe87620 0x55dbebe92200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.499+0000 7f873985e740 1 -- 172.21.15.69:0/7515830 >> 172.21.15.69:0/7515830 conn(0x55dbebe83b30 msgr2=0x55dbebe89860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.499+0000 7f873985e740 1 -- 172.21.15.69:0/7515830 shutdown_connections 2024-04-23T10:30:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.499+0000 7f873985e740 1 -- 172.21.15.69:0/7515830 wait complete. 2024-04-23T10:30:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.499+0000 7f873985e740 20 client.16137 trim_cache size 0 max 16384 2024-04-23T10:30:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.516+0000 7f873985e740 1 Processor -- start 2024-04-23T10:30:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.516+0000 7f873985e740 1 -- start start 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f873985e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f873985e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe91d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f873985e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebeaa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f873985e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f87301adcb0 con 0x55dbebe87620 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f873985e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f87301afa30 con 0x55dbebe92800 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f873985e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87301ae440 con 0x55dbebe87f40 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f87348e0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f87348e0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60444/0 (socket says 172.21.15.69:60444) 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f87348e0640 1 -- 172.21.15.69:0/2557769791 learned_addr learned my addr 172.21.15.69:0/2557769791 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f872ffff640 1 --2- 172.21.15.69:0/2557769791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe91d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f87350e1640 1 --2- 172.21.15.69:0/2557769791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebeaa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f87348e0640 1 -- 172.21.15.69:0/2557769791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 msgr2=0x55dbebe91d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f87348e0640 1 --2- 172.21.15.69:0/2557769791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe91d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f87348e0640 1 -- 172.21.15.69:0/2557769791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 msgr2=0x55dbebeaa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f87348e0640 1 --2- 172.21.15.69:0/2557769791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebeaa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f87348e0640 1 -- 172.21.15.69:0/2557769791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbebe84140 con 0x55dbebe87620 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f87350e1640 1 --2- 172.21.15.69:0/2557769791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebeaa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f87348e0640 1 --2- 172.21.15.69:0/2557769791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9e290 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f87240ce3f0 tx=0x7f8724014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e686e2aea900908a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f871a7fc640 1 -- 172.21.15.69:0/2557769791 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240a0f90 con 0x55dbebe87620 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f871a7fc640 1 -- 172.21.15.69:0/2557769791 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f87240a5850 con 0x55dbebe87620 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.517+0000 7f871a7fc640 1 -- 172.21.15.69:0/2557769791 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240bd0b0 con 0x55dbebe87620 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.518+0000 7f873985e740 1 -- 172.21.15.69:0/2557769791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 msgr2=0x55dbebe9e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.518+0000 7f873985e740 1 --2- 172.21.15.69:0/2557769791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9e290 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f87240ce3f0 tx=0x7f8724014000 comp rx=0 tx=0).stop 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.518+0000 7f873985e740 1 -- 172.21.15.69:0/2557769791 shutdown_connections 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.518+0000 7f873985e740 1 --2- 172.21.15.69:0/2557769791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebeaa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.518+0000 7f873985e740 1 --2- 172.21.15.69:0/2557769791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe91d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.518+0000 7f873985e740 1 --2- 172.21.15.69:0/2557769791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9e290 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.518+0000 7f873985e740 1 -- 172.21.15.69:0/2557769791 >> 172.21.15.69:0/2557769791 conn(0x55dbebe83b30 msgr2=0x55dbebe82cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.518+0000 7f873985e740 1 -- 172.21.15.69:0/2557769791 shutdown_connections 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.518+0000 7f873985e740 1 -- 172.21.15.69:0/2557769791 wait complete. 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.518+0000 7f873985e740 1 -- start start 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f873985e740 1 Processor -- start 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f873985e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f873985e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe9ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f873985e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebe97770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f873985e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f87301af360 con 0x55dbebe87620 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f873985e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f87301aebd0 con 0x55dbebe92800 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f873985e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87301abbd0 con 0x55dbebe87f40 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f873985e740 10 client.0 _ll_register_callbacks cb 0x7f8728009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f87348e0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f87348e0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60460/0 (socket says 172.21.15.69:60460) 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f87348e0640 1 -- 172.21.15.69:0/1492926277 learned_addr learned my addr 172.21.15.69:0/1492926277 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f872ffff640 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe9ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f87350e1640 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebe97770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f87348e0640 1 -- 172.21.15.69:0/1492926277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 msgr2=0x55dbebe9ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f87348e0640 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe9ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f87348e0640 1 -- 172.21.15.69:0/1492926277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 msgr2=0x55dbebe97770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f87348e0640 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebe97770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f87348e0640 1 -- 172.21.15.69:0/1492926277 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbebe97f70 con 0x55dbebe87620 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f872ffff640 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe9ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f87348e0640 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9a7a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f872409c560 tx=0x7f872400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17506239df806c55 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.519+0000 7f870ffff640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f870ffff640 1 -- 172.21.15.69:0/1492926277 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87240992c0 con 0x55dbebe87620 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f870ffff640 1 -- 172.21.15.69:0/1492926277 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f87240bd0e0 con 0x55dbebe87620 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f873985e740 1 -- 172.21.15.69:0/1492926277 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87240a5850 con 0x55dbebe87620 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f870ffff640 1 -- 172.21.15.69:0/1492926277 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f87240ce610 con 0x55dbebe87620 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f873985e740 10 client.16143 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f873985e740 1 -- 172.21.15.69:0/1492926277 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55dbebf09430 con 0x55dbebe87620 2024-04-23T10:30:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f870ffff640 1 -- 172.21.15.69:0/1492926277 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f87240a5850 con 0x55dbebe87620 2024-04-23T10:30:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f870ffff640 1 -- 172.21.15.69:0/1492926277 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f87240ceae0 con 0x55dbebe87620 2024-04-23T10:30:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f873985e740 10 client.16143 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f873985e740 10 client.16143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:30:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f873985e740 20 client.16143 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f873985e740 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dbebf09b00 0x55dbebf0bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f873985e740 4 client.16143 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:30:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f873985e740 1 -- 172.21.15.69:0/1492926277 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dbebdf4200 con 0x55dbebf09b00 2024-04-23T10:30:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.520+0000 7f872ffff640 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dbebf09b00 0x55dbebf0bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.521+0000 7f870ffff640 10 client.16143 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.521+0000 7f872ffff640 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dbebf09b00 0x55dbebf0bf20 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49099f4d094e482 server_cookie=d4bed90e284052c2 in_seq=0 out_seq=0 2024-04-23T10:30:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.528+0000 7f870ffff640 1 -- 172.21.15.69:0/1492926277 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dbebdf4200 con 0x55dbebf09b00 2024-04-23T10:30:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.528+0000 7f870ffff640 10 client.16143 handle_command_reply: tid=0 2024-04-23T10:30:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 1 client.16143 shutdown 2024-04-23T10:30:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 1 -- 172.21.15.69:0/1492926277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 msgr2=0x55dbebe9a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9a7a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f872409c560 tx=0x7f872400cf90 comp rx=0 tx=0).stop 2024-04-23T10:30:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 1 -- 172.21.15.69:0/1492926277 shutdown_connections 2024-04-23T10:30:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55dbebf09b00 0x55dbebf0bf20 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dbebe92800 0x55dbebe97770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbebe87f40 0x55dbebe9ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f870ffff640 0 client.16143 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 1 --2- 172.21.15.69:0/1492926277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dbebe87620 0x55dbebe9a7a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 1 -- 172.21.15.69:0/1492926277 >> 172.21.15.69:0/1492926277 conn(0x55dbebe83b30 msgr2=0x55dbebe88fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 1 -- 172.21.15.69:0/1492926277 shutdown_connections 2024-04-23T10:30:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 1 -- 172.21.15.69:0/1492926277 wait complete. 2024-04-23T10:30:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f873985e740 20 client.16143 trim_cache size 0 max 16384 2024-04-23T10:30:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:30:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:30:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:30:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:30:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f8736b44640 1 -- 172.21.15.69:0/1236563875 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f87200a3dc0 msgr2=0x7f87200a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f8736b44640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f87200a3dc0 0x7f87200a6280 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8728009cd0 tx=0x7f8728036000 comp rx=0 tx=0).stop 2024-04-23T10:30:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f8736b44640 1 -- 172.21.15.69:0/1236563875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873006a780 msgr2=0x7f87301987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.529+0000 7f8736b44640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873006a780 0x7f87301987b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f872400e9f0 tx=0x7f872400eeb0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.530+0000 7f8736b44640 1 -- 172.21.15.69:0/1236563875 shutdown_connections 2024-04-23T10:30:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.530+0000 7f8736b44640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f87200a3dc0 0x7f87200a6280 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.530+0000 7f8736b44640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8730107fe0 0x7f873019d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.530+0000 7f8736b44640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f873006b120 0x7f8730198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.530+0000 7f8736b44640 1 --2- 172.21.15.69:0/1236563875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873006a780 0x7f87301987b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.530+0000 7f8736b44640 1 -- 172.21.15.69:0/1236563875 >> 172.21.15.69:0/1236563875 conn(0x7f8730076c50 msgr2=0x7f87300ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.530+0000 7f8736b44640 1 -- 172.21.15.69:0/1236563875 shutdown_connections 2024-04-23T10:30:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:45.530+0000 7f8736b44640 1 -- 172.21.15.69:0/1236563875 wait complete. 2024-04-23T10:30:46.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:46 smithi167 ceph-mon[32940]: pgmap v120: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 19 op/s 2024-04-23T10:30:46.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:46 smithi146 ceph-mon[32800]: pgmap v120: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 19 op/s 2024-04-23T10:30:46.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:46 smithi069 ceph-mon[29593]: pgmap v120: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 19 op/s 2024-04-23T10:30:48.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:48 smithi167 ceph-mon[32940]: pgmap v121: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-04-23T10:30:48.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:48 smithi146 ceph-mon[32800]: pgmap v121: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-04-23T10:30:48.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:48 smithi069 ceph-mon[29593]: pgmap v121: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-04-23T10:30:50.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:50 smithi167 ceph-mon[32940]: pgmap v122: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2024-04-23T10:30:50.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:50 smithi146 ceph-mon[32800]: pgmap v122: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2024-04-23T10:30:50.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:50 smithi069 ceph-mon[29593]: pgmap v122: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2024-04-23T10:30:52.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:52 smithi167 ceph-mon[32940]: pgmap v123: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-04-23T10:30:52.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:52 smithi146 ceph-mon[32800]: pgmap v123: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-04-23T10:30:52.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:52 smithi069 ceph-mon[29593]: pgmap v123: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-04-23T10:30:54.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:54 smithi167 ceph-mon[32940]: pgmap v124: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-04-23T10:30:54.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:54 smithi146 ceph-mon[32800]: pgmap v124: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-04-23T10:30:54.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:54 smithi069 ceph-mon[29593]: pgmap v124: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-04-23T10:30:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:56 smithi167 ceph-mon[32940]: pgmap v125: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.3 KiB/s wr, 14 op/s 2024-04-23T10:30:57.006 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:56 smithi069 ceph-mon[29593]: pgmap v125: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.3 KiB/s wr, 14 op/s 2024-04-23T10:30:57.007 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:56 smithi146 ceph-mon[32800]: pgmap v125: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.3 KiB/s wr, 14 op/s 2024-04-23T10:30:58.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.626+0000 7fbc4196f640 1 -- 172.21.15.69:0/254912195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c103b00 msgr2=0x7fbc3c10bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:58.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.626+0000 7fbc4196f640 1 --2- 172.21.15.69:0/254912195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c103b00 0x7fbc3c10bfe0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009900 tx=0x7fbc3002a510 comp rx=0 tx=0).stop 2024-04-23T10:30:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.626+0000 7fbc4196f640 1 -- 172.21.15.69:0/254912195 shutdown_connections 2024-04-23T10:30:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.626+0000 7fbc4196f640 1 --2- 172.21.15.69:0/254912195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c103b00 0x7fbc3c10bfe0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.626+0000 7fbc4196f640 1 --2- 172.21.15.69:0/254912195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c10c520 0x7fbc3c10e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.626+0000 7fbc4196f640 1 --2- 172.21.15.69:0/254912195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c1031e0 0x7fbc3c1035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.626+0000 7fbc4196f640 1 -- 172.21.15.69:0/254912195 >> 172.21.15.69:0/254912195 conn(0x7fbc3c077fd0 msgr2=0x7fbc3c0783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.626+0000 7fbc4196f640 1 -- 172.21.15.69:0/254912195 shutdown_connections 2024-04-23T10:30:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.626+0000 7fbc4196f640 1 -- 172.21.15.69:0/254912195 wait complete. 2024-04-23T10:30:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.626+0000 7fbc4196f640 1 Processor -- start 2024-04-23T10:30:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc4196f640 1 -- start start 2024-04-23T10:30:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc4196f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c1031e0 0x7fbc3c100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc4196f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c103b00 0x7fbc3c101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc4196f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c10c520 0x7fbc3c1018b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc4196f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c112340 con 0x7fbc3c103b00 2024-04-23T10:30:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc4196f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1121c0 con 0x7fbc3c10c520 2024-04-23T10:30:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc4196f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1124c0 con 0x7fbc3c1031e0 2024-04-23T10:30:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc3a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c103b00 0x7fbc3c101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc3a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c103b00 0x7fbc3c101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41848/0 (socket says 172.21.15.69:41848) 2024-04-23T10:30:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc3a7fc640 1 -- 172.21.15.69:0/1538068057 learned_addr learned my addr 172.21.15.69:0/1538068057 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc3b7fe640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c10c520 0x7fbc3c1018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc3affd640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c1031e0 0x7fbc3c100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc3a7fc640 1 -- 172.21.15.69:0/1538068057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c1031e0 msgr2=0x7fbc3c100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c1031e0 0x7fbc3c100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc3a7fc640 1 -- 172.21.15.69:0/1538068057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c10c520 msgr2=0x7fbc3c1018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c10c520 0x7fbc3c1018b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc3a7fc640 1 -- 172.21.15.69:0/1538068057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3c1a6d20 con 0x7fbc3c103b00 2024-04-23T10:30:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.627+0000 7fbc3affd640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c1031e0 0x7fbc3c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:30:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.628+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c103b00 0x7fbc3c101370 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbc300314b0 tx=0x7fbc30003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.628+0000 7fbc4096d640 1 -- 172.21.15.69:0/1538068057 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3003f070 con 0x7fbc3c103b00 2024-04-23T10:30:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.628+0000 7fbc4096d640 1 -- 172.21.15.69:0/1538068057 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbc30031bf0 con 0x7fbc3c103b00 2024-04-23T10:30:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.628+0000 7fbc4196f640 1 -- 172.21.15.69:0/1538068057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3c1a6fb0 con 0x7fbc3c103b00 2024-04-23T10:30:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.628+0000 7fbc4096d640 1 -- 172.21.15.69:0/1538068057 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30035030 con 0x7fbc3c103b00 2024-04-23T10:30:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.628+0000 7fbc4196f640 1 -- 172.21.15.69:0/1538068057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3c1a7410 con 0x7fbc3c103b00 2024-04-23T10:30:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.630+0000 7fbc4096d640 1 -- 172.21.15.69:0/1538068057 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fbc30042070 con 0x7fbc3c103b00 2024-04-23T10:30:58.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.630+0000 7fbc44763740 1 Processor -- start 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.630+0000 7fbc44763740 1 -- start start 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc4096d640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbc240a3dc0 0x7fbc240a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc44763740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61ee620 0x558fe61eea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc44763740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61eef40 0x558fe61f92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc44763740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61f9800 0x558fe61fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc44763740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558fe6153970 con 0x558fe61eef40 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc44763740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558fe60f04a0 con 0x558fe61ee620 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc44763740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558fe614f930 con 0x558fe61f9800 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61eef40 0x558fe61f92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3b7fe640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbc240a3dc0 0x7fbc240a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61eef40 0x558fe61f92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41856/0 (socket says 172.21.15.69:41856) 2024-04-23T10:30:58.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3a7fc640 1 -- 172.21.15.69:0/1049453950 learned_addr learned my addr 172.21.15.69:0/1049453950 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3affd640 1 --2- 172.21.15.69:0/1049453950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61ee620 0x558fe61eea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc4096d640 1 -- 172.21.15.69:0/1538068057 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7fbc300f1050 con 0x7fbc3c103b00 2024-04-23T10:30:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3a7fc640 1 -- 172.21.15.69:0/1049453950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61f9800 msgr2=0x558fe61fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/1049453950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61f9800 0x558fe61fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3a7fc640 1 -- 172.21.15.69:0/1049453950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61ee620 msgr2=0x558fe61eea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/1049453950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61ee620 0x558fe61eea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3a7fc640 1 -- 172.21.15.69:0/1049453950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe5e66210 con 0x558fe61eef40 2024-04-23T10:30:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3b7fe640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbc240a3dc0 0x7fbc240a6280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc34005e00 tx=0x7fbc3400b570 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/1049453950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61eef40 0x558fe61f92c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbc300c5760 tx=0x7fbc30009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b61e7b983e145dc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc21ffb640 1 -- 172.21.15.69:0/1049453950 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc300d00e0 con 0x558fe61eef40 2024-04-23T10:30:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc21ffb640 1 -- 172.21.15.69:0/1049453950 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbc300bd720 con 0x558fe61eef40 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.631+0000 7fbc21ffb640 1 -- 172.21.15.69:0/1049453950 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc300bb320 con 0x558fe61eef40 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.632+0000 7fbc44763740 1 -- 172.21.15.69:0/1049453950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61eef40 msgr2=0x558fe61f92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.632+0000 7fbc44763740 1 --2- 172.21.15.69:0/1049453950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61eef40 0x558fe61f92c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbc300c5760 tx=0x7fbc30009260 comp rx=0 tx=0).stop 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.632+0000 7fbc44763740 1 -- 172.21.15.69:0/1049453950 shutdown_connections 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.632+0000 7fbc44763740 1 --2- 172.21.15.69:0/1049453950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61eef40 0x558fe61f92c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.632+0000 7fbc44763740 1 --2- 172.21.15.69:0/1049453950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61f9800 0x558fe61fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.632+0000 7fbc44763740 1 --2- 172.21.15.69:0/1049453950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61ee620 0x558fe61eea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.632+0000 7fbc44763740 1 -- 172.21.15.69:0/1049453950 >> 172.21.15.69:0/1049453950 conn(0x558fe61eab30 msgr2=0x558fe61eaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.632+0000 7fbc44763740 1 -- 172.21.15.69:0/1049453950 shutdown_connections 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.632+0000 7fbc44763740 1 -- 172.21.15.69:0/1049453950 wait complete. 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.632+0000 7fbc44763740 1 -- start start 2024-04-23T10:30:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc44763740 1 Processor -- start 2024-04-23T10:30:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc44763740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61ee620 0x558fe61f9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc44763740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe61f6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc44763740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61f9800 0x558fe61f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc44763740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558fe61fc1f0 con 0x558fe61ee620 2024-04-23T10:30:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc44763740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558fe60ee0b0 con 0x558fe61eef40 2024-04-23T10:30:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc44763740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558fe61fc370 con 0x558fe61f9800 2024-04-23T10:30:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc44763740 10 client.0 _ll_register_callbacks cb 0x558fe60dbd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc3affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61ee620 0x558fe61f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc3affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61ee620 0x558fe61f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41868/0 (socket says 172.21.15.69:41868) 2024-04-23T10:30:58.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc3affd640 1 -- 172.21.15.69:0/3140795921 learned_addr learned my addr 172.21.15.69:0/3140795921 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe61f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc3affd640 1 -- 172.21.15.69:0/3140795921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61f9800 msgr2=0x558fe61f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc3b7fe640 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61f9800 0x558fe61f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc3affd640 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61f9800 0x558fe61f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc3affd640 1 -- 172.21.15.69:0/3140795921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 msgr2=0x558fe61f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc3affd640 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe61f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.633+0000 7fbc3affd640 1 -- 172.21.15.69:0/3140795921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fe5f32620 con 0x558fe61ee620 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc3affd640 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61ee620 0x558fe61f9150 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0126b0 tx=0x7fbc2c012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bcad92b55d71fa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc1affd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc1affd640 1 -- 172.21.15.69:0/3140795921 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c010dc0 con 0x558fe61ee620 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc1affd640 1 -- 172.21.15.69:0/3140795921 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7fbc2c01a3e0 con 0x558fe61ee620 2024-04-23T10:30:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc44763740 1 -- 172.21.15.69:0/3140795921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc300bd720 con 0x558fe61ee620 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc1affd640 1 -- 172.21.15.69:0/3140795921 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fbc2c01a5e0 con 0x558fe61ee620 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc44763740 10 client.16155 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc44763740 1 -- 172.21.15.69:0/3140795921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558fe62080b0 con 0x558fe61ee620 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc1affd640 1 -- 172.21.15.69:0/3140795921 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbc300bd720 con 0x558fe61ee620 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc1affd640 1 -- 172.21.15.69:0/3140795921 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7fbc2c019070 con 0x558fe61ee620 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc44763740 10 client.16155 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc44763740 10 client.16155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc44763740 20 client.16155 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc44763740 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558fe6209680 0x558fe620bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc44763740 4 client.16155 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.634+0000 7fbc44763740 1 -- 172.21.15.69:0/3140795921 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fe6161390 con 0x558fe6209680 2024-04-23T10:30:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.635+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558fe6209680 0x558fe620bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.635+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558fe6209680 0x558fe620bb00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74423b857f9c4496 server_cookie=3cf4300c132d0af0 in_seq=0 out_seq=0 2024-04-23T10:30:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.635+0000 7fbc1affd640 10 client.16155 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc1affd640 1 -- 172.21.15.69:0/3140795921 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558fe6161390 con 0x558fe6209680 2024-04-23T10:30:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc1affd640 10 client.16155 handle_command_reply: tid=0 2024-04-23T10:30:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 1 client.16155 shutdown 2024-04-23T10:30:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 1 -- 172.21.15.69:0/3140795921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61ee620 msgr2=0x558fe61f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61ee620 0x558fe61f9150 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0126b0 tx=0x7fbc2c012b70 comp rx=0 tx=0).stop 2024-04-23T10:30:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 1 -- 172.21.15.69:0/3140795921 shutdown_connections 2024-04-23T10:30:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558fe6209680 0x558fe620bb00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61f9800 0x558fe61f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe61f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 1 --2- 172.21.15.69:0/3140795921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61ee620 0x558fe61f9150 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc1affd640 0 client.16155 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 1 -- 172.21.15.69:0/3140795921 >> 172.21.15.69:0/3140795921 conn(0x558fe61eab30 msgr2=0x558fe61f08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 1 -- 172.21.15.69:0/3140795921 shutdown_connections 2024-04-23T10:30:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 1 -- 172.21.15.69:0/3140795921 wait complete. 2024-04-23T10:30:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.636+0000 7fbc44763740 20 client.16155 trim_cache size 0 max 16384 2024-04-23T10:30:58.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc44763740 1 Processor -- start 2024-04-23T10:30:58.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc44763740 1 -- start start 2024-04-23T10:30:58.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc44763740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61ee620 0x558fe61ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc44763740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe6211410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc44763740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe6211950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc44763740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1afea0 con 0x558fe61f9800 2024-04-23T10:30:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc44763740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1b1c20 con 0x558fe61eef40 2024-04-23T10:30:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc44763740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1b0630 con 0x558fe61ee620 2024-04-23T10:30:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc3b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe6211950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc3b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe6211950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41884/0 (socket says 172.21.15.69:41884) 2024-04-23T10:30:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc3b7fe640 1 -- 172.21.15.69:0/3846591071 learned_addr learned my addr 172.21.15.69:0/3846591071 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc3affd640 1 --2- 172.21.15.69:0/3846591071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61ee620 0x558fe61ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/3846591071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe6211410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc3b7fe640 1 -- 172.21.15.69:0/3846591071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61ee620 msgr2=0x558fe61ea3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc3b7fe640 1 --2- 172.21.15.69:0/3846591071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61ee620 0x558fe61ea3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc3b7fe640 1 -- 172.21.15.69:0/3846591071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 msgr2=0x558fe6211410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc3b7fe640 1 --2- 172.21.15.69:0/3846591071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe6211410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc3b7fe640 1 -- 172.21.15.69:0/3846591071 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe61ebd60 con 0x558fe61f9800 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.651+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/3846591071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe6211410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc3b7fe640 1 --2- 172.21.15.69:0/3846591071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe6211950 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbc34005fd0 tx=0x7fbc34014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800f25ce44bba672 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc217fa640 1 -- 172.21.15.69:0/3846591071 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3401f420 con 0x558fe61f9800 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc217fa640 1 -- 172.21.15.69:0/3846591071 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbc3401fa90 con 0x558fe61f9800 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc217fa640 1 -- 172.21.15.69:0/3846591071 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34027b40 con 0x558fe61f9800 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc44763740 1 -- 172.21.15.69:0/3846591071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 msgr2=0x558fe6211950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc44763740 1 --2- 172.21.15.69:0/3846591071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe6211950 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbc34005fd0 tx=0x7fbc34014000 comp rx=0 tx=0).stop 2024-04-23T10:30:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc44763740 1 -- 172.21.15.69:0/3846591071 shutdown_connections 2024-04-23T10:30:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc44763740 1 --2- 172.21.15.69:0/3846591071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe6211950 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc44763740 1 --2- 172.21.15.69:0/3846591071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe6211410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc44763740 1 --2- 172.21.15.69:0/3846591071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61ee620 0x558fe61ea3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc44763740 1 -- 172.21.15.69:0/3846591071 >> 172.21.15.69:0/3846591071 conn(0x558fe61eab30 msgr2=0x558fe61e9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc44763740 1 -- 172.21.15.69:0/3846591071 shutdown_connections 2024-04-23T10:30:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.652+0000 7fbc44763740 1 -- 172.21.15.69:0/3846591071 wait complete. 2024-04-23T10:30:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc44763740 1 -- start start 2024-04-23T10:30:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc44763740 1 Processor -- start 2024-04-23T10:30:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc44763740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61ee620 0x558fe61fef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc44763740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe61ff4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc44763740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe61ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc44763740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1b1550 con 0x558fe61f9800 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc44763740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1b0dc0 con 0x558fe61eef40 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc44763740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1addc0 con 0x558fe61ee620 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc44763740 10 client.0 _ll_register_callbacks cb 0x7fbc2c009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc3b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe61ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc3b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe61ff9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41892/0 (socket says 172.21.15.69:41892) 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.653+0000 7fbc3b7fe640 1 -- 172.21.15.69:0/1144762643 learned_addr learned my addr 172.21.15.69:0/1144762643 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe61ff4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc3affd640 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61ee620 0x558fe61fef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc3b7fe640 1 -- 172.21.15.69:0/1144762643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61ee620 msgr2=0x558fe61fef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc3b7fe640 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61ee620 0x558fe61fef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc3b7fe640 1 -- 172.21.15.69:0/1144762643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 msgr2=0x558fe61ff4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc3b7fe640 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe61ff4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc3b7fe640 1 -- 172.21.15.69:0/1144762643 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fe626ec90 con 0x558fe61f9800 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc3a7fc640 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe61ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc3b7fe640 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe61ff9e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbc340276c0 tx=0x7fbc34005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afd1e88d3cb4bf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc1affd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc1affd640 1 -- 172.21.15.69:0/1144762643 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3401f630 con 0x558fe61f9800 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc1affd640 1 -- 172.21.15.69:0/1144762643 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7fbc3401f7d0 con 0x558fe61f9800 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc44763740 1 -- 172.21.15.69:0/1144762643 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc3401fa90 con 0x558fe61f9800 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc1affd640 1 -- 172.21.15.69:0/1144762643 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fbc340278c0 con 0x558fe61f9800 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc44763740 10 client.16161 fetch_fsmap learned FSMap version 40 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc44763740 1 -- 172.21.15.69:0/1144762643 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558fe626fe50 con 0x558fe61f9800 2024-04-23T10:30:58.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc1affd640 1 -- 172.21.15.69:0/1144762643 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbc3401fa90 con 0x558fe61f9800 2024-04-23T10:30:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.654+0000 7fbc1affd640 1 -- 172.21.15.69:0/1144762643 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7fbc340303b0 con 0x558fe61f9800 2024-04-23T10:30:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.655+0000 7fbc44763740 10 client.16161 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:30:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.655+0000 7fbc44763740 10 client.16161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-23T10:30:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.655+0000 7fbc44763740 20 client.16161 populate_metadata read hostname 'smithi069' 2024-04-23T10:30:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.655+0000 7fbc44763740 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558fe62705a0 0x558fe62729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:30:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.655+0000 7fbc44763740 4 client.16161 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-23T10:30:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.655+0000 7fbc44763740 1 -- 172.21.15.69:0/1144762643 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558fe615b200 con 0x558fe62705a0 2024-04-23T10:30:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.655+0000 7fbc3affd640 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558fe62705a0 0x558fe62729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:30:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.655+0000 7fbc3affd640 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558fe62705a0 0x558fe62729c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85f81302ab721b2f server_cookie=12fae8e761b61e8a in_seq=0 out_seq=0 2024-04-23T10:30:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.655+0000 7fbc1affd640 10 client.16161 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc1affd640 1 -- 172.21.15.69:0/1144762643 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558fe615b200 con 0x558fe62705a0 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc1affd640 10 client.16161 handle_command_reply: tid=0 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 1 client.16161 shutdown 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 1 -- 172.21.15.69:0/1144762643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 msgr2=0x558fe61ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe61ff9e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbc340276c0 tx=0x7fbc34005740 comp rx=0 tx=0).stop 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 1 -- 172.21.15.69:0/1144762643 shutdown_connections 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x558fe62705a0 0x558fe62729c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558fe61f9800 0x558fe61ff9e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc1affd640 0 client.16161 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558fe61eef40 0x558fe61ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 1 --2- 172.21.15.69:0/1144762643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fe61ee620 0x558fe61fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 1 -- 172.21.15.69:0/1144762643 >> 172.21.15.69:0/1144762643 conn(0x558fe61eab30 msgr2=0x558fe6204010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 1 -- 172.21.15.69:0/1144762643 shutdown_connections 2024-04-23T10:30:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 1 -- 172.21.15.69:0/1144762643 wait complete. 2024-04-23T10:30:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.660+0000 7fbc44763740 20 client.16161 trim_cache size 0 max 16384 2024-04-23T10:30:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-04-23T10:30:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-04-23T10:30:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-04-23T10:30:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-04-23T10:30:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 -- 172.21.15.69:0/1538068057 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbc240a3dc0 msgr2=0x7fbc240a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbc240a3dc0 0x7fbc240a6280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc34005e00 tx=0x7fbc3400b570 comp rx=0 tx=0).stop 2024-04-23T10:30:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 -- 172.21.15.69:0/1538068057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c103b00 msgr2=0x7fbc3c101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:30:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c103b00 0x7fbc3c101370 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbc300314b0 tx=0x7fbc30003c10 comp rx=0 tx=0).stop 2024-04-23T10:30:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 -- 172.21.15.69:0/1538068057 shutdown_connections 2024-04-23T10:30:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fbc240a3dc0 0x7fbc240a6280 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c103b00 0x7fbc3c101370 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c10c520 0x7fbc3c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 --2- 172.21.15.69:0/1538068057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c1031e0 0x7fbc3c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:30:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 -- 172.21.15.69:0/1538068057 >> 172.21.15.69:0/1538068057 conn(0x7fbc3c077fd0 msgr2=0x7fbc3c0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:30:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 -- 172.21.15.69:0/1538068057 shutdown_connections 2024-04-23T10:30:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-04-23T10:30:58.661+0000 7fbc4196f640 1 -- 172.21.15.69:0/1538068057 wait complete. 2024-04-23T10:30:58.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:30:58 smithi167 ceph-mon[32940]: pgmap v126: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T10:30:58.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:30:58 smithi146 ceph-mon[32800]: pgmap v126: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T10:30:58.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:30:58 smithi069 ceph-mon[29593]: pgmap v126: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-04-23T10:31:00.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:00 smithi167 ceph-mon[32940]: pgmap v127: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-04-23T10:31:00.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:00 smithi146 ceph-mon[32800]: pgmap v127: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-04-23T10:31:00.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:00 smithi069 ceph-mon[29593]: pgmap v127: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-04-23T10:31:01.903 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:31:02.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.012+0000 7f8d89984640 1 -- 172.21.15.69:0/4224157832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d84101a50 msgr2=0x7f8d84105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.013+0000 7f8d89984640 1 --2- 172.21.15.69:0/4224157832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d84101a50 0x7f8d84105a90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009900 tx=0x7f8d7402a410 comp rx=0 tx=0).stop 2024-04-23T10:31:02.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.013+0000 7f8d89984640 1 -- 172.21.15.69:0/4224157832 shutdown_connections 2024-04-23T10:31:02.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.013+0000 7f8d89984640 1 --2- 172.21.15.69:0/4224157832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d84101a50 0x7f8d84105a90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.013+0000 7f8d89984640 1 --2- 172.21.15.69:0/4224157832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d84106170 0x7f8d8410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.013+0000 7f8d89984640 1 --2- 172.21.15.69:0/4224157832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d841010a0 0x7f8d84101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.013+0000 7f8d89984640 1 -- 172.21.15.69:0/4224157832 >> 172.21.15.69:0/4224157832 conn(0x7f8d84077f50 msgr2=0x7f8d84078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:02.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.013+0000 7f8d89984640 1 -- 172.21.15.69:0/4224157832 shutdown_connections 2024-04-23T10:31:02.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.013+0000 7f8d89984640 1 -- 172.21.15.69:0/4224157832 wait complete. 2024-04-23T10:31:02.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.013+0000 7f8d89984640 1 Processor -- start 2024-04-23T10:31:02.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.013+0000 7f8d89984640 1 -- start start 2024-04-23T10:31:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.013+0000 7f8d89984640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d841010a0 0x7f8d84197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d89984640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d84106170 0x7f8d84197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d89984640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8419c010 0x7f8d8419c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d89984640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841111f0 con 0x7f8d84106170 2024-04-23T10:31:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d89984640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84111070 con 0x7f8d8419c010 2024-04-23T10:31:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d89984640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84111370 con 0x7f8d841010a0 2024-04-23T10:31:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d84106170 0x7f8d84197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d84106170 0x7f8d84197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46224/0 (socket says 172.21.15.69:46224) 2024-04-23T10:31:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d827fc640 1 -- 172.21.15.69:0/613063909 learned_addr learned my addr 172.21.15.69:0/613063909 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d82ffd640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d841010a0 0x7f8d84197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d837fe640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8419c010 0x7f8d8419c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d827fc640 1 -- 172.21.15.69:0/613063909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d841010a0 msgr2=0x7f8d84197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d827fc640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d841010a0 0x7f8d84197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d827fc640 1 -- 172.21.15.69:0/613063909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8419c010 msgr2=0x7f8d8419c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d827fc640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8419c010 0x7f8d8419c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d827fc640 1 -- 172.21.15.69:0/613063909 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8419cb00 con 0x7f8d84106170 2024-04-23T10:31:02.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d827fc640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d84106170 0x7f8d84197c90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8d74005940 tx=0x7f8d74004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:02.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d88982640 1 -- 172.21.15.69:0/613063909 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7403f030 con 0x7f8d84106170 2024-04-23T10:31:02.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d88982640 1 -- 172.21.15.69:0/613063909 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d74004440 con 0x7f8d84106170 2024-04-23T10:31:02.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d88982640 1 -- 172.21.15.69:0/613063909 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74035070 con 0x7f8d84106170 2024-04-23T10:31:02.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d89984640 1 -- 172.21.15.69:0/613063909 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8419cd90 con 0x7f8d84106170 2024-04-23T10:31:02.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.014+0000 7f8d89984640 1 -- 172.21.15.69:0/613063909 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d841a4500 con 0x7f8d84106170 2024-04-23T10:31:02.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.016+0000 7f8d89984640 1 -- 172.21.15.69:0/613063909 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d84068d70 con 0x7f8d84106170 2024-04-23T10:31:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.016+0000 7f8d88982640 1 -- 172.21.15.69:0/613063909 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f8d74042030 con 0x7f8d84106170 2024-04-23T10:31:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.017+0000 7f8d88982640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8d6c0a3d20 0x7f8d6c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.017+0000 7f8d88982640 1 -- 172.21.15.69:0/613063909 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f8d740f0ab0 con 0x7f8d84106170 2024-04-23T10:31:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.017+0000 7f8d82ffd640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8d6c0a3d20 0x7f8d6c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.017+0000 7f8d82ffd640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8d6c0a3d20 0x7f8d6c0a61e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009bd0 tx=0x7f8d78005f90 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:02.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.022+0000 7f8d88982640 1 -- 172.21.15.69:0/613063909 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8d740bcb30 con 0x7f8d84106170 2024-04-23T10:31:02.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.246+0000 7f8d89984640 1 -- 172.21.15.69:0/613063909 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d84101a50 con 0x7f8d84106170 2024-04-23T10:31:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.247+0000 7f8d88982640 1 -- 172.21.15.69:0/613063909 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11965 (secure 0 0 0) 0x7f8d740c0e30 con 0x7f8d84106170 2024-04-23T10:31:02.246 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:31:02.246 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:29:33.510879+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25297":{"gid":25297,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/1216686871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1216686871},{"type":"v1","addr":"172.21.15.167:6835","nonce":1216686871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24416,24392,24487,24421,24463]},"id":1}]} 2024-04-23T10:31:02.247 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 40 2024-04-23T10:31:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 -- 172.21.15.69:0/613063909 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8d6c0a3d20 msgr2=0x7f8d6c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8d6c0a3d20 0x7f8d6c0a61e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009bd0 tx=0x7f8d78005f90 comp rx=0 tx=0).stop 2024-04-23T10:31:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 -- 172.21.15.69:0/613063909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d84106170 msgr2=0x7f8d84197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d84106170 0x7f8d84197c90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8d74005940 tx=0x7f8d74004040 comp rx=0 tx=0).stop 2024-04-23T10:31:02.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 -- 172.21.15.69:0/613063909 shutdown_connections 2024-04-23T10:31:02.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8d6c0a3d20 0x7f8d6c0a61e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d84106170 0x7f8d84197c90 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8419c010 0x7f8d8419c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 --2- 172.21.15.69:0/613063909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d841010a0 0x7f8d84197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 -- 172.21.15.69:0/613063909 >> 172.21.15.69:0/613063909 conn(0x7f8d84077f50 msgr2=0x7f8d840ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:02.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 -- 172.21.15.69:0/613063909 shutdown_connections 2024-04-23T10:31:02.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.249+0000 7f8d89984640 1 -- 172.21.15.69:0/613063909 wait complete. 2024-04-23T10:31:02.260 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id af2ef696 --release --await' 2024-04-23T10:31:02.260 DEBUG:teuthology.orchestra.run.smithi069:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24487 quiesce db --set-id af2ef696 --release --await 2024-04-23T10:31:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.371+0000 7f07815cd640 1 -- 172.21.15.69:0/2712908505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f077c103af0 msgr2=0x7f077c10bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.371+0000 7f07815cd640 1 --2- 172.21.15.69:0/2712908505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f077c103af0 0x7f077c10bfd0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0770009900 tx=0x7f077002a510 comp rx=0 tx=0).stop 2024-04-23T10:31:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.371+0000 7f07815cd640 1 -- 172.21.15.69:0/2712908505 shutdown_connections 2024-04-23T10:31:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.371+0000 7f07815cd640 1 --2- 172.21.15.69:0/2712908505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f077c103af0 0x7f077c10bfd0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.371+0000 7f07815cd640 1 --2- 172.21.15.69:0/2712908505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f077c10c510 0x7f077c10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.371+0000 7f07815cd640 1 --2- 172.21.15.69:0/2712908505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f077c1031d0 0x7f077c1035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.371+0000 7f07815cd640 1 -- 172.21.15.69:0/2712908505 >> 172.21.15.69:0/2712908505 conn(0x7f077c077f50 msgr2=0x7f077c078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.371+0000 7f07815cd640 1 -- 172.21.15.69:0/2712908505 shutdown_connections 2024-04-23T10:31:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.371+0000 7f07815cd640 1 -- 172.21.15.69:0/2712908505 wait complete. 2024-04-23T10:31:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f07815cd640 1 Processor -- start 2024-04-23T10:31:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f07815cd640 1 -- start start 2024-04-23T10:31:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f07815cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f077c1031d0 0x7f077c19e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f07815cd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f077c103af0 0x7f077c19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f07815cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f077c10c510 0x7f077c1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f07815cd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f077c1122e0 con 0x7f077c103af0 2024-04-23T10:31:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f07815cd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f077c112160 con 0x7f077c1031d0 2024-04-23T10:31:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f07815cd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f077c112460 con 0x7f077c10c510 2024-04-23T10:31:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f077a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f077c103af0 0x7f077c19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f077a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f077c103af0 0x7f077c19ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46244/0 (socket says 172.21.15.69:46244) 2024-04-23T10:31:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f077a7fc640 1 -- 172.21.15.69:0/1014769742 learned_addr learned my addr 172.21.15.69:0/1014769742 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f077affd640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f077c1031d0 0x7f077c19e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f077b7fe640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f077c10c510 0x7f077c1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f077a7fc640 1 -- 172.21.15.69:0/1014769742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f077c10c510 msgr2=0x7f077c1986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f077a7fc640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f077c10c510 0x7f077c1986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f077a7fc640 1 -- 172.21.15.69:0/1014769742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f077c1031d0 msgr2=0x7f077c19e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f077a7fc640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f077c1031d0 0x7f077c19e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f077a7fc640 1 -- 172.21.15.69:0/1014769742 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c198f60 con 0x7f077c103af0 2024-04-23T10:31:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.372+0000 7f077affd640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f077c1031d0 0x7f077c19e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:31:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.373+0000 7f077a7fc640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f077c103af0 0x7f077c19ead0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0770005ab0 tx=0x7f07700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.373+0000 7f0763fff640 1 -- 172.21.15.69:0/1014769742 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077003f030 con 0x7f077c103af0 2024-04-23T10:31:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.373+0000 7f07815cd640 1 -- 172.21.15.69:0/1014769742 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077c1991f0 con 0x7f077c103af0 2024-04-23T10:31:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.373+0000 7f0763fff640 1 -- 172.21.15.69:0/1014769742 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0770003cd0 con 0x7f077c103af0 2024-04-23T10:31:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.373+0000 7f07815cd640 1 -- 172.21.15.69:0/1014769742 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077c1a5510 con 0x7f077c103af0 2024-04-23T10:31:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.373+0000 7f0763fff640 1 -- 172.21.15.69:0/1014769742 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770035070 con 0x7f077c103af0 2024-04-23T10:31:02.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.375+0000 7f0763fff640 1 -- 172.21.15.69:0/1014769742 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f0770042030 con 0x7f077c103af0 2024-04-23T10:31:02.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.375+0000 7f07843c1740 1 Processor -- start 2024-04-23T10:31:02.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.375+0000 7f07843c1740 1 -- start start 2024-04-23T10:31:02.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f07843c1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 0x562a1dab0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f07843c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dabaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f07843c1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dabb480 0x562a1dabd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f07843c1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x562a1da156d0 con 0x562a1dabb480 2024-04-23T10:31:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f07843c1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562a1d9b21a0 con 0x562a1dab0490 2024-04-23T10:31:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f07843c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562a1da11690 con 0x562a1dab0db0 2024-04-23T10:31:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f0763fff640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07640a3d20 0x7f07640a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 0x562a1dab0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dabaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dabb480 0x562a1dabd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 0x562a1dab0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.69:35718/0 (socket says 172.21.15.69:35718) 2024-04-23T10:31:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dabaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.69:41094/0 (socket says 172.21.15.69:41094) 2024-04-23T10:31:02.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077b7fe640 1 -- 172.21.15.69:0/2933320974 learned_addr learned my addr 172.21.15.69:0/2933320974 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:02.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077b7fe640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07640a3d20 0x7f07640a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f0763fff640 1 -- 172.21.15.69:0/1014769742 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f07700f0b80 con 0x7f077c103af0 2024-04-23T10:31:02.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077affd640 1 -- 172.21.15.69:0/2933320974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 msgr2=0x562a1dab0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:02.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077affd640 1 --2- 172.21.15.69:0/2933320974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 0x562a1dab0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077affd640 1 -- 172.21.15.69:0/2933320974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dabb480 msgr2=0x562a1dabd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:02.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077affd640 1 --2- 172.21.15.69:0/2933320974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dabb480 0x562a1dabd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077affd640 1 -- 172.21.15.69:0/2933320974 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a1d9bc5b0 con 0x562a1dab0db0 2024-04-23T10:31:02.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077b7fe640 1 --2- 172.21.15.69:0/2933320974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 0x562a1dab0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:31:02.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077b7fe640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07640a3d20 0x7f07640a61e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0774005c40 tx=0x7f0774009500 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:02.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.376+0000 7f077affd640 1 --2- 172.21.15.69:0/2933320974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dabaf40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f076c005fd0 tx=0x7f076c00bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcf58924442a2111 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:02.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07617fa640 1 -- 172.21.15.69:0/2933320974 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c011700 con 0x562a1dab0db0 2024-04-23T10:31:02.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07617fa640 1 -- 172.21.15.69:0/2933320974 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f076c011d70 con 0x562a1dab0db0 2024-04-23T10:31:02.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07617fa640 1 -- 172.21.15.69:0/2933320974 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c01a380 con 0x562a1dab0db0 2024-04-23T10:31:02.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07843c1740 1 -- 172.21.15.69:0/2933320974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 msgr2=0x562a1dabaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07843c1740 1 --2- 172.21.15.69:0/2933320974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dabaf40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f076c005fd0 tx=0x7f076c00bf90 comp rx=0 tx=0).stop 2024-04-23T10:31:02.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07843c1740 1 -- 172.21.15.69:0/2933320974 shutdown_connections 2024-04-23T10:31:02.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07843c1740 1 --2- 172.21.15.69:0/2933320974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dabb480 0x562a1dabd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07843c1740 1 --2- 172.21.15.69:0/2933320974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dabaf40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07843c1740 1 --2- 172.21.15.69:0/2933320974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 0x562a1dab0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07843c1740 1 -- 172.21.15.69:0/2933320974 >> 172.21.15.69:0/2933320974 conn(0x562a1daac7b0 msgr2=0x562a1daacb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07843c1740 1 -- 172.21.15.69:0/2933320974 shutdown_connections 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.377+0000 7f07843c1740 1 -- 172.21.15.69:0/2933320974 wait complete. 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f07843c1740 1 -- start start 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f07843c1740 1 Processor -- start 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f07843c1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dabaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f07843c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dab81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f07843c1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dabb480 0x562a1dab8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f07843c1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x562a1dabe310 con 0x562a1dab0490 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f07843c1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562a1d9afb20 con 0x562a1dabb480 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f07843c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562a1dabe490 con 0x562a1dab0db0 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f07843c1740 10 client.0 _ll_register_callbacks cb 0x562a1d9af530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:31:02.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f077affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dabaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f077affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dabaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46262/0 (socket says 172.21.15.69:46262) 2024-04-23T10:31:02.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f077affd640 1 -- 172.21.15.69:0/1493830391 learned_addr learned my addr 172.21.15.69:0/1493830391 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:02.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f077a7fc640 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dab81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f077b7fe640 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dabb480 0x562a1dab8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f077affd640 1 -- 172.21.15.69:0/1493830391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 msgr2=0x562a1dab81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:02.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f077affd640 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dab81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f077affd640 1 -- 172.21.15.69:0/1493830391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dabb480 msgr2=0x562a1dab8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:02.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f077affd640 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dabb480 0x562a1dab8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.378+0000 7f077affd640 1 -- 172.21.15.69:0/1493830391 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a1d727920 con 0x562a1dab0490 2024-04-23T10:31:02.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f077affd640 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dabaf00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f076c000c00 tx=0x7f076c01c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f2791c8212eba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:02.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f075eff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:31:02.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f075eff5640 1 -- 172.21.15.69:0/1493830391 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c02b060 con 0x562a1dab0490 2024-04-23T10:31:02.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f075eff5640 1 -- 172.21.15.69:0/1493830391 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f076c011710 con 0x562a1dab0490 2024-04-23T10:31:02.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f07843c1740 1 -- 172.21.15.69:0/1493830391 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f076c011d70 con 0x562a1dab0490 2024-04-23T10:31:02.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f075eff5640 1 -- 172.21.15.69:0/1493830391 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f076c00bc50 con 0x562a1dab0490 2024-04-23T10:31:02.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f07843c1740 10 client.16179 fetch_fsmap learned FSMap version 40 2024-04-23T10:31:02.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f07843c1740 1 -- 172.21.15.69:0/1493830391 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x562a1d7f3d30 con 0x562a1dab0490 2024-04-23T10:31:02.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f075eff5640 1 -- 172.21.15.69:0/1493830391 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f076c011d70 con 0x562a1dab0490 2024-04-23T10:31:02.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f075eff5640 1 -- 172.21.15.69:0/1493830391 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f076c01cce0 con 0x562a1dab0490 2024-04-23T10:31:02.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f07843c1740 10 client.16179 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:31:02.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f07843c1740 10 client.16179 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:31:02.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f07843c1740 20 client.16179 populate_metadata read hostname 'smithi069' 2024-04-23T10:31:02.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f07843c1740 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562a1dacb630 0x562a1dacda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f07843c1740 4 client.16179 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:31:02.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.379+0000 7f07843c1740 1 -- 172.21.15.69:0/1493830391 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a1d9d3500 con 0x562a1dacb630 2024-04-23T10:31:02.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.380+0000 7f077a7fc640 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562a1dacb630 0x562a1dacda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.380+0000 7f075eff5640 10 client.16179 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:31:02.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.380+0000 7f077a7fc640 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562a1dacb630 0x562a1dacda20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed60c72fa3eaa7db server_cookie=f75ab7a8ec3861b6 in_seq=0 out_seq=0 2024-04-23T10:31:02.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f075eff5640 1 -- 172.21.15.69:0/1493830391 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562a1d9d3500 con 0x562a1dacb630 2024-04-23T10:31:02.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f075eff5640 10 client.16179 handle_command_reply: tid=0 2024-04-23T10:31:02.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 1 client.16179 shutdown 2024-04-23T10:31:02.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 1 -- 172.21.15.69:0/1493830391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 msgr2=0x562a1dabaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dabaf00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f076c000c00 tx=0x7f076c01c6b0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 1 -- 172.21.15.69:0/1493830391 shutdown_connections 2024-04-23T10:31:02.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562a1dacb630 0x562a1dacda20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dabb480 0x562a1dab8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f075eff5640 0 client.16179 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:31:02.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dab81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 1 --2- 172.21.15.69:0/1493830391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dabaf00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 1 -- 172.21.15.69:0/1493830391 >> 172.21.15.69:0/1493830391 conn(0x562a1daac7b0 msgr2=0x562a1dab25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:02.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 1 -- 172.21.15.69:0/1493830391 shutdown_connections 2024-04-23T10:31:02.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 1 -- 172.21.15.69:0/1493830391 wait complete. 2024-04-23T10:31:02.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.381+0000 7f07843c1740 20 client.16179 trim_cache size 0 max 16384 2024-04-23T10:31:02.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.402+0000 7f07843c1740 1 Processor -- start 2024-04-23T10:31:02.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.402+0000 7f07843c1740 1 -- start start 2024-04-23T10:31:02.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f07843c1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dab7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f07843c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dabaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f07843c1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dabb480 0x562a1dad30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f07843c1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f077c1add20 con 0x562a1dab0490 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f07843c1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f077c1afaa0 con 0x562a1dabb480 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f07843c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f077c1ae4b0 con 0x562a1dab0db0 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f077affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dab7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f077affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dab7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46274/0 (socket says 172.21.15.69:46274) 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f077affd640 1 -- 172.21.15.69:0/2449596249 learned_addr learned my addr 172.21.15.69:0/2449596249 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f077a7fc640 1 --2- 172.21.15.69:0/2449596249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dabaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f077b7fe640 1 --2- 172.21.15.69:0/2449596249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dabb480 0x562a1dad30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f077affd640 1 -- 172.21.15.69:0/2449596249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 msgr2=0x562a1dabaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f077affd640 1 --2- 172.21.15.69:0/2449596249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dabaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f077affd640 1 -- 172.21.15.69:0/2449596249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dabb480 msgr2=0x562a1dad30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f077affd640 1 --2- 172.21.15.69:0/2449596249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dabb480 0x562a1dad30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f077affd640 1 -- 172.21.15.69:0/2449596249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a1dab6740 con 0x562a1dab0490 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f077affd640 1 --2- 172.21.15.69:0/2449596249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dab7130 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f076c005d00 tx=0x7f076c024370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c700a16ed8e04a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f0760ff9640 1 -- 172.21.15.69:0/2449596249 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c01c720 con 0x562a1dab0490 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f0760ff9640 1 -- 172.21.15.69:0/2449596249 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f076c024490 con 0x562a1dab0490 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.403+0000 7f0760ff9640 1 -- 172.21.15.69:0/2449596249 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c0249f0 con 0x562a1dab0490 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.404+0000 7f07843c1740 1 -- 172.21.15.69:0/2449596249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 msgr2=0x562a1dab7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.404+0000 7f07843c1740 1 --2- 172.21.15.69:0/2449596249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dab7130 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f076c005d00 tx=0x7f076c024370 comp rx=0 tx=0).stop 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.404+0000 7f07843c1740 1 -- 172.21.15.69:0/2449596249 shutdown_connections 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.404+0000 7f07843c1740 1 --2- 172.21.15.69:0/2449596249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dabb480 0x562a1dad30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.404+0000 7f07843c1740 1 --2- 172.21.15.69:0/2449596249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dab0db0 0x562a1dabaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.404+0000 7f07843c1740 1 --2- 172.21.15.69:0/2449596249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0490 0x562a1dab7130 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.404+0000 7f07843c1740 1 -- 172.21.15.69:0/2449596249 >> 172.21.15.69:0/2449596249 conn(0x562a1daac7b0 msgr2=0x562a1daab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:02.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.404+0000 7f07843c1740 1 -- 172.21.15.69:0/2449596249 shutdown_connections 2024-04-23T10:31:02.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.404+0000 7f07843c1740 1 -- 172.21.15.69:0/2449596249 wait complete. 2024-04-23T10:31:02.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.404+0000 7f07843c1740 1 -- start start 2024-04-23T10:31:02.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f07843c1740 1 Processor -- start 2024-04-23T10:31:02.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f07843c1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 0x562a1dac36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f07843c1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0db0 0x562a1dac3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f07843c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dabb480 0x562a1dabc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f07843c1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f077c1af3d0 con 0x562a1dab0db0 2024-04-23T10:31:02.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f07843c1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f077c1aec40 con 0x562a1dab0490 2024-04-23T10:31:02.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f07843c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f077c1abc40 con 0x562a1dabb480 2024-04-23T10:31:02.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f07843c1740 10 client.0 _ll_register_callbacks cb 0x7f076c00be90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0db0 0x562a1dac3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077a7fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0db0 0x562a1dac3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46288/0 (socket says 172.21.15.69:46288) 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077a7fc640 1 -- 172.21.15.69:0/1517355844 learned_addr learned my addr 172.21.15.69:0/1517355844 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077affd640 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 0x562a1dac36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077b7fe640 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dabb480 0x562a1dabc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077a7fc640 1 -- 172.21.15.69:0/1517355844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dabb480 msgr2=0x562a1dabc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077a7fc640 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dabb480 0x562a1dabc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077a7fc640 1 -- 172.21.15.69:0/1517355844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 msgr2=0x562a1dac36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077a7fc640 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 0x562a1dac36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077a7fc640 1 -- 172.21.15.69:0/1517355844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a1dabccd0 con 0x562a1dab0db0 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077affd640 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 0x562a1dac36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:31:02.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f077a7fc640 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0db0 0x562a1dac3c20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f07700b8f20 tx=0x7f077008c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b75e114624243e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.405+0000 7f075eff5640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:31:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f075eff5640 1 -- 172.21.15.69:0/1517355844 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770049040 con 0x562a1dab0db0 2024-04-23T10:31:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f075eff5640 1 -- 172.21.15.69:0/1517355844 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f07700dd0b0 con 0x562a1dab0db0 2024-04-23T10:31:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f07843c1740 1 -- 172.21.15.69:0/1517355844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f076c024490 con 0x562a1dab0db0 2024-04-23T10:31:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f075eff5640 1 -- 172.21.15.69:0/1517355844 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f07700bcc00 con 0x562a1dab0db0 2024-04-23T10:31:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f07843c1740 10 client.16185 fetch_fsmap learned FSMap version 40 2024-04-23T10:31:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f07843c1740 1 -- 172.21.15.69:0/1517355844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x562a1db321c0 con 0x562a1dab0db0 2024-04-23T10:31:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f075eff5640 1 -- 172.21.15.69:0/1517355844 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f076c024490 con 0x562a1dab0db0 2024-04-23T10:31:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f075eff5640 1 -- 172.21.15.69:0/1517355844 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f07700b9270 con 0x562a1dab0db0 2024-04-23T10:31:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f07843c1740 10 client.16185 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:31:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f07843c1740 10 client.16185 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:31:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f07843c1740 20 client.16185 populate_metadata read hostname 'smithi069' 2024-04-23T10:31:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f07843c1740 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562a1dacb630 0x562a1db34a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f07843c1740 4 client.16185 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "af2ef696", "release": true, "await": true}] 2024-04-23T10:31:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f07843c1740 1 -- 172.21.15.69:0/1517355844 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "quiesce db", "set_id": "af2ef696", "release": true, "await": true}) -- 0x562a1da230f0 con 0x562a1dacb630 2024-04-23T10:31:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.406+0000 7f077affd640 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562a1dacb630 0x562a1db34a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.407+0000 7f075eff5640 10 client.16185 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:31:02.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.407+0000 7f077affd640 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562a1dacb630 0x562a1db34a20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a973c79f3aa0cbf7 server_cookie=fb8dc90444dd3cf8 in_seq=0 out_seq=0 2024-04-23T10:31:02.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f075eff5640 1 -- 172.21.15.69:0/1517355844 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x562a1da230f0 con 0x562a1dacb630 2024-04-23T10:31:02.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f075eff5640 10 client.16185 handle_command_reply: tid=0 2024-04-23T10:31:02.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 1 client.16185 shutdown 2024-04-23T10:31:02.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 1 -- 172.21.15.69:0/1517355844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0db0 msgr2=0x562a1dac3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0db0 0x562a1dac3c20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f07700b8f20 tx=0x7f077008c4e0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 1 -- 172.21.15.69:0/1517355844 shutdown_connections 2024-04-23T10:31:02.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x562a1dacb630 0x562a1db34a20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a1dab0db0 0x562a1dac3c20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a1dabb480 0x562a1dabc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f075eff5640 0 client.16185 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:31:02.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 1 --2- 172.21.15.69:0/1517355844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562a1dab0490 0x562a1dac36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 1 -- 172.21.15.69:0/1517355844 >> 172.21.15.69:0/1517355844 conn(0x562a1daac7b0 msgr2=0x562a1dab1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:02.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 1 -- 172.21.15.69:0/1517355844 shutdown_connections 2024-04-23T10:31:02.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 1 -- 172.21.15.69:0/1517355844 wait complete. 2024-04-23T10:31:02.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.424+0000 7f07843c1740 20 client.16185 trim_cache size 0 max 16384 2024-04-23T10:31:02.425 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:31:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 40, 2024-04-23T10:31:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "leader": 24487, 2024-04-23T10:31:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "set_version": 16, 2024-04-23T10:31:02.425 INFO:teuthology.orchestra.run.smithi069.stdout: "sets": { 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "af2ef696": { 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "version": 16, 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "age_ref": 0.0, 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RELEASED", 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "timeout": 60.0, 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "expiration": 90.0, 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "members": { 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "file:/": { 2024-04-23T10:31:02.426 INFO:teuthology.orchestra.run.smithi069.stdout: "excluded": false, 2024-04-23T10:31:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "state": { 2024-04-23T10:31:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RELEASED", 2024-04-23T10:31:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: "age": 0.0 2024-04-23T10:31:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:31:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:31:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:31:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:31:02.427 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:31:02.427 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:31:02.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 -- 172.21.15.69:0/1014769742 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07640a3d20 msgr2=0x7f07640a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07640a3d20 0x7f07640a61e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0774005c40 tx=0x7f0774009500 comp rx=0 tx=0).stop 2024-04-23T10:31:02.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 -- 172.21.15.69:0/1014769742 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f077c103af0 msgr2=0x7f077c19ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:02.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f077c103af0 0x7f077c19ead0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0770005ab0 tx=0x7f07700042f0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 -- 172.21.15.69:0/1014769742 shutdown_connections 2024-04-23T10:31:02.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f07640a3d20 0x7f07640a61e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f077c103af0 0x7f077c19ead0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f077c10c510 0x7f077c1986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 --2- 172.21.15.69:0/1014769742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f077c1031d0 0x7f077c19e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:02.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 -- 172.21.15.69:0/1014769742 >> 172.21.15.69:0/1014769742 conn(0x7f077c077f50 msgr2=0x7f077c0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:02.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 -- 172.21.15.69:0/1014769742 shutdown_connections 2024-04-23T10:31:02.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:02.425+0000 7f07815cd640 1 -- 172.21.15.69:0/1014769742 wait complete. 2024-04-23T10:31:02.435 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'af2ef696', seconds elapsed: 31.7 2024-04-23T10:31:02.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:02 smithi167 ceph-mon[32940]: pgmap v128: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-04-23T10:31:02.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:02 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:31:02.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:02 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/613063909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:31:02.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:02 smithi146 ceph-mon[32800]: pgmap v128: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-04-23T10:31:02.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:02 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:31:02.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:02 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/613063909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:31:02.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:02 smithi069 ceph-mon[29593]: pgmap v128: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-04-23T10:31:02.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:02 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:31:02.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:02 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/613063909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:31:03.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:03 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:31:03.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:03 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:31:03.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:03 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:31:03.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:03 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:31:03.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:03 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:31:03.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:03 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:31:03.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:03 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:31:03.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:03 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:31:03.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:03 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:31:04.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:04 smithi146 ceph-mon[32800]: pgmap v129: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-04-23T10:31:04.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:04 smithi069 ceph-mon[29593]: pgmap v129: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-04-23T10:31:05.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:04 smithi167 ceph-mon[32940]: pgmap v129: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-04-23T10:31:06.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:06 smithi146 ceph-mon[32800]: pgmap v130: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 256 KiB/s wr, 58 op/s 2024-04-23T10:31:06.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:06 smithi069 ceph-mon[29593]: pgmap v130: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 256 KiB/s wr, 58 op/s 2024-04-23T10:31:07.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:06 smithi167 ceph-mon[32940]: pgmap v130: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 256 KiB/s wr, 58 op/s 2024-04-23T10:31:08.046 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-04-23T10:31:08.046 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-23T10:31:08.356 DEBUG:teuthology.parallel:result is None 2024-04-23T10:31:08.357 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T10:31:08.387 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T10:31:08.387 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-23T10:31:08.399 INFO:tasks.quiescer:joining Quiescers 2024-04-23T10:31:08.399 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-04-23T10:31:08.399 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:31:08.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.530+0000 7f03da635640 1 -- 172.21.15.69:0/2468778835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03d410e7c0 msgr2=0x7f03d4110bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.530+0000 7f03da635640 1 --2- 172.21.15.69:0/2468778835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03d410e7c0 0x7f03d4110bd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009ca0 tx=0x7f03cc02a950 comp rx=0 tx=0).stop 2024-04-23T10:31:08.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.530+0000 7f03da635640 1 -- 172.21.15.69:0/2468778835 shutdown_connections 2024-04-23T10:31:08.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.530+0000 7f03da635640 1 --2- 172.21.15.69:0/2468778835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03d410e7c0 0x7f03d4110bd0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.530+0000 7f03da635640 1 --2- 172.21.15.69:0/2468778835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d4074c40 0x7f03d410e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.530+0000 7f03da635640 1 --2- 172.21.15.69:0/2468778835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03d4074320 0x7f03d4074700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.530+0000 7f03da635640 1 -- 172.21.15.69:0/2468778835 >> 172.21.15.69:0/2468778835 conn(0x7f03d4079310 msgr2=0x7f03d4079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:08.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.530+0000 7f03da635640 1 -- 172.21.15.69:0/2468778835 shutdown_connections 2024-04-23T10:31:08.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.530+0000 7f03da635640 1 -- 172.21.15.69:0/2468778835 wait complete. 2024-04-23T10:31:08.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.530+0000 7f03da635640 1 Processor -- start 2024-04-23T10:31:08.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.530+0000 7f03da635640 1 -- start start 2024-04-23T10:31:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03da635640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03d4074320 0x7f03d41a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03da635640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03d4074c40 0x7f03d41a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03da635640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d410e7c0 0x7f03d419a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03da635640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f03d41144f0 con 0x7f03d4074c40 2024-04-23T10:31:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03da635640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4114370 con 0x7f03d410e7c0 2024-04-23T10:31:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03da635640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4114670 con 0x7f03d4074320 2024-04-23T10:31:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d37fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03d4074c40 0x7f03d41a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d37fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03d4074c40 0x7f03d41a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46318/0 (socket says 172.21.15.69:46318) 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d37fe640 1 -- 172.21.15.69:0/1630405059 learned_addr learned my addr 172.21.15.69:0/1630405059 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d3fff640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03d4074320 0x7f03d41a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d8bd2640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d410e7c0 0x7f03d419a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d37fe640 1 -- 172.21.15.69:0/1630405059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03d4074320 msgr2=0x7f03d41a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d37fe640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03d4074320 0x7f03d41a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d37fe640 1 -- 172.21.15.69:0/1630405059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d410e7c0 msgr2=0x7f03d419a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d37fe640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d410e7c0 0x7f03d419a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d37fe640 1 -- 172.21.15.69:0/1630405059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d419b020 con 0x7f03d4074c40 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d37fe640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03d4074c40 0x7f03d41a0c20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f03c800d950 tx=0x7f03c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d17fa640 1 -- 172.21.15.69:0/1630405059 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8017070 con 0x7f03d4074c40 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d17fa640 1 -- 172.21.15.69:0/1630405059 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f03c8009c30 con 0x7f03d4074c40 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03da635640 1 -- 172.21.15.69:0/1630405059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d419b310 con 0x7f03d4074c40 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03d17fa640 1 -- 172.21.15.69:0/1630405059 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c800f6b0 con 0x7f03d4074c40 2024-04-23T10:31:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.531+0000 7f03da635640 1 -- 172.21.15.69:0/1630405059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d41a7530 con 0x7f03d4074c40 2024-04-23T10:31:08.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.532+0000 7f03da635640 1 -- 172.21.15.69:0/1630405059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d40759d0 con 0x7f03d4074c40 2024-04-23T10:31:08.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.533+0000 7f03d17fa640 1 -- 172.21.15.69:0/1630405059 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f03c80109c0 con 0x7f03d4074c40 2024-04-23T10:31:08.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.534+0000 7f03d17fa640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f03bc0a3d20 0x7f03bc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.534+0000 7f03d3fff640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f03bc0a3d20 0x7f03bc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.534+0000 7f03d17fa640 1 -- 172.21.15.69:0/1630405059 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f03c80d02f0 con 0x7f03d4074c40 2024-04-23T10:31:08.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.534+0000 7f03d3fff640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f03bc0a3d20 0x7f03bc0a61e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f03c400bbe0 tx=0x7f03c400b390 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:08.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.539+0000 7f03d17fa640 1 -- 172.21.15.69:0/1630405059 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f03c8009de0 con 0x7f03d4074c40 2024-04-23T10:31:08.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:08 smithi069 ceph-mon[29593]: pgmap v131: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 256 KiB/s wr, 54 op/s 2024-04-23T10:31:08.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.755+0000 7f03da635640 1 -- 172.21.15.69:0/1630405059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03d4109940 con 0x7f03d4074c40 2024-04-23T10:31:08.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.756+0000 7f03d17fa640 1 -- 172.21.15.69:0/1630405059 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11965 (secure 0 0 0) 0x7f03c809c370 con 0x7f03d4074c40 2024-04-23T10:31:08.755 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:31:08.755 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:29:33.510879+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25297":{"gid":25297,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/1216686871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1216686871},{"type":"v1","addr":"172.21.15.167:6835","nonce":1216686871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24416,24392,24487,24421,24463]},"id":1}]} 2024-04-23T10:31:08.755 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 40 2024-04-23T10:31:08.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 -- 172.21.15.69:0/1630405059 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f03bc0a3d20 msgr2=0x7f03bc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f03bc0a3d20 0x7f03bc0a61e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f03c400bbe0 tx=0x7f03c400b390 comp rx=0 tx=0).stop 2024-04-23T10:31:08.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 -- 172.21.15.69:0/1630405059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03d4074c40 msgr2=0x7f03d41a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03d4074c40 0x7f03d41a0c20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f03c800d950 tx=0x7f03c800de10 comp rx=0 tx=0).stop 2024-04-23T10:31:08.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 -- 172.21.15.69:0/1630405059 shutdown_connections 2024-04-23T10:31:08.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f03bc0a3d20 0x7f03bc0a61e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03d4074c40 0x7f03d41a0c20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d410e7c0 0x7f03d419a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 --2- 172.21.15.69:0/1630405059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03d4074320 0x7f03d41a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 -- 172.21.15.69:0/1630405059 >> 172.21.15.69:0/1630405059 conn(0x7f03d4079310 msgr2=0x7f03d40feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:08.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 -- 172.21.15.69:0/1630405059 shutdown_connections 2024-04-23T10:31:08.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.758+0000 7f03da635640 1 -- 172.21.15.69:0/1630405059 wait complete. 2024-04-23T10:31:08.768 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --cancel --all' 2024-04-23T10:31:08.768 DEBUG:teuthology.orchestra.run.smithi069:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24487 quiesce db --cancel --all 2024-04-23T10:31:08.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.871+0000 7f6719d68640 1 -- 172.21.15.69:0/1807075392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6714101b40 msgr2=0x7f671410dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.871+0000 7f6719d68640 1 --2- 172.21.15.69:0/1807075392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6714101b40 0x7f671410dc80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f670c009cd0 tx=0x7f670c02a8e0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.871+0000 7f6719d68640 1 -- 172.21.15.69:0/1807075392 shutdown_connections 2024-04-23T10:31:08.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.871+0000 7f6719d68640 1 --2- 172.21.15.69:0/1807075392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6714101b40 0x7f671410dc80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.871+0000 7f6719d68640 1 --2- 172.21.15.69:0/1807075392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67141011a0 0x7f6714101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.871+0000 7f6719d68640 1 --2- 172.21.15.69:0/1807075392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6714107030 0x7f6714107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.871+0000 7f6719d68640 1 -- 172.21.15.69:0/1807075392 >> 172.21.15.69:0/1807075392 conn(0x7f6714076c50 msgr2=0x7f6714077060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:08.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.871+0000 7f6719d68640 1 -- 172.21.15.69:0/1807075392 shutdown_connections 2024-04-23T10:31:08.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.871+0000 7f6719d68640 1 -- 172.21.15.69:0/1807075392 wait complete. 2024-04-23T10:31:08.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.871+0000 7f6719d68640 1 Processor -- start 2024-04-23T10:31:08.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6719d68640 1 -- start start 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6719d68640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67141011a0 0x7f671419e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6719d68640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6714101b40 0x7f671419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6719d68640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6714107030 0x7f67141986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6719d68640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6714112380 con 0x7f67141011a0 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6719d68640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6714112200 con 0x7f6714101b40 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6719d68640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6714112500 con 0x7f6714107030 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f67137fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67141011a0 0x7f671419e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f67137fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67141011a0 0x7f671419e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46336/0 (socket says 172.21.15.69:46336) 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f67137fe640 1 -- 172.21.15.69:0/530047819 learned_addr learned my addr 172.21.15.69:0/530047819 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6713fff640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6714107030 0x7f67141986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6712ffd640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6714101b40 0x7f671419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f67137fe640 1 -- 172.21.15.69:0/530047819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6714107030 msgr2=0x7f67141986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f67137fe640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6714107030 0x7f67141986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f67137fe640 1 -- 172.21.15.69:0/530047819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6714101b40 msgr2=0x7f671419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f67137fe640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6714101b40 0x7f671419eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f67137fe640 1 -- 172.21.15.69:0/530047819 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6714198f60 con 0x7f67141011a0 2024-04-23T10:31:08.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f67137fe640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67141011a0 0x7f671419e5e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f670400d950 tx=0x7f670400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:08.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6710ff9640 1 -- 172.21.15.69:0/530047819 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704017070 con 0x7f67141011a0 2024-04-23T10:31:08.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6710ff9640 1 -- 172.21.15.69:0/530047819 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6704009c30 con 0x7f67141011a0 2024-04-23T10:31:08.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6719d68640 1 -- 172.21.15.69:0/530047819 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6714199250 con 0x7f67141011a0 2024-04-23T10:31:08.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.872+0000 7f6710ff9640 1 -- 172.21.15.69:0/530047819 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670400f6b0 con 0x7f67141011a0 2024-04-23T10:31:08.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.873+0000 7f6719d68640 1 -- 172.21.15.69:0/530047819 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67141a5560 con 0x7f67141011a0 2024-04-23T10:31:08.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.874+0000 7f6710ff9640 1 -- 172.21.15.69:0/530047819 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f67040109c0 con 0x7f67141011a0 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f671c722740 1 Processor -- start 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f671c722740 1 -- start start 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f671c722740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5329740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f6710ff9640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f66fc0a3d20 0x7f66fc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f671c722740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329d10 0x55aba5333db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f671c722740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 0x55aba53367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f671c722740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55aba528f130 con 0x55aba5329360 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f671c722740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55aba522bc50 con 0x55aba5329d10 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f671c722740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aba528b0f0 con 0x55aba5334380 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f6713fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5329740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f67137fe640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f66fc0a3d20 0x7f66fc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f6713fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5329740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46348/0 (socket says 172.21.15.69:46348) 2024-04-23T10:31:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f6713fff640 1 -- 172.21.15.69:0/3823532975 learned_addr learned my addr 172.21.15.69:0/3823532975 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f6712ffd640 1 --2- 172.21.15.69:0/3823532975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329d10 0x55aba5333db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f6710ff9640 1 -- 172.21.15.69:0/530047819 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f67040d03c0 con 0x7f67141011a0 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.875+0000 7f6713fff640 1 --2- 172.21.15.69:0/3823532975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 0x55aba53367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f6713fff640 1 -- 172.21.15.69:0/3823532975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 msgr2=0x55aba53367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f6713fff640 1 --2- 172.21.15.69:0/3823532975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 0x55aba53367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f6713fff640 1 -- 172.21.15.69:0/3823532975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329d10 msgr2=0x55aba5333db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f6713fff640 1 --2- 172.21.15.69:0/3823532975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329d10 0x55aba5333db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f6713fff640 1 -- 172.21.15.69:0/3823532975 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba5245fd0 con 0x55aba5329360 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f67137fe640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f66fc0a3d20 0x7f66fc0a61e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f67040ce140 tx=0x7f670406ddd0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f6713fff640 1 --2- 172.21.15.69:0/3823532975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5329740 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f670c009cd0 tx=0x7f670c005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7742f96d3f00e4bb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f66f9ffb640 1 -- 172.21.15.69:0/3823532975 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c045020 con 0x55aba5329360 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f66f9ffb640 1 -- 172.21.15.69:0/3823532975 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f670c036040 con 0x55aba5329360 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f66f9ffb640 1 -- 172.21.15.69:0/3823532975 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c0044c0 con 0x55aba5329360 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f671c722740 1 -- 172.21.15.69:0/3823532975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 msgr2=0x55aba5329740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f671c722740 1 --2- 172.21.15.69:0/3823532975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5329740 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f670c009cd0 tx=0x7f670c005fa0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f671c722740 1 -- 172.21.15.69:0/3823532975 shutdown_connections 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f671c722740 1 --2- 172.21.15.69:0/3823532975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 0x55aba53367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.876+0000 7f671c722740 1 --2- 172.21.15.69:0/3823532975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329d10 0x55aba5333db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 --2- 172.21.15.69:0/3823532975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5329740 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 -- 172.21.15.69:0/3823532975 >> 172.21.15.69:0/3823532975 conn(0x55aba5325620 msgr2=0x55aba5325a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 -- 172.21.15.69:0/3823532975 shutdown_connections 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 -- 172.21.15.69:0/3823532975 wait complete. 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 -- start start 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 Processor -- start 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329360 0x55aba5331250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5329d10 0x55aba5331790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5334380 0x55aba5331cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55aba5337290 con 0x55aba5334380 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55aba5229640 con 0x55aba5329360 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aba5337410 con 0x55aba5329d10 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f671c722740 10 client.0 _ll_register_callbacks cb 0x55aba5229030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:31:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f6713fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5334380 0x55aba5331cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f6713fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5334380 0x55aba5331cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46362/0 (socket says 172.21.15.69:46362) 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f6713fff640 1 -- 172.21.15.69:0/2644396244 learned_addr learned my addr 172.21.15.69:0/2644396244 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f6712ffd640 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5329d10 0x55aba5331790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.877+0000 7f6713fff640 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329360 0x55aba5331250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f6712ffd640 1 -- 172.21.15.69:0/2644396244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329360 msgr2=0x55aba5331250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f6712ffd640 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329360 0x55aba5331250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f6712ffd640 1 -- 172.21.15.69:0/2644396244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5334380 msgr2=0x55aba5331cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f6712ffd640 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5334380 0x55aba5331cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f6712ffd640 1 -- 172.21.15.69:0/2644396244 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba506da20 con 0x55aba5329d10 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f6713fff640 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5334380 0x55aba5331cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f6712ffd640 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5329d10 0x55aba5331790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55aba532a0f0 tx=0x7f6708012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f5bff5804432f70 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f66f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2644396244 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708004440 con 0x55aba5329d10 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f671c722740 1 -- 172.21.15.69:0/2644396244 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f670c036040 con 0x55aba5329d10 2024-04-23T10:31:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2644396244 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f67080035f0 con 0x55aba5329d10 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2644396244 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f67080037f0 con 0x55aba5329d10 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f671c722740 10 client.25615 fetch_fsmap learned FSMap version 40 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f671c722740 1 -- 172.21.15.69:0/2644396244 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55aba50ce1b0 con 0x55aba5329d10 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.878+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2644396244 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f670c036040 con 0x55aba5329d10 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.879+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2644396244 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f6708019020 con 0x55aba5329d10 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.879+0000 7f671c722740 10 client.25615 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.879+0000 7f671c722740 10 client.25615 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.879+0000 7f671c722740 20 client.25615 populate_metadata read hostname 'smithi069' 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.879+0000 7f671c722740 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55aba5344860 0x55aba5346c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.879+0000 7f671c722740 4 client.25615 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.879+0000 7f671c722740 1 -- 172.21.15.69:0/2644396244 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aba529cb50 con 0x55aba5344860 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.879+0000 7f6713fff640 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55aba5344860 0x55aba5346c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.879+0000 7f6713fff640 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55aba5344860 0x55aba5346c50 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a66d1509ee047a server_cookie=1a544cd0bfb0d99 in_seq=0 out_seq=0 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.879+0000 7f66f2ffd640 10 client.25615 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2644396244 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aba529cb50 con 0x55aba5344860 2024-04-23T10:31:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f66f2ffd640 10 client.25615 handle_command_reply: tid=0 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 1 client.25615 shutdown 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 1 -- 172.21.15.69:0/2644396244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5329d10 msgr2=0x55aba5331790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5329d10 0x55aba5331790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55aba532a0f0 tx=0x7f6708012820 comp rx=0 tx=0).stop 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 1 -- 172.21.15.69:0/2644396244 shutdown_connections 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55aba5344860 0x55aba5346c50 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5334380 0x55aba5331cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f66f2ffd640 0 client.25615 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5329d10 0x55aba5331790 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 1 --2- 172.21.15.69:0/2644396244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329360 0x55aba5331250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 1 -- 172.21.15.69:0/2644396244 >> 172.21.15.69:0/2644396244 conn(0x55aba5325620 msgr2=0x55aba532b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 1 -- 172.21.15.69:0/2644396244 shutdown_connections 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 1 -- 172.21.15.69:0/2644396244 wait complete. 2024-04-23T10:31:08.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.880+0000 7f671c722740 20 client.25615 trim_cache size 0 max 16384 2024-04-23T10:31:08.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.897+0000 7f671c722740 1 Processor -- start 2024-04-23T10:31:08.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.897+0000 7f671c722740 1 -- start start 2024-04-23T10:31:08.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.897+0000 7f671c722740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5340180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.897+0000 7f671c722740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329d10 0x55aba53247c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.897+0000 7f671c722740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 0x55aba534c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.897+0000 7f671c722740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f67141add40 con 0x55aba5329360 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.897+0000 7f671c722740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f67141afac0 con 0x55aba5329d10 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.897+0000 7f671c722740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f67141ae4d0 con 0x55aba5334380 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.897+0000 7f6713fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5340180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f6713fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5340180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46374/0 (socket says 172.21.15.69:46374) 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f6713fff640 1 -- 172.21.15.69:0/1016752107 learned_addr learned my addr 172.21.15.69:0/1016752107 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f6712ffd640 1 --2- 172.21.15.69:0/1016752107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329d10 0x55aba53247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f6713fff640 1 -- 172.21.15.69:0/1016752107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 msgr2=0x55aba534c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f6713fff640 1 --2- 172.21.15.69:0/1016752107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 0x55aba534c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f6713fff640 1 -- 172.21.15.69:0/1016752107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329d10 msgr2=0x55aba53247c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f6713fff640 1 --2- 172.21.15.69:0/1016752107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329d10 0x55aba53247c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f6713fff640 1 -- 172.21.15.69:0/1016752107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba5329ab0 con 0x55aba5329360 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f6712ffd640 1 --2- 172.21.15.69:0/1016752107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329d10 0x55aba53247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:31:08.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f6713fff640 1 --2- 172.21.15.69:0/1016752107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5340180 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f670c009dc0 tx=0x7f670c02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd565aa12b76c1b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f66f97fa640 1 -- 172.21.15.69:0/1016752107 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c045040 con 0x55aba5329360 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f66f97fa640 1 -- 172.21.15.69:0/1016752107 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f670c04e030 con 0x55aba5329360 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.898+0000 7f66f97fa640 1 -- 172.21.15.69:0/1016752107 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c004760 con 0x55aba5329360 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 -- 172.21.15.69:0/1016752107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 msgr2=0x55aba5340180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 --2- 172.21.15.69:0/1016752107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5340180 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f670c009dc0 tx=0x7f670c02a8e0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 -- 172.21.15.69:0/1016752107 shutdown_connections 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 --2- 172.21.15.69:0/1016752107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 0x55aba534c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 --2- 172.21.15.69:0/1016752107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329d10 0x55aba53247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 --2- 172.21.15.69:0/1016752107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329360 0x55aba5340180 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 -- 172.21.15.69:0/1016752107 >> 172.21.15.69:0/1016752107 conn(0x55aba5325620 msgr2=0x55aba53240b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 -- 172.21.15.69:0/1016752107 shutdown_connections 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 -- 172.21.15.69:0/1016752107 wait complete. 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 -- start start 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 Processor -- start 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329360 0x55aba5338890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329d10 0x55aba5338dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 0x55aba53a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f67141af3f0 con 0x55aba5329d10 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f67141aec60 con 0x55aba5329360 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f67141abc60 con 0x55aba5334380 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f6712ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329d10 0x55aba5338dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.899+0000 7f671c722740 10 client.0 _ll_register_callbacks cb 0x7f670800b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f6712ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329d10 0x55aba5338dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46376/0 (socket says 172.21.15.69:46376) 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f6712ffd640 1 -- 172.21.15.69:0/2390099156 learned_addr learned my addr 172.21.15.69:0/2390099156 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f6713fff640 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 0x55aba53a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f6713fff640 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329360 0x55aba5338890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f6712ffd640 1 -- 172.21.15.69:0/2390099156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 msgr2=0x55aba53a9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f6712ffd640 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 0x55aba53a9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f6712ffd640 1 -- 172.21.15.69:0/2390099156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329360 msgr2=0x55aba5338890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:31:08.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f6712ffd640 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329360 0x55aba5338890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f6712ffd640 1 -- 172.21.15.69:0/2390099156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba4f61310 con 0x55aba5329d10 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f6712ffd640 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329d10 0x55aba5338dd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6708024be0 tx=0x7f670800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cce821ec0483ba2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f66f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2390099156 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670802a040 con 0x55aba5329d10 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2390099156 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8469+0+0 (secure 0 0 0) 0x7f6708004240 con 0x55aba5329d10 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f671c722740 1 -- 172.21.15.69:0/2390099156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f670c04e030 con 0x55aba5329d10 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2390099156 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f670801b440 con 0x55aba5329d10 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f671c722740 10 client.16209 fetch_fsmap learned FSMap version 40 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f671c722740 1 -- 172.21.15.69:0/2390099156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55aba53ab430 con 0x55aba5329d10 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.900+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2390099156 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f670c04e030 con 0x55aba5329d10 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2390099156 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f6708019050 con 0x55aba5329d10 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f671c722740 10 client.16209 fetch_fsmap finished waiting for FSMap version 40 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f671c722740 10 client.16209 resolve_mds: validated gid 24487 aka daemon mds.i 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f671c722740 20 client.16209 populate_metadata read hostname 'smithi069' 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f671c722740 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55aba53abca0 0x55aba53ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:31:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f671c722740 4 client.16209 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f671c722740 1 -- 172.21.15.69:0/2390099156 --> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55aba52969c0 con 0x55aba53abca0 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f6713fff640 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55aba53abca0 0x55aba53ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f66f2ffd640 10 client.16209 ms_handle_connect on v2:172.21.15.167:6838/1688975356 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f6713fff640 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55aba53abca0 0x55aba53ae0c0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1335d12c979891b8 server_cookie=af763447b4ee7456 in_seq=0 out_seq=0 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f66f2ffd640 1 -- 172.21.15.69:0/2390099156 <== mds.0 v2:172.21.15.167:6838/1688975356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55aba52969c0 con 0x55aba53abca0 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f66f2ffd640 10 client.16209 handle_command_reply: tid=0 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.901+0000 7f671c722740 1 client.16209 shutdown 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f671c722740 1 -- 172.21.15.69:0/2390099156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329d10 msgr2=0x55aba5338dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f671c722740 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329d10 0x55aba5338dd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6708024be0 tx=0x7f670800b910 comp rx=0 tx=0).stop 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f671c722740 1 -- 172.21.15.69:0/2390099156 shutdown_connections 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f671c722740 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.167:6838/1688975356,v1:172.21.15.167:6839/1688975356] conn(0x55aba53abca0 0x55aba53ae0c0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f671c722740 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aba5329d10 0x55aba5338dd0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f671c722740 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aba5334380 0x55aba53a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f66f2ffd640 0 client.16209 ms_handle_reset on v2:172.21.15.167:6838/1688975356 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f671c722740 1 --2- 172.21.15.69:0/2390099156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55aba5329360 0x55aba5338890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f671c722740 1 -- 172.21.15.69:0/2390099156 >> 172.21.15.69:0/2390099156 conn(0x55aba5325620 msgr2=0x55aba5324940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:08.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f671c722740 1 -- 172.21.15.69:0/2390099156 shutdown_connections 2024-04-23T10:31:08.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f671c722740 1 -- 172.21.15.69:0/2390099156 wait complete. 2024-04-23T10:31:08.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f671c722740 20 client.16209 trim_cache size 0 max 16384 2024-04-23T10:31:08.908 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:31:08.908 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 40, 2024-04-23T10:31:08.908 INFO:teuthology.orchestra.run.smithi069.stdout: "leader": 24487, 2024-04-23T10:31:08.908 INFO:teuthology.orchestra.run.smithi069.stdout: "set_version": 16, 2024-04-23T10:31:08.908 INFO:teuthology.orchestra.run.smithi069.stdout: "sets": {} 2024-04-23T10:31:08.908 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:31:08.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 -- 172.21.15.69:0/530047819 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f66fc0a3d20 msgr2=0x7f66fc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f66fc0a3d20 0x7f66fc0a61e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f67040ce140 tx=0x7f670406ddd0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 -- 172.21.15.69:0/530047819 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67141011a0 msgr2=0x7f671419e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:31:08.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67141011a0 0x7f671419e5e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f670400d950 tx=0x7f670400de10 comp rx=0 tx=0).stop 2024-04-23T10:31:08.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 -- 172.21.15.69:0/530047819 shutdown_connections 2024-04-23T10:31:08.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f66fc0a3d20 0x7f66fc0a61e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6714107030 0x7f67141986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6714101b40 0x7f671419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 --2- 172.21.15.69:0/530047819 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67141011a0 0x7f671419e5e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:31:08.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 -- 172.21.15.69:0/530047819 >> 172.21.15.69:0/530047819 conn(0x7f6714076c50 msgr2=0x7f67140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:31:08.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 -- 172.21.15.69:0/530047819 shutdown_connections 2024-04-23T10:31:08.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:31:08.902+0000 7f6719d68640 1 -- 172.21.15.69:0/530047819 wait complete. 2024-04-23T10:31:08.913 INFO:tasks.quiescer:done joining Quiescers 2024-04-23T10:31:08.913 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-04-23T10:31:08.923 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi069.front.sepia.ceph.com 2024-04-23T10:31:08.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:08 smithi146 ceph-mon[32800]: pgmap v131: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 256 KiB/s wr, 54 op/s 2024-04-23T10:31:08.931 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-04-23T10:31:08.940 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-04-23T10:31:08.940 INFO:teuthology.task.exec:Executing custom commands... 2024-04-23T10:31:08.941 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-04-23T10:31:08.941 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-04-23T10:31:08.996 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-04-23T10:31:09.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:08 smithi167 ceph-mon[32940]: pgmap v131: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 256 KiB/s wr, 54 op/s 2024-04-23T10:31:09.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:09 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1630405059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:31:09.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:09 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1630405059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:31:10.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:09 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1630405059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:31:10.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:10 smithi146 ceph-mon[32800]: pgmap v132: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 791 KiB/s wr, 181 op/s 2024-04-23T10:31:10.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:10 smithi069 ceph-mon[29593]: pgmap v132: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 791 KiB/s wr, 181 op/s 2024-04-23T10:31:11.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:10 smithi167 ceph-mon[32940]: pgmap v132: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 791 KiB/s wr, 181 op/s 2024-04-23T10:31:12.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:12 smithi146 ceph-mon[32800]: pgmap v133: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 789 KiB/s wr, 177 op/s 2024-04-23T10:31:12.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:12 smithi069 ceph-mon[29593]: pgmap v133: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 789 KiB/s wr, 177 op/s 2024-04-23T10:31:13.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:12 smithi167 ceph-mon[32940]: pgmap v133: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 789 KiB/s wr, 177 op/s 2024-04-23T10:31:14.885 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:14 smithi167 ceph-mon[32940]: pgmap v134: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 789 KiB/s wr, 177 op/s 2024-04-23T10:31:14.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:14 smithi146 ceph-mon[32800]: pgmap v134: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 789 KiB/s wr, 177 op/s 2024-04-23T10:31:14.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:14 smithi069 ceph-mon[29593]: pgmap v134: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 789 KiB/s wr, 177 op/s 2024-04-23T10:31:16.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:16 smithi146 ceph-mon[32800]: pgmap v135: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 797 KiB/s wr, 185 op/s 2024-04-23T10:31:16.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:16 smithi069 ceph-mon[29593]: pgmap v135: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 797 KiB/s wr, 185 op/s 2024-04-23T10:31:17.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:16 smithi167 ceph-mon[32940]: pgmap v135: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 797 KiB/s wr, 185 op/s 2024-04-23T10:31:18.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:18 smithi146 ceph-mon[32800]: pgmap v136: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 543 KiB/s wr, 135 op/s 2024-04-23T10:31:18.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:18 smithi069 ceph-mon[29593]: pgmap v136: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 543 KiB/s wr, 135 op/s 2024-04-23T10:31:19.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:18 smithi167 ceph-mon[32940]: pgmap v136: 97 pgs: 97 active+clean; 214 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 543 KiB/s wr, 135 op/s 2024-04-23T10:31:20.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:20 smithi146 ceph-mon[32800]: pgmap v137: 97 pgs: 97 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 545 KiB/s wr, 141 op/s 2024-04-23T10:31:20.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:20 smithi069 ceph-mon[29593]: pgmap v137: 97 pgs: 97 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 545 KiB/s wr, 141 op/s 2024-04-23T10:31:21.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:20 smithi167 ceph-mon[32940]: pgmap v137: 97 pgs: 97 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 545 KiB/s wr, 141 op/s 2024-04-23T10:31:22.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:22 smithi146 ceph-mon[32800]: pgmap v138: 97 pgs: 97 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-04-23T10:31:22.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:22 smithi069 ceph-mon[29593]: pgmap v138: 97 pgs: 97 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-04-23T10:31:23.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:22 smithi167 ceph-mon[32940]: pgmap v138: 97 pgs: 97 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-04-23T10:31:24.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:24 smithi146 ceph-mon[32800]: pgmap v139: 97 pgs: 97 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-04-23T10:31:24.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:24 smithi069 ceph-mon[29593]: pgmap v139: 97 pgs: 97 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-04-23T10:31:25.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:24 smithi167 ceph-mon[32940]: pgmap v139: 97 pgs: 97 active+clean; 215 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-04-23T10:31:26.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:26 smithi146 ceph-mon[32800]: pgmap v140: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 KiB/s wr, 19 op/s 2024-04-23T10:31:26.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:26 smithi069 ceph-mon[29593]: pgmap v140: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 KiB/s wr, 19 op/s 2024-04-23T10:31:27.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:26 smithi167 ceph-mon[32940]: pgmap v140: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 KiB/s wr, 19 op/s 2024-04-23T10:31:28.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:28 smithi146 ceph-mon[32800]: pgmap v141: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-04-23T10:31:28.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:28 smithi069 ceph-mon[29593]: pgmap v141: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-04-23T10:31:29.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:28 smithi167 ceph-mon[32940]: pgmap v141: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-04-23T10:31:30.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:30 smithi146 ceph-mon[32800]: pgmap v142: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.7 KiB/s wr, 16 op/s 2024-04-23T10:31:30.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:30 smithi069 ceph-mon[29593]: pgmap v142: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.7 KiB/s wr, 16 op/s 2024-04-23T10:31:31.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:30 smithi167 ceph-mon[32940]: pgmap v142: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.7 KiB/s wr, 16 op/s 2024-04-23T10:31:32.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:32 smithi146 ceph-mon[32800]: pgmap v143: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-04-23T10:31:32.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:32 smithi069 ceph-mon[29593]: pgmap v143: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-04-23T10:31:33.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:32 smithi167 ceph-mon[32940]: pgmap v143: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-04-23T10:31:34.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:34 smithi146 ceph-mon[32800]: pgmap v144: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-04-23T10:31:34.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:34 smithi069 ceph-mon[29593]: pgmap v144: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-04-23T10:31:35.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:34 smithi167 ceph-mon[32940]: pgmap v144: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-04-23T10:31:36.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:36 smithi146 ceph-mon[32800]: pgmap v145: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-04-23T10:31:36.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:36 smithi069 ceph-mon[29593]: pgmap v145: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-04-23T10:31:37.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:36 smithi167 ceph-mon[32940]: pgmap v145: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-04-23T10:31:38.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:38 smithi146 ceph-mon[32800]: pgmap v146: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-23T10:31:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:38 smithi069 ceph-mon[29593]: pgmap v146: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-23T10:31:39.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:38 smithi167 ceph-mon[32940]: pgmap v146: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-04-23T10:31:40.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:40 smithi146 ceph-mon[32800]: pgmap v147: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 426 B/s wr, 14 op/s 2024-04-23T10:31:40.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:40 smithi069 ceph-mon[29593]: pgmap v147: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 426 B/s wr, 14 op/s 2024-04-23T10:31:41.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:40 smithi167 ceph-mon[32940]: pgmap v147: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 426 B/s wr, 14 op/s 2024-04-23T10:31:42.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:42 smithi146 ceph-mon[32800]: pgmap v148: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:42.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:42 smithi069 ceph-mon[29593]: pgmap v148: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:43.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:42 smithi167 ceph-mon[32940]: pgmap v148: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:44.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:44 smithi146 ceph-mon[32800]: pgmap v149: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:44.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:44 smithi069 ceph-mon[29593]: pgmap v149: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:45.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:44 smithi167 ceph-mon[32940]: pgmap v149: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:46.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:46 smithi146 ceph-mon[32800]: pgmap v150: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 13 op/s 2024-04-23T10:31:46.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:46 smithi069 ceph-mon[29593]: pgmap v150: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 13 op/s 2024-04-23T10:31:47.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:46 smithi167 ceph-mon[32940]: pgmap v150: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 13 op/s 2024-04-23T10:31:48.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:48 smithi146 ceph-mon[32800]: pgmap v151: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:48.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:48 smithi069 ceph-mon[29593]: pgmap v151: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:49.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:48 smithi167 ceph-mon[32940]: pgmap v151: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:50.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:50 smithi146 ceph-mon[32800]: pgmap v152: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:31:50.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:50 smithi069 ceph-mon[29593]: pgmap v152: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:31:51.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:50 smithi167 ceph-mon[32940]: pgmap v152: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:31:52.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:52 smithi146 ceph-mon[32800]: pgmap v153: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:52.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:52 smithi069 ceph-mon[29593]: pgmap v153: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:53.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:52 smithi167 ceph-mon[32940]: pgmap v153: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:54.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:54 smithi069 ceph-mon[29593]: pgmap v154: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:54.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:54 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:31:55.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:54 smithi167 ceph-mon[32940]: pgmap v154: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:55.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:54 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:31:55.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:54 smithi146 ceph-mon[32800]: pgmap v154: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:31:55.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:54 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:31:56.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:56 smithi069 ceph-mon[29593]: pgmap v155: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:31:57.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:56 smithi167 ceph-mon[32940]: pgmap v155: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:31:57.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:56 smithi146 ceph-mon[32800]: pgmap v155: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:31:58.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:31:58 smithi069 ceph-mon[29593]: pgmap v156: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:31:59.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:31:58 smithi167 ceph-mon[32940]: pgmap v156: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:31:59.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:31:58 smithi146 ceph-mon[32800]: pgmap v156: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:32:00.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:00 smithi069 ceph-mon[29593]: pgmap v157: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:01.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:00 smithi167 ceph-mon[32940]: pgmap v157: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:01.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:00 smithi146 ceph-mon[32800]: pgmap v157: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:02.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:02 smithi069 ceph-mon[29593]: pgmap v158: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:32:03.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:02 smithi167 ceph-mon[32940]: pgmap v158: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:32:03.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:02 smithi146 ceph-mon[32800]: pgmap v158: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:32:03.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:03 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:32:03.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:03 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:32:03.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:03 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:32:03.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:03 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:32:04.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:03 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:32:04.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:03 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:32:04.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:03 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:32:04.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:03 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:32:04.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:03 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:32:04.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:03 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:32:04.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:03 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:32:04.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:03 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:32:04.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:04 smithi069 ceph-mon[29593]: pgmap v159: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:32:05.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:04 smithi167 ceph-mon[32940]: pgmap v159: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:32:05.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:04 smithi146 ceph-mon[32800]: pgmap v159: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:32:06.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:06 smithi069 ceph-mon[29593]: pgmap v160: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-23T10:32:07.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:06 smithi167 ceph-mon[32940]: pgmap v160: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-23T10:32:07.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:06 smithi146 ceph-mon[32800]: pgmap v160: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-23T10:32:08.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:08 smithi069 ceph-mon[29593]: pgmap v161: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-23T10:32:09.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:08 smithi167 ceph-mon[32940]: pgmap v161: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-23T10:32:09.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:08 smithi146 ceph-mon[32800]: pgmap v161: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-23T10:32:10.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:10 smithi069 ceph-mon[29593]: pgmap v162: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-23T10:32:11.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:10 smithi167 ceph-mon[32940]: pgmap v162: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-23T10:32:11.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:10 smithi146 ceph-mon[32800]: pgmap v162: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-23T10:32:12.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:12 smithi069 ceph-mon[29593]: pgmap v163: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T10:32:13.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:12 smithi167 ceph-mon[32940]: pgmap v163: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T10:32:13.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:12 smithi146 ceph-mon[32800]: pgmap v163: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T10:32:14.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:14 smithi069 ceph-mon[29593]: pgmap v164: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T10:32:15.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:14 smithi167 ceph-mon[32940]: pgmap v164: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T10:32:15.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:14 smithi146 ceph-mon[32800]: pgmap v164: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-23T10:32:16.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:16 smithi069 ceph-mon[29593]: pgmap v165: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-23T10:32:17.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:16 smithi167 ceph-mon[32940]: pgmap v165: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-23T10:32:17.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:16 smithi146 ceph-mon[32800]: pgmap v165: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-23T10:32:18.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:18 smithi069 ceph-mon[29593]: pgmap v166: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T10:32:19.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:18 smithi167 ceph-mon[32940]: pgmap v166: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T10:32:19.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:18 smithi146 ceph-mon[32800]: pgmap v166: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-23T10:32:20.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:20 smithi069 ceph-mon[29593]: pgmap v167: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-23T10:32:21.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:20 smithi167 ceph-mon[32940]: pgmap v167: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-23T10:32:21.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:20 smithi146 ceph-mon[32800]: pgmap v167: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-23T10:32:22.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:22 smithi069 ceph-mon[29593]: pgmap v168: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-23T10:32:23.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:22 smithi167 ceph-mon[32940]: pgmap v168: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-23T10:32:23.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:22 smithi146 ceph-mon[32800]: pgmap v168: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-23T10:32:25.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:24 smithi167 ceph-mon[32940]: pgmap v169: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-23T10:32:25.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:24 smithi146 ceph-mon[32800]: pgmap v169: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-23T10:32:25.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:24 smithi069 ceph-mon[29593]: pgmap v169: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-23T10:32:27.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:26 smithi167 ceph-mon[32940]: pgmap v170: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:32:27.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:26 smithi146 ceph-mon[32800]: pgmap v170: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:32:27.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:26 smithi069 ceph-mon[29593]: pgmap v170: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:32:29.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:28 smithi167 ceph-mon[32940]: pgmap v171: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:29.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:28 smithi146 ceph-mon[32800]: pgmap v171: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:29.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:28 smithi069 ceph-mon[29593]: pgmap v171: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:31.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:30 smithi167 ceph-mon[32940]: pgmap v172: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:31.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:30 smithi146 ceph-mon[32800]: pgmap v172: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:31.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:30 smithi069 ceph-mon[29593]: pgmap v172: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:33.044 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:32 smithi069 ceph-mon[29593]: pgmap v173: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:33.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:32 smithi167 ceph-mon[32940]: pgmap v173: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:33.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:32 smithi146 ceph-mon[32800]: pgmap v173: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:35.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:34 smithi167 ceph-mon[32940]: pgmap v174: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:35.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:34 smithi146 ceph-mon[32800]: pgmap v174: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:35.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:34 smithi069 ceph-mon[29593]: pgmap v174: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:37.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:36 smithi167 ceph-mon[32940]: pgmap v175: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:37.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:36 smithi146 ceph-mon[32800]: pgmap v175: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:37.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:36 smithi069 ceph-mon[29593]: pgmap v175: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:39.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:38 smithi167 ceph-mon[32940]: pgmap v176: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:39.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:38 smithi146 ceph-mon[32800]: pgmap v176: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:39.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:38 smithi069 ceph-mon[29593]: pgmap v176: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:41.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:40 smithi167 ceph-mon[32940]: pgmap v177: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:41.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:40 smithi146 ceph-mon[32800]: pgmap v177: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:41.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:40 smithi069 ceph-mon[29593]: pgmap v177: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:43.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:42 smithi167 ceph-mon[32940]: pgmap v178: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:43.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:42 smithi146 ceph-mon[32800]: pgmap v178: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:43.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:42 smithi069 ceph-mon[29593]: pgmap v178: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:45.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:44 smithi167 ceph-mon[32940]: pgmap v179: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:45.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:44 smithi146 ceph-mon[32800]: pgmap v179: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:45.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:44 smithi069 ceph-mon[29593]: pgmap v179: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:47.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:46 smithi167 ceph-mon[32940]: pgmap v180: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:47.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:46 smithi146 ceph-mon[32800]: pgmap v180: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:47.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:46 smithi069 ceph-mon[29593]: pgmap v180: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:49.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:48 smithi167 ceph-mon[32940]: pgmap v181: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:49.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:48 smithi146 ceph-mon[32800]: pgmap v181: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:49.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:48 smithi069 ceph-mon[29593]: pgmap v181: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:51.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:50 smithi167 ceph-mon[32940]: pgmap v182: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:51.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:50 smithi146 ceph-mon[32800]: pgmap v182: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:51.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:50 smithi069 ceph-mon[29593]: pgmap v182: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:53.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:52 smithi167 ceph-mon[32940]: pgmap v183: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:53.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:52 smithi146 ceph-mon[32800]: pgmap v183: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:53.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:52 smithi069 ceph-mon[29593]: pgmap v183: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:55.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:54 smithi167 ceph-mon[32940]: pgmap v184: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:55.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:54 smithi146 ceph-mon[32800]: pgmap v184: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:55.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:54 smithi069 ceph-mon[29593]: pgmap v184: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:57.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:56 smithi167 ceph-mon[32940]: pgmap v185: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:57.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:56 smithi146 ceph-mon[32800]: pgmap v185: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:56 smithi069 ceph-mon[29593]: pgmap v185: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:32:59.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:32:58 smithi167 ceph-mon[32940]: pgmap v186: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:59.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:32:58 smithi146 ceph-mon[32800]: pgmap v186: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:32:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:32:58 smithi069 ceph-mon[29593]: pgmap v186: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:01.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:00 smithi167 ceph-mon[32940]: pgmap v187: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:01.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:00 smithi146 ceph-mon[32800]: pgmap v187: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:01.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:00 smithi069 ceph-mon[29593]: pgmap v187: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:03.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:02 smithi167 ceph-mon[32940]: pgmap v188: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:03.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:02 smithi146 ceph-mon[32800]: pgmap v188: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:03.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:02 smithi069 ceph-mon[29593]: pgmap v188: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:03 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:33:04.142 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:03 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:33:04.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:03 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:33:05.082 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:04 smithi167 ceph-mon[32940]: pgmap v189: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:04 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:33:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:04 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:33:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:04 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:33:05.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:04 smithi146 ceph-mon[32800]: pgmap v189: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:05.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:04 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:33:05.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:04 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:33:05.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:04 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:33:05.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:04 smithi069 ceph-mon[29593]: pgmap v189: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:05.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:04 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:33:05.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:04 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:33:05.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:04 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:33:06.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:05 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:06.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:05 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:06.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:05 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:07.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:06 smithi146 ceph-mon[32800]: pgmap v190: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-23T10:33:07.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:06 smithi069 ceph-mon[29593]: pgmap v190: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-23T10:33:07.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:06 smithi167 ceph-mon[32940]: pgmap v190: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-23T10:33:09.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:08 smithi146 ceph-mon[32800]: pgmap v191: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-23T10:33:09.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:08 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:09.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:08 smithi069 ceph-mon[29593]: pgmap v191: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-23T10:33:09.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:08 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:09.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:08 smithi167 ceph-mon[32940]: pgmap v191: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-23T10:33:09.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:08 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:11.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:10 smithi146 ceph-mon[32800]: pgmap v192: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-04-23T10:33:11.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:10 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:11.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:10 smithi146 ceph-mon[32800]: osdmap e91: 12 total, 12 up, 12 in 2024-04-23T10:33:11.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:10 smithi069 ceph-mon[29593]: pgmap v192: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-04-23T10:33:11.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:10 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:11.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:10 smithi069 ceph-mon[29593]: osdmap e91: 12 total, 12 up, 12 in 2024-04-23T10:33:11.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:10 smithi167 ceph-mon[32940]: pgmap v192: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-04-23T10:33:11.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:10 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:11.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:10 smithi167 ceph-mon[32940]: osdmap e91: 12 total, 12 up, 12 in 2024-04-23T10:33:13.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:12 smithi146 ceph-mon[32800]: pgmap v194: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:33:13.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:12 smithi069 ceph-mon[29593]: pgmap v194: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:33:13.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:12 smithi167 ceph-mon[32940]: pgmap v194: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:33:15.136 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:14 smithi167 ceph-mon[32940]: pgmap v195: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:33:15.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:14 smithi146 ceph-mon[32800]: pgmap v195: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:33:15.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:14 smithi069 ceph-mon[29593]: pgmap v195: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:33:16.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:15 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:16.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:15 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:16.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:15 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:17.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:16 smithi146 ceph-mon[32800]: pgmap v196: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:33:17.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:16 smithi146 ceph-mon[32800]: osdmap e92: 12 total, 12 up, 12 in 2024-04-23T10:33:17.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:16 smithi069 ceph-mon[29593]: pgmap v196: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:33:17.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:16 smithi069 ceph-mon[29593]: osdmap e92: 12 total, 12 up, 12 in 2024-04-23T10:33:17.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:16 smithi167 ceph-mon[32940]: pgmap v196: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:33:17.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:16 smithi167 ceph-mon[32940]: osdmap e92: 12 total, 12 up, 12 in 2024-04-23T10:33:19.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:18 smithi146 ceph-mon[32800]: pgmap v198: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:33:19.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:18 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:19.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:18 smithi069 ceph-mon[29593]: pgmap v198: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:33:19.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:18 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:19.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:18 smithi167 ceph-mon[32940]: pgmap v198: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:33:19.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:18 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:20.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:19 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:20.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:19 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:20.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:19 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:21.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:20 smithi146 ceph-mon[32800]: pgmap v199: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 11 op/s 2024-04-23T10:33:21.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:20 smithi069 ceph-mon[29593]: pgmap v199: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 11 op/s 2024-04-23T10:33:21.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:20 smithi167 ceph-mon[32940]: pgmap v199: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 11 op/s 2024-04-23T10:33:23.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:22 smithi146 ceph-mon[32800]: pgmap v200: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:33:23.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:22 smithi069 ceph-mon[29593]: pgmap v200: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:33:23.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:22 smithi167 ceph-mon[32940]: pgmap v200: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:33:24.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:23 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:24.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:23 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:24.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:23 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:25.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:24 smithi146 ceph-mon[32800]: pgmap v201: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:33:25.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:24 smithi069 ceph-mon[29593]: pgmap v201: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:33:25.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:24 smithi167 ceph-mon[32940]: pgmap v201: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:33:27.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:26 smithi146 ceph-mon[32800]: pgmap v202: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:33:27.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:26 smithi069 ceph-mon[29593]: pgmap v202: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:33:27.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:26 smithi167 ceph-mon[32940]: pgmap v202: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:33:29.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:28 smithi146 ceph-mon[32800]: pgmap v203: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:33:29.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:28 smithi069 ceph-mon[29593]: pgmap v203: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:33:29.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:28 smithi167 ceph-mon[32940]: pgmap v203: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:33:31.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:30 smithi146 ceph-mon[32800]: pgmap v204: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:33:31.177 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:30 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:31.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:30 smithi069 ceph-mon[29593]: pgmap v204: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:33:31.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:30 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:31.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:30 smithi167 ceph-mon[32940]: pgmap v204: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:33:31.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:30 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:33.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:32 smithi069 ceph-mon[29593]: pgmap v205: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:33.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:32 smithi167 ceph-mon[32940]: pgmap v205: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:33.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:32 smithi146 ceph-mon[32800]: pgmap v205: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:35.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:34 smithi069 ceph-mon[29593]: pgmap v206: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:35.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:34 smithi167 ceph-mon[32940]: pgmap v206: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:35.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:34 smithi146 ceph-mon[32800]: pgmap v206: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:37.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:36 smithi069 ceph-mon[29593]: pgmap v207: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:37.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:36 smithi167 ceph-mon[32940]: pgmap v207: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:37.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:36 smithi146 ceph-mon[32800]: pgmap v207: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:38.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:37 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:38.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:37 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:38.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:37 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:39.241 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:38 smithi069 ceph-mon[29593]: pgmap v208: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:39.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:38 smithi167 ceph-mon[32940]: pgmap v208: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:39.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:38 smithi146 ceph-mon[32800]: pgmap v208: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:41.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:40 smithi069 ceph-mon[29593]: pgmap v209: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:41.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:40 smithi167 ceph-mon[32940]: pgmap v209: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:41.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:40 smithi146 ceph-mon[32800]: pgmap v209: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:43.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:42 smithi069 ceph-mon[29593]: pgmap v210: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:43.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:42 smithi167 ceph-mon[32940]: pgmap v210: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:43.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:42 smithi146 ceph-mon[32800]: pgmap v210: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:45.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:44 smithi069 ceph-mon[29593]: pgmap v211: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:45.243 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:44 smithi069 ceph-mon[29593]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:45.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:44 smithi167 ceph-mon[32940]: pgmap v211: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:45.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:44 smithi167 ceph-mon[32940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:45.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:44 smithi146 ceph-mon[32800]: pgmap v211: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:45.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:44 smithi146 ceph-mon[32800]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-23T10:33:47.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:46 smithi069 ceph-mon[29593]: pgmap v212: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:47.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:46 smithi167 ceph-mon[32940]: pgmap v212: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:47.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:46 smithi146 ceph-mon[32800]: pgmap v212: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:49.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:48 smithi069 ceph-mon[29593]: pgmap v213: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:49.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:48 smithi167 ceph-mon[32940]: pgmap v213: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:49.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:48 smithi146 ceph-mon[32800]: pgmap v213: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:51.230 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:50 smithi146 ceph-mon[32800]: pgmap v214: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:51.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:50 smithi069 ceph-mon[29593]: pgmap v214: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:51.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:50 smithi167 ceph-mon[32940]: pgmap v214: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:53.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:52 smithi069 ceph-mon[29593]: pgmap v215: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:53.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:52 smithi167 ceph-mon[32940]: pgmap v215: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:53.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:52 smithi146 ceph-mon[32800]: pgmap v215: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:55.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:54 smithi069 ceph-mon[29593]: pgmap v216: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:55.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:54 smithi167 ceph-mon[32940]: pgmap v216: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:55.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:54 smithi146 ceph-mon[32800]: pgmap v216: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:57.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:56 smithi069 ceph-mon[29593]: pgmap v217: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:57.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:56 smithi167 ceph-mon[32940]: pgmap v217: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:57.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:56 smithi146 ceph-mon[32800]: pgmap v217: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:33:59.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:33:58 smithi069 ceph-mon[29593]: pgmap v218: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:33:58 smithi167 ceph-mon[32940]: pgmap v218: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:33:59.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:33:58 smithi146 ceph-mon[32800]: pgmap v218: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:01.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:00 smithi069 ceph-mon[29593]: pgmap v219: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:01.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:00 smithi167 ceph-mon[32940]: pgmap v219: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:01.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:00 smithi146 ceph-mon[32800]: pgmap v219: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:03.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:02 smithi069 ceph-mon[29593]: pgmap v220: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:03.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:02 smithi167 ceph-mon[32940]: pgmap v220: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:03.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:02 smithi146 ceph-mon[32800]: pgmap v220: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:05.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:04 smithi069 ceph-mon[29593]: pgmap v221: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:05.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:04 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:34:05.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:04 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:34:05.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:04 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:34:05.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:04 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:34:05.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:04 smithi167 ceph-mon[32940]: pgmap v221: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:05.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:04 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:34:05.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:04 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:34:05.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:04 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:34:05.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:04 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:34:05.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:04 smithi146 ceph-mon[32800]: pgmap v221: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:05.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:04 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:34:05.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:04 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:34:05.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:04 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:34:05.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:04 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:34:07.242 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:06 smithi069 ceph-mon[29593]: pgmap v222: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-23T10:34:07.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:06 smithi167 ceph-mon[32940]: pgmap v222: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-23T10:34:07.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:06 smithi146 ceph-mon[32800]: pgmap v222: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-23T10:34:09.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:08 smithi167 ceph-mon[32940]: pgmap v223: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-23T10:34:09.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:08 smithi146 ceph-mon[32800]: pgmap v223: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-23T10:34:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:08 smithi069 ceph-mon[29593]: pgmap v223: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-04-23T10:34:11.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:11 smithi167 ceph-mon[32940]: pgmap v224: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-04-23T10:34:11.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:11 smithi167 ceph-mon[32940]: osdmap e93: 12 total, 12 up, 12 in 2024-04-23T10:34:11.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:11 smithi146 ceph-mon[32800]: pgmap v224: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-04-23T10:34:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:11 smithi146 ceph-mon[32800]: osdmap e93: 12 total, 12 up, 12 in 2024-04-23T10:34:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:11 smithi069 ceph-mon[29593]: pgmap v224: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-04-23T10:34:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:11 smithi069 ceph-mon[29593]: osdmap e93: 12 total, 12 up, 12 in 2024-04-23T10:34:13.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:13 smithi167 ceph-mon[32940]: pgmap v226: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:34:13.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:13 smithi146 ceph-mon[32800]: pgmap v226: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:34:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:13 smithi069 ceph-mon[29593]: pgmap v226: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:34:15.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:15 smithi167 ceph-mon[32940]: pgmap v227: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:34:15.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:15 smithi146 ceph-mon[32800]: pgmap v227: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:34:15.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:15 smithi069 ceph-mon[29593]: pgmap v227: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 31 op/s 2024-04-23T10:34:17.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:17 smithi167 ceph-mon[32940]: pgmap v228: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:34:17.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:17 smithi167 ceph-mon[32940]: osdmap e94: 12 total, 12 up, 12 in 2024-04-23T10:34:17.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:17 smithi146 ceph-mon[32800]: pgmap v228: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:34:17.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:17 smithi146 ceph-mon[32800]: osdmap e94: 12 total, 12 up, 12 in 2024-04-23T10:34:17.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:17 smithi069 ceph-mon[29593]: pgmap v228: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:34:17.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:17 smithi069 ceph-mon[29593]: osdmap e94: 12 total, 12 up, 12 in 2024-04-23T10:34:19.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:19 smithi167 ceph-mon[32940]: pgmap v230: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:34:19.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:19 smithi146 ceph-mon[32800]: pgmap v230: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:34:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:19 smithi069 ceph-mon[29593]: pgmap v230: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:34:21.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:21 smithi167 ceph-mon[32940]: pgmap v231: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 12 op/s 2024-04-23T10:34:21.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:21 smithi146 ceph-mon[32800]: pgmap v231: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 12 op/s 2024-04-23T10:34:21.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:21 smithi069 ceph-mon[29593]: pgmap v231: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 12 op/s 2024-04-23T10:34:23.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:23 smithi167 ceph-mon[32940]: pgmap v232: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:34:23.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:23 smithi146 ceph-mon[32800]: pgmap v232: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:34:23.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:23 smithi069 ceph-mon[29593]: pgmap v232: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:34:25.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:25 smithi167 ceph-mon[32940]: pgmap v233: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:34:25.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:25 smithi146 ceph-mon[32800]: pgmap v233: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:34:25.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:25 smithi069 ceph-mon[29593]: pgmap v233: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:34:27.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:27 smithi167 ceph-mon[32940]: pgmap v234: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:34:27.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:27 smithi146 ceph-mon[32800]: pgmap v234: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:34:27.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:27 smithi069 ceph-mon[29593]: pgmap v234: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:34:29.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:29 smithi167 ceph-mon[32940]: pgmap v235: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:34:29.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:29 smithi146 ceph-mon[32800]: pgmap v235: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:34:29.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:29 smithi069 ceph-mon[29593]: pgmap v235: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:34:31.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:31 smithi167 ceph-mon[32940]: pgmap v236: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:34:31.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:31 smithi146 ceph-mon[32800]: pgmap v236: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:34:31.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:31 smithi069 ceph-mon[29593]: pgmap v236: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:34:33.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:33 smithi167 ceph-mon[32940]: pgmap v237: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:33.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:33 smithi146 ceph-mon[32800]: pgmap v237: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:33.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:33 smithi069 ceph-mon[29593]: pgmap v237: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:35.294 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:35 smithi069 ceph-mon[29593]: pgmap v238: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:35.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:35 smithi167 ceph-mon[32940]: pgmap v238: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:35.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:35 smithi146 ceph-mon[32800]: pgmap v238: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:37.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:37 smithi167 ceph-mon[32940]: pgmap v239: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:37.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:37 smithi146 ceph-mon[32800]: pgmap v239: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:37.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:37 smithi069 ceph-mon[29593]: pgmap v239: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:39.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:39 smithi167 ceph-mon[32940]: pgmap v240: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:39.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:39 smithi146 ceph-mon[32800]: pgmap v240: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:39.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:39 smithi069 ceph-mon[29593]: pgmap v240: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:41.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:41 smithi167 ceph-mon[32940]: pgmap v241: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:41.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:41 smithi146 ceph-mon[32800]: pgmap v241: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:41.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:41 smithi069 ceph-mon[29593]: pgmap v241: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:43.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:43 smithi167 ceph-mon[32940]: pgmap v242: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:43.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:43 smithi146 ceph-mon[32800]: pgmap v242: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:43.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:43 smithi069 ceph-mon[29593]: pgmap v242: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:45.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:45 smithi167 ceph-mon[32940]: pgmap v243: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:45.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:45 smithi146 ceph-mon[32800]: pgmap v243: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:45.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:45 smithi069 ceph-mon[29593]: pgmap v243: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:47.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:47 smithi167 ceph-mon[32940]: pgmap v244: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:47.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:47 smithi146 ceph-mon[32800]: pgmap v244: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:47.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:47 smithi069 ceph-mon[29593]: pgmap v244: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:49.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:49 smithi167 ceph-mon[32940]: pgmap v245: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:49.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:49 smithi146 ceph-mon[32800]: pgmap v245: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:49.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:49 smithi069 ceph-mon[29593]: pgmap v245: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:51.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:51 smithi167 ceph-mon[32940]: pgmap v246: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:51.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:51 smithi146 ceph-mon[32800]: pgmap v246: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:51.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:51 smithi069 ceph-mon[29593]: pgmap v246: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:53.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:53 smithi167 ceph-mon[32940]: pgmap v247: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:53.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:53 smithi146 ceph-mon[32800]: pgmap v247: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:53.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:53 smithi069 ceph-mon[29593]: pgmap v247: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:55.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:55 smithi167 ceph-mon[32940]: pgmap v248: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:55.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:55 smithi146 ceph-mon[32800]: pgmap v248: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:55.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:55 smithi069 ceph-mon[29593]: pgmap v248: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:57.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:57 smithi167 ceph-mon[32940]: pgmap v249: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:57.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:57 smithi146 ceph-mon[32800]: pgmap v249: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:57.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:57 smithi069 ceph-mon[29593]: pgmap v249: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:34:59.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:34:59 smithi167 ceph-mon[32940]: pgmap v250: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:59.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:34:59 smithi146 ceph-mon[32800]: pgmap v250: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:34:59.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:34:59 smithi069 ceph-mon[29593]: pgmap v250: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:01.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:01 smithi167 ceph-mon[32940]: pgmap v251: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:01.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:01 smithi146 ceph-mon[32800]: pgmap v251: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:01.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:01 smithi069 ceph-mon[29593]: pgmap v251: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:03.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:03 smithi167 ceph-mon[32940]: pgmap v252: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:03.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:03 smithi146 ceph-mon[32800]: pgmap v252: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:03 smithi069 ceph-mon[29593]: pgmap v252: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:05.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:05 smithi146 ceph-mon[32800]: pgmap v253: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:05.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:05 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:35:05.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:05 smithi069 ceph-mon[29593]: pgmap v253: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:05.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:05 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:35:05.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:05 smithi167 ceph-mon[32940]: pgmap v253: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:05.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:05 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:35:06.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:06 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:35:06.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:06 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:35:06.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:06 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:35:06.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:06 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:35:06.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:06 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:35:06.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:06 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:35:06.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:06 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:35:06.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:06 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:35:06.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:06 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:35:07.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:07 smithi146 ceph-mon[32800]: pgmap v254: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-23T10:35:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:07 smithi069 ceph-mon[29593]: pgmap v254: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-23T10:35:07.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:07 smithi167 ceph-mon[32940]: pgmap v254: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-23T10:35:09.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:09 smithi146 ceph-mon[32800]: pgmap v255: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-23T10:35:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:09 smithi069 ceph-mon[29593]: pgmap v255: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-23T10:35:09.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:09 smithi167 ceph-mon[32940]: pgmap v255: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-23T10:35:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:11 smithi146 ceph-mon[32800]: pgmap v256: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 31 op/s 2024-04-23T10:35:11.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:11 smithi146 ceph-mon[32800]: osdmap e95: 12 total, 12 up, 12 in 2024-04-23T10:35:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:11 smithi069 ceph-mon[29593]: pgmap v256: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 31 op/s 2024-04-23T10:35:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:11 smithi069 ceph-mon[29593]: osdmap e95: 12 total, 12 up, 12 in 2024-04-23T10:35:11.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:11 smithi167 ceph-mon[32940]: pgmap v256: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 31 op/s 2024-04-23T10:35:11.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:11 smithi167 ceph-mon[32940]: osdmap e95: 12 total, 12 up, 12 in 2024-04-23T10:35:13.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:13 smithi146 ceph-mon[32800]: pgmap v258: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:35:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:13 smithi069 ceph-mon[29593]: pgmap v258: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:35:13.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:13 smithi167 ceph-mon[32940]: pgmap v258: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:35:15.385 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:15 smithi167 ceph-mon[32940]: pgmap v259: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:35:15.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:15 smithi146 ceph-mon[32800]: pgmap v259: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:35:15.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:15 smithi069 ceph-mon[29593]: pgmap v259: 97 pgs: 97 active+clean; 215 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:35:17.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:17 smithi146 ceph-mon[32800]: pgmap v260: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:35:17.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:17 smithi146 ceph-mon[32800]: osdmap e96: 12 total, 12 up, 12 in 2024-04-23T10:35:17.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:17 smithi069 ceph-mon[29593]: pgmap v260: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:35:17.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:17 smithi069 ceph-mon[29593]: osdmap e96: 12 total, 12 up, 12 in 2024-04-23T10:35:17.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:17 smithi167 ceph-mon[32940]: pgmap v260: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:35:17.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:17 smithi167 ceph-mon[32940]: osdmap e96: 12 total, 12 up, 12 in 2024-04-23T10:35:19.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:19 smithi146 ceph-mon[32800]: pgmap v262: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:35:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:19 smithi069 ceph-mon[29593]: pgmap v262: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:35:19.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:19 smithi167 ceph-mon[32940]: pgmap v262: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:35:21.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:21 smithi146 ceph-mon[32800]: pgmap v263: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 12 op/s 2024-04-23T10:35:21.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:21 smithi069 ceph-mon[29593]: pgmap v263: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 12 op/s 2024-04-23T10:35:21.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:21 smithi167 ceph-mon[32940]: pgmap v263: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 12 op/s 2024-04-23T10:35:23.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:23 smithi146 ceph-mon[32800]: pgmap v264: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:35:23.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:23 smithi069 ceph-mon[29593]: pgmap v264: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:35:23.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:23 smithi167 ceph-mon[32940]: pgmap v264: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:35:25.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:25 smithi146 ceph-mon[32800]: pgmap v265: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:35:25.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:25 smithi069 ceph-mon[29593]: pgmap v265: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:35:25.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:25 smithi167 ceph-mon[32940]: pgmap v265: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:35:27.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:27 smithi146 ceph-mon[32800]: pgmap v266: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:35:27.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:27 smithi069 ceph-mon[29593]: pgmap v266: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:35:27.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:27 smithi167 ceph-mon[32940]: pgmap v266: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:35:29.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:29 smithi146 ceph-mon[32800]: pgmap v267: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:35:29.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:29 smithi069 ceph-mon[29593]: pgmap v267: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:35:29.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:29 smithi167 ceph-mon[32940]: pgmap v267: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:35:31.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:31 smithi146 ceph-mon[32800]: pgmap v268: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:35:31.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:31 smithi069 ceph-mon[29593]: pgmap v268: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:35:31.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:31 smithi167 ceph-mon[32940]: pgmap v268: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:35:33.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:33 smithi146 ceph-mon[32800]: pgmap v269: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:33.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:33 smithi069 ceph-mon[29593]: pgmap v269: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:33.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:33 smithi167 ceph-mon[32940]: pgmap v269: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:35.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:35 smithi146 ceph-mon[32800]: pgmap v270: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:35.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:35 smithi069 ceph-mon[29593]: pgmap v270: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:35.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:35 smithi167 ceph-mon[32940]: pgmap v270: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:37.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:37 smithi146 ceph-mon[32800]: pgmap v271: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:37.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:37 smithi069 ceph-mon[29593]: pgmap v271: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:37.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:37 smithi167 ceph-mon[32940]: pgmap v271: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:39.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:39 smithi146 ceph-mon[32800]: pgmap v272: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:39.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:39 smithi069 ceph-mon[29593]: pgmap v272: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:39.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:39 smithi167 ceph-mon[32940]: pgmap v272: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:41.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:41 smithi146 ceph-mon[32800]: pgmap v273: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:41.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:41 smithi069 ceph-mon[29593]: pgmap v273: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:41.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:41 smithi167 ceph-mon[32940]: pgmap v273: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:43.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:43 smithi146 ceph-mon[32800]: pgmap v274: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:43.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:43 smithi069 ceph-mon[29593]: pgmap v274: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:43.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:43 smithi167 ceph-mon[32940]: pgmap v274: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:45.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:45 smithi146 ceph-mon[32800]: pgmap v275: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:45.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:45 smithi069 ceph-mon[29593]: pgmap v275: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:45.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:45 smithi167 ceph-mon[32940]: pgmap v275: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:47.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:47 smithi146 ceph-mon[32800]: pgmap v276: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:47.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:47 smithi069 ceph-mon[29593]: pgmap v276: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:47.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:47 smithi167 ceph-mon[32940]: pgmap v276: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:49.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:49 smithi146 ceph-mon[32800]: pgmap v277: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:49.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:49 smithi069 ceph-mon[29593]: pgmap v277: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:49.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:49 smithi167 ceph-mon[32940]: pgmap v277: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:35:51.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:51 smithi146 ceph-mon[32800]: pgmap v278: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:51.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:51 smithi069 ceph-mon[29593]: pgmap v278: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:51.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:51 smithi167 ceph-mon[32940]: pgmap v278: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:53.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:53 smithi146 ceph-mon[32800]: pgmap v279: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-23T10:35:53.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:53 smithi069 ceph-mon[29593]: pgmap v279: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-23T10:35:53.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:53 smithi167 ceph-mon[32940]: pgmap v279: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-23T10:35:55.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:55 smithi146 ceph-mon[32800]: pgmap v280: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-23T10:35:55.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:55 smithi069 ceph-mon[29593]: pgmap v280: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-23T10:35:55.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:55 smithi167 ceph-mon[32940]: pgmap v280: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-23T10:35:57.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:57 smithi146 ceph-mon[32800]: pgmap v281: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:57.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:57 smithi069 ceph-mon[29593]: pgmap v281: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:57.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:57 smithi167 ceph-mon[32940]: pgmap v281: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:35:59.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:35:59 smithi146 ceph-mon[32800]: pgmap v282: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:35:59.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:35:59 smithi069 ceph-mon[29593]: pgmap v282: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:35:59.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:35:59 smithi167 ceph-mon[32940]: pgmap v282: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:36:01.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:01 smithi146 ceph-mon[32800]: pgmap v283: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 13 op/s 2024-04-23T10:36:01.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:01 smithi069 ceph-mon[29593]: pgmap v283: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 13 op/s 2024-04-23T10:36:01.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:01 smithi167 ceph-mon[32940]: pgmap v283: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 13 op/s 2024-04-23T10:36:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:03 smithi069 ceph-mon[29593]: pgmap v284: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:36:03.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:03 smithi167 ceph-mon[32940]: pgmap v284: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:36:03.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:03 smithi146 ceph-mon[32800]: pgmap v284: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:36:05.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:05 smithi069 ceph-mon[29593]: pgmap v285: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:36:05.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:05 smithi167 ceph-mon[32940]: pgmap v285: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:36:05.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:05 smithi146 ceph-mon[32800]: pgmap v285: 97 pgs: 97 active+clean; 117 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-23T10:36:06.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:06 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:36:06.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:06 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:36:06.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:06 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:36:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:07 smithi069 ceph-mon[29593]: pgmap v286: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-23T10:36:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:07 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:36:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:07 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:36:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:07 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:36:07.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:07 smithi167 ceph-mon[32940]: pgmap v286: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-23T10:36:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:07 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:36:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:07 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:36:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:07 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:36:07.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:07 smithi146 ceph-mon[32800]: pgmap v286: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-23T10:36:07.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:07 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:36:07.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:07 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:36:07.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:07 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:36:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:09 smithi069 ceph-mon[29593]: pgmap v287: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-23T10:36:09.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:09 smithi167 ceph-mon[32940]: pgmap v287: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-23T10:36:09.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:09 smithi146 ceph-mon[32800]: pgmap v287: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-23T10:36:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:11 smithi069 ceph-mon[29593]: pgmap v288: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-23T10:36:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:11 smithi069 ceph-mon[29593]: osdmap e97: 12 total, 12 up, 12 in 2024-04-23T10:36:11.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:11 smithi167 ceph-mon[32940]: pgmap v288: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-23T10:36:11.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:11 smithi167 ceph-mon[32940]: osdmap e97: 12 total, 12 up, 12 in 2024-04-23T10:36:11.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:11 smithi146 ceph-mon[32800]: pgmap v288: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-23T10:36:11.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:11 smithi146 ceph-mon[32800]: osdmap e97: 12 total, 12 up, 12 in 2024-04-23T10:36:13.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:13 smithi069 ceph-mon[29593]: pgmap v290: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:36:13.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:13 smithi167 ceph-mon[32940]: pgmap v290: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:36:13.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:13 smithi146 ceph-mon[32800]: pgmap v290: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:36:15.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:15 smithi069 ceph-mon[29593]: pgmap v291: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:36:15.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:15 smithi167 ceph-mon[32940]: pgmap v291: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:36:15.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:15 smithi146 ceph-mon[32800]: pgmap v291: 97 pgs: 97 active+clean; 117 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:36:17.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:17 smithi069 ceph-mon[29593]: pgmap v292: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:36:17.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:17 smithi069 ceph-mon[29593]: osdmap e98: 12 total, 12 up, 12 in 2024-04-23T10:36:17.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:17 smithi167 ceph-mon[32940]: pgmap v292: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:36:17.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:17 smithi167 ceph-mon[32940]: osdmap e98: 12 total, 12 up, 12 in 2024-04-23T10:36:17.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:17 smithi146 ceph-mon[32800]: pgmap v292: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:36:17.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:17 smithi146 ceph-mon[32800]: osdmap e98: 12 total, 12 up, 12 in 2024-04-23T10:36:19.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:19 smithi069 ceph-mon[29593]: pgmap v294: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:36:19.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:19 smithi167 ceph-mon[32940]: pgmap v294: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:36:19.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:19 smithi146 ceph-mon[32800]: pgmap v294: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:36:21.480 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:21 smithi146 ceph-mon[32800]: pgmap v295: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 12 op/s 2024-04-23T10:36:21.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:21 smithi069 ceph-mon[29593]: pgmap v295: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 12 op/s 2024-04-23T10:36:21.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:21 smithi167 ceph-mon[32940]: pgmap v295: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 12 op/s 2024-04-23T10:36:23.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:23 smithi069 ceph-mon[29593]: pgmap v296: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:36:23.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:23 smithi167 ceph-mon[32940]: pgmap v296: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:36:23.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:23 smithi146 ceph-mon[32800]: pgmap v296: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:36:25.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:25 smithi069 ceph-mon[29593]: pgmap v297: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:36:25.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:25 smithi167 ceph-mon[32940]: pgmap v297: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:36:25.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:25 smithi146 ceph-mon[32800]: pgmap v297: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:36:27.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:27 smithi069 ceph-mon[29593]: pgmap v298: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:36:27.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:27 smithi167 ceph-mon[32940]: pgmap v298: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:36:27.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:27 smithi146 ceph-mon[32800]: pgmap v298: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:36:29.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:29 smithi069 ceph-mon[29593]: pgmap v299: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:36:29.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:29 smithi167 ceph-mon[32940]: pgmap v299: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:36:29.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:29 smithi146 ceph-mon[32800]: pgmap v299: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:36:31.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:31 smithi069 ceph-mon[29593]: pgmap v300: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:36:31.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:31 smithi167 ceph-mon[32940]: pgmap v300: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:36:31.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:31 smithi146 ceph-mon[32800]: pgmap v300: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:36:33.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:33 smithi069 ceph-mon[29593]: pgmap v301: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:33.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:33 smithi167 ceph-mon[32940]: pgmap v301: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:33.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:33 smithi146 ceph-mon[32800]: pgmap v301: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:35.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:35 smithi069 ceph-mon[29593]: pgmap v302: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:35.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:35 smithi167 ceph-mon[32940]: pgmap v302: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:35.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:35 smithi146 ceph-mon[32800]: pgmap v302: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:37.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:37 smithi069 ceph-mon[29593]: pgmap v303: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:37.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:37 smithi167 ceph-mon[32940]: pgmap v303: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:37.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:37 smithi146 ceph-mon[32800]: pgmap v303: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:39.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:39 smithi069 ceph-mon[29593]: pgmap v304: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:39.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:39 smithi167 ceph-mon[32940]: pgmap v304: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:39.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:39 smithi146 ceph-mon[32800]: pgmap v304: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:41.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:41 smithi167 ceph-mon[32940]: pgmap v305: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:41.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:41 smithi146 ceph-mon[32800]: pgmap v305: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:41.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:41 smithi069 ceph-mon[29593]: pgmap v305: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:43.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:43 smithi167 ceph-mon[32940]: pgmap v306: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:43.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:43 smithi146 ceph-mon[32800]: pgmap v306: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:43.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:43 smithi069 ceph-mon[29593]: pgmap v306: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:45.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:45 smithi167 ceph-mon[32940]: pgmap v307: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:45.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:45 smithi146 ceph-mon[32800]: pgmap v307: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:45.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:45 smithi069 ceph-mon[29593]: pgmap v307: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:47.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:47 smithi167 ceph-mon[32940]: pgmap v308: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:47.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:47 smithi146 ceph-mon[32800]: pgmap v308: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:47.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:47 smithi069 ceph-mon[29593]: pgmap v308: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:49.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:49 smithi167 ceph-mon[32940]: pgmap v309: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:49.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:49 smithi146 ceph-mon[32800]: pgmap v309: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:49.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:49 smithi069 ceph-mon[29593]: pgmap v309: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:51.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:51 smithi167 ceph-mon[32940]: pgmap v310: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:51.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:51 smithi146 ceph-mon[32800]: pgmap v310: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:51.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:51 smithi069 ceph-mon[29593]: pgmap v310: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:53.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:53 smithi167 ceph-mon[32940]: pgmap v311: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:53.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:53 smithi146 ceph-mon[32800]: pgmap v311: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:53.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:53 smithi069 ceph-mon[29593]: pgmap v311: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:55.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:55 smithi167 ceph-mon[32940]: pgmap v312: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:55.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:55 smithi146 ceph-mon[32800]: pgmap v312: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:55.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:55 smithi069 ceph-mon[29593]: pgmap v312: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:56.063 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-23T10:36:56.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.175+0000 7f8d06751640 1 -- 172.21.15.69:0/833783686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d00103b20 msgr2=0x7f8d0010c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.175+0000 7f8d06751640 1 --2- 172.21.15.69:0/833783686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d00103b20 0x7f8d0010c000 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009900 tx=0x7f8cf402a480 comp rx=0 tx=0).stop 2024-04-23T10:36:56.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.175+0000 7f8d06751640 1 -- 172.21.15.69:0/833783686 shutdown_connections 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.175+0000 7f8d06751640 1 --2- 172.21.15.69:0/833783686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d00103b20 0x7f8d0010c000 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.175+0000 7f8d06751640 1 --2- 172.21.15.69:0/833783686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d0010c5d0 0x7f8d0010ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.175+0000 7f8d06751640 1 --2- 172.21.15.69:0/833783686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d00103200 0x7f8d001035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.175+0000 7f8d06751640 1 -- 172.21.15.69:0/833783686 >> 172.21.15.69:0/833783686 conn(0x7f8d000771d0 msgr2=0x7f8d000775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.175+0000 7f8d06751640 1 -- 172.21.15.69:0/833783686 shutdown_connections 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.175+0000 7f8d06751640 1 -- 172.21.15.69:0/833783686 wait complete. 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8d06751640 1 Processor -- start 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8d06751640 1 -- start start 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8d06751640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d00103200 0x7f8d00198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8d06751640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d00103b20 0x7f8d00198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8d06751640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0010c5d0 0x7f8d0019cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8d06751640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00112330 con 0x7f8d00103200 2024-04-23T10:36:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8d06751640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8d001121b0 con 0x7f8d0010c5d0 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8d06751640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d001124b0 con 0x7f8d00103b20 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8cfffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d00103200 0x7f8d00198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8cfffff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d00103200 0x7f8d00198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34098/0 (socket says 172.21.15.69:34098) 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8cfffff640 1 -- 172.21.15.69:0/263105206 learned_addr learned my addr 172.21.15.69:0/263105206 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8cfffff640 1 -- 172.21.15.69:0/263105206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d00103b20 msgr2=0x7f8d00198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8d04cee640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0010c5d0 0x7f8d0019cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8cfffff640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d00103b20 0x7f8d00198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8cfffff640 1 -- 172.21.15.69:0/263105206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0010c5d0 msgr2=0x7f8d0019cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8cfffff640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0010c5d0 0x7f8d0019cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.176+0000 7f8cfffff640 1 -- 172.21.15.69:0/263105206 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0019d720 con 0x7f8d00103200 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.177+0000 7f8cfffff640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d00103200 0x7f8d00198730 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000d950 tx=0x7f8cf000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.177+0000 7f8cfd7fa640 1 -- 172.21.15.69:0/263105206 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0017070 con 0x7f8d00103200 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.177+0000 7f8d06751640 1 -- 172.21.15.69:0/263105206 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d0019da10 con 0x7f8d00103200 2024-04-23T10:36:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.177+0000 7f8cfd7fa640 1 -- 172.21.15.69:0/263105206 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8cf0009c30 con 0x7f8d00103200 2024-04-23T10:36:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.177+0000 7f8cfd7fa640 1 -- 172.21.15.69:0/263105206 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf000f6b0 con 0x7f8d00103200 2024-04-23T10:36:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.177+0000 7f8d06751640 1 -- 172.21.15.69:0/263105206 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d001a52a0 con 0x7f8d00103200 2024-04-23T10:36:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.178+0000 7f8d06751640 1 -- 172.21.15.69:0/263105206 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d0004fce0 con 0x7f8d00103200 2024-04-23T10:36:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.179+0000 7f8cfd7fa640 1 -- 172.21.15.69:0/263105206 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f8cf00109c0 con 0x7f8d00103200 2024-04-23T10:36:56.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.179+0000 7f8cfd7fa640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ce80a3dc0 0x7f8ce80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.180+0000 7f8cff7fe640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ce80a3dc0 0x7f8ce80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:56.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.180+0000 7f8cfd7fa640 1 -- 172.21.15.69:0/263105206 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7f8cf00d0500 con 0x7f8d00103200 2024-04-23T10:36:56.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.180+0000 7f8cff7fe640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ce80a3dc0 0x7f8ce80a6280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4005c20 tx=0x7f8cf4000bc0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:56.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.183+0000 7f8cfd7fa640 1 -- 172.21.15.69:0/263105206 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8cf0009de0 con 0x7f8d00103200 2024-04-23T10:36:56.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.382+0000 7f8d06751640 1 -- 172.21.15.69:0/263105206 --> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f8d000fe390 con 0x7f8ce80a3dc0 2024-04-23T10:36:56.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.390+0000 7f8cfd7fa640 1 -- 172.21.15.69:0/263105206 <== mgr.24836 v2:172.21.15.69:6800/908508073 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f8d000fe390 con 0x7f8ce80a3dc0 2024-04-23T10:36:56.389 INFO:teuthology.orchestra.run.smithi069.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-23T00:00:00", "created": "2024-04-23T10:26:54", "first": "2024-04-23T10:27:00", "last": "2024-04-23T10:36:00", "last_pruned": "2024-04-23T10:36:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-04-23T10:36:56.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.392+0000 7f8d06751640 1 -- 172.21.15.69:0/263105206 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ce80a3dc0 msgr2=0x7f8ce80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.392+0000 7f8d06751640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ce80a3dc0 0x7f8ce80a6280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4005c20 tx=0x7f8cf4000bc0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.392+0000 7f8d06751640 1 -- 172.21.15.69:0/263105206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d00103200 msgr2=0x7f8d00198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.392+0000 7f8d06751640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d00103200 0x7f8d00198730 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000d950 tx=0x7f8cf000de10 comp rx=0 tx=0).stop 2024-04-23T10:36:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.393+0000 7f8d06751640 1 -- 172.21.15.69:0/263105206 shutdown_connections 2024-04-23T10:36:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.393+0000 7f8d06751640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ce80a3dc0 0x7f8ce80a6280 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.393+0000 7f8d06751640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0010c5d0 0x7f8d0019cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.393+0000 7f8d06751640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d00103b20 0x7f8d00198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.393+0000 7f8d06751640 1 --2- 172.21.15.69:0/263105206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d00103200 0x7f8d00198730 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.393+0000 7f8d06751640 1 -- 172.21.15.69:0/263105206 >> 172.21.15.69:0/263105206 conn(0x7f8d000771d0 msgr2=0x7f8d000fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.393+0000 7f8d06751640 1 -- 172.21.15.69:0/263105206 shutdown_connections 2024-04-23T10:36:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.393+0000 7f8d06751640 1 -- 172.21.15.69:0/263105206 wait complete. 2024-04-23T10:36:56.402 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-23T10:36:56.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.504+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/1999352498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aa0106fb0 msgr2=0x7f6aa0107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.504+0000 7f6aa5ecf640 1 --2- 172.21.15.69:0/1999352498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aa0106fb0 0x7f6aa0107390 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009900 tx=0x7f6a9002a410 comp rx=0 tx=0).stop 2024-04-23T10:36:56.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/1999352498 shutdown_connections 2024-04-23T10:36:56.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 --2- 172.21.15.69:0/1999352498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aa0101a60 0x7f6aa010dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 --2- 172.21.15.69:0/1999352498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa01010c0 0x7f6aa0101520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 --2- 172.21.15.69:0/1999352498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aa0106fb0 0x7f6aa0107390 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/1999352498 >> 172.21.15.69:0/1999352498 conn(0x7f6aa0077dc0 msgr2=0x7f6aa00781d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/1999352498 shutdown_connections 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/1999352498 wait complete. 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 Processor -- start 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 -- start start 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa01010c0 0x7f6aa01996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aa0101a60 0x7f6aa0199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aa0106fb0 0x7f6aa01a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa01112a0 con 0x7f6aa0101a60 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa0111120 con 0x7f6aa0106fb0 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6aa5ecf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa0111420 con 0x7f6aa01010c0 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6a97fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aa0101a60 0x7f6aa0199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6a97fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aa0101a60 0x7f6aa0199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34106/0 (socket says 172.21.15.69:34106) 2024-04-23T10:36:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.505+0000 7f6a97fff640 1 -- 172.21.15.69:0/211859342 learned_addr learned my addr 172.21.15.69:0/211859342 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a9f7fe640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa01010c0 0x7f6aa01996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a9ffff640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aa0106fb0 0x7f6aa01a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a97fff640 1 -- 172.21.15.69:0/211859342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa01010c0 msgr2=0x7f6aa01996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a97fff640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa01010c0 0x7f6aa01996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a97fff640 1 -- 172.21.15.69:0/211859342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aa0106fb0 msgr2=0x7f6aa01a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a97fff640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aa0106fb0 0x7f6aa01a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a97fff640 1 -- 172.21.15.69:0/211859342 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa01a4c80 con 0x7f6aa0101a60 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a9f7fe640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa01010c0 0x7f6aa01996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a9ffff640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aa0106fb0 0x7f6aa01a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a97fff640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aa0101a60 0x7f6aa0199c00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800d770 tx=0x7f6a8800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a9d7fa640 1 -- 172.21.15.69:0/211859342 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88017070 con 0x7f6aa0101a60 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a9d7fa640 1 -- 172.21.15.69:0/211859342 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6a880054f0 con 0x7f6aa0101a60 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/211859342 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa01a4e50 con 0x7f6aa0101a60 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6a9d7fa640 1 -- 172.21.15.69:0/211859342 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88004de0 con 0x7f6aa0101a60 2024-04-23T10:36:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.506+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/211859342 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa01a52c0 con 0x7f6aa0101a60 2024-04-23T10:36:56.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.507+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/211859342 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aa004fce0 con 0x7f6aa0101a60 2024-04-23T10:36:56.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.508+0000 7f6a9d7fa640 1 -- 172.21.15.69:0/211859342 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f6a88004f80 con 0x7f6aa0101a60 2024-04-23T10:36:56.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.509+0000 7f6a9d7fa640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f6a8c0a3dc0 0x7f6a8c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.509+0000 7f6a9f7fe640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f6a8c0a3dc0 0x7f6a8c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:56.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.509+0000 7f6a9d7fa640 1 -- 172.21.15.69:0/211859342 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7f6a880d03b0 con 0x7f6aa0101a60 2024-04-23T10:36:56.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.509+0000 7f6a9f7fe640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f6a8c0a3dc0 0x7f6a8c0a6280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6a90005ab0 tx=0x7f6a90005a20 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.513+0000 7f6a9d7fa640 1 -- 172.21.15.69:0/211859342 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6a8809ca50 con 0x7f6aa0101a60 2024-04-23T10:36:56.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.713+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/211859342 --> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f6aa01093e0 con 0x7f6a8c0a3dc0 2024-04-23T10:36:56.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.720+0000 7f6a9d7fa640 1 -- 172.21.15.69:0/211859342 <== mgr.24836 v2:172.21.15.69:6800/908508073 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f6aa01093e0 con 0x7f6a8c0a3dc0 2024-04-23T10:36:56.719 INFO:teuthology.orchestra.run.smithi069.stdout:/ 1m 6m3h 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.722+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/211859342 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f6a8c0a3dc0 msgr2=0x7f6a8c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.722+0000 7f6aa5ecf640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f6a8c0a3dc0 0x7f6a8c0a6280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6a90005ab0 tx=0x7f6a90005a20 comp rx=0 tx=0).stop 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.722+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/211859342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aa0101a60 msgr2=0x7f6aa0199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.722+0000 7f6aa5ecf640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aa0101a60 0x7f6aa0199c00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800d770 tx=0x7f6a8800dc30 comp rx=0 tx=0).stop 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.723+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/211859342 shutdown_connections 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.723+0000 7f6aa5ecf640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f6a8c0a3dc0 0x7f6a8c0a6280 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.723+0000 7f6aa5ecf640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6aa0101a60 0x7f6aa0199c00 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.723+0000 7f6aa5ecf640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6aa0106fb0 0x7f6aa01a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.723+0000 7f6aa5ecf640 1 --2- 172.21.15.69:0/211859342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6aa01010c0 0x7f6aa01996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.723+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/211859342 >> 172.21.15.69:0/211859342 conn(0x7f6aa0077dc0 msgr2=0x7f6aa00ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.723+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/211859342 shutdown_connections 2024-04-23T10:36:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.723+0000 7f6aa5ecf640 1 -- 172.21.15.69:0/211859342 wait complete. 2024-04-23T10:36:56.732 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-23T10:36:56.743 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:36:56.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.842+0000 7f126c3d8640 1 -- 172.21.15.69:0/3349149345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1264101a50 msgr2=0x7f1264105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.842+0000 7f126c3d8640 1 --2- 172.21.15.69:0/3349149345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1264101a50 0x7f1264105a90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1254009900 tx=0x7f125402a410 comp rx=0 tx=0).stop 2024-04-23T10:36:56.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 -- 172.21.15.69:0/3349149345 shutdown_connections 2024-04-23T10:36:56.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 --2- 172.21.15.69:0/3349149345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1264101a50 0x7f1264105a90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 --2- 172.21.15.69:0/3349149345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1264106170 0x7f126410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 --2- 172.21.15.69:0/3349149345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12641010a0 0x7f1264101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 -- 172.21.15.69:0/3349149345 >> 172.21.15.69:0/3349149345 conn(0x7f1264077f50 msgr2=0x7f1264078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:56.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 -- 172.21.15.69:0/3349149345 shutdown_connections 2024-04-23T10:36:56.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 -- 172.21.15.69:0/3349149345 wait complete. 2024-04-23T10:36:56.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 Processor -- start 2024-04-23T10:36:56.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 -- start start 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12641010a0 0x7f1264197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1264106170 0x7f1264197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126419bff0 0x7f126419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f12641111f0 con 0x7f12641010a0 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1264111070 con 0x7f126419bff0 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126c3d8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1264111370 con 0x7f1264106170 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126a174640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12641010a0 0x7f1264197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126a174640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12641010a0 0x7f1264197730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34114/0 (socket says 172.21.15.69:34114) 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.843+0000 7f126a174640 1 -- 172.21.15.69:0/852119046 learned_addr learned my addr 172.21.15.69:0/852119046 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f1269973640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1264106170 0x7f1264197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f126a975640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126419bff0 0x7f126419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f126a174640 1 -- 172.21.15.69:0/852119046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1264106170 msgr2=0x7f1264197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f126a174640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1264106170 0x7f1264197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f126a174640 1 -- 172.21.15.69:0/852119046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126419bff0 msgr2=0x7f126419c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:56.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f126a174640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126419bff0 0x7f126419c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:56.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f126a174640 1 -- 172.21.15.69:0/852119046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126419cae0 con 0x7f12641010a0 2024-04-23T10:36:56.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f126a174640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12641010a0 0x7f1264197730 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f126000ea80 tx=0x7f126000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:56.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f125b7fe640 1 -- 172.21.15.69:0/852119046 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126000ce40 con 0x7f12641010a0 2024-04-23T10:36:56.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f125b7fe640 1 -- 172.21.15.69:0/852119046 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1260005020 con 0x7f12641010a0 2024-04-23T10:36:56.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f126c3d8640 1 -- 172.21.15.69:0/852119046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126419cdd0 con 0x7f12641010a0 2024-04-23T10:36:56.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f125b7fe640 1 -- 172.21.15.69:0/852119046 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260011760 con 0x7f12641010a0 2024-04-23T10:36:56.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.844+0000 7f126c3d8640 1 -- 172.21.15.69:0/852119046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12641a4540 con 0x7f12641010a0 2024-04-23T10:36:56.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.845+0000 7f126c3d8640 1 -- 172.21.15.69:0/852119046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1264068d70 con 0x7f12641010a0 2024-04-23T10:36:56.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.846+0000 7f125b7fe640 1 -- 172.21.15.69:0/852119046 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f12600051d0 con 0x7f12641010a0 2024-04-23T10:36:56.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.846+0000 7f125b7fe640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f12500a3d20 0x7f12500a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:56.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.847+0000 7f1269973640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f12500a3d20 0x7f12500a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:56.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.847+0000 7f125b7fe640 1 -- 172.21.15.69:0/852119046 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7f12600d0ae0 con 0x7f12641010a0 2024-04-23T10:36:56.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.847+0000 7f1269973640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f12500a3d20 0x7f12500a61e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f12540314b0 tx=0x7f12540058d0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:56.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:56.851+0000 7f125b7fe640 1 -- 172.21.15.69:0/852119046 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1260016030 con 0x7f12641010a0 2024-04-23T10:36:57.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.030+0000 7f126c3d8640 1 -- 172.21.15.69:0/852119046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12641093a0 con 0x7f12641010a0 2024-04-23T10:36:57.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.032+0000 7f125b7fe640 1 -- 172.21.15.69:0/852119046 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+23061 (secure 0 0 0) 0x7f126009d180 con 0x7f12641010a0 2024-04-23T10:36:57.031 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:36:57.031 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":98,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:36:16.451652+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/2621408239":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1024244898":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1462548780":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6800/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3272003821":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:36:57.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 -- 172.21.15.69:0/852119046 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f12500a3d20 msgr2=0x7f12500a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f12500a3d20 0x7f12500a61e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f12540314b0 tx=0x7f12540058d0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 -- 172.21.15.69:0/852119046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12641010a0 msgr2=0x7f1264197730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12641010a0 0x7f1264197730 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f126000ea80 tx=0x7f126000ef40 comp rx=0 tx=0).stop 2024-04-23T10:36:57.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 -- 172.21.15.69:0/852119046 shutdown_connections 2024-04-23T10:36:57.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f12500a3d20 0x7f12500a61e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126419bff0 0x7f126419c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1264106170 0x7f1264197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 --2- 172.21.15.69:0/852119046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12641010a0 0x7f1264197730 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 -- 172.21.15.69:0/852119046 >> 172.21.15.69:0/852119046 conn(0x7f1264077f50 msgr2=0x7f12640ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:57.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 -- 172.21.15.69:0/852119046 shutdown_connections 2024-04-23T10:36:57.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.034+0000 7f126c3d8640 1 -- 172.21.15.69:0/852119046 wait complete. 2024-04-23T10:36:57.044 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:24:50.484063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:24:51.816315+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:36:57.044 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:36:57.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.147+0000 7f63fe3ad640 1 -- 172.21.15.69:0/1324569159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63f8106160 msgr2=0x7f63f810dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.147+0000 7f63fe3ad640 1 --2- 172.21.15.69:0/1324569159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63f8106160 0x7f63f810dd30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009ca0 tx=0x7f63f002a8c0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.147+0000 7f63fe3ad640 1 -- 172.21.15.69:0/1324569159 shutdown_connections 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.147+0000 7f63fe3ad640 1 --2- 172.21.15.69:0/1324569159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63f8106160 0x7f63f810dd30 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.147+0000 7f63fe3ad640 1 --2- 172.21.15.69:0/1324569159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63f8101a40 0x7f63f8105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.147+0000 7f63fe3ad640 1 --2- 172.21.15.69:0/1324569159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f8101090 0x7f63f8101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.147+0000 7f63fe3ad640 1 -- 172.21.15.69:0/1324569159 >> 172.21.15.69:0/1324569159 conn(0x7f63f8077f50 msgr2=0x7f63f8078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.147+0000 7f63fe3ad640 1 -- 172.21.15.69:0/1324569159 shutdown_connections 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.147+0000 7f63fe3ad640 1 -- 172.21.15.69:0/1324569159 wait complete. 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.147+0000 7f63fe3ad640 1 Processor -- start 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.147+0000 7f63fe3ad640 1 -- start start 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fe3ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63f8101090 0x7f63f8197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fe3ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f8106160 0x7f63f8197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fe3ad640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63f819bf00 0x7f63f819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fe3ad640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8111200 con 0x7f63f819bf00 2024-04-23T10:36:57.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fe3ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8111080 con 0x7f63f8101090 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fe3ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8111380 con 0x7f63f8106160 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fc94a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63f819bf00 0x7f63f819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fc94a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63f819bf00 0x7f63f819c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34128/0 (socket says 172.21.15.69:34128) 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fc94a640 1 -- 172.21.15.69:0/3960261907 learned_addr learned my addr 172.21.15.69:0/3960261907 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63f7fff640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63f8101090 0x7f63f8197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fc94a640 1 -- 172.21.15.69:0/3960261907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f8106160 msgr2=0x7f63f8197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63f77fe640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f8106160 0x7f63f8197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fc94a640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f8106160 0x7f63f8197b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fc94a640 1 -- 172.21.15.69:0/3960261907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63f8101090 msgr2=0x7f63f8197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fc94a640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63f8101090 0x7f63f8197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fc94a640 1 -- 172.21.15.69:0/3960261907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f819c9f0 con 0x7f63f819bf00 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63f7fff640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63f8101090 0x7f63f8197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:36:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63f77fe640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f8106160 0x7f63f8197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:36:57.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63fc94a640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63f819bf00 0x7f63f819c3b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f63f0005cc0 tx=0x7f63f0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:57.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.148+0000 7f63f57fa640 1 -- 172.21.15.69:0/3960261907 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f00317d0 con 0x7f63f819bf00 2024-04-23T10:36:57.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.149+0000 7f63f57fa640 1 -- 172.21.15.69:0/3960261907 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f63f0004510 con 0x7f63f819bf00 2024-04-23T10:36:57.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.149+0000 7f63fe3ad640 1 -- 172.21.15.69:0/3960261907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f819cc80 con 0x7f63f819bf00 2024-04-23T10:36:57.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.149+0000 7f63f57fa640 1 -- 172.21.15.69:0/3960261907 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f002fda0 con 0x7f63f819bf00 2024-04-23T10:36:57.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.149+0000 7f63fe3ad640 1 -- 172.21.15.69:0/3960261907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f81a44a0 con 0x7f63f819bf00 2024-04-23T10:36:57.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.150+0000 7f63fe3ad640 1 -- 172.21.15.69:0/3960261907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f8068d70 con 0x7f63f819bf00 2024-04-23T10:36:57.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.151+0000 7f63f57fa640 1 -- 172.21.15.69:0/3960261907 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f63f0004040 con 0x7f63f819bf00 2024-04-23T10:36:57.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.151+0000 7f63f57fa640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f63e00a3d20 0x7f63e00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.151+0000 7f63f7fff640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f63e00a3d20 0x7f63e00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:57.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.151+0000 7f63f57fa640 1 -- 172.21.15.69:0/3960261907 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7f63f00f1e80 con 0x7f63f819bf00 2024-04-23T10:36:57.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.152+0000 7f63f7fff640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f63e00a3d20 0x7f63e00a61e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63e80058c0 tx=0x7f63e8005d30 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:57.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.156+0000 7f63f57fa640 1 -- 172.21.15.69:0/3960261907 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f63f0004330 con 0x7f63f819bf00 2024-04-23T10:36:57.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.332+0000 7f63fe3ad640 1 -- 172.21.15.69:0/3960261907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f63f8101a40 con 0x7f63f819bf00 2024-04-23T10:36:57.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.332+0000 7f63f57fa640 1 -- 172.21.15.69:0/3960261907 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) ==== 93+0+10 (secure 0 0 0) 0x7f63f00be630 con 0x7f63f819bf00 2024-04-23T10:36:57.331 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:36:57.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.334+0000 7f63fe3ad640 1 -- 172.21.15.69:0/3960261907 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f63e00a3d20 msgr2=0x7f63e00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.334+0000 7f63fe3ad640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f63e00a3d20 0x7f63e00a61e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63e80058c0 tx=0x7f63e8005d30 comp rx=0 tx=0).stop 2024-04-23T10:36:57.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.334+0000 7f63fe3ad640 1 -- 172.21.15.69:0/3960261907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63f819bf00 msgr2=0x7f63f819c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.334+0000 7f63fe3ad640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63f819bf00 0x7f63f819c3b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f63f0005cc0 tx=0x7f63f0003f90 comp rx=0 tx=0).stop 2024-04-23T10:36:57.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.334+0000 7f63fe3ad640 1 -- 172.21.15.69:0/3960261907 shutdown_connections 2024-04-23T10:36:57.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.334+0000 7f63fe3ad640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f63e00a3d20 0x7f63e00a61e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.334+0000 7f63fe3ad640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63f819bf00 0x7f63f819c3b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.334+0000 7f63fe3ad640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63f8106160 0x7f63f8197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.334+0000 7f63fe3ad640 1 --2- 172.21.15.69:0/3960261907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63f8101090 0x7f63f8197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.334+0000 7f63fe3ad640 1 -- 172.21.15.69:0/3960261907 >> 172.21.15.69:0/3960261907 conn(0x7f63f8077f50 msgr2=0x7f63f80fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:57.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.335+0000 7f63fe3ad640 1 -- 172.21.15.69:0/3960261907 shutdown_connections 2024-04-23T10:36:57.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.335+0000 7f63fe3ad640 1 -- 172.21.15.69:0/3960261907 wait complete. 2024-04-23T10:36:57.343 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:57 smithi069 ceph-mon[29593]: pgmap v313: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:57.343 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:57 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/852119046' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:36:57.344 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:36:57.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.447+0000 7fd8766e8640 1 -- 172.21.15.69:0/2093127352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd870101a60 msgr2=0x7fd870105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.447+0000 7fd8766e8640 1 --2- 172.21.15.69:0/2093127352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd870101a60 0x7fd870105aa0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd864009900 tx=0x7fd86402a410 comp rx=0 tx=0).stop 2024-04-23T10:36:57.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.447+0000 7fd8766e8640 1 -- 172.21.15.69:0/2093127352 shutdown_connections 2024-04-23T10:36:57.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.447+0000 7fd8766e8640 1 --2- 172.21.15.69:0/2093127352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd870101a60 0x7fd870105aa0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.447+0000 7fd8766e8640 1 --2- 172.21.15.69:0/2093127352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd870106180 0x7fd87010dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.447+0000 7fd8766e8640 1 --2- 172.21.15.69:0/2093127352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8701010b0 0x7fd870101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.447+0000 7fd8766e8640 1 -- 172.21.15.69:0/2093127352 >> 172.21.15.69:0/2093127352 conn(0x7fd8700771d0 msgr2=0x7fd8700775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:57.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.447+0000 7fd8766e8640 1 -- 172.21.15.69:0/2093127352 shutdown_connections 2024-04-23T10:36:57.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.447+0000 7fd8766e8640 1 -- 172.21.15.69:0/2093127352 wait complete. 2024-04-23T10:36:57.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.447+0000 7fd8766e8640 1 Processor -- start 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.447+0000 7fd8766e8640 1 -- start start 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd8766e8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8701010b0 0x7fd87019e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd8766e8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd870106180 0x7fd87019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd8766e8640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd870198660 0x7fd870198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd8766e8640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd870112360 con 0x7fd870198660 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd8766e8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701121e0 con 0x7fd8701010b0 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd8766e8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8701124e0 con 0x7fd870106180 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd874c85640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd870198660 0x7fd870198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd874c85640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd870198660 0x7fd870198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34150/0 (socket says 172.21.15.69:34150) 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd874c85640 1 -- 172.21.15.69:0/2010862376 learned_addr learned my addr 172.21.15.69:0/2010862376 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd86ffff640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8701010b0 0x7fd87019e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:57.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd86f7fe640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd870106180 0x7fd87019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:57.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd874c85640 1 -- 172.21.15.69:0/2010862376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd870106180 msgr2=0x7fd87019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd874c85640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd870106180 0x7fd87019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd874c85640 1 -- 172.21.15.69:0/2010862376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8701010b0 msgr2=0x7fd87019e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd874c85640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8701010b0 0x7fd87019e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd874c85640 1 -- 172.21.15.69:0/2010862376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd870199260 con 0x7fd870198660 2024-04-23T10:36:57.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd86f7fe640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd870106180 0x7fd87019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:36:57.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd874c85640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd870198660 0x7fd870198ae0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd86800b970 tx=0x7fd86800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:57.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.448+0000 7fd86d7fa640 1 -- 172.21.15.69:0/2010862376 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd868019070 con 0x7fd870198660 2024-04-23T10:36:57.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.449+0000 7fd86d7fa640 1 -- 172.21.15.69:0/2010862376 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd86800cb40 con 0x7fd870198660 2024-04-23T10:36:57.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.449+0000 7fd86d7fa640 1 -- 172.21.15.69:0/2010862376 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd868007650 con 0x7fd870198660 2024-04-23T10:36:57.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.449+0000 7fd8766e8640 1 -- 172.21.15.69:0/2010862376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8701a5340 con 0x7fd870198660 2024-04-23T10:36:57.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.449+0000 7fd8766e8640 1 -- 172.21.15.69:0/2010862376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8701a5740 con 0x7fd870198660 2024-04-23T10:36:57.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.449+0000 7fd8766e8640 1 -- 172.21.15.69:0/2010862376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd870102580 con 0x7fd870198660 2024-04-23T10:36:57.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.451+0000 7fd86d7fa640 1 -- 172.21.15.69:0/2010862376 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fd86801c070 con 0x7fd870198660 2024-04-23T10:36:57.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.451+0000 7fd86d7fa640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd8580a3da0 0x7fd8580a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.451+0000 7fd86ffff640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd8580a3da0 0x7fd8580a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:57.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.451+0000 7fd86d7fa640 1 -- 172.21.15.69:0/2010862376 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7fd8680cfbc0 con 0x7fd870198660 2024-04-23T10:36:57.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.452+0000 7fd86ffff640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd8580a3da0 0x7fd8580a6260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8600058c0 tx=0x7fd86000a2d0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:57.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.456+0000 7fd86d7fa640 1 -- 172.21.15.69:0/2010862376 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd86809bd00 con 0x7fd870198660 2024-04-23T10:36:57.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:57 smithi167 ceph-mon[32940]: pgmap v313: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:57.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:57 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/852119046' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:36:57.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.632+0000 7fd8766e8640 1 -- 172.21.15.69:0/2010862376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd8700691c0 con 0x7fd870198660 2024-04-23T10:36:57.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.632+0000 7fd86d7fa640 1 -- 172.21.15.69:0/2010862376 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) ==== 104+0+11 (secure 0 0 0) 0x7fd8680a0000 con 0x7fd870198660 2024-04-23T10:36:57.631 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-04-23T10:36:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 -- 172.21.15.69:0/2010862376 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd8580a3da0 msgr2=0x7fd8580a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd8580a3da0 0x7fd8580a6260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8600058c0 tx=0x7fd86000a2d0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 -- 172.21.15.69:0/2010862376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd870198660 msgr2=0x7fd870198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd870198660 0x7fd870198ae0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd86800b970 tx=0x7fd86800be30 comp rx=0 tx=0).stop 2024-04-23T10:36:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 -- 172.21.15.69:0/2010862376 shutdown_connections 2024-04-23T10:36:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd8580a3da0 0x7fd8580a6260 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd870198660 0x7fd870198ae0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd870106180 0x7fd87019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 --2- 172.21.15.69:0/2010862376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8701010b0 0x7fd87019e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 -- 172.21.15.69:0/2010862376 >> 172.21.15.69:0/2010862376 conn(0x7fd8700771d0 msgr2=0x7fd8700fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:57.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 -- 172.21.15.69:0/2010862376 shutdown_connections 2024-04-23T10:36:57.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.634+0000 7fd8766e8640 1 -- 172.21.15.69:0/2010862376 wait complete. 2024-04-23T10:36:57.643 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:36:57.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:57 smithi146 ceph-mon[32800]: pgmap v313: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:36:57.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:57 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/852119046' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:36:57.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.746+0000 7f1debacf640 1 -- 172.21.15.69:0/1780209357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de4103af0 msgr2=0x7f1de410bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.746+0000 7f1debacf640 1 --2- 172.21.15.69:0/1780209357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de4103af0 0x7f1de410bfd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009900 tx=0x7f1de002a510 comp rx=0 tx=0).stop 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.746+0000 7f1debacf640 1 -- 172.21.15.69:0/1780209357 shutdown_connections 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.746+0000 7f1debacf640 1 --2- 172.21.15.69:0/1780209357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de4103af0 0x7f1de410bfd0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.746+0000 7f1debacf640 1 --2- 172.21.15.69:0/1780209357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1de410c510 0x7f1de410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.746+0000 7f1debacf640 1 --2- 172.21.15.69:0/1780209357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de41031d0 0x7f1de41035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.746+0000 7f1debacf640 1 -- 172.21.15.69:0/1780209357 >> 172.21.15.69:0/1780209357 conn(0x7f1de4077f50 msgr2=0x7f1de4078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.746+0000 7f1debacf640 1 -- 172.21.15.69:0/1780209357 shutdown_connections 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.746+0000 7f1debacf640 1 -- 172.21.15.69:0/1780209357 wait complete. 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.746+0000 7f1debacf640 1 Processor -- start 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1debacf640 1 -- start start 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1debacf640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de41031d0 0x7f1de419e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1debacf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de4103af0 0x7f1de419e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1debacf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1de410c510 0x7f1de4198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1debacf640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1de4112340 con 0x7f1de41031d0 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1debacf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1de41121c0 con 0x7f1de4103af0 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1debacf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1de41124c0 con 0x7f1de410c510 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1de986b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de41031d0 0x7f1de419e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1de986b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de41031d0 0x7f1de419e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34174/0 (socket says 172.21.15.69:34174) 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1de986b640 1 -- 172.21.15.69:0/1033714179 learned_addr learned my addr 172.21.15.69:0/1033714179 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1de986b640 1 -- 172.21.15.69:0/1033714179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1de410c510 msgr2=0x7f1de4198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1de906a640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de4103af0 0x7f1de419e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1de986b640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1de410c510 0x7f1de4198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1de986b640 1 -- 172.21.15.69:0/1033714179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de4103af0 msgr2=0x7f1de419e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1de986b640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de4103af0 0x7f1de419e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1de986b640 1 -- 172.21.15.69:0/1033714179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de4198da0 con 0x7f1de41031d0 2024-04-23T10:36:57.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1de986b640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de41031d0 0x7f1de419e470 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c920 tx=0x7f1dd400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:57.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1ddaffd640 1 -- 172.21.15.69:0/1033714179 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4007c70 con 0x7f1de41031d0 2024-04-23T10:36:57.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1debacf640 1 -- 172.21.15.69:0/1033714179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de4199090 con 0x7f1de41031d0 2024-04-23T10:36:57.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1ddaffd640 1 -- 172.21.15.69:0/1033714179 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1dd4007e10 con 0x7f1de41031d0 2024-04-23T10:36:57.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1ddaffd640 1 -- 172.21.15.69:0/1033714179 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40188c0 con 0x7f1de41031d0 2024-04-23T10:36:57.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.747+0000 7f1debacf640 1 -- 172.21.15.69:0/1033714179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de41a5330 con 0x7f1de41031d0 2024-04-23T10:36:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.748+0000 7f1debacf640 1 -- 172.21.15.69:0/1033714179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1de4068d70 con 0x7f1de41031d0 2024-04-23T10:36:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.749+0000 7f1ddaffd640 1 -- 172.21.15.69:0/1033714179 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f1dd4018a60 con 0x7f1de41031d0 2024-04-23T10:36:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.750+0000 7f1ddaffd640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1dd00a3d20 0x7f1dd00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.750+0000 7f1de906a640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1dd00a3d20 0x7f1dd00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.750+0000 7f1ddaffd640 1 -- 172.21.15.69:0/1033714179 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7f1dd40d0cb0 con 0x7f1de41031d0 2024-04-23T10:36:57.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.750+0000 7f1de906a640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1dd00a3d20 0x7f1dd00a61e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1de00096c0 tx=0x7f1de0000bc0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.753+0000 7f1ddaffd640 1 -- 172.21.15.69:0/1033714179 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1dd4014030 con 0x7f1de41031d0 2024-04-23T10:36:57.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.929+0000 7f1debacf640 1 -- 172.21.15.69:0/1033714179 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1de41a5730 con 0x7f1de41031d0 2024-04-23T10:36:57.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.930+0000 7f1ddaffd640 1 -- 172.21.15.69:0/1033714179 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) ==== 100+0+11 (secure 0 0 0) 0x7f1dd409d3e0 con 0x7f1de41031d0 2024-04-23T10:36:57.929 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-04-23T10:36:57.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.931+0000 7f1debacf640 1 -- 172.21.15.69:0/1033714179 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1dd00a3d20 msgr2=0x7f1dd00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.931+0000 7f1debacf640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1dd00a3d20 0x7f1dd00a61e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1de00096c0 tx=0x7f1de0000bc0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.931+0000 7f1debacf640 1 -- 172.21.15.69:0/1033714179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de41031d0 msgr2=0x7f1de419e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:57.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.931+0000 7f1debacf640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de41031d0 0x7f1de419e470 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c920 tx=0x7f1dd400cde0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.932+0000 7f1debacf640 1 -- 172.21.15.69:0/1033714179 shutdown_connections 2024-04-23T10:36:57.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.932+0000 7f1debacf640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f1dd00a3d20 0x7f1dd00a61e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.932+0000 7f1debacf640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1de410c510 0x7f1de4198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.932+0000 7f1debacf640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1de4103af0 0x7f1de419e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.932+0000 7f1debacf640 1 --2- 172.21.15.69:0/1033714179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de41031d0 0x7f1de419e470 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:57.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.932+0000 7f1debacf640 1 -- 172.21.15.69:0/1033714179 >> 172.21.15.69:0/1033714179 conn(0x7f1de4077f50 msgr2=0x7f1de40fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:57.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.932+0000 7f1debacf640 1 -- 172.21.15.69:0/1033714179 shutdown_connections 2024-04-23T10:36:57.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:57.932+0000 7f1debacf640 1 -- 172.21.15.69:0/1033714179 wait complete. 2024-04-23T10:36:57.941 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-23T10:36:58.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.039+0000 7f531cdfe640 1 -- 172.21.15.69:0/3409225957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5318106160 msgr2=0x7f531810dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:58.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.039+0000 7f531cdfe640 1 --2- 172.21.15.69:0/3409225957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5318106160 0x7f531810dd30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5310009ca0 tx=0x7f531002a8c0 comp rx=0 tx=0).stop 2024-04-23T10:36:58.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.039+0000 7f531cdfe640 1 -- 172.21.15.69:0/3409225957 shutdown_connections 2024-04-23T10:36:58.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.039+0000 7f531cdfe640 1 --2- 172.21.15.69:0/3409225957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5318106160 0x7f531810dd30 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:58.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.039+0000 7f531cdfe640 1 --2- 172.21.15.69:0/3409225957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5318101a40 0x7f5318105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:58.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.039+0000 7f531cdfe640 1 --2- 172.21.15.69:0/3409225957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5318101090 0x7f5318101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:58.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.039+0000 7f531cdfe640 1 -- 172.21.15.69:0/3409225957 >> 172.21.15.69:0/3409225957 conn(0x7f53180771d0 msgr2=0x7f53180775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:58.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.039+0000 7f531cdfe640 1 -- 172.21.15.69:0/3409225957 shutdown_connections 2024-04-23T10:36:58.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.039+0000 7f531cdfe640 1 -- 172.21.15.69:0/3409225957 wait complete. 2024-04-23T10:36:58.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f531cdfe640 1 Processor -- start 2024-04-23T10:36:58.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f531cdfe640 1 -- start start 2024-04-23T10:36:58.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f531cdfe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5318101090 0x7f531819e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:58.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f531cdfe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5318106160 0x7f531819e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:58.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f531cdfe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5318198600 0x7f5318198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:58.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f531cdfe640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5318112300 con 0x7f5318198600 2024-04-23T10:36:58.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f531cdfe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5318112180 con 0x7f5318101090 2024-04-23T10:36:58.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f531cdfe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5318112480 con 0x7f5318106160 2024-04-23T10:36:58.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f5316d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5318198600 0x7f5318198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:58.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f5316d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5318198600 0x7f5318198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34182/0 (socket says 172.21.15.69:34182) 2024-04-23T10:36:58.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f5316d9d640 1 -- 172.21.15.69:0/2402180094 learned_addr learned my addr 172.21.15.69:0/2402180094 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:36:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f531659c640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5318101090 0x7f531819e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.040+0000 7f5315d9b640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5318106160 0x7f531819e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f5316d9d640 1 -- 172.21.15.69:0/2402180094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5318106160 msgr2=0x7f531819e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:58.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f5316d9d640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5318106160 0x7f531819e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:58.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f5316d9d640 1 -- 172.21.15.69:0/2402180094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5318101090 msgr2=0x7f531819e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:58.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f5316d9d640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5318101090 0x7f531819e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:58.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f5316d9d640 1 -- 172.21.15.69:0/2402180094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5318199120 con 0x7f5318198600 2024-04-23T10:36:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f531659c640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5318101090 0x7f531819e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:36:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f5315d9b640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5318106160 0x7f531819e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:36:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f5316d9d640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5318198600 0x7f5318198ab0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5310005e30 tx=0x7f5310003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f53077fe640 1 -- 172.21.15.69:0/2402180094 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5310031650 con 0x7f5318198600 2024-04-23T10:36:58.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f53077fe640 1 -- 172.21.15.69:0/2402180094 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f53100317f0 con 0x7f5318198600 2024-04-23T10:36:58.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f531cdfe640 1 -- 172.21.15.69:0/2402180094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53181993b0 con 0x7f5318198600 2024-04-23T10:36:58.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f53077fe640 1 -- 172.21.15.69:0/2402180094 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531002fb70 con 0x7f5318198600 2024-04-23T10:36:58.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.041+0000 7f531cdfe640 1 -- 172.21.15.69:0/2402180094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53181a5600 con 0x7f5318198600 2024-04-23T10:36:58.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.042+0000 7f531cdfe640 1 -- 172.21.15.69:0/2402180094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5318102560 con 0x7f5318198600 2024-04-23T10:36:58.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.043+0000 7f53077fe640 1 -- 172.21.15.69:0/2402180094 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f531002fd10 con 0x7f5318198600 2024-04-23T10:36:58.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.044+0000 7f53077fe640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f53000a3d20 0x7f53000a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:36:58.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.044+0000 7f531659c640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f53000a3d20 0x7f53000a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:36:58.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.044+0000 7f53077fe640 1 -- 172.21.15.69:0/2402180094 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7f53100f1e30 con 0x7f5318198600 2024-04-23T10:36:58.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.044+0000 7f531659c640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f53000a3d20 0x7f53000a61e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53080058c0 tx=0x7f5308005850 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:36:58.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.048+0000 7f53077fe640 1 -- 172.21.15.69:0/2402180094 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f53100be5e0 con 0x7f5318198600 2024-04-23T10:36:58.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.280+0000 7f531cdfe640 1 -- 172.21.15.69:0/2402180094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f53180691c0 con 0x7f5318198600 2024-04-23T10:36:58.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.288+0000 7f53077fe640 1 -- 172.21.15.69:0/2402180094 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+746058 (secure 0 0 0) 0x7f53180691c0 con 0x7f5318198600 2024-04-23T10:36:58.301 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:36:58.301 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:36:58.301 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 25, 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: "active_gid": 24836, 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: "active_name": "x", 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: "active_addrs": { 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:6800", 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 908508073 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.302 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2024-04-23T10:36:58.303 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:6801", 2024-04-23T10:36:58.303 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 908508073 2024-04-23T10:36:58.303 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.303 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:36:58.303 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.303 INFO:teuthology.orchestra.run.smithi069.stdout: "active_addr": "172.21.15.69:6801/908508073", 2024-04-23T10:36:58.303 INFO:teuthology.orchestra.run.smithi069.stdout: "active_change": "2024-04-23T10:26:53.261729+0000", 2024-04-23T10:36:58.303 INFO:teuthology.orchestra.run.smithi069.stdout: "active_mgr_features": 4540701547738038271, 2024-04-23T10:36:58.303 INFO:teuthology.orchestra.run.smithi069.stdout: "available": true, 2024-04-23T10:36:58.303 INFO:teuthology.orchestra.run.smithi069.stdout: "standbys": [ 2024-04-23T10:36:58.304 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.304 INFO:teuthology.orchestra.run.smithi069.stdout: "gid": 24830, 2024-04-23T10:36:58.304 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "y", 2024-04-23T10:36:58.304 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_features": 4540701547738038271, 2024-04-23T10:36:58.304 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2024-04-23T10:36:58.304 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.304 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2024-04-23T10:36:58.304 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.304 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.305 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.305 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:58.305 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:58.305 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.305 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.305 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.305 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:58.305 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.305 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.305 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.305 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2024-04-23T10:36:58.306 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.306 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.306 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.306 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.306 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.306 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.306 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.306 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.306 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.307 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.307 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.307 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.307 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.307 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.307 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.307 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.307 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.307 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.308 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.308 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.308 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.308 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.308 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.308 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.308 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.308 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.308 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.308 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.309 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.309 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.309 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.309 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.309 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.309 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.309 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.309 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.310 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.310 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.310 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.310 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.310 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.310 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.310 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.310 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.311 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.311 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.311 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.314 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.315 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.315 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.315 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.315 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.316 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.316 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.316 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.316 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.316 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.316 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.317 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.317 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.317 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.317 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.317 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.317 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.317 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.318 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.318 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.318 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.318 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.318 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.318 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.318 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.318 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.319 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.319 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2024-04-23T10:36:58.319 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2024-04-23T10:36:58.319 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.319 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.319 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.319 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.320 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.320 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.320 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.320 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2024-04-23T10:36:58.320 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.320 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.320 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.320 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.320 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2024-04-23T10:36:58.321 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2024-04-23T10:36:58.321 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.321 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.321 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.321 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2024-04-23T10:36:58.321 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.321 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.322 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.322 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2024-04-23T10:36:58.322 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.322 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.322 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.322 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.323 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2024-04-23T10:36:58.323 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2024-04-23T10:36:58.323 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.323 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.323 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.323 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.323 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.323 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.324 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.324 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2024-04-23T10:36:58.324 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.324 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.324 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.324 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.324 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2024-04-23T10:36:58.324 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2024-04-23T10:36:58.325 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.325 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.325 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.325 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.325 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.325 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.325 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.325 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2024-04-23T10:36:58.326 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.326 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.326 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.326 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.326 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2024-04-23T10:36:58.326 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2024-04-23T10:36:58.326 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.326 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.326 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.326 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.327 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.328 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.328 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.328 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.328 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.328 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.328 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2024-04-23T10:36:58.328 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.328 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.328 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.329 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.329 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2024-04-23T10:36:58.329 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2024-04-23T10:36:58.329 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.329 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.329 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.329 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.330 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.330 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.330 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.330 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-23T10:36:58.330 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.330 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.330 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.331 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.331 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2024-04-23T10:36:58.331 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2024-04-23T10:36:58.331 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.331 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.331 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.331 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.331 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.331 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.332 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.332 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2024-04-23T10:36:58.332 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.332 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.332 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.333 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.333 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.333 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.333 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.333 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2024-04-23T10:36:58.333 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.333 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.333 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.333 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2024-04-23T10:36:58.333 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2024-04-23T10:36:58.334 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.334 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.334 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.334 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.334 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.334 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.334 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.334 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2024-04-23T10:36:58.334 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.335 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.335 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.335 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.335 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2024-04-23T10:36:58.335 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2024-04-23T10:36:58.335 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.335 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.335 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.335 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2024-04-23T10:36:58.335 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.335 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.336 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.336 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2024-04-23T10:36:58.336 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T10:36:58.336 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.336 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.336 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.336 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2024-04-23T10:36:58.336 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2024-04-23T10:36:58.336 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:58.337 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.337 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.337 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:58.337 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-04-23T10:36:58.337 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-04-23T10:36:58.337 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.337 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-23T10:36:58.337 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T10:36:58.337 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.337 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.337 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.338 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2024-04-23T10:36:58.338 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2024-04-23T10:36:58.338 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:58.338 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.338 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.338 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2024-04-23T10:36:58.338 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:58.338 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2024-04-23T10:36:58.339 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.339 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-23T10:36:58.339 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.339 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.339 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.339 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.339 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2024-04-23T10:36:58.339 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2024-04-23T10:36:58.339 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.339 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.340 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.340 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2024-04-23T10:36:58.340 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.340 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.340 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.340 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-23T10:36:58.340 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-23T10:36:58.340 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.340 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.340 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.341 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2024-04-23T10:36:58.341 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2024-04-23T10:36:58.341 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:58.341 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.341 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.341 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2024-04-23T10:36:58.341 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2024-04-23T10:36:58.341 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2024-04-23T10:36:58.341 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.341 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.342 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.343 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.343 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2024-04-23T10:36:58.343 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T10:36:58.343 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.343 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.343 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.343 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2024-04-23T10:36:58.343 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2024-04-23T10:36:58.343 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:58.343 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.344 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.344 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:58.344 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-04-23T10:36:58.344 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-04-23T10:36:58.344 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.344 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-23T10:36:58.344 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T10:36:58.344 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.345 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.345 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.345 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.345 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.345 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.345 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.345 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.345 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.345 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.345 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.345 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.346 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.346 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.346 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.346 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.346 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.346 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.346 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.346 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.347 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.347 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.347 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.347 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.347 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.347 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.347 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.347 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.347 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.347 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.348 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.348 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.348 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.348 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.348 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.348 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.348 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.349 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.349 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.349 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.349 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.349 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.349 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.349 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.350 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.350 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.350 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.350 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.350 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.350 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.350 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.350 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.351 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.351 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.351 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.351 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.351 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.351 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.351 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.352 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.352 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.352 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.352 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.352 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.352 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.352 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.352 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.353 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.353 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.353 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.353 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.353 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.354 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.354 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2024-04-23T10:36:58.354 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2024-04-23T10:36:58.354 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:58.354 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.354 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.354 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:58.354 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.354 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.355 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.355 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-23T10:36:58.355 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.355 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.355 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.355 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.355 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-04-23T10:36:58.356 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-04-23T10:36:58.356 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.356 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.356 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.356 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2024-04-23T10:36:58.357 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.357 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.357 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.357 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2024-04-23T10:36:58.357 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2024-04-23T10:36:58.357 INFO:teuthology.orchestra.run.smithi069.stdout: "read", 2024-04-23T10:36:58.357 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap", 2024-04-23T10:36:58.357 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap-read" 2024-04-23T10:36:58.357 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.358 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2024-04-23T10:36:58.358 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.358 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.358 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.358 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.358 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2024-04-23T10:36:58.358 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2024-04-23T10:36:58.358 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.358 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.359 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.359 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.359 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.359 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.359 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.359 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-23T10:36:58.359 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.359 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.360 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.360 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.360 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:58.360 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:58.360 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.360 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.360 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.360 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:58.360 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.360 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.360 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.361 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-23T10:36:58.361 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.361 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.361 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.361 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.361 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2024-04-23T10:36:58.361 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2024-04-23T10:36:58.361 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.362 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.362 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.362 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:58.362 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:58.362 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.362 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.362 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-23T10:36:58.362 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-23T10:36:58.362 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.363 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.363 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.363 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2024-04-23T10:36:58.363 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2024-04-23T10:36:58.363 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:58.363 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.363 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.363 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.363 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2024-04-23T10:36:58.364 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.365 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.365 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.365 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2024-04-23T10:36:58.365 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2024-04-23T10:36:58.365 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:58.365 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.365 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.365 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-04-23T10:36:58.365 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.366 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.366 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.366 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-23T10:36:58.366 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.366 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.366 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.366 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.366 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2024-04-23T10:36:58.367 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2024-04-23T10:36:58.367 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.367 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.367 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.367 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2024-04-23T10:36:58.367 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.367 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.367 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.367 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-23T10:36:58.367 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.367 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.368 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.368 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.368 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2024-04-23T10:36:58.368 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2024-04-23T10:36:58.368 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.368 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.368 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.368 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2024-04-23T10:36:58.369 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.369 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.369 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.369 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-23T10:36:58.369 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.370 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.370 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.370 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.370 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2024-04-23T10:36:58.370 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2024-04-23T10:36:58.370 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.370 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.371 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.371 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.371 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.371 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.371 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.371 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-23T10:36:58.371 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-23T10:36:58.371 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.372 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.372 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.372 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2024-04-23T10:36:58.372 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2024-04-23T10:36:58.372 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.372 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.372 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.373 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:58.373 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.373 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.373 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.373 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-23T10:36:58.373 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.373 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.373 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.374 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.374 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2024-04-23T10:36:58.374 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2024-04-23T10:36:58.374 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:58.374 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.374 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.375 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2024-04-23T10:36:58.375 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.375 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.375 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.375 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-23T10:36:58.375 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.375 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.375 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.375 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.376 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm_log_destination": { 2024-04-23T10:36:58.376 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm_log_destination", 2024-04-23T10:36:58.376 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.376 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.376 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.376 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.376 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.376 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.376 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.377 INFO:teuthology.orchestra.run.smithi069.stdout: "file", 2024-04-23T10:36:58.377 INFO:teuthology.orchestra.run.smithi069.stdout: "file,syslog", 2024-04-23T10:36:58.377 INFO:teuthology.orchestra.run.smithi069.stdout: "syslog" 2024-04-23T10:36:58.377 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.377 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-23T10:36:58.377 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.377 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.377 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.377 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.377 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2024-04-23T10:36:58.378 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2024-04-23T10:36:58.378 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.378 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.378 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.378 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.378 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.378 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.378 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.379 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-23T10:36:58.379 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.379 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.379 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.379 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.379 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2024-04-23T10:36:58.379 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2024-04-23T10:36:58.380 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.380 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.380 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.380 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.380 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.380 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.380 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.381 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-23T10:36:58.381 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.381 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.381 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.381 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.381 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2024-04-23T10:36:58.381 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2024-04-23T10:36:58.381 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.382 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.382 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.382 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.382 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.382 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.382 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.382 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-23T10:36:58.382 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.383 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.383 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.383 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.383 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2024-04-23T10:36:58.383 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2024-04-23T10:36:58.383 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.383 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.383 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.383 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-23T10:36:58.383 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.384 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.384 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.384 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:58.384 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.384 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.384 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.384 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.385 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2024-04-23T10:36:58.385 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2024-04-23T10:36:58.385 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.385 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.385 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.385 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-23T10:36:58.385 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.385 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.386 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.386 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2024-04-23T10:36:58.386 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.386 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.386 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.386 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.387 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2024-04-23T10:36:58.387 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2024-04-23T10:36:58.387 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.387 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.387 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.387 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-23T10:36:58.387 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.387 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.387 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.388 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2024-04-23T10:36:58.388 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.388 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.388 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.388 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.388 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2024-04-23T10:36:58.389 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2024-04-23T10:36:58.389 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.389 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.389 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.389 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-23T10:36:58.389 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.389 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.389 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.389 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:58.389 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.389 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.390 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.390 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.390 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2024-04-23T10:36:58.390 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2024-04-23T10:36:58.390 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.391 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.391 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.391 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-23T10:36:58.392 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.392 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.393 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.393 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2024-04-23T10:36:58.393 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.393 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.393 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.393 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.394 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2024-04-23T10:36:58.394 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2024-04-23T10:36:58.394 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.394 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.394 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.394 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-23T10:36:58.394 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.394 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.395 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.395 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2024-04-23T10:36:58.395 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.395 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.395 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.395 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.395 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2024-04-23T10:36:58.396 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2024-04-23T10:36:58.396 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.396 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.396 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.396 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-23T10:36:58.397 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.397 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.397 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.397 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2024-04-23T10:36:58.397 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.397 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.397 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.398 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.398 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2024-04-23T10:36:58.398 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2024-04-23T10:36:58.398 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.398 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.398 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.399 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-23T10:36:58.399 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.399 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.399 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.399 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2024-04-23T10:36:58.399 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.400 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.400 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.400 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.400 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2024-04-23T10:36:58.400 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2024-04-23T10:36:58.401 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.401 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.401 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.401 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-23T10:36:58.401 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.401 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.402 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.402 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2024-04-23T10:36:58.403 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.403 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.403 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.403 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.404 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2024-04-23T10:36:58.404 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2024-04-23T10:36:58.404 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.404 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.404 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.405 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-23T10:36:58.405 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.405 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.405 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.405 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2024-04-23T10:36:58.405 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.406 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.406 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.406 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.406 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2024-04-23T10:36:58.406 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2024-04-23T10:36:58.406 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.407 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.407 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.407 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-23T10:36:58.407 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.408 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.408 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.408 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:58.408 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.408 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.409 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.409 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.409 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_nvmeof": { 2024-04-23T10:36:58.409 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_nvmeof", 2024-04-23T10:36:58.409 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.409 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.410 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.410 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-23T10:36:58.410 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.410 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.410 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.410 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Nvme-of container image", 2024-04-23T10:36:58.411 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.411 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.411 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.411 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.411 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2024-04-23T10:36:58.411 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2024-04-23T10:36:58.412 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.412 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.412 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.412 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-23T10:36:58.412 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.412 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.412 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.412 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:58.413 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.413 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.413 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.413 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.413 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2024-04-23T10:36:58.413 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2024-04-23T10:36:58.414 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.414 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.414 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.414 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-23T10:36:58.415 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.415 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.415 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.415 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2024-04-23T10:36:58.415 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.415 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.415 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.415 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.415 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_samba": { 2024-04-23T10:36:58.415 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_samba", 2024-04-23T10:36:58.415 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Samba/SMB container image", 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2024-04-23T10:36:58.416 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2024-04-23T10:36:58.417 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.418 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.418 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.418 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.418 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.418 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.418 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.418 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2024-04-23T10:36:58.418 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.418 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.418 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.418 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.419 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.420 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.421 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.422 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.423 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "grafana_dashboards_path": { 2024-04-23T10:36:58.424 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "grafana_dashboards_path", 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.425 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "hw_monitoring": { 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hw_monitoring", 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.426 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "inventory_list_all": { 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "inventory_list_all", 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.427 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.428 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2024-04-23T10:36:58.429 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.430 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.431 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.433 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.434 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-23T10:36:58.435 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.436 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.437 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.438 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.439 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "oob_default_addr": { 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "oob_default_addr", 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "169.254.1.1", 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.440 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.441 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.442 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2024-04-23T10:36:58.443 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2024-04-23T10:36:58.444 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2024-04-23T10:36:58.445 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2024-04-23T10:36:58.446 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.447 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.448 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.449 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.450 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-23T10:36:58.451 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.452 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.453 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.454 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.455 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.456 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.457 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.458 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.459 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.460 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.461 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.462 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.463 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.464 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.465 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.466 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.467 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-23T10:36:58.468 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-23T10:36:58.469 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.470 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.471 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.472 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.473 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.474 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.475 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.476 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.477 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.478 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.479 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.480 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "[]", 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.481 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "MULTICLUSTER_CONFIG": { 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "{}", 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.482 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-23T10:36:58.483 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.484 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.485 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.486 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.487 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.488 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.489 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.490 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.491 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.492 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.493 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.494 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2024-04-23T10:36:58.495 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-23T10:36:58.496 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.497 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.498 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "UNSAFE_TLS_v1_2": { 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.499 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:58.500 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.501 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.502 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.503 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.504 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.505 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.506 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.507 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.508 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.509 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.510 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.511 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2024-04-23T10:36:58.512 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.513 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.514 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-04-23T10:36:58.515 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.515 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.515 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.515 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.517 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.517 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.518 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.520 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.521 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.522 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.523 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2024-04-23T10:36:58.524 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.525 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.526 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.527 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.528 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.529 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.530 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2024-04-23T10:36:58.531 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2024-04-23T10:36:58.532 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.533 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.534 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.535 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.536 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.537 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.538 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.539 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.540 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.541 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.542 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.543 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.544 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.546 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2024-04-23T10:36:58.547 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.548 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.549 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.551 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.552 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2024-04-23T10:36:58.553 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.554 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-23T10:36:58.555 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.556 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.557 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.558 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.559 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.560 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.561 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.562 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.563 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.564 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.565 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.566 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.567 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-23T10:36:58.568 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.569 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.570 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.571 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.572 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.573 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2024-04-23T10:36:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2024-04-23T10:36:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.583 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.584 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.585 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.586 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.587 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.588 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.589 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.590 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.591 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.592 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.593 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.594 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.595 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.596 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.597 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.598 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.599 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2024-04-23T10:36:58.600 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.601 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.602 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.603 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.604 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.605 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.606 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.607 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.608 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.609 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.610 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.611 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.612 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.613 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.614 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.615 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.616 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.617 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.618 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.619 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.620 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.621 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.622 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.623 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.624 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.625 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.626 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.627 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.628 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.629 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.630 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.631 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.632 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.633 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-23T10:36:58.634 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.635 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.636 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.637 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.638 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.639 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.640 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.641 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.642 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.643 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.644 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.645 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.646 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.647 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.648 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.649 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.650 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.651 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.652 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.653 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.654 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2024-04-23T10:36:58.655 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2024-04-23T10:36:58.655 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.655 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.655 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.655 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.655 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.655 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.655 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.655 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.656 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.657 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.658 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.659 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.660 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.661 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.662 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.663 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.664 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.665 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.666 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.667 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.668 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.669 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.670 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.671 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.672 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.673 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.674 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.675 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.676 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.677 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.678 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.679 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.680 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.681 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.682 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2024-04-23T10:36:58.683 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.684 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.685 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.686 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.687 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.688 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.689 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.690 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.691 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.692 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.694 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.695 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.696 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.697 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.698 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.699 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.700 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.701 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.702 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.703 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.704 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.705 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.706 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.707 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.708 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2024-04-23T10:36:58.709 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:58.710 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.711 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.712 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.713 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.714 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.715 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.716 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.717 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.718 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.719 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.720 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.721 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.722 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.723 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.724 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2024-04-23T10:36:58.725 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.726 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.727 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.729 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.730 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.731 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.732 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.733 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.734 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-23T10:36:58.735 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.736 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.737 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.738 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.739 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.740 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.741 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.742 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.743 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.744 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.745 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2024-04-23T10:36:58.746 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "periodic_async_work": { 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "periodic_async_work", 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.747 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Periodically check for async work", 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.748 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_no_wait": { 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_no_wait", 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-23T10:36:58.749 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:58.750 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.751 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:58.752 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.753 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.754 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.755 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.756 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.757 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.758 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.759 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.760 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: "gid": 24955, 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "z", 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_features": 4540701547738038271, 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:58.761 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.762 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.763 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.764 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.765 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.766 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.767 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2024-04-23T10:36:58.768 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.769 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.770 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.771 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2024-04-23T10:36:58.772 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.773 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.774 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.775 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.776 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2024-04-23T10:36:58.777 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2024-04-23T10:36:58.778 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.779 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2024-04-23T10:36:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.781 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.782 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.783 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.784 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.785 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.786 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.787 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "read", 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap", 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap-read" 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.788 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.789 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:58.790 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.791 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:58.792 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.793 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.794 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.795 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.796 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-23T10:36:58.797 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm_log_destination": { 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm_log_destination", 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "file", 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "file,syslog", 2024-04-23T10:36:58.798 INFO:teuthology.orchestra.run.smithi069.stdout: "syslog" 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-23T10:36:58.799 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.800 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2024-04-23T10:36:58.801 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2024-04-23T10:36:58.802 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.803 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-23T10:36:58.804 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.805 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.806 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.807 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.808 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.809 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.810 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.811 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_nvmeof": { 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_nvmeof", 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Nvme-of container image", 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2024-04-23T10:36:58.812 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.813 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_samba": { 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_samba", 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.814 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Samba/SMB container image", 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-23T10:36:58.815 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.816 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.817 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.818 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.819 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.820 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.821 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.822 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "grafana_dashboards_path": { 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "grafana_dashboards_path", 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2024-04-23T10:36:58.823 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "hw_monitoring": { 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hw_monitoring", 2024-04-23T10:36:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "inventory_list_all": { 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "inventory_list_all", 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-23T10:36:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-23T10:36:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2024-04-23T10:36:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.837 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "oob_default_addr": { 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "oob_default_addr", 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "169.254.1.1", 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-23T10:36:58.838 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.839 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.840 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.841 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2024-04-23T10:36:58.842 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2024-04-23T10:36:58.843 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.844 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.845 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.846 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.847 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.848 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.849 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.850 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.851 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.852 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.853 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.854 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.855 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.856 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.857 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.858 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.859 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.860 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.861 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.862 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.864 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-23T10:36:58.865 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-23T10:36:58.866 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.867 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.868 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.869 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.870 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.870 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.870 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.870 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.870 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.870 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.870 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.870 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.871 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-23T10:36:58.871 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-23T10:36:58.871 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.871 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.871 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.871 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.871 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.872 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.872 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.872 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.872 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.872 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.872 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.872 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.872 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2024-04-23T10:36:58.873 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-23T10:36:58.873 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.873 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.873 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.873 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-04-23T10:36:58.873 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.873 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.873 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.873 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.874 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.874 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.874 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.874 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.874 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-23T10:36:58.874 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-23T10:36:58.874 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.874 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.875 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.875 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.875 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.875 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.875 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.875 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.875 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.875 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.876 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.876 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.876 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2024-04-23T10:36:58.876 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2024-04-23T10:36:58.876 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.876 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.876 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.876 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.876 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.877 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.877 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.877 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.877 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.877 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.877 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.877 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.878 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2024-04-23T10:36:58.878 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-23T10:36:58.878 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.878 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.878 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.878 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-04-23T10:36:58.878 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.878 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.878 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.879 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.880 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.881 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.882 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "[]", 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.883 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "MULTICLUSTER_CONFIG": { 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "{}", 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2024-04-23T10:36:58.884 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.885 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.886 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.887 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.888 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.889 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.890 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.892 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.893 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.894 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-23T10:36:58.895 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.896 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.897 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.898 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.899 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.900 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "UNSAFE_TLS_v1_2": { 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.901 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.902 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.903 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.904 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.905 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.906 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.907 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.908 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.909 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.910 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.911 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.912 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.913 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.914 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.915 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.916 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.918 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.919 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.920 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.921 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.922 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.923 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.924 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.925 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.926 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.927 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.929 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.930 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.931 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2024-04-23T10:36:58.932 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:58.933 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2024-04-23T10:36:58.934 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.935 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.936 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.937 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.938 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.939 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.940 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.941 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.942 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.943 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-23T10:36:58.944 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.945 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.946 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.947 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.948 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.949 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.950 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.951 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.952 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.953 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.954 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2024-04-23T10:36:58.955 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.956 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.957 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.958 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.959 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.960 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.962 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.963 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.964 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.965 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.966 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.967 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.968 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.969 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.970 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.971 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.972 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2024-04-23T10:36:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2024-04-23T10:36:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-23T10:36:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.988 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.989 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.990 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.991 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.992 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.993 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.994 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.995 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:58.996 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:58.997 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:58.999 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.000 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-04-23T10:36:59.001 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.002 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.003 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.004 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.005 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.006 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.007 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2024-04-23T10:36:59.008 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.009 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.010 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.011 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.012 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.013 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.014 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.015 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.016 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.017 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.018 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.019 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.020 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.021 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.022 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.023 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-23T10:36:59.024 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.025 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.026 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.027 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.028 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.030 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.031 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:59.032 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2024-04-23T10:36:59.033 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.034 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.035 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.036 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.037 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.038 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.039 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.040 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.041 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:59.042 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.043 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2024-04-23T10:36:59.044 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.045 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.046 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-04-23T10:36:59.047 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.048 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.049 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.050 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.051 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.052 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.053 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.054 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.055 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.056 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.057 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.058 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.059 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.060 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-04-23T10:36:59.062 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.063 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2024-04-23T10:36:59.064 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.065 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.066 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.067 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.068 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2024-04-23T10:36:59.069 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.070 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.071 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.072 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.073 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2024-04-23T10:36:59.074 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.075 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.076 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.078 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.079 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.080 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.081 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.082 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.083 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.084 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.085 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2024-04-23T10:36:59.086 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2024-04-23T10:36:59.087 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2024-04-23T10:36:59.088 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.089 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.090 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2024-04-23T10:36:59.091 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.092 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.093 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.094 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.095 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.096 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.097 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.098 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.099 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.100 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.101 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.102 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.103 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.104 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.105 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.106 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.107 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.108 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.109 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.110 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.111 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.112 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.113 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.114 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.115 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.116 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.117 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.118 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.119 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-23T10:36:59.120 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.121 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.122 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.123 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.124 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2024-04-23T10:36:59.125 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.127 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.128 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.129 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.130 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.131 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.132 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.133 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.134 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.135 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.136 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.137 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.138 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.139 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.140 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.141 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.142 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.143 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.144 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.145 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-23T10:36:59.146 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "periodic_async_work": { 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "periodic_async_work", 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Periodically check for async work", 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.147 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.148 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_no_wait": { 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_no_wait", 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.149 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.150 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.151 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.152 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.153 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.154 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.155 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.156 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.157 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.158 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.159 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: "modules": [ 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2024-04-23T10:36:59.160 INFO:teuthology.orchestra.run.smithi069.stdout: "dashboard", 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "iostat", 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "nfs", 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "restful", 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_schedule" 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.161 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.162 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.163 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.164 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.165 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.166 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2024-04-23T10:36:59.167 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.168 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.169 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.170 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.171 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.172 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.173 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.174 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.175 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.176 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.177 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.179 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-23T10:36:59.180 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-23T10:36:59.181 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.182 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.183 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.184 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.185 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.186 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.187 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2024-04-23T10:36:59.188 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "read", 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap", 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap-read" 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2024-04-23T10:36:59.189 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:59.190 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.191 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.192 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2024-04-23T10:36:59.193 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2024-04-23T10:36:59.194 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2024-04-23T10:36:59.195 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.196 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:59.197 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2024-04-23T10:36:59.198 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm_log_destination": { 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm_log_destination", 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.199 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "file", 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "file,syslog", 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "syslog" 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.200 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.201 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.202 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.203 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.204 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.205 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.206 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2024-04-23T10:36:59.207 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.208 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-23T10:36:59.209 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.210 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.211 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.212 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_nvmeof": { 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_nvmeof", 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.213 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Nvme-of container image", 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.214 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2024-04-23T10:36:59.215 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_samba": { 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_samba", 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Samba/SMB container image", 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.216 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.217 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.218 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.219 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2024-04-23T10:36:59.220 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2024-04-23T10:36:59.221 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.222 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.223 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "grafana_dashboards_path": { 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "grafana_dashboards_path", 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.224 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:59.225 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "hw_monitoring": { 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hw_monitoring", 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.226 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "inventory_list_all": { 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "inventory_list_all", 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.227 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.228 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.229 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.230 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.231 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.232 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.233 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:59.235 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.236 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2024-04-23T10:36:59.237 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2024-04-23T10:36:59.238 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "oob_default_addr": { 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "oob_default_addr", 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "169.254.1.1", 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.239 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.240 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.241 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2024-04-23T10:36:59.242 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2024-04-23T10:36:59.243 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.244 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2024-04-23T10:36:59.245 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.246 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.247 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-23T10:36:59.248 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.249 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.250 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.251 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.252 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.253 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.254 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.255 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.256 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.257 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.258 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:59.259 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.260 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.261 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.262 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.263 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.264 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.265 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-23T10:36:59.266 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.267 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.268 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.269 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.270 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.271 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.272 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.273 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.274 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.275 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.276 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.277 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-23T10:36:59.278 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.279 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "[]", 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "MULTICLUSTER_CONFIG": { 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.280 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "{}", 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.281 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.282 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.283 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.284 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.285 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.286 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.287 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-23T10:36:59.288 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.290 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.291 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.292 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.293 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.294 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.295 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.296 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.297 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "UNSAFE_TLS_v1_2": { 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.298 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-23T10:36:59.299 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-23T10:36:59.300 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.301 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.302 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.303 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2024-04-23T10:36:59.304 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.305 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.307 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.308 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.309 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.310 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.311 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.313 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.314 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.315 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.316 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.317 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.318 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.319 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.320 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.321 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.324 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.325 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.326 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2024-04-23T10:36:59.327 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.328 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.329 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.330 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2024-04-23T10:36:59.331 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.332 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.333 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.334 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.335 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.336 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.337 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.338 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.339 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2024-04-23T10:36:59.340 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.341 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.342 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.343 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.344 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.345 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.346 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.347 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.348 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.349 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.350 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T10:36:59.351 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-23T10:36:59.352 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.353 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.354 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.355 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.356 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.357 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.358 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.359 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.360 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.361 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.362 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.363 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.364 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.365 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2024-04-23T10:36:59.366 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2024-04-23T10:36:59.367 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.367 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.367 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.367 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:59.367 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2024-04-23T10:36:59.367 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.367 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.367 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-23T10:36:59.367 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.367 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.367 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.368 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.369 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.370 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.371 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.373 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.374 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.375 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.376 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.377 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.378 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.379 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.380 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2024-04-23T10:36:59.381 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-23T10:36:59.382 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.383 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.384 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.386 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.387 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.388 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.389 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.390 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.391 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.392 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.393 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.394 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.395 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.396 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.397 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.398 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.399 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.400 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.401 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.402 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.403 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.404 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.406 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.407 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.408 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.409 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.410 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.411 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.412 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.413 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.414 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.415 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.416 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.417 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.418 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.419 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:59.420 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:59.421 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2024-04-23T10:36:59.422 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.423 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.424 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.425 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.426 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.427 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.428 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.429 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.430 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2024-04-23T10:36:59.431 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.432 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.433 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.434 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.435 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.436 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.437 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.438 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.439 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-04-23T10:36:59.440 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.441 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.442 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2024-04-23T10:36:59.443 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.444 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.445 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.446 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.447 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.448 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.449 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.450 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.451 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.452 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.453 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.454 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.455 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.456 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.457 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.458 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.459 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.460 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.461 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.462 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.463 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.464 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.465 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.466 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.467 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.468 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.469 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.470 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.471 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.472 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.473 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.474 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.475 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.476 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2024-04-23T10:36:59.477 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2024-04-23T10:36:59.478 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.479 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.480 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.481 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.482 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.483 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.484 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.485 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.486 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.487 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.488 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.489 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.490 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.491 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.492 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.493 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.494 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.495 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.496 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.497 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.498 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.499 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.500 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.501 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.502 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.503 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.504 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.505 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.506 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.507 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.508 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.509 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.510 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.511 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.512 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.513 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.514 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.515 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2024-04-23T10:36:59.516 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.517 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.518 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.519 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.520 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.521 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.522 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2024-04-23T10:36:59.523 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.524 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.525 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.526 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.528 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.529 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.530 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.531 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.532 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.533 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.534 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.535 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.536 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.537 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.538 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.539 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.540 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.541 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.542 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "periodic_async_work": { 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "periodic_async_work", 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.543 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Periodically check for async work", 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.544 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_no_wait": { 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_no_wait", 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.545 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-04-23T10:36:59.546 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.547 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.548 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.549 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.550 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.551 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.552 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2024-04-23T10:36:59.553 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.554 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-04-23T10:36:59.555 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: "services": { 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: "dashboard": "https://172.21.15.69:8443/" 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: "always_on_modules": { 2024-04-23T10:36:59.556 INFO:teuthology.orchestra.run.smithi069.stdout: "octopus": [ 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "pacific": [ 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2024-04-23T10:36:59.557 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "quincy": [ 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2024-04-23T10:36:59.558 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "reef": [ 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2024-04-23T10:36:59.559 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "squid": [ 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.560 INFO:teuthology.orchestra.run.smithi069.stdout: "last_failure_osd_epoch": 89, 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: "active_clients": [ 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 325780069 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "libcephsqlite", 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.561 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 2614823597 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3763877532 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:36:59.562 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 721885410 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.563 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3694692198 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3878630422 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:36:59.564 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:36:59.565 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-23T10:36:59.565 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:36:59.566 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:58 smithi146 ceph-mon[32800]: from='client.16215 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:36:59.566 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:58 smithi146 ceph-mon[32800]: from='client.16221 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:36:59.566 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:58 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3960261907' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:36:59.566 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:58 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2010862376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:36:59.566 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:58 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1033714179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:36:59.567 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:58 smithi167 ceph-mon[32940]: from='client.16215 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:36:59.567 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:58 smithi167 ceph-mon[32940]: from='client.16221 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:36:59.567 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:58 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3960261907' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:36:59.567 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:58 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2010862376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:36:59.567 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:58 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1033714179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:36:59.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 -- 172.21.15.69:0/2402180094 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f53000a3d20 msgr2=0x7f53000a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:59.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f53000a3d20 0x7f53000a61e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53080058c0 tx=0x7f5308005850 comp rx=0 tx=0).stop 2024-04-23T10:36:59.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 -- 172.21.15.69:0/2402180094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5318198600 msgr2=0x7f5318198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:36:59.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5318198600 0x7f5318198ab0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5310005e30 tx=0x7f5310003f90 comp rx=0 tx=0).stop 2024-04-23T10:36:59.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 -- 172.21.15.69:0/2402180094 shutdown_connections 2024-04-23T10:36:59.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f53000a3d20 0x7f53000a61e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:59.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5318198600 0x7f5318198ab0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:59.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5318106160 0x7f531819e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:59.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 --2- 172.21.15.69:0/2402180094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5318101090 0x7f531819e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:36:59.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 -- 172.21.15.69:0/2402180094 >> 172.21.15.69:0/2402180094 conn(0x7f53180771d0 msgr2=0x7f53180fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:36:59.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 -- 172.21.15.69:0/2402180094 shutdown_connections 2024-04-23T10:36:59.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:36:58.293+0000 7f531cdfe640 1 -- 172.21.15.69:0/2402180094 wait complete. 2024-04-23T10:36:59.574 DEBUG:tasks.check_counter:Getting stats from a 2024-04-23T10:36:59.574 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-23T10:36:59.574 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:58 smithi069 ceph-mon[29593]: from='client.16215 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:36:59.575 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:58 smithi069 ceph-mon[29593]: from='client.16221 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-23T10:36:59.575 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:58 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3960261907' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:36:59.575 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:58 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2010862376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:36:59.575 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:58 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1033714179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:36:59.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:59 smithi167 ceph-mon[32940]: pgmap v314: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:59.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:36:59 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2402180094' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-23T10:36:59.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:59 smithi069 ceph-mon[29593]: pgmap v314: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:59.599 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:36:59 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2402180094' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-23T10:36:59.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:59 smithi146 ceph-mon[32800]: pgmap v314: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:36:59.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:36:59 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2402180094' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-23T10:36:59.822 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:37:01.396 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:01 smithi069 ceph-mon[29593]: pgmap v315: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-23T10:37:01.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:01 smithi167 ceph-mon[32940]: pgmap v315: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 973, 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 937, 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1888032, 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 354366, 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 5, 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.126858875, 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.040618945, 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.056265834, 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.031254726, 2024-04-23T10:37:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 936, 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.047207622, 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000050435 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 1645776, 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 125088 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 650, 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 800, 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 4146005, 2024-04-23T10:37:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 640228, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 7, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 5, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.071203362, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.027330940, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.018474028, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.017854156, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 797, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.036428296, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000045706 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 434096 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 748, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 748, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 4385449, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 237041, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 5, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 4, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.067852487, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.023806839, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.017715895, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.020348078, 2024-04-23T10:37:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 747, 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.025382217, 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000033978 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 448 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 1, 2024-04-23T10:37:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-MDSRank": { 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 3532, 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.098787966, 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000027969 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-PurgeQueue": { 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": { 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "request": 0, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "reply": 0, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "reply_latency": { 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "slow_reply": 0, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "forward": 0, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_fetch_complete": 0, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_fetch_keys": 0, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_commit": 0, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_split": 0, 2024-04-23T10:37:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_merge": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes": 2016, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_top": 51, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_bottom": 1965, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_pin_tail": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_pinned": 1942, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_expired": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_with_caps": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "subtrees": 1, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_hit": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_forward": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_discover": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_dir_fetch": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_remote_ino": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_lock": 0, 2024-04-23T10:37:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "load_cent": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "q": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "exported": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "exported_inodes": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "imported": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "imported_inodes": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_dir_fetch": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_backtrace_fetch": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_peer_discover": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rfiles": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rbytes": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rsnaps": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_set_tag": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_inotable_repaired": 0, 2024-04-23T10:37:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dir_inodes": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_file_inodes": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_inode_file_caps": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_revoke": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_grant": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_caps": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_caps_dirty": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_cap_release": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "process_request_cap_release": 0 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cache": { 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_update": 0, 2024-04-23T10:37:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_update_receipt": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_try_discover": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_send_discover": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_handle_discover": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays_delayed": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays_enqueuing": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_created": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_enqueued": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_reintegrated": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_migrated": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_processing": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_enqueued": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_prioritized": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "recovery_started": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "recovery_completed": 0, 2024-04-23T10:37:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_quiesce_path": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_quiesce_inode": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_exportdir": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_flush": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_fragmentdir": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_fragstats": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_inodestats": 0 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_log": { 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "evlrg": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "evadd": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "evex": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "evtrm": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "ev": 3168, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "evexg": 0, 2024-04-23T10:37:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "evexd": 0, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "segadd": 0, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "segex": 0, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "segtrm": 0, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "seg": 5, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "segmjr": 2, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "segexg": 0, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "segexd": 0, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "expos": 4194304, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "wrpos": 12367449, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "rdpos": 12361962, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "jlat": { 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "replayed": 3168 2024-04-23T10:37:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_mem": { 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 471, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "ino+": 2133, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "ino-": 1662, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "dir": 67, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "dir+": 158, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "dir-": 91, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "dn": 2016, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "dn+": 3382, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "dn-": 1366, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "cap": 0, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "cap+": 0, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "cap-": 0, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "rss": 55896, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "heap": 215416 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_server": { 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "dispatch_client_request": 0, 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "dispatch_server_request": 0, 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_request": 0, 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_session": 0, 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_peer_request": 0, 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "req_create_latency": { 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getattr_latency": { 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getfilelock_latency": { 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "req_link_latency": { 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookup_latency": { 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookuphash_latency": { 2024-04-23T10:37:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupino_latency": { 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupname_latency": { 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupparent_latency": { 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupsnap_latency": { 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lssnap_latency": { 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mkdir_latency": { 2024-04-23T10:37:01.690 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:01 smithi146 ceph-mon[32800]: pgmap v315: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-23T10:37:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mknod_latency": { 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mksnap_latency": { 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "req_open_latency": { 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "req_readdir_latency": { 2024-04-23T10:37:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rename_latency": { 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "req_renamesnap_latency": { 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "req_snapdiff_latency": { 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmdir_latency": { 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmsnap_latency": { 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmxattr_latency": { 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setattr_latency": { 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setdirlayout_latency": { 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setfilelock_latency": { 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setlayout_latency": { 2024-04-23T10:37:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setxattr_latency": { 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "req_symlink_latency": { 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "req_unlink_latency": { 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "cap_revoke_eviction": 0, 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "cap_acquisition_throttle": 0, 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getvxattr_latency": { 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_sessions": { 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "session_count": 2, 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "session_add": 4, 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "session_remove": 2, 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "sessions_open": 3, 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "sessions_stale": 0, 2024-04-23T10:37:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "total_load": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "average_load": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "avg_session_uptime": 3182, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "mdthresh_evicted": 0 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 217867, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 587, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 8032, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 167, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 2665406, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 32129, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter": { 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 0, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2024-04-23T10:37:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 2113, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 21, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 3, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 2113, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "op_latency": { 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 2113, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 1.435966440, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000679586 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "op_inflight": 0, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 2113, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 2114 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 2113, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 2113, 2024-04-23T10:37:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 1352, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 759, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2024-04-23T10:37:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 1, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2024-04-23T10:37:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 98, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 12, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 6, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 6, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 0, 2024-04-23T10:37:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 2, 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "oft": { 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_objs": 0, 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_kv_pairs": 0, 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_updates": 0, 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_removes": 0 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "osd-slow-ops": { 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "slow_ops_count": 0 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "purge_queue": { 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_ops": 0, 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_ops_high_water": 0, 2024-04-23T10:37:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing": 0, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_high_water": 0, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executed_ops": 0, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executed": 0, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_item_in_journal": 0 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 2367, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 10190683, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 2367, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-04-23T10:37:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 2367, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 10190683, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes": { 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 2113, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 8173150, 2024-04-23T10:37:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 2113, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 8173150, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops": { 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 2113, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 2113, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 2113, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 2113, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-write_buf_throttle": { 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 3758096384, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-write_buf_throttle-0x5584c08e06e0": { 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 3758096384, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-04-23T10:37:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:01.711 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:37:02.515 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-04-23T10:37:02.515 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-04-23T10:37:02.515 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-04-23T10:37:02.515 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-04-23T10:37:02.515 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-04-23T10:37:02.515 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-04-23T10:37:02.515 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T10:37:02.515 DEBUG:tasks.check_counter:Getting stats from d 2024-04-23T10:37:02.515 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-23T10:37:02.804 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:37:03.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:03 smithi069 ceph-mon[29593]: pgmap v316: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-23T10:37:03.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:03 smithi167 ceph-mon[32940]: pgmap v316: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-23T10:37:03.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:03 smithi146 ceph-mon[32800]: pgmap v316: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-23T10:37:04.550 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:37:04.550 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:04.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 0, 2024-04-23T10:37:04.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 2, 2024-04-23T10:37:04.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 0, 2024-04-23T10:37:04.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 0, 2024-04-23T10:37:04.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.001120364, 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000000000, 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.000254075, 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:04.551 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 214, 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 204, 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1448992, 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 125344, 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.042046713, 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.013796453, 2024-04-23T10:37:04.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.031628685, 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.004251473, 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 203, 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.010588939, 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000052162 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 1448992, 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 125344 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:04.553 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 6, 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 159, 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 3312, 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 184160, 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 5, 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 3, 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.014087620, 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.009871012, 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.002235721, 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 157, 2024-04-23T10:37:04.554 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.010363425, 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000066009 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 184160 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:04.555 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:04.556 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:04.557 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 149017, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 31, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:04.558 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2024-04-23T10:37:04.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 216, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 1418830, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 216, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 216, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 1418830, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:04.560 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:04.561 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:04.561 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:04.561 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:37:05.216 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-23T10:37:05.216 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-23T10:37:05.216 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-04-23T10:37:05.216 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-04-23T10:37:05.216 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-04-23T10:37:05.217 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-04-23T10:37:05.217 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-04-23T10:37:05.217 DEBUG:tasks.check_counter:Getting stats from g 2024-04-23T10:37:05.217 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-23T10:37:05.461 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:37:05.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:05 smithi069 ceph-mon[29593]: pgmap v317: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-23T10:37:05.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:05 smithi167 ceph-mon[32940]: pgmap v317: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-23T10:37:05.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:05 smithi146 ceph-mon[32800]: pgmap v317: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-23T10:37:07.202 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 1169, 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 1171, 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1180917, 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 371743, 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 6, 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 2, 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.112052521, 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.045772695, 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.024288995, 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.031497568, 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 1169, 2024-04-23T10:37:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.047220164, 2024-04-23T10:37:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000040393 2024-04-23T10:37:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T10:37:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T10:37:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 1202, 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 1164, 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 14478770, 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 427065, 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 3, 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.112984636, 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.033281058, 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.059300747, 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.025226040, 2024-04-23T10:37:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 1164, 2024-04-23T10:37:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.034771230, 2024-04-23T10:37:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000029872 2024-04-23T10:37:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 1649312, 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 126816 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 5, 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 156, 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1668, 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 435237, 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 7, 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 5, 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.011938314, 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.007529007, 2024-04-23T10:37:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.002378340, 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000039239, 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 153, 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.009924386, 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000064865 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-23T10:37:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 434272 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 1, 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-MDSRank": { 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 3607, 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.087267641, 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000024193 2024-04-23T10:37:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-PurgeQueue": { 2024-04-23T10:37:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2024-04-23T10:37:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2024-04-23T10:37:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": { 2024-04-23T10:37:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "request": 0, 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "reply": 0, 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "reply_latency": { 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "slow_reply": 0, 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "forward": 0, 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_fetch_complete": 0, 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_fetch_keys": 0, 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_commit": 0, 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_split": 0, 2024-04-23T10:37:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_merge": 0, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes": 2766, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_top": 6, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_bottom": 2760, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_pin_tail": 0, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_pinned": 2757, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_expired": 0, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_with_caps": 0, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": 0, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "subtrees": 1, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse": 0, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_hit": 0, 2024-04-23T10:37:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_forward": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_discover": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_dir_fetch": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_remote_ino": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_lock": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "load_cent": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "q": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "exported": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "exported_inodes": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "imported": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "imported_inodes": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_dir_fetch": 0, 2024-04-23T10:37:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_backtrace_fetch": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_peer_discover": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rfiles": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rbytes": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rsnaps": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_set_tag": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_inotable_repaired": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dir_inodes": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_file_inodes": 0, 2024-04-23T10:37:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_inode_file_caps": 0, 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_revoke": 0, 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_grant": 0, 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_caps": 0, 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_caps_dirty": 0, 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_cap_release": 0, 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "process_request_cap_release": 0 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cache": { 2024-04-23T10:37:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_update": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_update_receipt": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_try_discover": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_send_discover": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_handle_discover": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays_delayed": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays_enqueuing": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_created": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_enqueued": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_reintegrated": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_migrated": 0, 2024-04-23T10:37:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_processing": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_enqueued": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_prioritized": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "recovery_started": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "recovery_completed": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_quiesce_path": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_quiesce_inode": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_exportdir": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_flush": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_fragmentdir": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_fragstats": 0, 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_inodestats": 0 2024-04-23T10:37:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_log": { 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "evlrg": 0, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "evadd": 0, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "evex": 0, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "evtrm": 0, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "ev": 5898, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "evexg": 0, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "evexd": 0, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "segadd": 0, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "segex": 0, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "segtrm": 0, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "seg": 8, 2024-04-23T10:37:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "segmjr": 2, 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "segexg": 0, 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "segexd": 0, 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "expos": 4194304, 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "wrpos": 17599408, 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "rdpos": 17596847, 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "jlat": { 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "replayed": 5898 2024-04-23T10:37:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_mem": { 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 533, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "ino+": 2807, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "ino-": 2274, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "dir": 72, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "dir+": 234, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "dir-": 162, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "dn": 2766, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "dn+": 4410, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "dn-": 1644, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "cap": 0, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "cap+": 0, 2024-04-23T10:37:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "cap-": 0, 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "rss": 56680, 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "heap": 215416 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_server": { 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "dispatch_client_request": 0, 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "dispatch_server_request": 0, 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_request": 0, 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_session": 0, 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_peer_request": 0, 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "req_create_latency": { 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getattr_latency": { 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getfilelock_latency": { 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "req_link_latency": { 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookup_latency": { 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookuphash_latency": { 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupino_latency": { 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupname_latency": { 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupparent_latency": { 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupsnap_latency": { 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lssnap_latency": { 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mkdir_latency": { 2024-04-23T10:37:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mknod_latency": { 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mksnap_latency": { 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "req_open_latency": { 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "req_readdir_latency": { 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rename_latency": { 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "req_renamesnap_latency": { 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "req_snapdiff_latency": { 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmdir_latency": { 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmsnap_latency": { 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmxattr_latency": { 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setattr_latency": { 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setdirlayout_latency": { 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setfilelock_latency": { 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setlayout_latency": { 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setxattr_latency": { 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "req_symlink_latency": { 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "req_unlink_latency": { 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "cap_revoke_eviction": 0, 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "cap_acquisition_throttle": 0, 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getvxattr_latency": { 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_sessions": { 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "session_count": 2, 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "session_add": 4, 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "session_remove": 2, 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "sessions_open": 4, 2024-04-23T10:37:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "sessions_stale": 0, 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "total_load": 0, 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "average_load": 0, 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "avg_session_uptime": 4043, 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "mdthresh_evicted": 0 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 218691, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 629, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 8032, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 167, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 3326132, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 34067, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter": { 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 0, 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 2116, 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 21, 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 3, 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 2116, 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "op_latency": { 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 2116, 2024-04-23T10:37:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 2.333945434, 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.001102998 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "op_inflight": 0, 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 2116, 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 2117 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 2116, 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 2116, 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 0, 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2024-04-23T10:37:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 1337, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 0, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 777, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 0, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2024-04-23T10:37:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 1, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2024-04-23T10:37:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2024-04-23T10:37:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 0, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 98, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 12, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 6, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 6, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 0, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 2, 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2024-04-23T10:37:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "oft": { 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_objs": 0, 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_kv_pairs": 0, 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_updates": 0, 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_removes": 0 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "osd-slow-ops": { 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "slow_ops_count": 0 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "purge_queue": { 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_ops": 0, 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_ops_high_water": 0, 2024-04-23T10:37:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing": 0, 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_high_water": 0, 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executed_ops": 0, 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executed": 0, 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_item_in_journal": 0 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 2372, 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 15431998, 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 2372, 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 2372, 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 15431998, 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes": { 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 2116, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 13407463, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 2116, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 13407463, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops": { 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 2116, 2024-04-23T10:37:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 2116, 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 2116, 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 2116, 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-write_buf_throttle": { 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 3758096384, 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-write_buf_throttle-0x5606856c86e0": { 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 3758096384, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2024-04-23T10:37:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:07.254 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:37:07.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:07 smithi069 ceph-mon[29593]: pgmap v318: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 33 op/s 2024-04-23T10:37:07.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:07 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:37:07.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:07 smithi167 ceph-mon[32940]: pgmap v318: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 33 op/s 2024-04-23T10:37:07.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:07 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:37:07.617 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:07 smithi146 ceph-mon[32800]: pgmap v318: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 33 op/s 2024-04-23T10:37:07.617 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:07 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-23T10:37:08.007 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-04-23T10:37:08.007 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-04-23T10:37:08.007 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-04-23T10:37:08.008 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-04-23T10:37:08.008 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-04-23T10:37:08.008 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-04-23T10:37:08.008 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T10:37:08.008 DEBUG:tasks.check_counter:Getting stats from j 2024-04-23T10:37:08.008 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-23T10:37:08.770 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.a/config 2024-04-23T10:37:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: pgmap v319: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-23T10:37:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.493 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:09 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: pgmap v319: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:09 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: pgmap v319: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:09.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:09 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:10.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:10 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi146 to 176.2M 2024-04-23T10:37:10.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:10 smithi069 ceph-mon[29593]: Unable to set osd_memory_target on smithi146 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-23T10:37:10.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:10 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi167 to 176.2M 2024-04-23T10:37:10.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:10 smithi069 ceph-mon[29593]: Unable to set osd_memory_target on smithi167 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-23T10:37:10.566 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-23T10:37:10.566 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:10.566 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 220, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 208, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1452528, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 127072, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.041154001, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.013481032, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.031055451, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.004168377, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 208, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.011930188, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000057356 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:10.567 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 1452528, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 127072 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 2, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 158, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 320, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 183888, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 5, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 3, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.013582515, 2024-04-23T10:37:10.568 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.009476705, 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.001811042, 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 155, 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.010260925, 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000066199 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 183888 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:10.569 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 0, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 2, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 0, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 0, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.000395153, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000000000, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.000316356, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:10.570 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2024-04-23T10:37:10.571 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:10.572 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2024-04-23T10:37:10.573 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 149057, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 32, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2024-04-23T10:37:10.574 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-04-23T10:37:10.575 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 218, 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 1419090, 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 218, 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 218, 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 1419090, 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-23T10:37:10.576 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-23T10:37:10.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:10 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi146 to 176.2M 2024-04-23T10:37:10.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:10 smithi167 ceph-mon[32940]: Unable to set osd_memory_target on smithi146 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-23T10:37:10.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:10 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi167 to 176.2M 2024-04-23T10:37:10.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:10 smithi167 ceph-mon[32940]: Unable to set osd_memory_target on smithi167 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-23T10:37:10.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:10 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi146 to 176.2M 2024-04-23T10:37:10.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:10 smithi146 ceph-mon[32800]: Unable to set osd_memory_target on smithi146 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-04-23T10:37:10.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:10 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi167 to 176.2M 2024-04-23T10:37:10.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:10 smithi146 ceph-mon[32800]: Unable to set osd_memory_target on smithi167 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-23T10:37:11.264 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-04-23T10:37:11.264 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-04-23T10:37:11.264 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-04-23T10:37:11.264 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-04-23T10:37:11.264 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-04-23T10:37:11.264 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-04-23T10:37:11.264 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-04-23T10:37:11.264 DEBUG:tasks.check_counter:Getting stats from b 2024-04-23T10:37:11.265 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-23T10:37:11.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:11 smithi069 ceph-mon[29593]: pgmap v320: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 33 op/s 2024-04-23T10:37:11.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:11 smithi069 ceph-mon[29593]: osdmap e99: 12 total, 12 up, 12 in 2024-04-23T10:37:11.503 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:37:11.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:11 smithi167 ceph-mon[32940]: pgmap v320: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 33 op/s 2024-04-23T10:37:11.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:11 smithi167 ceph-mon[32940]: osdmap e99: 12 total, 12 up, 12 in 2024-04-23T10:37:11.625 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:11 smithi146 ceph-mon[32800]: pgmap v320: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 33 op/s 2024-04-23T10:37:11.625 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:11 smithi146 ceph-mon[32800]: osdmap e99: 12 total, 12 up, 12 in 2024-04-23T10:37:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: pgmap v322: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:37:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: Adjusting osd_memory_target on smithi069 to 176.1M 2024-04-23T10:37:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: Unable to set osd_memory_target on smithi069 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-04-23T10:37:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:37:12.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:37:12.679 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:12 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:12.741 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: pgmap v322: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:37:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: Adjusting osd_memory_target on smithi069 to 176.1M 2024-04-23T10:37:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: Unable to set osd_memory_target on smithi069 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-04-23T10:37:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:37:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:37:12.742 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:12 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:12.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:12.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:12.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: pgmap v322: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:37:12.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-23T10:37:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: Adjusting osd_memory_target on smithi069 to 176.1M 2024-04-23T10:37:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: Unable to set osd_memory_target on smithi069 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-04-23T10:37:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-23T10:37:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-23T10:37:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:12 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' 2024-04-23T10:37:13.510 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-23T10:37:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 1175, 2024-04-23T10:37:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 1177, 2024-04-23T10:37:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 29727697, 2024-04-23T10:37:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 373657, 2024-04-23T10:37:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 7, 2024-04-23T10:37:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2024-04-23T10:37:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.125488949, 2024-04-23T10:37:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.040464320, 2024-04-23T10:37:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.042103964, 2024-04-23T10:37:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.031615380, 2024-04-23T10:37:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1175, 2024-04-23T10:37:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.049545256, 2024-04-23T10:37:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000042166 2024-04-23T10:37:13.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T10:37:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T10:37:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 875, 2024-04-23T10:37:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 830, 2024-04-23T10:37:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 25544321, 2024-04-23T10:37:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 320716, 2024-04-23T10:37:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 5, 2024-04-23T10:37:13.513 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2024-04-23T10:37:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.102271470, 2024-04-23T10:37:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.030350956, 2024-04-23T10:37:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.057565970, 2024-04-23T10:37:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.018645664, 2024-04-23T10:37:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 830, 2024-04-23T10:37:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.029586415, 2024-04-23T10:37:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000035646 2024-04-23T10:37:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:13.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 1679568, 2024-04-23T10:37:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 126992 2024-04-23T10:37:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 478, 2024-04-23T10:37:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 629, 2024-04-23T10:37:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 12701617, 2024-04-23T10:37:13.515 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 588872, 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 8, 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 6, 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.054223778, 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.016941971, 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.017740431, 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.014551097, 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 626, 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.023104272, 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000036907 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.516 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-23T10:37:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 437504 2024-04-23T10:37:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-04-23T10:37:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2024-04-23T10:37:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-04-23T10:37:13.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2024-04-23T10:37:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-04-23T10:37:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-04-23T10:37:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3811, 2024-04-23T10:37:13.518 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.089157364, 2024-04-23T10:37:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000023394 2024-04-23T10:37:13.519 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.520 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2024-04-23T10:37:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-04-23T10:37:13.521 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-04-23T10:37:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.522 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2024-04-23T10:37:13.523 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 0, 2024-04-23T10:37:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 0, 2024-04-23T10:37:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2024-04-23T10:37:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.525 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2024-04-23T10:37:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2024-04-23T10:37:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_complete": 0, 2024-04-23T10:37:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_keys": 0, 2024-04-23T10:37:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 0, 2024-04-23T10:37:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2024-04-23T10:37:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2024-04-23T10:37:13.526 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 5997, 2024-04-23T10:37:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 88, 2024-04-23T10:37:13.528 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 5909, 2024-04-23T10:37:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2024-04-23T10:37:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 5871, 2024-04-23T10:37:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 0, 2024-04-23T10:37:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 0, 2024-04-23T10:37:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 0, 2024-04-23T10:37:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 3, 2024-04-23T10:37:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 0, 2024-04-23T10:37:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 0, 2024-04-23T10:37:13.529 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2024-04-23T10:37:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2024-04-23T10:37:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2024-04-23T10:37:13.530 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2024-04-23T10:37:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 0, 2024-04-23T10:37:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 0, 2024-04-23T10:37:13.531 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2024-04-23T10:37:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2024-04-23T10:37:13.532 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2024-04-23T10:37:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2024-04-23T10:37:13.534 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2024-04-23T10:37:13.535 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2024-04-23T10:37:13.536 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 0, 2024-04-23T10:37:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2024-04-23T10:37:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2024-04-23T10:37:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2024-04-23T10:37:13.537 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2024-04-23T10:37:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T10:37:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2024-04-23T10:37:13.539 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T10:37:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2024-04-23T10:37:13.540 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 0, 2024-04-23T10:37:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T10:37:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T10:37:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 0, 2024-04-23T10:37:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2024-04-23T10:37:13.541 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 0, 2024-04-23T10:37:13.544 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 0, 2024-04-23T10:37:13.546 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T10:37:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T10:37:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T10:37:13.547 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 0, 2024-04-23T10:37:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 0, 2024-04-23T10:37:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 0, 2024-04-23T10:37:13.548 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 0 2024-04-23T10:37:13.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2024-04-23T10:37:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update": 0, 2024-04-23T10:37:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update_receipt": 0, 2024-04-23T10:37:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_try_discover": 0, 2024-04-23T10:37:13.550 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_send_discover": 0, 2024-04-23T10:37:13.551 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_handle_discover": 0, 2024-04-23T10:37:13.551 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 0, 2024-04-23T10:37:13.551 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 0, 2024-04-23T10:37:13.551 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2024-04-23T10:37:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 0, 2024-04-23T10:37:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 0, 2024-04-23T10:37:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 0, 2024-04-23T10:37:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2024-04-23T10:37:13.552 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2024-04-23T10:37:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2024-04-23T10:37:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2024-04-23T10:37:13.553 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2024-04-23T10:37:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2024-04-23T10:37:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_path": 0, 2024-04-23T10:37:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_inode": 0, 2024-04-23T10:37:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T10:37:13.554 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2024-04-23T10:37:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2024-04-23T10:37:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2024-04-23T10:37:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2024-04-23T10:37:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0 2024-04-23T10:37:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2024-04-23T10:37:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: "evlrg": 0, 2024-04-23T10:37:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 0, 2024-04-23T10:37:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 0, 2024-04-23T10:37:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 0, 2024-04-23T10:37:13.555 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 29590, 2024-04-23T10:37:13.556 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2024-04-23T10:37:13.556 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 0, 2024-04-23T10:37:13.556 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 0, 2024-04-23T10:37:13.556 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 0, 2024-04-23T10:37:13.556 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 0, 2024-04-23T10:37:13.556 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 36, 2024-04-23T10:37:13.556 INFO:teuthology.orchestra.run.smithi146.stdout: "segmjr": 4, 2024-04-23T10:37:13.556 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2024-04-23T10:37:13.556 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 0, 2024-04-23T10:37:13.556 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 4194304, 2024-04-23T10:37:13.556 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 69841255, 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 69840681, 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 29590 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 1242, 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 10241, 2024-04-23T10:37:13.557 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 8999, 2024-04-23T10:37:13.558 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 141, 2024-04-23T10:37:13.558 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 772, 2024-04-23T10:37:13.558 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 631, 2024-04-23T10:37:13.558 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 5997, 2024-04-23T10:37:13.558 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 13397, 2024-04-23T10:37:13.558 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 7400, 2024-04-23T10:37:13.558 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 0, 2024-04-23T10:37:13.558 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 0, 2024-04-23T10:37:13.558 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 0, 2024-04-23T10:37:13.558 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 69160, 2024-04-23T10:37:13.558 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 215416 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 0, 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 0, 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 0, 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.559 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2024-04-23T10:37:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.561 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.562 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2024-04-23T10:37:13.562 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.562 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.562 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.562 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.562 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2024-04-23T10:37:13.562 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.562 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.562 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.563 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2024-04-23T10:37:13.564 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.564 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.564 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.564 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.565 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2024-04-23T10:37:13.565 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.565 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.565 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.566 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2024-04-23T10:37:13.566 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.566 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.566 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.566 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.566 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2024-04-23T10:37:13.566 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.567 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.567 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.567 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2024-04-23T10:37:13.567 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.567 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.567 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.567 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.567 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2024-04-23T10:37:13.567 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.568 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.568 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.568 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2024-04-23T10:37:13.568 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.568 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.568 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.568 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.568 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2024-04-23T10:37:13.569 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.569 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.569 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.569 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.569 INFO:teuthology.orchestra.run.smithi146.stdout: "req_snapdiff_latency": { 2024-04-23T10:37:13.569 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.569 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.569 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.570 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2024-04-23T10:37:13.570 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.570 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.570 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.570 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.570 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2024-04-23T10:37:13.570 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.570 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.570 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.571 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2024-04-23T10:37:13.571 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.571 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.571 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.571 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.571 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2024-04-23T10:37:13.571 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.571 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.571 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.572 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2024-04-23T10:37:13.572 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.572 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.572 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.572 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2024-04-23T10:37:13.572 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.572 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.572 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.572 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.573 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2024-04-23T10:37:13.573 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.573 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.573 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.573 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.573 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2024-04-23T10:37:13.573 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.573 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.573 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.574 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2024-04-23T10:37:13.574 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.574 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.574 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.574 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2024-04-23T10:37:13.574 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.574 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.574 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2024-04-23T10:37:13.575 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 2, 2024-04-23T10:37:13.576 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 1, 2024-04-23T10:37:13.576 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 2, 2024-04-23T10:37:13.576 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2024-04-23T10:37:13.576 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 0, 2024-04-23T10:37:13.576 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 0, 2024-04-23T10:37:13.576 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 3972, 2024-04-23T10:37:13.577 INFO:teuthology.orchestra.run.smithi146.stdout: "mdthresh_evicted": 0 2024-04-23T10:37:13.577 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.577 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-04-23T10:37:13.577 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-04-23T10:37:13.577 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-04-23T10:37:13.577 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:13.577 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:13.577 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:13.577 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:13.577 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:13.578 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:13.578 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:13.578 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:13.578 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:13.578 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:13.578 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:13.578 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:13.579 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:13.579 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:13.579 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:13.579 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:13.579 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:13.579 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:13.579 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:13.579 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:13.579 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:13.579 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:13.580 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:13.580 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:13.580 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:13.580 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:13.580 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:13.580 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:13.580 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:13.581 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-04-23T10:37:13.581 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:13.581 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:13.581 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:13.581 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:13.581 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 271034, 2024-04-23T10:37:13.581 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 1382, 2024-04-23T10:37:13.581 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:13.581 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:13.581 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-04-23T10:37:13.581 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-04-23T10:37:13.582 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:13.582 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:13.582 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:13.582 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:13.582 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 8152, 2024-04-23T10:37:13.582 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 170, 2024-04-23T10:37:13.582 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:13.582 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:13.582 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:13.583 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-04-23T10:37:13.583 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 7364771, 2024-04-23T10:37:13.583 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 84030, 2024-04-23T10:37:13.583 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:13.583 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-04-23T10:37:13.583 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:13.583 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-04-23T10:37:13.583 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.583 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2024-04-23T10:37:13.584 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2024-04-23T10:37:13.584 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2024-04-23T10:37:13.584 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 2260, 2024-04-23T10:37:13.584 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 21, 2024-04-23T10:37:13.584 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 3, 2024-04-23T10:37:13.584 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 2260, 2024-04-23T10:37:13.584 INFO:teuthology.orchestra.run.smithi146.stdout: "op_latency": { 2024-04-23T10:37:13.584 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2260, 2024-04-23T10:37:13.584 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.242979301, 2024-04-23T10:37:13.584 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000549990 2024-04-23T10:37:13.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.585 INFO:teuthology.orchestra.run.smithi146.stdout: "op_inflight": 0, 2024-04-23T10:37:13.585 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2024-04-23T10:37:13.585 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2260, 2024-04-23T10:37:13.585 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2261 2024-04-23T10:37:13.585 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.585 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 2260, 2024-04-23T10:37:13.585 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 2260, 2024-04-23T10:37:13.586 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 0, 2024-04-23T10:37:13.586 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2024-04-23T10:37:13.586 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2024-04-23T10:37:13.586 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 1407, 2024-04-23T10:37:13.586 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 0, 2024-04-23T10:37:13.586 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 851, 2024-04-23T10:37:13.586 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 0, 2024-04-23T10:37:13.586 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 0, 2024-04-23T10:37:13.586 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2024-04-23T10:37:13.586 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2024-04-23T10:37:13.587 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 0, 2024-04-23T10:37:13.587 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2024-04-23T10:37:13.587 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 0, 2024-04-23T10:37:13.587 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2024-04-23T10:37:13.587 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2024-04-23T10:37:13.587 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2024-04-23T10:37:13.587 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 1, 2024-04-23T10:37:13.587 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 0, 2024-04-23T10:37:13.587 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2024-04-23T10:37:13.587 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2024-04-23T10:37:13.587 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2024-04-23T10:37:13.588 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2024-04-23T10:37:13.588 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2024-04-23T10:37:13.588 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2024-04-23T10:37:13.588 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T10:37:13.588 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2024-04-23T10:37:13.588 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2024-04-23T10:37:13.588 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2024-04-23T10:37:13.588 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2024-04-23T10:37:13.588 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2024-04-23T10:37:13.588 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2024-04-23T10:37:13.589 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2024-04-23T10:37:13.589 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2024-04-23T10:37:13.589 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2024-04-23T10:37:13.589 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2024-04-23T10:37:13.589 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2024-04-23T10:37:13.589 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2024-04-23T10:37:13.589 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2024-04-23T10:37:13.589 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2024-04-23T10:37:13.589 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2024-04-23T10:37:13.589 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2024-04-23T10:37:13.589 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2024-04-23T10:37:13.590 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2024-04-23T10:37:13.590 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2024-04-23T10:37:13.590 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 99, 2024-04-23T10:37:13.590 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2024-04-23T10:37:13.590 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 13, 2024-04-23T10:37:13.590 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 9, 2024-04-23T10:37:13.590 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 9, 2024-04-23T10:37:13.590 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2024-04-23T10:37:13.590 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2024-04-23T10:37:13.590 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 0, 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 2, 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 0 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 0, 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: "osd-slow-ops": { 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_ops_count": 0 2024-04-23T10:37:13.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.592 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2024-04-23T10:37:13.592 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2024-04-23T10:37:13.592 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 0, 2024-04-23T10:37:13.592 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2024-04-23T10:37:13.592 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 0, 2024-04-23T10:37:13.592 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed_ops": 0, 2024-04-23T10:37:13.592 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 0, 2024-04-23T10:37:13.592 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2024-04-23T10:37:13.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.592 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:13.592 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:13.593 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-04-23T10:37:13.593 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:13.593 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 2524, 2024-04-23T10:37:13.593 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 67730222, 2024-04-23T10:37:13.593 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:13.593 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 2524, 2024-04-23T10:37:13.593 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:13.593 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:13.593 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2524, 2024-04-23T10:37:13.593 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 67730222, 2024-04-23T10:37:13.594 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:13.594 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.594 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.594 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.594 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:13.594 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.594 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2024-04-23T10:37:13.594 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:13.594 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-04-23T10:37:13.594 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:13.594 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 2260, 2024-04-23T10:37:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 65657263, 2024-04-23T10:37:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2260, 2024-04-23T10:37:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 65657263, 2024-04-23T10:37:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2024-04-23T10:37:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2024-04-23T10:37:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 2260, 2024-04-23T10:37:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 2260, 2024-04-23T10:37:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2260, 2024-04-23T10:37:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 2260, 2024-04-23T10:37:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.598 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:13.598 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.598 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2024-04-23T10:37:13.598 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:13.598 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-04-23T10:37:13.598 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:13.598 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:13.599 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:13.599 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:13.599 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:13.599 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:13.599 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:13.599 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 0, 2024-04-23T10:37:13.599 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 0, 2024-04-23T10:37:13.599 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:13.599 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.599 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.600 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.600 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:13.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:13.600 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x5652de0b06e0": { 2024-04-23T10:37:13.600 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:13.600 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-04-23T10:37:13.600 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:13.600 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:13.600 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:13.600 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:13.601 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:13.601 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:13.601 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:13.601 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 0, 2024-04-23T10:37:13.601 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 0, 2024-04-23T10:37:13.601 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:13.601 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:13.601 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:13.601 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:13.601 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:13.601 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:13.602 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-23T10:37:14.260 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-04-23T10:37:14.260 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-04-23T10:37:14.260 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=0 2024-04-23T10:37:14.260 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-04-23T10:37:14.260 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=0 2024-04-23T10:37:14.260 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-04-23T10:37:14.260 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T10:37:14.260 DEBUG:tasks.check_counter:Getting stats from e 2024-04-23T10:37:14.260 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-23T10:37:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:37:14.777 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:14 smithi146 ceph-mon[32800]: pgmap v323: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:37:14.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:14 smithi167 ceph-mon[32940]: pgmap v323: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:37:14.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:14 smithi069 ceph-mon[29593]: pgmap v323: 97 pgs: 97 active+clean; 117 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-23T10:37:16.266 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-23T10:37:16.266 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:16.266 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 6416, 2024-04-23T10:37:16.266 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 6012, 2024-04-23T10:37:16.266 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 3712725, 2024-04-23T10:37:16.266 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 7179847, 2024-04-23T10:37:16.266 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 18, 2024-04-23T10:37:16.266 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2024-04-23T10:37:16.266 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.341686444, 2024-04-23T10:37:16.267 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.145312260, 2024-04-23T10:37:16.267 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.210822060, 2024-04-23T10:37:16.267 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.021379578, 2024-04-23T10:37:16.267 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:16.267 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6010, 2024-04-23T10:37:16.267 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.127052656, 2024-04-23T10:37:16.267 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000021140 2024-04-23T10:37:16.267 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.267 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 10732, 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.001424831, 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000132 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 5648, 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 7536 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 13661, 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 18419, 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 5740540, 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 8879172, 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 12, 2024-04-23T10:37:16.268 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 8, 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.788569658, 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.360968750, 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.493363506, 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.021932958, 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 18415, 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.355971495, 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000019330 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 28312, 2024-04-23T10:37:16.269 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.003924367, 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000138 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 1421328, 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 5512736 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 4155, 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 4384, 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 3193552, 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 10392366, 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 11, 2024-04-23T10:37:16.270 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 5, 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.283780895, 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.113502742, 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.170903514, 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.029951600, 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4385, 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.137775337, 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000031419 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 5677, 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000841909, 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000148 2024-04-23T10:37:16.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 1663744, 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 447808 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 960, 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2.020489243, 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002104676 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:16.272 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3199, 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.338167645, 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000105710 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 3099, 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 3099, 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3099, 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 5.962638949, 2024-04-23T10:37:16.273 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001924052 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_complete": 13, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_keys": 0, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 20, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 1, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 957, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 2, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 5, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 950, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 953, 2024-04-23T10:37:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 2206, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 1, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 1, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 6, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 6991, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 4844, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 1042, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 2, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 0, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 49, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 1002, 2024-04-23T10:37:16.275 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 62, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 1832, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 0, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 4, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 234, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 1, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 0, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T10:37:16.276 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 0, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 26, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 278, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 2353, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 666, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 375, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 31, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 2723 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update": 164, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update_receipt": 2644, 2024-04-23T10:37:16.277 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_try_discover": 1830, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_send_discover": 1610, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_handle_discover": 276, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 50, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 0, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 1783, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 1733, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 0, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2024-04-23T10:37:16.278 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_path": 4, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_inode": 481, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 49, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 1, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "evlrg": 0, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 5898, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 0, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 0, 2024-04-23T10:37:16.279 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 5898, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 0, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 8, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 0, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 0, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 8, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "segmjr": 2, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 0, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 4194304, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 17599408, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 0, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 440, 2024-04-23T10:37:16.280 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.178300447, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002677955 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 0 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 461, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 3439, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 2978, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 86, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 945, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 859, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 957, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 5408, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 4451, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 1, 2024-04-23T10:37:16.281 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 1824, 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 1823, 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 72852, 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 223608 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 4786, 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 381, 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 3099, 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 26, 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 2015, 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 351, 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.344116705, 2024-04-23T10:37:16.282 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000980389 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.283 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 856, 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.281988103, 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000329425 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-04-23T10:37:16.284 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000131239, 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000131239 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.285 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.286 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.286 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2024-04-23T10:37:16.286 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.286 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.287 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 95, 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.086888787, 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000914618 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2024-04-23T10:37:16.288 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "req_snapdiff_latency": { 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2024-04-23T10:37:16.289 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 95, 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.643877556, 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.017303974 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.290 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 13, 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.852879227, 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.065606094 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.291 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1688, 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2.752757332, 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001630780 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 2, 2024-04-23T10:37:16.293 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 4, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 2, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 2, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 1419, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 709, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 612, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "mdthresh_evicted": 0 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:16.294 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:16.295 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 728781, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 654, 2024-04-23T10:37:16.296 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 8152, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 170, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 1952898, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 28845, 2024-04-23T10:37:16.297 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 2434, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 13892871, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 33, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 2434, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "op_latency": { 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2434, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 5.247912670, 2024-04-23T10:37:16.298 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002156085 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "op_inflight": 0, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2434, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2536 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 2434, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 76, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 2358, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 0, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 10, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 63, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 503, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 39, 2024-04-23T10:37:16.299 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 0, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 1, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 1748, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 12, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 20, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2024-04-23T10:37:16.300 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2024-04-23T10:37:16.301 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 99, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 13, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 12, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 12, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 93, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 26, 2024-04-23T10:37:16.302 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 21 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 1, 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "osd-slow-ops": { 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_ops_count": 497 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 6, 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 6, 2024-04-23T10:37:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed_ops": 1733, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 1733, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 24228, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 10271076, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 24228, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 24228, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 10271076, 2024-04-23T10:37:16.304 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 2434, 2024-04-23T10:37:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 14074696, 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2434, 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 14074696, 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:16.306 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 2434, 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 2434, 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2434, 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 2434, 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-04-23T10:37:16.307 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 1733, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 182033, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 1733, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 63, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 182033, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x56060afd2500": { 2024-04-23T10:37:16.308 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 5898, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 13405104, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 5898, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 440, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 13405104, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:16.309 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:16.310 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-23T10:37:16.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:16 smithi146 ceph-mon[32800]: pgmap v324: 97 pgs: 97 active+clean; 105 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:37:16.677 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:16 smithi146 ceph-mon[32800]: osdmap e100: 12 total, 12 up, 12 in 2024-04-23T10:37:16.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:16 smithi167 ceph-mon[32940]: pgmap v324: 97 pgs: 97 active+clean; 105 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:37:16.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:16 smithi167 ceph-mon[32940]: osdmap e100: 12 total, 12 up, 12 in 2024-04-23T10:37:16.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:16 smithi069 ceph-mon[29593]: pgmap v324: 97 pgs: 97 active+clean; 105 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:37:16.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:16 smithi069 ceph-mon[29593]: osdmap e100: 12 total, 12 up, 12 in 2024-04-23T10:37:17.090 INFO:tasks.check_counter:Daemon mds.e mds.exported=49 2024-04-23T10:37:17.090 INFO:tasks.check_counter:Daemon mds.e mds.imported=62 2024-04-23T10:37:17.090 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=164 2024-04-23T10:37:17.090 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=2644 2024-04-23T10:37:17.090 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=1 2024-04-23T10:37:17.090 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-04-23T10:37:17.090 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T10:37:17.090 DEBUG:tasks.check_counter:Getting stats from h 2024-04-23T10:37:17.091 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-23T10:37:17.334 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:37:18.775 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:18 smithi146 ceph-mon[32800]: pgmap v326: 97 pgs: 97 active+clean; 105 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:37:18.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:18 smithi167 ceph-mon[32940]: pgmap v326: 97 pgs: 97 active+clean; 105 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:37:18.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:18 smithi069 ceph-mon[29593]: pgmap v326: 97 pgs: 97 active+clean; 105 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-04-23T10:37:19.057 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-23T10:37:19.057 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:19.057 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 9932, 2024-04-23T10:37:19.057 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 9150, 2024-04-23T10:37:19.057 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 4967171, 2024-04-23T10:37:19.057 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 8175002, 2024-04-23T10:37:19.057 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 13, 2024-04-23T10:37:19.057 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 5, 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.511583266, 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.209691962, 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.345551900, 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.022235041, 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 9148, 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.201272156, 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000022001 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 17492, 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.002581285, 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000147 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.058 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 3306, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 3362, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 2840076, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 5630527, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 12, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 6, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.241446961, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.104509150, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.131950565, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.023960726, 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:19.059 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3361, 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.105435357, 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000031370 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4352, 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000593262, 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000136 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 1672688, 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 447168 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 8703, 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 10989, 2024-04-23T10:37:19.060 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 4201062, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 5537992, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 16, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 6, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.483702190, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.212532422, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.306648218, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.014917903, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 10987, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.241186504, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000021951 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 16558, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.002270873, 2024-04-23T10:37:19.061 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000137 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 1009808, 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 4032768 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 858, 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.731435815, 2024-04-23T10:37:19.062 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002017990 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2030, 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.394666782, 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000194417 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 2115, 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 2096, 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2096, 2024-04-23T10:37:19.063 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 67.489060057, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.032198979 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 19, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_complete": 9, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_keys": 0, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 11, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 839, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 0, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 6, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 833, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 837, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 2428, 2024-04-23T10:37:19.064 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 2, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 2, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 5, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 5703, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 3870, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 15, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 1056, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 0, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 0, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 31, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 1119, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 31, 2024-04-23T10:37:19.065 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 1695, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 0, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 4, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 234, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 1, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 0, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 0, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 38, 2024-04-23T10:37:19.066 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 598, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 1331, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 584, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 0, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 40, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 2006 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update": 111, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update_receipt": 2756, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_try_discover": 1893, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_send_discover": 1688, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_handle_discover": 203, 2024-04-23T10:37:19.067 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 62, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 0, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 1177, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 1115, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 0, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_path": 4, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_inode": 969, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 33, 2024-04-23T10:37:19.068 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "evlrg": 0, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 3168, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 0, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 0, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 3168, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 0, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 5, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 0, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 0, 2024-04-23T10:37:19.069 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 5, 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "segmjr": 2, 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 0, 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 4194304, 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 12367449, 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 0, 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 624, 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 10.460720043, 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.016763974 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 0 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2024-04-23T10:37:19.070 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 413, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 2908, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 2495, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 82, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 996, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 914, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 839, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 4552, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 3713, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 2, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 1608, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 1606, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 68816, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 223608 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 3322, 2024-04-23T10:37:19.071 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 315, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 2115, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 26, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 1391, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.001776844, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000444211 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 843, 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.379541161, 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001636466 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.073 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.074 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2024-04-23T10:37:19.075 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.075 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.075 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.075 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2024-04-23T10:37:19.075 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.075 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.075 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.076 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 72, 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.077987396, 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001083158 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2024-04-23T10:37:19.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "req_snapdiff_latency": { 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 78, 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.779252937, 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.022810935 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2024-04-23T10:37:19.078 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.079 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.080 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1099, 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 64.250501719, 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.058462694 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.081 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 2, 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 4, 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 2, 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 2, 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 1265, 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 632, 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 620, 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "mdthresh_evicted": 0 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-04-23T10:37:19.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:19.083 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:19.084 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 816110, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 642, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 8032, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 167, 2024-04-23T10:37:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 1769824, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 30167, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 1933, 2024-04-23T10:37:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 8424345, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 33, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 1933, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "op_latency": { 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1933, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 5.493908601, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002842166 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "op_inflight": 0, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1933, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2020 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 1933, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 50, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 1883, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2024-04-23T10:37:19.087 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 0, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 10, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 41, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 665, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 35, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 0, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 1128, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 9, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 20, 2024-04-23T10:37:19.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2024-04-23T10:37:19.089 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 100, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 14, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 12, 2024-04-23T10:37:19.090 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 12, 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 70, 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 18, 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 24 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 1, 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "osd-slow-ops": { 2024-04-23T10:37:19.091 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_ops_count": 1219 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 6, 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 6, 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed_ops": 1115, 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 1115, 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:19.092 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 21937, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 9892998, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 21937, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 21937, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 9892998, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:19.093 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 1933, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 8542728, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 1933, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 8542728, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:19.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 1933, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 1933, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 1933, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 1933, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.095 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 1115, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 118527, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 1115, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 41, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 118527, 2024-04-23T10:37:19.096 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55aa9a044500": { 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 3168, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 8173145, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 3168, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 624, 2024-04-23T10:37:19.098 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 8173145, 2024-04-23T10:37:19.098 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:19.098 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:19.098 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:19.098 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:19.098 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:19.098 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:19.098 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-23T10:37:19.772 INFO:tasks.check_counter:Daemon mds.h mds.exported=31 2024-04-23T10:37:19.772 INFO:tasks.check_counter:Daemon mds.h mds.imported=31 2024-04-23T10:37:19.772 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=111 2024-04-23T10:37:19.772 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=2756 2024-04-23T10:37:19.772 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=1 2024-04-23T10:37:19.772 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-04-23T10:37:19.772 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T10:37:19.772 DEBUG:tasks.check_counter:Getting stats from k 2024-04-23T10:37:19.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-23T10:37:20.011 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.b/config 2024-04-23T10:37:20.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:20 smithi167 ceph-mon[32940]: pgmap v327: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 12 op/s 2024-04-23T10:37:20.910 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:20 smithi146 ceph-mon[32800]: pgmap v327: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 12 op/s 2024-04-23T10:37:20.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:20 smithi069 ceph-mon[29593]: pgmap v327: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 12 op/s 2024-04-23T10:37:21.799 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-04-23T10:37:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 651, 2024-04-23T10:37:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 653, 2024-04-23T10:37:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 4359714, 2024-04-23T10:37:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 207082, 2024-04-23T10:37:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 7, 2024-04-23T10:37:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2024-04-23T10:37:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.066598348, 2024-04-23T10:37:21.799 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.019614166, 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.018060561, 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.022762157, 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 651, 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.023911135, 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000036729 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T10:37:21.800 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 676, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 833, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 6457803, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 655657, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 7, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 5, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.075106490, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.024858731, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.022081610, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.020706115, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 831, 2024-04-23T10:37:21.801 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.037625801, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000045277 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 442592 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 1132, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 1096, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 6126084, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 408186, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 4, 2024-04-23T10:37:21.802 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.147918746, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.044888713, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.066650580, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.037337350, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1095, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.055570377, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000050749 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 1650096, 2024-04-23T10:37:21.803 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 132480 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3663, 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.107058244, 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000029226 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-04-23T10:37:21.804 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 0, 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 0, 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_complete": 0, 2024-04-23T10:37:21.805 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_keys": 0, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 0, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 3474, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 84, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 3390, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 3353, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 0, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 0, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 0, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 1, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 0, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 0, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2024-04-23T10:37:21.806 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T10:37:21.807 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 0, 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 0 2024-04-23T10:37:21.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update_receipt": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_try_discover": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_send_discover": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_handle_discover": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2024-04-23T10:37:21.809 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_path": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_inode": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "evlrg": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 0, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 6267, 2024-04-23T10:37:21.810 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 0, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 0, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 0, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 0, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 8, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "segmjr": 2, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 0, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 4194304, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 18866081, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 18862530, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 6267 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 830, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 3294, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 2464, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 75, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 184, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 109, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 3474, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 4913, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 1439, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 0, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 0, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 0, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 57776, 2024-04-23T10:37:21.812 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 215416 2024-04-23T10:37:21.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.813 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2024-04-23T10:37:21.813 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 0, 2024-04-23T10:37:21.813 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2024-04-23T10:37:21.813 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 0, 2024-04-23T10:37:21.813 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 0, 2024-04-23T10:37:21.813 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2024-04-23T10:37:21.813 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2024-04-23T10:37:21.813 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.813 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.813 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.814 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.815 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.816 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2024-04-23T10:37:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2024-04-23T10:37:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.818 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.819 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "req_snapdiff_latency": { 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.820 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.821 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.822 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.823 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 2, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 5, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 3, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 4, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 0, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 0, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 3979, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "mdthresh_evicted": 0 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-04-23T10:37:21.824 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:21.825 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 239432, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 936, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 8032, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 167, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-04-23T10:37:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 4509510, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 51214, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 2188, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 21, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 3, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 2188, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "op_latency": { 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2188, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.451975802, 2024-04-23T10:37:21.828 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000663608 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "op_inflight": 0, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2188, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2189 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 2188, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 2188, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 0, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 1392, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 0, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 794, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 0, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 0, 2024-04-23T10:37:21.829 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 1, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T10:37:21.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2024-04-23T10:37:21.831 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 100, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 14, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 7, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 7, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 0, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 2, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 0 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.832 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 0, 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "osd-slow-ops": { 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_ops_count": 0 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 0, 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 0, 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed_ops": 0, 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 0, 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2024-04-23T10:37:21.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 2455, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 16706213, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 2455, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2455, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 16706213, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.834 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 2188, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 14672007, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2188, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 14672007, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.835 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 2188, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 2188, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2188, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 2188, 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:21.836 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 0, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 0, 2024-04-23T10:37:21.837 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55e6df3906e0": { 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 0, 2024-04-23T10:37:21.838 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 0, 2024-04-23T10:37:21.839 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-04-23T10:37:21.839 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-04-23T10:37:21.839 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-04-23T10:37:21.839 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-04-23T10:37:21.839 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:21.839 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-04-23T10:37:21.839 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-04-23T10:37:22.595 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:22 smithi146 ceph-mon[32800]: pgmap v328: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:37:22.621 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-04-23T10:37:22.622 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-04-23T10:37:22.622 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-04-23T10:37:22.622 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-04-23T10:37:22.622 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-04-23T10:37:22.622 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-04-23T10:37:22.622 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T10:37:22.622 DEBUG:tasks.check_counter:Getting stats from c 2024-04-23T10:37:22.622 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-23T10:37:22.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:22 smithi167 ceph-mon[32940]: pgmap v328: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:37:22.873 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:37:22.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:22 smithi069 ceph-mon[29593]: pgmap v328: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:37:24.536 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:24 smithi167 ceph-mon[32940]: pgmap v329: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:37:24.659 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-04-23T10:37:24.659 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:24.659 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 38407, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 68043, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 14355487, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 65854457, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 14, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 9, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 2.575976550, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 1.256110125, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 2.127795475, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.097869198, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 68037, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.291033070, 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000033673 2024-04-23T10:37:24.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 90089, 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.013677094, 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000151 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 9908224, 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 28910432 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 9958, 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 12894, 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 4721296, 2024-04-23T10:37:24.661 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 21088616, 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 13, 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 5, 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.693425886, 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.323999996, 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.392600341, 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.039701421, 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 12897, 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.392967121, 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000030469 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 19640, 2024-04-23T10:37:24.662 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.003303072, 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000168 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 1685248, 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 451568 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 8437, 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 8892, 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 2661284, 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 24571912, 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 12, 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 7, 2024-04-23T10:37:24.663 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.557890352, 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.247861150, 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.253241710, 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.075665920, 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 8890, 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.253808204, 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000028549 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 10697, 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.002035808, 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000190 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.664 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 6128, 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 132816 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1939, 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 19.151744367, 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.009877124 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.665 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 5096, 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.684848330, 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000134389 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 12919, 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 12834, 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 12834, 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 62.900621709, 2024-04-23T10:37:24.666 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.004901092 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 85, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 119, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 12, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 2856, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 93, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 2126, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 637, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 2722, 2024-04-23T10:37:24.667 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 6940, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 1, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 1, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 7, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 14966, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 14199, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 33, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 404, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 61, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 6245, 2024-04-23T10:37:24.668 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 49, 2024-04-23T10:37:24.669 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 1500, 2024-04-23T10:37:24.669 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-04-23T10:37:24.669 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 0, 2024-04-23T10:37:24.669 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-04-23T10:37:24.669 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 4, 2024-04-23T10:37:24.669 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 234, 2024-04-23T10:37:24.669 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 1, 2024-04-23T10:37:24.669 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T10:37:24.669 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-04-23T10:37:24.669 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T10:37:24.669 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 0, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 80, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 6886, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 11928, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 13089, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 8839, 2024-04-23T10:37:24.670 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 94, 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 4467 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 1810, 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 1351, 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 876, 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 924, 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 3543, 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 97, 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 2952, 2024-04-23T10:37:24.671 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 2855, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 4, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 4318, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 62, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 12, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-04-23T10:37:24.672 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 29590, 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 29590, 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 36, 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-04-23T10:37:24.673 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 36, 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 4, 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 69841255, 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 0, 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 4807, 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 104.734771529, 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.021787969 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 0 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.674 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 1223, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 10598, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 9375, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 162, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 1296, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 1134, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 2856, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 14040, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 11184, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 1, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 9985, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 9984, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 100484, 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 223608 2024-04-23T10:37:24.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 14505, 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 1428, 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 12919, 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 38, 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 3164, 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 7964, 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 15.622106654, 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001961590 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 47, 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.437474869, 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.009307975 2024-04-23T10:37:24.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 721, 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.801014273, 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.005271864 2024-04-23T10:37:24.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.678 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.679 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.679 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-04-23T10:37:24.679 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.679 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.679 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.679 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-04-23T10:37:24.679 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.679 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.679 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.680 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-04-23T10:37:24.680 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.680 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.680 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.680 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-04-23T10:37:24.680 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 616, 2024-04-23T10:37:24.680 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.533331976, 2024-04-23T10:37:24.680 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000865798 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-04-23T10:37:24.681 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 518, 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.519212867, 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001002341 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.682 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 209, 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.840511413, 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.018375652 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.683 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 16, 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 33.924667476, 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 2.120291717 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-04-23T10:37:24.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.685 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.685 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.685 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-04-23T10:37:24.685 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.685 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.685 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.685 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-04-23T10:37:24.685 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.685 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-04-23T10:37:24.686 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2743, 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 4.222302181, 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001539300 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.687 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 2, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 1, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 1, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 3969, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 3969, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 630, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 120, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 120, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:24.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:24.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-04-23T10:37:24.690 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 981715, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 1470, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:24.691 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 8032, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 167, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 5238565, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 78933, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-04-23T10:37:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 8189, 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 68724859, 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 29, 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 8189, 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 8189, 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 17.371690817, 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002121344 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 8189, 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 8428 2024-04-23T10:37:24.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 8189, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 94, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 8095, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 10, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 94, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 4901, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 61, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-04-23T10:37:24.694 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 12, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 2914, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 20, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-04-23T10:37:24.695 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-04-23T10:37:24.696 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 100, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 14, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 12, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 12, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 358, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 58 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-04-23T10:37:24.697 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 1, 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 4408 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 20, 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 6, 2024-04-23T10:37:24.698 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 2887, 2024-04-23T10:37:24.699 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 2855, 2024-04-23T10:37:24.699 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-04-23T10:37:24.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.699 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:24.699 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:24.699 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-04-23T10:37:24.699 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:24.699 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 56798, 2024-04-23T10:37:24.699 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 15339801, 2024-04-23T10:37:24.699 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 56798, 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 56798, 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 15339801, 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-04-23T10:37:24.700 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:24.701 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-04-23T10:37:24.701 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-04-23T10:37:24.701 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:24.701 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:24.701 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 8189, 2024-04-23T10:37:24.701 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 69021574, 2024-04-23T10:37:24.701 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 8189, 2024-04-23T10:37:24.701 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 69021574, 2024-04-23T10:37:24.701 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:24.701 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.701 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 8189, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 8189, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 8189, 2024-04-23T10:37:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 8189, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 2855, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 296715, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 2855, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:24.703 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 94, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 296715, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x564d9b806500": { 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 29590, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 65646951, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:24.704 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 29590, 2024-04-23T10:37:24.705 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:24.705 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:24.705 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 4807, 2024-04-23T10:37:24.705 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 65646951, 2024-04-23T10:37:24.705 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:24.705 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:24.705 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:24.705 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:24.705 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:24.705 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:24.705 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-04-23T10:37:24.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:24 smithi146 ceph-mon[32800]: pgmap v329: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:37:24.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:24 smithi069 ceph-mon[29593]: pgmap v329: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2024-04-23T10:37:25.390 INFO:tasks.check_counter:Daemon mds.c mds.exported=61 2024-04-23T10:37:25.390 INFO:tasks.check_counter:Daemon mds.c mds.imported=49 2024-04-23T10:37:25.390 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=1810 2024-04-23T10:37:25.390 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=1351 2024-04-23T10:37:25.390 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=1 2024-04-23T10:37:25.390 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-04-23T10:37:25.390 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T10:37:25.390 DEBUG:tasks.check_counter:Getting stats from f 2024-04-23T10:37:25.390 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-23T10:37:25.631 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:37:26.738 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:26 smithi167 ceph-mon[32940]: pgmap v330: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:37:26.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:26 smithi146 ceph-mon[32800]: pgmap v330: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:37:26.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:26 smithi069 ceph-mon[29593]: pgmap v330: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-23T10:37:27.338 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-04-23T10:37:27.338 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:27.338 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 1663, 2024-04-23T10:37:27.338 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 1665, 2024-04-23T10:37:27.338 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 18429464, 2024-04-23T10:37:27.338 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 528844, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 7, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 3, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.155922877, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.042905870, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.046667037, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.054203785, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1663, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.059129379, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000035555 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.339 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 0 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 40, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 150, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 16791594, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 296524, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 5, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 4, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.015560221, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.005295979, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.008317359, 2024-04-23T10:37:27.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000742336, 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 149, 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.010083925, 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000067677 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 285328 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 262, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 239, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 8899361, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 117535, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 4, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 3, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.036814840, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.011794630, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.018948779, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.006191241, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 238, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.012421045, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000052189 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 488272, 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 94320 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-04-23T10:37:27.343 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2810, 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.144949612, 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000051583 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 0, 2024-04-23T10:37:27.344 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 0, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 0, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 0, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 9062, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 5639, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 3423, 2024-04-23T10:37:27.345 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 1006, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 3, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-04-23T10:37:27.346 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 4, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 234, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 6, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2024-04-23T10:37:27.347 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 0 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 0, 2024-04-23T10:37:27.348 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-04-23T10:37:27.349 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 0, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 0, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 0, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 0, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 16786, 2024-04-23T10:37:27.350 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 0, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 2, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 13, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 45937652, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 47437940, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 47437828, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 16786 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 2543, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 9236, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 6693, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 250, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 347, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 97, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 9062, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 12135, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 3073, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 0, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 0, 2024-04-23T10:37:27.352 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 0, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 72196, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 215416 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 0, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 0, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 0, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 0, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 0, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.353 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.354 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.357 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-04-23T10:37:27.357 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.357 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.357 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.357 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-04-23T10:37:27.357 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.357 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.357 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.358 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.359 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.360 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.361 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.362 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:27.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 2, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 4, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 2, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 0, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 0, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 0, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 4411, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-04-23T10:37:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:27.365 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:27.366 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 305645, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 2764, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:27.367 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 8032, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 167, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 12732512, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 157865, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-04-23T10:37:27.368 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 1771, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 26, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 4, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 1771, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1771, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.693969970, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000956504 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1771, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1772 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 1771, 2024-04-23T10:37:27.369 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 1771, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 1115, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 653, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-04-23T10:37:27.370 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 2, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-04-23T10:37:27.371 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 100, 2024-04-23T10:37:27.372 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 10, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 7, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 7, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 2, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 0, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.373 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 0, 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 0, 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 0, 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 0, 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-04-23T10:37:27.374 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 1961, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 43931364, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 1961, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1961, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 43931364, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.375 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 1771, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 43130516, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1771, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 43130516, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.376 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 1771, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 1771, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1771, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 1771, 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:27.377 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:27.378 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x55f84ebfc6e0": { 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:27.379 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:27.380 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:27.380 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-04-23T10:37:27.380 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-04-23T10:37:27.380 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:27.380 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:27.380 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:27.380 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:27.380 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:27.380 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:27.380 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-04-23T10:37:28.070 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-04-23T10:37:28.070 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-04-23T10:37:28.070 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-04-23T10:37:28.070 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-04-23T10:37:28.071 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-04-23T10:37:28.071 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-04-23T10:37:28.071 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T10:37:28.071 DEBUG:tasks.check_counter:Getting stats from i 2024-04-23T10:37:28.071 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-23T10:37:28.310 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:37:28.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:28 smithi167 ceph-mon[32940]: pgmap v331: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:37:28.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:28 smithi146 ceph-mon[32800]: pgmap v331: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:37:28.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:28 smithi069 ceph-mon[29593]: pgmap v331: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 10 op/s 2024-04-23T10:37:29.994 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-04-23T10:37:29.994 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:29.994 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 19353, 2024-04-23T10:37:29.995 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 19859, 2024-04-23T10:37:29.995 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 10246838, 2024-04-23T10:37:29.995 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 27937914, 2024-04-23T10:37:29.995 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 11, 2024-04-23T10:37:29.995 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 4, 2024-04-23T10:37:29.995 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 1.310535763, 2024-04-23T10:37:29.995 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.549331331, 2024-04-23T10:37:29.995 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.663679376, 2024-04-23T10:37:29.995 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.193071045, 2024-04-23T10:37:29.995 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:29.995 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 19864, 2024-04-23T10:37:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.342852994, 2024-04-23T10:37:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000168287 2024-04-23T10:37:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 30451, 2024-04-23T10:37:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.005307987, 2024-04-23T10:37:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000174 2024-04-23T10:37:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-04-23T10:37:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 319648 2024-04-23T10:37:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 16246, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 17714, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 7874884, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 26156049, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 9, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 6, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 1.183003819, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.494427216, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.579611682, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.186681781, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 17719, 2024-04-23T10:37:29.997 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.711705545, 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000153039 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 25642, 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.004538087, 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000176 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 2024704, 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 237888 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 16531, 2024-04-23T10:37:29.998 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 30631, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 5975145, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 27710376, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 76, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 9, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 1.289805367, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.562697564, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 1.000290011, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.136899092, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 30616, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.855911242, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000093281 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:29.999 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 35723, 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.005823121, 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000163 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 5085200, 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 15938400 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-04-23T10:37:30.000 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2353, 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 13.205687632, 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.005612276 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 6585, 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.026347199, 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000307721 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 8773, 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 8618, 2024-04-23T10:37:30.001 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 8618, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 15.425114706, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001789871 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 155, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 808, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 7, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 5214, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 3090, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 1942, 2024-04-23T10:37:30.002 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 182, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 797, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 4041, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 1, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 1, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 7, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 12282, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 10949, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 16, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 843, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-04-23T10:37:30.003 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 73, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 3062, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 72, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 5377, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 0, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 4, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 234, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 6, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-04-23T10:37:30.004 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 0, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 117, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 1084, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 6815, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 3698, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 2629, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 67, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 5030 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.005 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 1011, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 1839, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 1273, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 1120, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 2346, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 172, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 3964, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 3792, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-04-23T10:37:30.006 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 4, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 1034, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 73, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 7, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 1, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 16840, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 16295, 2024-04-23T10:37:30.007 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 16295, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 545, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 1, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 38, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 36, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 36, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 2, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 1, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 1, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 45937652, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 47437940, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 0, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1323, 2024-04-23T10:37:30.008 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 24.280018693, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.018352243 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 0 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 2491, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 9739, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 7248, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 278, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 925, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 647, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 5214, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 13047, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 7833, 2024-04-23T10:37:30.009 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 1, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 5864, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 5863, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 105972, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 231800 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 10442, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 1415, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 8773, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 98, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 3605, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2388, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.037337005, 2024-04-23T10:37:30.010 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001271916 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 161, 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.103155586, 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000640717 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.011 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1566, 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.745426362, 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000476006 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.012 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.013 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.014 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.014 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.014 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-04-23T10:37:30.014 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 11, 2024-04-23T10:37:30.014 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.001467709, 2024-04-23T10:37:30.014 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000133428 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 7, 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.015121167, 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002160166 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 11, 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.240934079, 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.021903098 2024-04-23T10:37:30.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000276275, 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000276275 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 494, 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.404542919, 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000818912 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2, 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.002003368, 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001001684 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.016 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 172, 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.572634671, 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.020771131 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-04-23T10:37:30.017 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 5, 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.025124221, 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.005024844 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.001622777, 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001622777 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-04-23T10:37:30.018 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 7, 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.017841628, 2024-04-23T10:37:30.019 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002548804 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3792, 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 7.257626939, 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001913931 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-04-23T10:37:30.020 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 2, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 5, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 3, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 2, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 72, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 36, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 633, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.021 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 240, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 240, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:30.022 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:30.023 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 1755826, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 2887, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 8032, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 167, 2024-04-23T10:37:30.024 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 10122241, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 159025, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 10778, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 51729959, 2024-04-23T10:37:30.025 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 31, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 10778, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 10778, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1331.300308919, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.123520162 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 10778, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 20004 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 10778, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 88, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 10690, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-04-23T10:37:30.026 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 498, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 3942, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 88, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 1411, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 120, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 7, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 4323, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 0, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 7884, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-04-23T10:37:30.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-04-23T10:37:30.028 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 100, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 15, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 12, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 12, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 1469, 2024-04-23T10:37:30.029 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 262 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 1, 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 1257 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 6, 2024-04-23T10:37:30.030 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 6, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 3792, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 3792, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 52126, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 18714295, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 52126, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:30.031 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 52126, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 18714295, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:30.032 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 10778, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 52135367, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 10778, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 52135367, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:30.033 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 10778, 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 10778, 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 10778, 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 10778, 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:30.034 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 3792, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 405408, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 3792, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 88, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 405408, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x55a6ccf2c500": { 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:30.035 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 16840, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 43243636, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 16840, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1323, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 43243636, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:30.036 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-04-23T10:37:30.793 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:30 smithi167 ceph-mon[32940]: pgmap v332: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:37:30.820 INFO:tasks.check_counter:Daemon mds.i mds.exported=73 2024-04-23T10:37:30.820 INFO:tasks.check_counter:Daemon mds.i mds.imported=72 2024-04-23T10:37:30.820 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1011 2024-04-23T10:37:30.820 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=1839 2024-04-23T10:37:30.820 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-04-23T10:37:30.820 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=11 2024-04-23T10:37:30.820 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=5 2024-04-23T10:37:30.820 DEBUG:tasks.check_counter:Getting stats from l 2024-04-23T10:37:30.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-23T10:37:30.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:30 smithi146 ceph-mon[32800]: pgmap v332: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:37:30.991 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:30 smithi069 ceph-mon[29593]: pgmap v332: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-23T10:37:31.061 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/mon.c/config 2024-04-23T10:37:32.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:32 smithi167 ceph-mon[32940]: pgmap v333: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:37:32.824 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-04-23T10:37:32.824 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-04-23T10:37:32.824 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 7954, 2024-04-23T10:37:32.824 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 13839, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 4574710, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 10132866, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 15, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 4, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.572162517, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.261356447, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.411782510, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.016140743, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 13838, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.697161232, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000050380 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:32.825 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 17523, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.002815514, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000160 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 3547200, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 6471696 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 4080, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 4106, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 1531881, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 8290815, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 17, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 6, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.273182002, 2024-04-23T10:37:32.826 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.119425681, 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.140070713, 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.030234578, 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 4103, 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.177485033, 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000043257 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 5721, 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000915028, 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000159 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 2960, 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 449872 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.827 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 14033, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 11516, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 7432152, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 8153895, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 10, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 6, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.830816447, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.379733087, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.512776617, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.041554659, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 11515, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.326995717, 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000028397 2024-04-23T10:37:32.828 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 22283, 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.003579277, 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000160 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 4720, 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 6320 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1321, 2024-04-23T10:37:32.829 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.091379283, 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002340181 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3193, 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.501776007, 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000157148 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 3596, 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 3560, 2024-04-23T10:37:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3560, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 5.356440696, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001504618 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 36, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 2, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 11, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 1523, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 1, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 5, 2024-04-23T10:37:32.831 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 1517, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 1520, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 2307, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 1, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 1, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 5, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 7686, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 5510, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 20, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 1036, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-04-23T10:37:32.832 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 45, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 1067, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 45, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 2091, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 0, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 4, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 234, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 1, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 0, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-04-23T10:37:32.833 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 0, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 6, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 705, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 2523, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 1147, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 455, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 34, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 2749 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 382, 2024-04-23T10:37:32.834 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 2463, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 1703, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 1488, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 577, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 46, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 1885, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 1839, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-04-23T10:37:32.835 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 4, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 998, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 45, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 6267, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 6267, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-04-23T10:37:32.836 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 8, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 8, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 2, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 18866081, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 0, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 834, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 6.253441892, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.007498131 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.837 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 0 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 722, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 3902, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 3180, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 87, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 928, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 841, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 1523, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 5936, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 4413, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 1, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 2428, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 2427, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 74544, 2024-04-23T10:37:32.838 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 223608 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 5138, 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 340, 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 3596, 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 30, 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 1792, 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 445, 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.514899444, 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001157077 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 5, 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.003907597, 2024-04-23T10:37:32.839 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000781519 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1087, 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.380276794, 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000349840 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.840 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000132246, 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000132246 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.841 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-04-23T10:37:32.842 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.842 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.842 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.842 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.842 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-04-23T10:37:32.842 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.842 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.842 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.842 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.842 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.843 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 137, 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.133627820, 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000975385 2024-04-23T10:37:32.844 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.845 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 63, 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.405675052, 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.022312302 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.846 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.847 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-04-23T10:37:32.848 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1822, 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.917921743, 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001601493 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 2, 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 5, 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 3, 2024-04-23T10:37:32.849 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 2, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 1618, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 809, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 630, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-04-23T10:37:32.850 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-04-23T10:37:32.851 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 714889, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 919, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-04-23T10:37:32.852 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 8032, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 167, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 2963762, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 46394, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-04-23T10:37:32.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 2908, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 15046453, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 33, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 2908, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2908, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 6.877877607, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002365157 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2908, 2024-04-23T10:37:32.854 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2984 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 2908, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 58, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 2850, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 10, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 56, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 890, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 39, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-04-23T10:37:32.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 1862, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 2, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 20, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-04-23T10:37:32.856 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 100, 2024-04-23T10:37:32.857 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 14, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 12, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 12, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 78, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 4, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 23 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 1, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.858 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 1136 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 14, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 6, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 1847, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 1839, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 26063, 2024-04-23T10:37:32.859 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 10941175, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 26063, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 26063, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 10941175, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-04-23T10:37:32.860 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 2908, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 15241088, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2908, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 15241088, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:32.861 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 2908, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 2908, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2908, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2908, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.862 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 1839, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 194667, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 1839, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 56, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 194667, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:32.863 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x5571e3c78500": { 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 6267, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 14671777, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 6267, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 834, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 14671777, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-04-23T10:37:32.864 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:32.865 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-04-23T10:37:32.865 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-04-23T10:37:32.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:32 smithi146 ceph-mon[32800]: pgmap v333: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:37:32.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:32 smithi069 ceph-mon[29593]: pgmap v333: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:37:33.608 INFO:tasks.check_counter:Daemon mds.l mds.exported=45 2024-04-23T10:37:33.608 INFO:tasks.check_counter:Daemon mds.l mds.imported=45 2024-04-23T10:37:33.608 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=382 2024-04-23T10:37:33.608 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=2463 2024-04-23T10:37:33.608 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=1 2024-04-23T10:37:33.608 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-04-23T10:37:33.608 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-04-23T10:37:33.608 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-23T10:37:33.619 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-23T10:37:33.619 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:37:33.619 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:37:33.639 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-23T10:37:33.639 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:37:33.699 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:37:33.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.852+0000 7f543d60b640 1 -- 172.21.15.69:0/3947673035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5438103230 msgr2=0x7f5438103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:33.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.852+0000 7f543d60b640 1 --2- 172.21.15.69:0/3947673035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5438103230 0x7f5438103610 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f542c009900 tx=0x7f542c02a480 comp rx=0 tx=0).stop 2024-04-23T10:37:33.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.852+0000 7f543d60b640 1 -- 172.21.15.69:0/3947673035 shutdown_connections 2024-04-23T10:37:33.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.852+0000 7f543d60b640 1 --2- 172.21.15.69:0/3947673035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543810c570 0x7f543810e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:33.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.852+0000 7f543d60b640 1 --2- 172.21.15.69:0/3947673035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5438103b50 0x7f543810c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:33.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.852+0000 7f543d60b640 1 --2- 172.21.15.69:0/3947673035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5438103230 0x7f5438103610 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:33.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.852+0000 7f543d60b640 1 -- 172.21.15.69:0/3947673035 >> 172.21.15.69:0/3947673035 conn(0x7f5438077fb0 msgr2=0x7f54380783c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:33.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.852+0000 7f543d60b640 1 -- 172.21.15.69:0/3947673035 shutdown_connections 2024-04-23T10:37:33.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.852+0000 7f543d60b640 1 -- 172.21.15.69:0/3947673035 wait complete. 2024-04-23T10:37:33.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.853+0000 7f543d60b640 1 Processor -- start 2024-04-23T10:37:33.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.853+0000 7f543d60b640 1 -- start start 2024-04-23T10:37:33.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.853+0000 7f543d60b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5438103230 0x7f543819e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.853+0000 7f543d60b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5438103b50 0x7f543819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.853+0000 7f543d60b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543810c570 0x7f5438198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.853+0000 7f543d60b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5438112310 con 0x7f5438103b50 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.853+0000 7f543d60b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5438112190 con 0x7f543810c570 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.853+0000 7f543d60b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5438112490 con 0x7f5438103230 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.853+0000 7f54367fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5438103b50 0x7f543819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.853+0000 7f54367fc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5438103b50 0x7f543819eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56646/0 (socket says 172.21.15.69:56646) 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.853+0000 7f54367fc640 1 -- 172.21.15.69:0/2572126755 learned_addr learned my addr 172.21.15.69:0/2572126755 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f54377fe640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543810c570 0x7f5438198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f5436ffd640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5438103230 0x7f543819e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f54367fc640 1 -- 172.21.15.69:0/2572126755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5438103230 msgr2=0x7f543819e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:33.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f54367fc640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5438103230 0x7f543819e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f54367fc640 1 -- 172.21.15.69:0/2572126755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543810c570 msgr2=0x7f5438198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f54367fc640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543810c570 0x7f5438198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f54367fc640 1 -- 172.21.15.69:0/2572126755 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5438198f50 con 0x7f5438103b50 2024-04-23T10:37:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f5436ffd640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5438103230 0x7f543819e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:37:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f54367fc640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5438103b50 0x7f543819eac0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f542800d950 tx=0x7f542800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f541ffff640 1 -- 172.21.15.69:0/2572126755 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5428017030 con 0x7f5438103b50 2024-04-23T10:37:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f543d60b640 1 -- 172.21.15.69:0/2572126755 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5438199240 con 0x7f5438103b50 2024-04-23T10:37:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f541ffff640 1 -- 172.21.15.69:0/2572126755 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5428004020 con 0x7f5438103b50 2024-04-23T10:37:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f541ffff640 1 -- 172.21.15.69:0/2572126755 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54280047a0 con 0x7f5438103b50 2024-04-23T10:37:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.854+0000 7f543d60b640 1 -- 172.21.15.69:0/2572126755 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54381a5500 con 0x7f5438103b50 2024-04-23T10:37:33.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.855+0000 7f543d60b640 1 -- 172.21.15.69:0/2572126755 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f543806ad80 con 0x7f5438103b50 2024-04-23T10:37:33.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.856+0000 7f541ffff640 1 -- 172.21.15.69:0/2572126755 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f54280041d0 con 0x7f5438103b50 2024-04-23T10:37:33.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.857+0000 7f541ffff640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f54200a3d20 0x7f54200a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:33.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.857+0000 7f5436ffd640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f54200a3d20 0x7f54200a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:33.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.857+0000 7f541ffff640 1 -- 172.21.15.69:0/2572126755 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7f54280d08c0 con 0x7f5438103b50 2024-04-23T10:37:33.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.857+0000 7f5436ffd640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f54200a3d20 0x7f54200a61e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f542c005ab0 tx=0x7f542c005a20 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:33.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:33.860+0000 7f541ffff640 1 -- 172.21.15.69:0/2572126755 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f542809cf60 con 0x7f5438103b50 2024-04-23T10:37:34.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.039+0000 7f543d60b640 1 -- 172.21.15.69:0/2572126755 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54381076f0 con 0x7f5438103b50 2024-04-23T10:37:34.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.040+0000 7f541ffff640 1 -- 172.21.15.69:0/2572126755 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+23062 (secure 0 0 0) 0x7f542809c860 con 0x7f5438103b50 2024-04-23T10:37:34.039 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:37:34.039 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":100,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:37:16.483685+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/2621408239":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1024244898":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1462548780":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6800/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3272003821":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:37:34.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.042+0000 7f543d60b640 1 -- 172.21.15.69:0/2572126755 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f54200a3d20 msgr2=0x7f54200a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.042+0000 7f543d60b640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f54200a3d20 0x7f54200a61e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f542c005ab0 tx=0x7f542c005a20 comp rx=0 tx=0).stop 2024-04-23T10:37:34.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.042+0000 7f543d60b640 1 -- 172.21.15.69:0/2572126755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5438103b50 msgr2=0x7f543819eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.042+0000 7f543d60b640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5438103b50 0x7f543819eac0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f542800d950 tx=0x7f542800de10 comp rx=0 tx=0).stop 2024-04-23T10:37:34.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.042+0000 7f543d60b640 1 -- 172.21.15.69:0/2572126755 shutdown_connections 2024-04-23T10:37:34.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.042+0000 7f543d60b640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f54200a3d20 0x7f54200a61e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.042+0000 7f543d60b640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5438103b50 0x7f543819eac0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.042+0000 7f543d60b640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543810c570 0x7f5438198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.042+0000 7f543d60b640 1 --2- 172.21.15.69:0/2572126755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5438103230 0x7f543819e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.042+0000 7f543d60b640 1 -- 172.21.15.69:0/2572126755 >> 172.21.15.69:0/2572126755 conn(0x7f5438077fb0 msgr2=0x7f54380fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:34.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.042+0000 7f543d60b640 1 -- 172.21.15.69:0/2572126755 shutdown_connections 2024-04-23T10:37:34.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.043+0000 7f543d60b640 1 -- 172.21.15.69:0/2572126755 wait complete. 2024-04-23T10:37:34.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:20:19.007924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:24:50.484063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:24:51.816315+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 99, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:37:34.053 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:37:34.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.156+0000 7fd71c54a640 1 -- 172.21.15.69:0/44544716 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd714106170 msgr2=0x7fd71410dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.156+0000 7fd71c54a640 1 --2- 172.21.15.69:0/44544716 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd714106170 0x7fd71410dd40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009ca0 tx=0x7fd70c02a8c0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.156+0000 7fd71c54a640 1 -- 172.21.15.69:0/44544716 shutdown_connections 2024-04-23T10:37:34.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.156+0000 7fd71c54a640 1 --2- 172.21.15.69:0/44544716 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd714106170 0x7fd71410dd40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.156+0000 7fd71c54a640 1 --2- 172.21.15.69:0/44544716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd714101a50 0x7fd714105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.156+0000 7fd71c54a640 1 --2- 172.21.15.69:0/44544716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7141010a0 0x7fd714101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.156+0000 7fd71c54a640 1 -- 172.21.15.69:0/44544716 >> 172.21.15.69:0/44544716 conn(0x7fd7140771d0 msgr2=0x7fd7140775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.156+0000 7fd71c54a640 1 -- 172.21.15.69:0/44544716 shutdown_connections 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71c54a640 1 -- 172.21.15.69:0/44544716 wait complete. 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71c54a640 1 Processor -- start 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71c54a640 1 -- start start 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71c54a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7141010a0 0x7fd71419e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71c54a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd714106170 0x7fd71419e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71c54a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7141985f0 0x7fd714198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71c54a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd714112310 con 0x7fd7141010a0 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71c54a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd714112190 con 0x7fd7141985f0 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71c54a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd714112490 con 0x7fd714106170 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71a2e6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7141010a0 0x7fd71419e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71a2e6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7141010a0 0x7fd71419e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56656/0 (socket says 172.21.15.69:56656) 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.157+0000 7fd71a2e6640 1 -- 172.21.15.69:0/2091768495 learned_addr learned my addr 172.21.15.69:0/2091768495 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd719ae5640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd714106170 0x7fd71419e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd71aae7640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7141985f0 0x7fd714198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd71a2e6640 1 -- 172.21.15.69:0/2091768495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd714106170 msgr2=0x7fd71419e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd71a2e6640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd714106170 0x7fd71419e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd71a2e6640 1 -- 172.21.15.69:0/2091768495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7141985f0 msgr2=0x7fd714198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd71a2e6640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7141985f0 0x7fd714198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd71a2e6640 1 -- 172.21.15.69:0/2091768495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd714199110 con 0x7fd7141010a0 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd71a2e6640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7141010a0 0x7fd71419e440 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d950 tx=0x7fd71000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd70b7fe640 1 -- 172.21.15.69:0/2091768495 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710017070 con 0x7fd7141010a0 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd71c54a640 1 -- 172.21.15.69:0/2091768495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd714199400 con 0x7fd7141010a0 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd70b7fe640 1 -- 172.21.15.69:0/2091768495 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd710009c30 con 0x7fd7141010a0 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd70b7fe640 1 -- 172.21.15.69:0/2091768495 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71000f6b0 con 0x7fd7141010a0 2024-04-23T10:37:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.158+0000 7fd71c54a640 1 -- 172.21.15.69:0/2091768495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7141a56a0 con 0x7fd7141010a0 2024-04-23T10:37:34.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.159+0000 7fd71c54a640 1 -- 172.21.15.69:0/2091768495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7140691c0 con 0x7fd7141010a0 2024-04-23T10:37:34.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.160+0000 7fd70b7fe640 1 -- 172.21.15.69:0/2091768495 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fd7100109c0 con 0x7fd7141010a0 2024-04-23T10:37:34.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.161+0000 7fd70b7fe640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd7000a3d20 0x7fd7000a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.161+0000 7fd719ae5640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd7000a3d20 0x7fd7000a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.161+0000 7fd70b7fe640 1 -- 172.21.15.69:0/2091768495 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7fd7100d04f0 con 0x7fd7141010a0 2024-04-23T10:37:34.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.161+0000 7fd719ae5640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd7000a3d20 0x7fd7000a61e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd704005fd0 tx=0x7fd70400b510 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:34.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.165+0000 7fd70b7fe640 1 -- 172.21.15.69:0/2091768495 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd710009de0 con 0x7fd7141010a0 2024-04-23T10:37:34.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.343+0000 7fd71c54a640 1 -- 172.21.15.69:0/2091768495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd714109460 con 0x7fd7141010a0 2024-04-23T10:37:34.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.343+0000 7fd70b7fe640 1 -- 172.21.15.69:0/2091768495 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) ==== 93+0+10 (secure 0 0 0) 0x7fd71009cb90 con 0x7fd7141010a0 2024-04-23T10:37:34.342 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-04-23T10:37:34.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 -- 172.21.15.69:0/2091768495 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd7000a3d20 msgr2=0x7fd7000a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd7000a3d20 0x7fd7000a61e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd704005fd0 tx=0x7fd70400b510 comp rx=0 tx=0).stop 2024-04-23T10:37:34.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 -- 172.21.15.69:0/2091768495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7141010a0 msgr2=0x7fd71419e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7141010a0 0x7fd71419e440 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d950 tx=0x7fd71000de10 comp rx=0 tx=0).stop 2024-04-23T10:37:34.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 -- 172.21.15.69:0/2091768495 shutdown_connections 2024-04-23T10:37:34.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fd7000a3d20 0x7fd7000a61e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7141985f0 0x7fd714198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd714106170 0x7fd71419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 --2- 172.21.15.69:0/2091768495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7141010a0 0x7fd71419e440 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 -- 172.21.15.69:0/2091768495 >> 172.21.15.69:0/2091768495 conn(0x7fd7140771d0 msgr2=0x7fd7140fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:34.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 -- 172.21.15.69:0/2091768495 shutdown_connections 2024-04-23T10:37:34.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.345+0000 7fd71c54a640 1 -- 172.21.15.69:0/2091768495 wait complete. 2024-04-23T10:37:34.355 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:37:34.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.457+0000 7f2479f07640 1 -- 172.21.15.69:0/785129454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24741021a0 msgr2=0x7f2474102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.457+0000 7f2479f07640 1 --2- 172.21.15.69:0/785129454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24741021a0 0x7f2474102580 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2464009900 tx=0x7f246402a410 comp rx=0 tx=0).stop 2024-04-23T10:37:34.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.457+0000 7f2479f07640 1 -- 172.21.15.69:0/785129454 shutdown_connections 2024-04-23T10:37:34.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.457+0000 7f2479f07640 1 --2- 172.21.15.69:0/785129454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2474107270 0x7f247410ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.457+0000 7f2479f07640 1 --2- 172.21.15.69:0/785129454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2474102b50 0x7f2474106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.457+0000 7f2479f07640 1 --2- 172.21.15.69:0/785129454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24741021a0 0x7f2474102580 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.457+0000 7f2479f07640 1 -- 172.21.15.69:0/785129454 >> 172.21.15.69:0/785129454 conn(0x7f24740793e0 msgr2=0x7f24740797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:34.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.457+0000 7f2479f07640 1 -- 172.21.15.69:0/785129454 shutdown_connections 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.457+0000 7f2479f07640 1 -- 172.21.15.69:0/785129454 wait complete. 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.458+0000 7f2479f07640 1 Processor -- start 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.458+0000 7f2479f07640 1 -- start start 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.458+0000 7f2479f07640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24741021a0 0x7f24741a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.458+0000 7f2479f07640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2474107270 0x7f24741a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.458+0000 7f2479f07640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f247419a850 0x7f247419ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.458+0000 7f2479f07640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2474112310 con 0x7f2474107270 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.458+0000 7f2479f07640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2474112190 con 0x7f247419a850 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.458+0000 7f2479f07640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2474112490 con 0x7f24741021a0 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2472ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2474107270 0x7f24741a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2472ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2474107270 0x7f24741a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56674/0 (socket says 172.21.15.69:56674) 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2472ffd640 1 -- 172.21.15.69:0/1595198047 learned_addr learned my addr 172.21.15.69:0/1595198047 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2473fff640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f247419a850 0x7f247419ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f24737fe640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24741021a0 0x7f24741a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2472ffd640 1 -- 172.21.15.69:0/1595198047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24741021a0 msgr2=0x7f24741a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2472ffd640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24741021a0 0x7f24741a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2472ffd640 1 -- 172.21.15.69:0/1595198047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f247419a850 msgr2=0x7f247419ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2472ffd640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f247419a850 0x7f247419ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2472ffd640 1 -- 172.21.15.69:0/1595198047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247419b3e0 con 0x7f2474107270 2024-04-23T10:37:34.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f24737fe640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24741021a0 0x7f24741a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:37:34.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2472ffd640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2474107270 0x7f24741a0c20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f246800e9f0 tx=0x7f246800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:34.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2470ff9640 1 -- 172.21.15.69:0/1595198047 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246800ccc0 con 0x7f2474107270 2024-04-23T10:37:34.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2479f07640 1 -- 172.21.15.69:0/1595198047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247419b6d0 con 0x7f2474107270 2024-04-23T10:37:34.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2470ff9640 1 -- 172.21.15.69:0/1595198047 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f24680054f0 con 0x7f2474107270 2024-04-23T10:37:34.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2470ff9640 1 -- 172.21.15.69:0/1595198047 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468010690 con 0x7f2474107270 2024-04-23T10:37:34.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.459+0000 7f2479f07640 1 -- 172.21.15.69:0/1595198047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24741a7860 con 0x7f2474107270 2024-04-23T10:37:34.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.460+0000 7f2479f07640 1 -- 172.21.15.69:0/1595198047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2474103670 con 0x7f2474107270 2024-04-23T10:37:34.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.461+0000 7f2470ff9640 1 -- 172.21.15.69:0/1595198047 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f24680046c0 con 0x7f2474107270 2024-04-23T10:37:34.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.462+0000 7f2470ff9640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f245c0a3d20 0x7f245c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.462+0000 7f24737fe640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f245c0a3d20 0x7f245c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.462+0000 7f2470ff9640 1 -- 172.21.15.69:0/1595198047 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7f24680d0cc0 con 0x7f2474107270 2024-04-23T10:37:34.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.462+0000 7f24737fe640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f245c0a3d20 0x7f245c0a61e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2464005ab0 tx=0x7f2464005a20 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:34.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.466+0000 7f2470ff9640 1 -- 172.21.15.69:0/1595198047 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f247419b6d0 con 0x7f2474107270 2024-04-23T10:37:34.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.646+0000 7f2479f07640 1 -- 172.21.15.69:0/1595198047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2474102b50 con 0x7f2474107270 2024-04-23T10:37:34.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.647+0000 7f2470ff9640 1 -- 172.21.15.69:0/1595198047 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) ==== 104+0+11 (secure 0 0 0) 0x7f24680bbe20 con 0x7f2474107270 2024-04-23T10:37:34.646 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-04-23T10:37:34.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 -- 172.21.15.69:0/1595198047 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f245c0a3d20 msgr2=0x7f245c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f245c0a3d20 0x7f245c0a61e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2464005ab0 tx=0x7f2464005a20 comp rx=0 tx=0).stop 2024-04-23T10:37:34.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 -- 172.21.15.69:0/1595198047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2474107270 msgr2=0x7f24741a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2474107270 0x7f24741a0c20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f246800e9f0 tx=0x7f246800eeb0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 -- 172.21.15.69:0/1595198047 shutdown_connections 2024-04-23T10:37:34.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f245c0a3d20 0x7f245c0a61e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2474107270 0x7f24741a0c20 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f247419a850 0x7f247419ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 --2- 172.21.15.69:0/1595198047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24741021a0 0x7f24741a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 -- 172.21.15.69:0/1595198047 >> 172.21.15.69:0/1595198047 conn(0x7f24740793e0 msgr2=0x7f24740fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:34.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 -- 172.21.15.69:0/1595198047 shutdown_connections 2024-04-23T10:37:34.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.649+0000 7f2479f07640 1 -- 172.21.15.69:0/1595198047 wait complete. 2024-04-23T10:37:34.657 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:34 smithi069 ceph-mon[29593]: pgmap v334: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:37:34.657 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:34 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2572126755' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:37:34.658 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:34 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2091768495' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:37:34.659 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:37:34.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.761+0000 7f49823e2640 1 -- 172.21.15.69:0/2959205570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f497c100af0 msgr2=0x7f497c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.761+0000 7f49823e2640 1 --2- 172.21.15.69:0/2959205570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f497c100af0 0x7f497c100ed0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f496c009900 tx=0x7f496c02a410 comp rx=0 tx=0).stop 2024-04-23T10:37:34.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.761+0000 7f49823e2640 1 -- 172.21.15.69:0/2959205570 shutdown_connections 2024-04-23T10:37:34.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.761+0000 7f49823e2640 1 --2- 172.21.15.69:0/2959205570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f497c1072b0 0x7f497c10eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.761+0000 7f49823e2640 1 --2- 172.21.15.69:0/2959205570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f497c1014a0 0x7f497c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.761+0000 7f49823e2640 1 --2- 172.21.15.69:0/2959205570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f497c100af0 0x7f497c100ed0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.761+0000 7f49823e2640 1 -- 172.21.15.69:0/2959205570 >> 172.21.15.69:0/2959205570 conn(0x7f497c0760e0 msgr2=0x7f497c0764f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.761+0000 7f49823e2640 1 -- 172.21.15.69:0/2959205570 shutdown_connections 2024-04-23T10:37:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.761+0000 7f49823e2640 1 -- 172.21.15.69:0/2959205570 wait complete. 2024-04-23T10:37:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f49823e2640 1 Processor -- start 2024-04-23T10:37:34.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f49823e2640 1 -- start start 2024-04-23T10:37:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f49823e2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f497c100af0 0x7f497c19e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f49823e2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f497c1072b0 0x7f497c19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f49823e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f497c198610 0x7f497c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f49823e2640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f497c112370 con 0x7f497c1072b0 2024-04-23T10:37:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f49823e2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1121f0 con 0x7f497c100af0 2024-04-23T10:37:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f49823e2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1124f0 con 0x7f497c198610 2024-04-23T10:37:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f497b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f497c1072b0 0x7f497c19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f497b7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f497c1072b0 0x7f497c19e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56686/0 (socket says 172.21.15.69:56686) 2024-04-23T10:37:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f497b7fe640 1 -- 172.21.15.69:0/153548941 learned_addr learned my addr 172.21.15.69:0/153548941 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f497bfff640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f497c100af0 0x7f497c19e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f497b7fe640 1 -- 172.21.15.69:0/153548941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f497c198610 msgr2=0x7f497c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f498097f640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f497c198610 0x7f497c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f497b7fe640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f497c198610 0x7f497c198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f497b7fe640 1 -- 172.21.15.69:0/153548941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f497c100af0 msgr2=0x7f497c19e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f497b7fe640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f497c100af0 0x7f497c19e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f497b7fe640 1 -- 172.21.15.69:0/153548941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c199130 con 0x7f497c1072b0 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.762+0000 7f497b7fe640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f497c1072b0 0x7f497c19e9a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f497000c970 tx=0x7f497000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.763+0000 7f49797fa640 1 -- 172.21.15.69:0/153548941 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970007bb0 con 0x7f497c1072b0 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.763+0000 7f49823e2640 1 -- 172.21.15.69:0/153548941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c199420 con 0x7f497c1072b0 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.763+0000 7f49823e2640 1 -- 172.21.15.69:0/153548941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c1a56c0 con 0x7f497c1072b0 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.763+0000 7f49797fa640 1 -- 172.21.15.69:0/153548941 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4970007d50 con 0x7f497c1072b0 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.763+0000 7f49797fa640 1 -- 172.21.15.69:0/153548941 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497001d060 con 0x7f497c1072b0 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.764+0000 7f49823e2640 1 -- 172.21.15.69:0/153548941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4968005290 con 0x7f497c1072b0 2024-04-23T10:37:34.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.765+0000 7f49797fa640 1 -- 172.21.15.69:0/153548941 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f49700046c0 con 0x7f497c1072b0 2024-04-23T10:37:34.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.765+0000 7f49797fa640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f49640a3d20 0x7f49640a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:34.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.765+0000 7f497bfff640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f49640a3d20 0x7f49640a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:34.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.765+0000 7f49797fa640 1 -- 172.21.15.69:0/153548941 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7f49700d0770 con 0x7f497c1072b0 2024-04-23T10:37:34.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.766+0000 7f497bfff640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f49640a3d20 0x7f49640a61e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f496c009230 tx=0x7f496c0058d0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:34.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.769+0000 7f49797fa640 1 -- 172.21.15.69:0/153548941 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4970014030 con 0x7f497c1072b0 2024-04-23T10:37:34.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:34 smithi167 ceph-mon[32940]: pgmap v334: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:37:34.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:34 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2572126755' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:37:34.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:34 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2091768495' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:37:34.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:34 smithi146 ceph-mon[32800]: pgmap v334: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-23T10:37:34.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:34 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2572126755' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:37:34.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:34 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2091768495' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-23T10:37:34.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.944+0000 7f49823e2640 1 -- 172.21.15.69:0/153548941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4968005850 con 0x7f497c1072b0 2024-04-23T10:37:34.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.945+0000 7f49797fa640 1 -- 172.21.15.69:0/153548941 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) ==== 100+0+11 (secure 0 0 0) 0x7f497009ce10 con 0x7f497c1072b0 2024-04-23T10:37:34.943 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-04-23T10:37:34.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 -- 172.21.15.69:0/153548941 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f49640a3d20 msgr2=0x7f49640a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f49640a3d20 0x7f49640a61e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f496c009230 tx=0x7f496c0058d0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 -- 172.21.15.69:0/153548941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f497c1072b0 msgr2=0x7f497c19e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:34.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f497c1072b0 0x7f497c19e9a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f497000c970 tx=0x7f497000ce30 comp rx=0 tx=0).stop 2024-04-23T10:37:34.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 -- 172.21.15.69:0/153548941 shutdown_connections 2024-04-23T10:37:34.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f49640a3d20 0x7f49640a61e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f497c1072b0 0x7f497c19e9a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f497c198610 0x7f497c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 --2- 172.21.15.69:0/153548941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f497c100af0 0x7f497c19e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:34.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 -- 172.21.15.69:0/153548941 >> 172.21.15.69:0/153548941 conn(0x7f497c0760e0 msgr2=0x7f497c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:34.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 -- 172.21.15.69:0/153548941 shutdown_connections 2024-04-23T10:37:34.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:34.947+0000 7f49823e2640 1 -- 172.21.15.69:0/153548941 wait complete. 2024-04-23T10:37:34.957 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T10:37:35.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.057+0000 7f0233820640 1 -- 172.21.15.69:0/2423091216 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f022c107240 msgr2=0x7f022c10ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:35.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.057+0000 7f0233820640 1 --2- 172.21.15.69:0/2423091216 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f022c107240 0x7f022c10ee10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0224009ca0 tx=0x7f022402a8c0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.057+0000 7f0233820640 1 -- 172.21.15.69:0/2423091216 shutdown_connections 2024-04-23T10:37:35.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.057+0000 7f0233820640 1 --2- 172.21.15.69:0/2423091216 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f022c107240 0x7f022c10ee10 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.057+0000 7f0233820640 1 --2- 172.21.15.69:0/2423091216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f022c102b20 0x7f022c106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.057+0000 7f0233820640 1 --2- 172.21.15.69:0/2423091216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f022c102170 0x7f022c102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.057+0000 7f0233820640 1 -- 172.21.15.69:0/2423091216 >> 172.21.15.69:0/2423091216 conn(0x7f022c079310 msgr2=0x7f022c079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:35.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.057+0000 7f0233820640 1 -- 172.21.15.69:0/2423091216 shutdown_connections 2024-04-23T10:37:35.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.057+0000 7f0233820640 1 -- 172.21.15.69:0/2423091216 wait complete. 2024-04-23T10:37:35.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0233820640 1 Processor -- start 2024-04-23T10:37:35.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0233820640 1 -- start start 2024-04-23T10:37:35.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0233820640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f022c102170 0x7f022c198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:35.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0233820640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f022c107240 0x7f022c198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:35.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0233820640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f022c19d000 0x7f022c19d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:35.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0233820640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f022c1122e0 con 0x7f022c19d000 2024-04-23T10:37:35.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0233820640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f022c112160 con 0x7f022c102170 2024-04-23T10:37:35.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0233820640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f022c112460 con 0x7f022c107240 2024-04-23T10:37:35.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0231dbd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f022c19d000 0x7f022c19d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:35.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0231dbd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f022c19d000 0x7f022c19d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56710/0 (socket says 172.21.15.69:56710) 2024-04-23T10:37:35.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0231dbd640 1 -- 172.21.15.69:0/3623390078 learned_addr learned my addr 172.21.15.69:0/3623390078 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:35.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f02315bc640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f022c102170 0x7f022c198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:35.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0230dbb640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f022c107240 0x7f022c198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:35.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0231dbd640 1 -- 172.21.15.69:0/3623390078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f022c107240 msgr2=0x7f022c198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:35.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0231dbd640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f022c107240 0x7f022c198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0231dbd640 1 -- 172.21.15.69:0/3623390078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f022c102170 msgr2=0x7f022c198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:35.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0231dbd640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f022c102170 0x7f022c198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0231dbd640 1 -- 172.21.15.69:0/3623390078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c19daf0 con 0x7f022c19d000 2024-04-23T10:37:35.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f02315bc640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f022c102170 0x7f022c198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:37:35.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0230dbb640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f022c107240 0x7f022c198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:37:35.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.058+0000 7f0231dbd640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f022c19d000 0x7f022c19d4b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0224005e30 tx=0x7f0224003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:35.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.059+0000 7f02227fc640 1 -- 172.21.15.69:0/3623390078 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224031650 con 0x7f022c19d000 2024-04-23T10:37:35.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.059+0000 7f02227fc640 1 -- 172.21.15.69:0/3623390078 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f02240317f0 con 0x7f022c19d000 2024-04-23T10:37:35.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.059+0000 7f0233820640 1 -- 172.21.15.69:0/3623390078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022c19dd80 con 0x7f022c19d000 2024-04-23T10:37:35.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.059+0000 7f02227fc640 1 -- 172.21.15.69:0/3623390078 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022402fb70 con 0x7f022c19d000 2024-04-23T10:37:35.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.059+0000 7f0233820640 1 -- 172.21.15.69:0/3623390078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022c1a55a0 con 0x7f022c19d000 2024-04-23T10:37:35.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.060+0000 7f0233820640 1 -- 172.21.15.69:0/3623390078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022c0691c0 con 0x7f022c19d000 2024-04-23T10:37:35.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.061+0000 7f02227fc640 1 -- 172.21.15.69:0/3623390078 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f022402fd10 con 0x7f022c19d000 2024-04-23T10:37:35.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.062+0000 7f02227fc640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02180a3d20 0x7f02180a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:35.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.062+0000 7f02315bc640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02180a3d20 0x7f02180a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:35.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.062+0000 7f02227fc640 1 -- 172.21.15.69:0/3623390078 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7f02240f1e50 con 0x7f022c19d000 2024-04-23T10:37:35.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.062+0000 7f02315bc640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02180a3d20 0x7f02180a61e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f022800baa0 tx=0x7f0228005d90 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:35.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.065+0000 7f02227fc640 1 -- 172.21.15.69:0/3623390078 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f02240be5e0 con 0x7f022c19d000 2024-04-23T10:37:35.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.257+0000 7f0233820640 1 -- 172.21.15.69:0/3623390078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f022c199a90 con 0x7f022c19d000 2024-04-23T10:37:35.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.257+0000 7f02227fc640 1 -- 172.21.15.69:0/3623390078 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v100) ==== 81+0+943 (secure 0 0 0) 0x7f022c199a90 con 0x7f022c19d000 2024-04-23T10:37:35.256 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/2621408239 2024-04-24T10:26:53.261526+0000 2024-04-23T10:37:35.256 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1024244898 2024-04-24T10:26:53.261526+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/847729550 2024-04-24T10:26:53.261526+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1462548780 2024-04-24T10:26:53.261526+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/847729550 2024-04-24T10:26:53.261526+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/3345837257 2024-04-24T10:17:58.923795+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/2765886879 2024-04-24T10:17:58.923795+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/2817046344 2024-04-24T10:17:58.923795+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/2746602813 2024-04-24T10:17:32.944635+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/2746602813 2024-04-24T10:17:32.944635+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3571277589 2024-04-24T10:17:32.944635+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/3345837257 2024-04-24T10:17:58.923795+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/617257351 2024-04-24T10:17:32.944635+0000 2024-04-23T10:37:35.257 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1291208672 2024-04-24T10:17:32.944635+0000 2024-04-23T10:37:35.258 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3272003821 2024-04-24T10:26:53.261526+0000 2024-04-23T10:37:35.258 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1162910246 2024-04-24T10:17:58.923795+0000 2024-04-23T10:37:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:listed 16 entries 2024-04-23T10:37:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 -- 172.21.15.69:0/3623390078 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02180a3d20 msgr2=0x7f02180a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02180a3d20 0x7f02180a61e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f022800baa0 tx=0x7f0228005d90 comp rx=0 tx=0).stop 2024-04-23T10:37:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 -- 172.21.15.69:0/3623390078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f022c19d000 msgr2=0x7f022c19d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f022c19d000 0x7f022c19d4b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0224005e30 tx=0x7f0224003f90 comp rx=0 tx=0).stop 2024-04-23T10:37:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 -- 172.21.15.69:0/3623390078 shutdown_connections 2024-04-23T10:37:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f02180a3d20 0x7f02180a61e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f022c19d000 0x7f022c19d4b0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f022c107240 0x7f022c198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 --2- 172.21.15.69:0/3623390078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f022c102170 0x7f022c198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 -- 172.21.15.69:0/3623390078 >> 172.21.15.69:0/3623390078 conn(0x7f022c079310 msgr2=0x7f022c0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:35.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 -- 172.21.15.69:0/3623390078 shutdown_connections 2024-04-23T10:37:35.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.259+0000 7f0233820640 1 -- 172.21.15.69:0/3623390078 wait complete. 2024-04-23T10:37:35.270 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-23T10:37:35.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:37:35.270 DEBUG:teuthology.orchestra.run.smithi069:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-23T10:37:35.345 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2024-04-23T10:37:35.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:37:35.346 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-23T10:37:35.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:37:35.390 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-04-23T10:37:35.468 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-23T10:37:35.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:37:35.469 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:37:35.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:37:35.546 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2024-04-23T10:37:35.652 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-23T10:37:35.663 INFO:tasks.cephadm:Teardown begin 2024-04-23T10:37:35.663 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-23T10:37:35.664 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:37:35.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.770+0000 7f106e660640 1 -- 172.21.15.69:0/946421312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1068107290 msgr2=0x7f106810ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:35.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.770+0000 7f106e660640 1 --2- 172.21.15.69:0/946421312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1068107290 0x7f106810ee60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1060009ca0 tx=0x7f106002a8c0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.770+0000 7f106e660640 1 -- 172.21.15.69:0/946421312 shutdown_connections 2024-04-23T10:37:35.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.770+0000 7f106e660640 1 --2- 172.21.15.69:0/946421312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1068107290 0x7f106810ee60 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.770+0000 7f106e660640 1 --2- 172.21.15.69:0/946421312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1068102c20 0x7f1068106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.770+0000 7f106e660640 1 --2- 172.21.15.69:0/946421312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1068102270 0x7f1068102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.770+0000 7f106e660640 1 -- 172.21.15.69:0/946421312 >> 172.21.15.69:0/946421312 conn(0x7f10680790e0 msgr2=0x7f10680794f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:35.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.770+0000 7f106e660640 1 -- 172.21.15.69:0/946421312 shutdown_connections 2024-04-23T10:37:35.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.770+0000 7f106e660640 1 -- 172.21.15.69:0/946421312 wait complete. 2024-04-23T10:37:35.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.770+0000 7f106e660640 1 Processor -- start 2024-04-23T10:37:35.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.770+0000 7f106e660640 1 -- start start 2024-04-23T10:37:35.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106e660640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1068102270 0x7f1068074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:35.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106e660640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1068107290 0x7f1068074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:35.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106e660640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1068074cd0 0x7f10681a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:35.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106e660640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f10681123a0 con 0x7f1068074cd0 2024-04-23T10:37:35.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106e660640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1068112220 con 0x7f1068107290 2024-04-23T10:37:35.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106e660640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1068112520 con 0x7f1068102270 2024-04-23T10:37:35.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106cbfd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1068074cd0 0x7f10681a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:35.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106cbfd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1068074cd0 0x7f10681a6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56736/0 (socket says 172.21.15.69:56736) 2024-04-23T10:37:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106cbfd640 1 -- 172.21.15.69:0/1878608870 learned_addr learned my addr 172.21.15.69:0/1878608870 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f10677fe640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1068107290 0x7f1068074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f1067fff640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1068102270 0x7f1068074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106cbfd640 1 -- 172.21.15.69:0/1878608870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1068102270 msgr2=0x7f1068074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106cbfd640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1068102270 0x7f1068074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106cbfd640 1 -- 172.21.15.69:0/1878608870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1068107290 msgr2=0x7f1068074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106cbfd640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1068107290 0x7f1068074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106cbfd640 1 -- 172.21.15.69:0/1878608870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10681a7110 con 0x7f1068074cd0 2024-04-23T10:37:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f1067fff640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1068102270 0x7f1068074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:37:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.771+0000 7f106cbfd640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1068074cd0 0x7f10681a6a10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1060033040 tx=0x7f1060003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.772+0000 7f10657fa640 1 -- 172.21.15.69:0/1878608870 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060031650 con 0x7f1068074cd0 2024-04-23T10:37:35.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.772+0000 7f10657fa640 1 -- 172.21.15.69:0/1878608870 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10600317f0 con 0x7f1068074cd0 2024-04-23T10:37:35.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.772+0000 7f106e660640 1 -- 172.21.15.69:0/1878608870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10681a73a0 con 0x7f1068074cd0 2024-04-23T10:37:35.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.772+0000 7f10657fa640 1 -- 172.21.15.69:0/1878608870 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106002fa40 con 0x7f1068074cd0 2024-04-23T10:37:35.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.772+0000 7f106e660640 1 -- 172.21.15.69:0/1878608870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10681a78f0 con 0x7f1068074cd0 2024-04-23T10:37:35.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.773+0000 7f106e660640 1 -- 172.21.15.69:0/1878608870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1068068d70 con 0x7f1068074cd0 2024-04-23T10:37:35.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.774+0000 7f10657fa640 1 -- 172.21.15.69:0/1878608870 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f106002fc20 con 0x7f1068074cd0 2024-04-23T10:37:35.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.774+0000 7f10657fa640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f10500a3d50 0x7f10500a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:35.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.775+0000 7f10657fa640 1 -- 172.21.15.69:0/1878608870 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7f10600f1b00 con 0x7f1068074cd0 2024-04-23T10:37:35.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.775+0000 7f1067fff640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f10500a3d50 0x7f10500a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:35.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.775+0000 7f1067fff640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f10500a3d50 0x7f10500a6210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1058009b40 tx=0x7f1058005e50 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:35.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:35.779+0000 7f10657fa640 1 -- 172.21.15.69:0/1878608870 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f10600be2b0 con 0x7f1068074cd0 2024-04-23T10:37:35.808 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:35 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1595198047' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:37:35.808 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:35 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/153548941' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:37:35.808 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:35 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3623390078' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T10:37:35.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:35 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1595198047' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:37:35.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:35 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/153548941' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:37:35.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:35 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3623390078' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T10:37:35.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:35 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1595198047' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-23T10:37:35.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:35 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/153548941' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-23T10:37:35.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:35 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3623390078' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-23T10:37:36.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.006+0000 7f106e660640 1 -- 172.21.15.69:0/1878608870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1068102c20 con 0x7f1068074cd0 2024-04-23T10:37:36.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.007+0000 7f10657fa640 1 -- 172.21.15.69:0/1878608870 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+11930 (secure 0 0 0) 0x7f10600bdbb0 con 0x7f1068074cd0 2024-04-23T10:37:36.007 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:37:36.007 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":51,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:33:43.515914+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25297":{"gid":25297,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/1216686871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1216686871},{"type":"v1","addr":"172.21.15.167:6835","nonce":1216686871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24421,24463,24487,24392,24416]},"id":1}]} 2024-04-23T10:37:36.007 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 51 2024-04-23T10:37:36.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.009+0000 7f106e660640 1 -- 172.21.15.69:0/1878608870 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f10500a3d50 msgr2=0x7f10500a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.009+0000 7f106e660640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f10500a3d50 0x7f10500a6210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1058009b40 tx=0x7f1058005e50 comp rx=0 tx=0).stop 2024-04-23T10:37:36.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.009+0000 7f106e660640 1 -- 172.21.15.69:0/1878608870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1068074cd0 msgr2=0x7f10681a6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.009+0000 7f106e660640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1068074cd0 0x7f10681a6a10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1060033040 tx=0x7f1060003ce0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.010+0000 7f106e660640 1 -- 172.21.15.69:0/1878608870 shutdown_connections 2024-04-23T10:37:36.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.010+0000 7f106e660640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f10500a3d50 0x7f10500a6210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.010+0000 7f106e660640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1068074cd0 0x7f10681a6a10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.010+0000 7f106e660640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1068107290 0x7f1068074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.010+0000 7f106e660640 1 --2- 172.21.15.69:0/1878608870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1068102270 0x7f1068074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.010+0000 7f106e660640 1 -- 172.21.15.69:0/1878608870 >> 172.21.15.69:0/1878608870 conn(0x7f10680790e0 msgr2=0x7f10681000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:36.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.010+0000 7f106e660640 1 -- 172.21.15.69:0/1878608870 shutdown_connections 2024-04-23T10:37:36.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.010+0000 7f106e660640 1 -- 172.21.15.69:0/1878608870 wait complete. 2024-04-23T10:37:36.021 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:37:36.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.120+0000 7f62985c6640 1 -- 172.21.15.69:0/4078212688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f629010c520 msgr2=0x7f629010e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.120+0000 7f62985c6640 1 --2- 172.21.15.69:0/4078212688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f629010c520 0x7f629010e9c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6288009ca0 tx=0x7f628802a9e0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.120+0000 7f62985c6640 1 -- 172.21.15.69:0/4078212688 shutdown_connections 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.120+0000 7f62985c6640 1 --2- 172.21.15.69:0/4078212688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f629010c520 0x7f629010e9c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.120+0000 7f62985c6640 1 --2- 172.21.15.69:0/4078212688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6290103b00 0x7f629010bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.120+0000 7f62985c6640 1 --2- 172.21.15.69:0/4078212688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62901031e0 0x7f62901035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.120+0000 7f62985c6640 1 -- 172.21.15.69:0/4078212688 >> 172.21.15.69:0/4078212688 conn(0x7f6290077f50 msgr2=0x7f6290078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.120+0000 7f62985c6640 1 -- 172.21.15.69:0/4078212688 shutdown_connections 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.120+0000 7f62985c6640 1 -- 172.21.15.69:0/4078212688 wait complete. 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f62985c6640 1 Processor -- start 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f62985c6640 1 -- start start 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f62985c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62901031e0 0x7f6290198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f62985c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6290103b00 0x7f6290198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f62985c6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f629010c520 0x7f629019cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f62985c6640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f62901122f0 con 0x7f629010c520 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f62985c6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6290112170 con 0x7f62901031e0 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f62985c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6290112470 con 0x7f6290103b00 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f6296b63640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f629010c520 0x7f629019cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f6296b63640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f629010c520 0x7f629019cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56748/0 (socket says 172.21.15.69:56748) 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f6296b63640 1 -- 172.21.15.69:0/3832085738 learned_addr learned my addr 172.21.15.69:0/3832085738 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f6296362640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62901031e0 0x7f6290198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f6295b61640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6290103b00 0x7f6290198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f6296b63640 1 -- 172.21.15.69:0/3832085738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6290103b00 msgr2=0x7f6290198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f6296b63640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6290103b00 0x7f6290198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f6296b63640 1 -- 172.21.15.69:0/3832085738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62901031e0 msgr2=0x7f6290198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f6296b63640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62901031e0 0x7f6290198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.121+0000 7f6296b63640 1 -- 172.21.15.69:0/3832085738 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629019d720 con 0x7f629010c520 2024-04-23T10:37:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.122+0000 7f6296b63640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f629010c520 0x7f629019cff0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6288004af0 tx=0x7f6288003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.122+0000 7f62877fe640 1 -- 172.21.15.69:0/3832085738 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288047070 con 0x7f629010c520 2024-04-23T10:37:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.122+0000 7f62877fe640 1 -- 172.21.15.69:0/3832085738 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f628802fb10 con 0x7f629010c520 2024-04-23T10:37:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.122+0000 7f62985c6640 1 -- 172.21.15.69:0/3832085738 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f629019d9b0 con 0x7f629010c520 2024-04-23T10:37:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.122+0000 7f62877fe640 1 -- 172.21.15.69:0/3832085738 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288033050 con 0x7f629010c520 2024-04-23T10:37:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.122+0000 7f62985c6640 1 -- 172.21.15.69:0/3832085738 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62901a52a0 con 0x7f629010c520 2024-04-23T10:37:36.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.123+0000 7f62985c6640 1 -- 172.21.15.69:0/3832085738 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6290068d70 con 0x7f629010c520 2024-04-23T10:37:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.124+0000 7f62877fe640 1 -- 172.21.15.69:0/3832085738 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f628802fd10 con 0x7f629010c520 2024-04-23T10:37:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.125+0000 7f62877fe640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f627c0a3da0 0x7f627c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.125+0000 7f62877fe640 1 -- 172.21.15.69:0/3832085738 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7f62880f1860 con 0x7f629010c520 2024-04-23T10:37:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.125+0000 7f6296362640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f627c0a3da0 0x7f627c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.125+0000 7f6296362640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f627c0a3da0 0x7f627c0a6260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f628c00abe0 tx=0x7f628c00a2d0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:36.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.129+0000 7f62877fe640 1 -- 172.21.15.69:0/3832085738 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6288051080 con 0x7f629010c520 2024-04-23T10:37:36.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.349+0000 7f62985c6640 1 -- 172.21.15.69:0/3832085738 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62901a54d0 con 0x7f629010c520 2024-04-23T10:37:36.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.349+0000 7f62877fe640 1 -- 172.21.15.69:0/3832085738 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+11930 (secure 0 0 0) 0x7f62880bdfc0 con 0x7f629010c520 2024-04-23T10:37:36.349 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:37:36.350 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/731475212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":731475212},{"type":"v1","addr":"172.21.15.69:6835","nonce":731475212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3924839786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":3924839786},{"type":"v1","addr":"172.21.15.69:6837","nonce":3924839786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":51,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-23T10:24:52.877417+0000","modified":"2024-04-23T10:33:43.515914+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24463,"mds_2":24421,"mds_3":24416,"mds_4":24392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/441538329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":441538329},{"type":"v1","addr":"172.21.15.69:6839","nonce":441538329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/3448889268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":3448889268},{"type":"v1","addr":"172.21.15.69:6841","nonce":3448889268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24368":{"gid":24368,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/318414865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":318414865},{"type":"v1","addr":"172.21.15.146:6833","nonce":318414865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"e","rank":4,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/3824729166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3824729166},{"type":"v1","addr":"172.21.15.146:6835","nonce":3824729166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"h","rank":3,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6837/1505523103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1505523103},{"type":"v1","addr":"172.21.15.146:6837","nonce":1505523103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6833/977410598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":977410598},{"type":"v1","addr":"172.21.15.167:6833","nonce":977410598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"b","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6839/712940861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":712940861},{"type":"v1","addr":"172.21.15.146:6839","nonce":712940861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":1,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.167:6837/1671189160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1671189160},{"type":"v1","addr":"172.21.15.167:6837","nonce":1671189160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6839/1688975356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":1688975356},{"type":"v1","addr":"172.21.15.167:6839","nonce":1688975356}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25297":{"gid":25297,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/1216686871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":1216686871},{"type":"v1","addr":"172.21.15.167:6835","nonce":1216686871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24421,24463,24487,24392,24416]},"id":1}]} 2024-04-23T10:37:36.350 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 51 2024-04-23T10:37:36.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.351+0000 7f62985c6640 1 -- 172.21.15.69:0/3832085738 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f627c0a3da0 msgr2=0x7f627c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.351+0000 7f62985c6640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f627c0a3da0 0x7f627c0a6260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f628c00abe0 tx=0x7f628c00a2d0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.351+0000 7f62985c6640 1 -- 172.21.15.69:0/3832085738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f629010c520 msgr2=0x7f629019cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.351+0000 7f62985c6640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f629010c520 0x7f629019cff0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6288004af0 tx=0x7f6288003bf0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.352+0000 7f62985c6640 1 -- 172.21.15.69:0/3832085738 shutdown_connections 2024-04-23T10:37:36.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.352+0000 7f62985c6640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f627c0a3da0 0x7f627c0a6260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.352+0000 7f62985c6640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f629010c520 0x7f629019cff0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.352+0000 7f62985c6640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6290103b00 0x7f6290198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.352+0000 7f62985c6640 1 --2- 172.21.15.69:0/3832085738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62901031e0 0x7f6290198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.352+0000 7f62985c6640 1 -- 172.21.15.69:0/3832085738 >> 172.21.15.69:0/3832085738 conn(0x7f6290077f50 msgr2=0x7f62900fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:36.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.352+0000 7f62985c6640 1 -- 172.21.15.69:0/3832085738 shutdown_connections 2024-04-23T10:37:36.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.352+0000 7f62985c6640 1 -- 172.21.15.69:0/3832085738 wait complete. 2024-04-23T10:37:36.363 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:37:36.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.461+0000 7efcb3322640 1 -- 172.21.15.69:0/2786436914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcac1031e0 msgr2=0x7efcac1035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.461+0000 7efcb3322640 1 --2- 172.21.15.69:0/2786436914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcac1031e0 0x7efcac1035c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009900 tx=0x7efc9c02a510 comp rx=0 tx=0).stop 2024-04-23T10:37:36.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.461+0000 7efcb3322640 1 -- 172.21.15.69:0/2786436914 shutdown_connections 2024-04-23T10:37:36.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.461+0000 7efcb3322640 1 --2- 172.21.15.69:0/2786436914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcac10c520 0x7efcac10e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.461+0000 7efcb3322640 1 --2- 172.21.15.69:0/2786436914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcac103b00 0x7efcac10bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.461+0000 7efcb3322640 1 --2- 172.21.15.69:0/2786436914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcac1031e0 0x7efcac1035c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.461+0000 7efcb3322640 1 -- 172.21.15.69:0/2786436914 >> 172.21.15.69:0/2786436914 conn(0x7efcac077f50 msgr2=0x7efcac078360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:36.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.461+0000 7efcb3322640 1 -- 172.21.15.69:0/2786436914 shutdown_connections 2024-04-23T10:37:36.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.461+0000 7efcb3322640 1 -- 172.21.15.69:0/2786436914 wait complete. 2024-04-23T10:37:36.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb3322640 1 Processor -- start 2024-04-23T10:37:36.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb3322640 1 -- start start 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb3322640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcac1031e0 0x7efcac19e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb3322640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcac103b00 0x7efcac19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb3322640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcac10c520 0x7efcac1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb3322640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7efcac1123d0 con 0x7efcac103b00 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb3322640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efcac112250 con 0x7efcac10c520 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb3322640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efcac112550 con 0x7efcac1031e0 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb08bd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcac103b00 0x7efcac19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb08bd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcac103b00 0x7efcac19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56768/0 (socket says 172.21.15.69:56768) 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb08bd640 1 -- 172.21.15.69:0/4010308787 learned_addr learned my addr 172.21.15.69:0/4010308787 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb10be640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcac1031e0 0x7efcac19e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb18bf640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcac10c520 0x7efcac1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb08bd640 1 -- 172.21.15.69:0/4010308787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcac1031e0 msgr2=0x7efcac19e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb08bd640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcac1031e0 0x7efcac19e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb08bd640 1 -- 172.21.15.69:0/4010308787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcac10c520 msgr2=0x7efcac1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.462+0000 7efcb08bd640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcac10c520 0x7efcac1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.463+0000 7efcb08bd640 1 -- 172.21.15.69:0/4010308787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac198f90 con 0x7efcac103b00 2024-04-23T10:37:36.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.463+0000 7efcb18bf640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcac10c520 0x7efcac1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:37:36.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.463+0000 7efcb08bd640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcac103b00 0x7efcac19eb90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efca800b4a0 tx=0x7efca800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:36.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.463+0000 7efca27fc640 1 -- 172.21.15.69:0/4010308787 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca8014070 con 0x7efcac103b00 2024-04-23T10:37:36.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.463+0000 7efca27fc640 1 -- 172.21.15.69:0/4010308787 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efca8010ae0 con 0x7efcac103b00 2024-04-23T10:37:36.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.463+0000 7efcb3322640 1 -- 172.21.15.69:0/4010308787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcac199280 con 0x7efcac103b00 2024-04-23T10:37:36.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.463+0000 7efca27fc640 1 -- 172.21.15.69:0/4010308787 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca8017ce0 con 0x7efcac103b00 2024-04-23T10:37:36.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.463+0000 7efcb3322640 1 -- 172.21.15.69:0/4010308787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcac1a54a0 con 0x7efcac103b00 2024-04-23T10:37:36.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.464+0000 7efcb3322640 1 -- 172.21.15.69:0/4010308787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcac0698e0 con 0x7efcac103b00 2024-04-23T10:37:36.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.466+0000 7efca27fc640 1 -- 172.21.15.69:0/4010308787 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7efca8017070 con 0x7efcac103b00 2024-04-23T10:37:36.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.466+0000 7efca27fc640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efc980a3d20 0x7efc980a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.467+0000 7efcb10be640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efc980a3d20 0x7efc980a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.467+0000 7efca27fc640 1 -- 172.21.15.69:0/4010308787 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7efca80cfdf0 con 0x7efcac103b00 2024-04-23T10:37:36.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.467+0000 7efcb10be640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efc980a3d20 0x7efc980a61e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009230 tx=0x7efc9c0058d0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:36.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.469+0000 7efca27fc640 1 -- 172.21.15.69:0/4010308787 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efca809c5a0 con 0x7efcac103b00 2024-04-23T10:37:36.622 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:36 smithi069 ceph-mon[29593]: pgmap v335: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:37:36.622 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:36 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1878608870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:37:36.622 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:36 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3832085738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:37:36.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.668+0000 7efcb3322640 1 -- 172.21.15.69:0/4010308787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcac1076a0 con 0x7efcac103b00 2024-04-23T10:37:36.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.670+0000 7efca27fc640 1 -- 172.21.15.69:0/4010308787 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+23062 (secure 0 0 0) 0x7efca809bea0 con 0x7efcac103b00 2024-04-23T10:37:36.670 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-23T10:37:36.670 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":100,"fsid":"ac4c3a2c-0159-11ef-bc93-c7b262605968","created":"2024-04-23T10:17:06.615299+0000","modified":"2024-04-23T10:37:16.483685+0000","last_up_change":"2024-04-23T10:24:05.196718+0000","last_in_change":"2024-04-23T10:23:45.551515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:20:19.007924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:24:50.484063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:24:51.816315+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"923a3db0-8499-4796-95e0-e95c2edfe544","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6803","nonce":3356554384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6805","nonce":3356554384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6809","nonce":3356554384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3356554384},{"type":"v1","addr":"172.21.15.69:6807","nonce":3356554384}]},"public_addr":"172.21.15.69:6803/3356554384","cluster_addr":"172.21.15.69:6805/3356554384","heartbeat_back_addr":"172.21.15.69:6809/3356554384","heartbeat_front_addr":"172.21.15.69:6807/3356554384","state":["exists","up"]},{"osd":1,"uuid":"17631476-4d26-4024-8f2c-189f271784e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6801","nonce":3367484957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6803","nonce":3367484957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6807","nonce":3367484957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3367484957},{"type":"v1","addr":"172.21.15.146:6805","nonce":3367484957}]},"public_addr":"172.21.15.146:6801/3367484957","cluster_addr":"172.21.15.146:6803/3367484957","heartbeat_back_addr":"172.21.15.146:6807/3367484957","heartbeat_front_addr":"172.21.15.146:6805/3367484957","state":["exists","up"]},{"osd":2,"uuid":"8acd12b7-4162-4f91-b3c6-772c8602c23c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6801","nonce":683605644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6803","nonce":683605644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6807","nonce":683605644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":683605644},{"type":"v1","addr":"172.21.15.167:6805","nonce":683605644}]},"public_addr":"172.21.15.167:6801/683605644","cluster_addr":"172.21.15.167:6803/683605644","heartbeat_back_addr":"172.21.15.167:6807/683605644","heartbeat_front_addr":"172.21.15.167:6805/683605644","state":["exists","up"]},{"osd":3,"uuid":"98a9cc15-ea9d-49a8-9173-3011a6547589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6811","nonce":4041470719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6813","nonce":4041470719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6817","nonce":4041470719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":4041470719},{"type":"v1","addr":"172.21.15.69:6815","nonce":4041470719}]},"public_addr":"172.21.15.69:6811/4041470719","cluster_addr":"172.21.15.69:6813/4041470719","heartbeat_back_addr":"172.21.15.69:6817/4041470719","heartbeat_front_addr":"172.21.15.69:6815/4041470719","state":["exists","up"]},{"osd":4,"uuid":"510df960-9801-46ba-8a2d-c4e89df94af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6809","nonce":1408511598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6811","nonce":1408511598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6815","nonce":1408511598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1408511598},{"type":"v1","addr":"172.21.15.146:6813","nonce":1408511598}]},"public_addr":"172.21.15.146:6809/1408511598","cluster_addr":"172.21.15.146:6811/1408511598","heartbeat_back_addr":"172.21.15.146:6815/1408511598","heartbeat_front_addr":"172.21.15.146:6813/1408511598","state":["exists","up"]},{"osd":5,"uuid":"9d20822f-0707-4836-96ac-f7dde45401f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6809","nonce":2875657496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6811","nonce":2875657496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6815","nonce":2875657496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2875657496},{"type":"v1","addr":"172.21.15.167:6813","nonce":2875657496}]},"public_addr":"172.21.15.167:6809/2875657496","cluster_addr":"172.21.15.167:6811/2875657496","heartbeat_back_addr":"172.21.15.167:6815/2875657496","heartbeat_front_addr":"172.21.15.167:6813/2875657496","state":["exists","up"]},{"osd":6,"uuid":"a6e4d748-c616-4ae4-a9ad-96a45037a58d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6819","nonce":556723413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6821","nonce":556723413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6825","nonce":556723413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":556723413},{"type":"v1","addr":"172.21.15.69:6823","nonce":556723413}]},"public_addr":"172.21.15.69:6819/556723413","cluster_addr":"172.21.15.69:6821/556723413","heartbeat_back_addr":"172.21.15.69:6825/556723413","heartbeat_front_addr":"172.21.15.69:6823/556723413","state":["exists","up"]},{"osd":7,"uuid":"f7ee0b7c-ea72-4bbc-9b24-543d6925263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6817","nonce":2492628604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6819","nonce":2492628604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6823","nonce":2492628604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2492628604},{"type":"v1","addr":"172.21.15.146:6821","nonce":2492628604}]},"public_addr":"172.21.15.146:6817/2492628604","cluster_addr":"172.21.15.146:6819/2492628604","heartbeat_back_addr":"172.21.15.146:6823/2492628604","heartbeat_front_addr":"172.21.15.146:6821/2492628604","state":["exists","up"]},{"osd":8,"uuid":"517269ab-67bb-46bf-9033-10bc65126107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6817","nonce":625996667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6819","nonce":625996667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6823","nonce":625996667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":625996667},{"type":"v1","addr":"172.21.15.167:6821","nonce":625996667}]},"public_addr":"172.21.15.167:6817/625996667","cluster_addr":"172.21.15.167:6819/625996667","heartbeat_back_addr":"172.21.15.167:6823/625996667","heartbeat_front_addr":"172.21.15.167:6821/625996667","state":["exists","up"]},{"osd":9,"uuid":"e141cd07-18ba-42c3-b3c8-86b81eee032b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6827","nonce":2332420509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6829","nonce":2332420509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6833","nonce":2332420509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2332420509},{"type":"v1","addr":"172.21.15.69:6831","nonce":2332420509}]},"public_addr":"172.21.15.69:6827/2332420509","cluster_addr":"172.21.15.69:6829/2332420509","heartbeat_back_addr":"172.21.15.69:6833/2332420509","heartbeat_front_addr":"172.21.15.69:6831/2332420509","state":["exists","up"]},{"osd":10,"uuid":"5b6dcefa-91b3-4973-a57e-bda851fa473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6825","nonce":1086639302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6827","nonce":1086639302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6831","nonce":1086639302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1086639302},{"type":"v1","addr":"172.21.15.146:6829","nonce":1086639302}]},"public_addr":"172.21.15.146:6825/1086639302","cluster_addr":"172.21.15.146:6827/1086639302","heartbeat_back_addr":"172.21.15.146:6831/1086639302","heartbeat_front_addr":"172.21.15.146:6829/1086639302","state":["exists","up"]},{"osd":11,"uuid":"d0630ee1-83c8-478f-951f-1175ca84eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6825","nonce":2968784052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6827","nonce":2968784052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6831","nonce":2968784052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2968784052},{"type":"v1","addr":"172.21.15.167:6829","nonce":2968784052}]},"public_addr":"172.21.15.167:6825/2968784052","cluster_addr":"172.21.15.167:6827/2968784052","heartbeat_back_addr":"172.21.15.167:6831/2968784052","heartbeat_front_addr":"172.21.15.167:6829/2968784052","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:28.935389+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:19:53.082865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:16.473059+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:20:40.497872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:05.268919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:29.375670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:21:53.959503+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:19.630629+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:22:44.460475+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:10.952429+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:23:37.920545+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:24:03.651262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/2621408239":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1024244898":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1462548780":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6800/847729550":"2024-04-24T10:26:53.261526+0000","172.21.15.69:6801/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2765886879":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/2817046344":"2024-04-24T10:17:58.923795+0000","172.21.15.69:6800/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6801/2746602813":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3571277589":"2024-04-24T10:17:32.944635+0000","172.21.15.69:6800/3345837257":"2024-04-24T10:17:58.923795+0000","172.21.15.69:0/617257351":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/1291208672":"2024-04-24T10:17:32.944635+0000","172.21.15.69:0/3272003821":"2024-04-24T10:26:53.261526+0000","172.21.15.69:0/1162910246":"2024-04-24T10:17:58.923795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:37:36.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 -- 172.21.15.69:0/4010308787 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efc980a3d20 msgr2=0x7efc980a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efc980a3d20 0x7efc980a61e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009230 tx=0x7efc9c0058d0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 -- 172.21.15.69:0/4010308787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcac103b00 msgr2=0x7efcac19eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcac103b00 0x7efcac19eb90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efca800b4a0 tx=0x7efca800b960 comp rx=0 tx=0).stop 2024-04-23T10:37:36.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 -- 172.21.15.69:0/4010308787 shutdown_connections 2024-04-23T10:37:36.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7efc980a3d20 0x7efc980a61e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcac103b00 0x7efcac19eb90 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcac10c520 0x7efcac1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 --2- 172.21.15.69:0/4010308787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcac1031e0 0x7efcac19e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 -- 172.21.15.69:0/4010308787 >> 172.21.15.69:0/4010308787 conn(0x7efcac077f50 msgr2=0x7efcac0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:36.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 -- 172.21.15.69:0/4010308787 shutdown_connections 2024-04-23T10:37:36.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.673+0000 7efcb3322640 1 -- 172.21.15.69:0/4010308787 wait complete. 2024-04-23T10:37:36.683 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-23T10:37:36.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.783+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1258494219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b9810b060 msgr2=0x7f4b9810d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.783+0000 7f4b9fae8640 1 --2- 172.21.15.69:0/1258494219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b9810b060 0x7f4b9810d450 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009ca0 tx=0x7f4b9002a8c0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1258494219 shutdown_connections 2024-04-23T10:37:36.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 --2- 172.21.15.69:0/1258494219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b9810b060 0x7f4b9810d450 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 --2- 172.21.15.69:0/1258494219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b98100d40 0x7f4b98105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 --2- 172.21.15.69:0/1258494219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b980684e0 0x7f4b98104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1258494219 >> 172.21.15.69:0/1258494219 conn(0x7f4b98076fe0 msgr2=0x7f4b980fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:36.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1258494219 shutdown_connections 2024-04-23T10:37:36.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1258494219 wait complete. 2024-04-23T10:37:36.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 Processor -- start 2024-04-23T10:37:36.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 -- start start 2024-04-23T10:37:36.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b980684e0 0x7f4b98197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b98100d40 0x7f4b98197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b9810b060 0x7f4b9819bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4b981108f0 con 0x7f4b98100d40 2024-04-23T10:37:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4b98110770 con 0x7f4b980684e0 2024-04-23T10:37:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9fae8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4b98110a70 con 0x7f4b9810b060 2024-04-23T10:37:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.784+0000 7f4b9d083640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b98100d40 0x7f4b98197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9d083640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b98100d40 0x7f4b98197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56786/0 (socket says 172.21.15.69:56786) 2024-04-23T10:37:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9d083640 1 -- 172.21.15.69:0/1205309002 learned_addr learned my addr 172.21.15.69:0/1205309002 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9d884640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b980684e0 0x7f4b98197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9e085640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b9810b060 0x7f4b9819bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9d083640 1 -- 172.21.15.69:0/1205309002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b9810b060 msgr2=0x7f4b9819bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9d083640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b9810b060 0x7f4b9819bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9d083640 1 -- 172.21.15.69:0/1205309002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b980684e0 msgr2=0x7f4b98197630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:36.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9d083640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b980684e0 0x7f4b98197630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:36.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9d083640 1 -- 172.21.15.69:0/1205309002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9819c620 con 0x7f4b98100d40 2024-04-23T10:37:36.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9e085640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b9810b060 0x7f4b9819bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:37:36.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9d083640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b98100d40 0x7f4b98197b70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009970 tx=0x7f4b88009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:36.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b8effd640 1 -- 172.21.15.69:0/1205309002 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800d020 con 0x7f4b98100d40 2024-04-23T10:37:36.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b8effd640 1 -- 172.21.15.69:0/1205309002 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4b8800d1c0 con 0x7f4b98100d40 2024-04-23T10:37:36.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1205309002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9819c910 con 0x7f4b98100d40 2024-04-23T10:37:36.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b8effd640 1 -- 172.21.15.69:0/1205309002 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800cbb0 con 0x7f4b98100d40 2024-04-23T10:37:36.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.785+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1205309002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9810c3e0 con 0x7f4b98100d40 2024-04-23T10:37:36.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.786+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1205309002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b980691c0 con 0x7f4b98100d40 2024-04-23T10:37:36.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.787+0000 7f4b8effd640 1 -- 172.21.15.69:0/1205309002 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f4b880077a0 con 0x7f4b98100d40 2024-04-23T10:37:36.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.788+0000 7f4b8effd640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4b840a3d20 0x7f4b840a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:36.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.788+0000 7f4b9d884640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4b840a3d20 0x7f4b840a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:36.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.788+0000 7f4b8effd640 1 -- 172.21.15.69:0/1205309002 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7f4b880d1bb0 con 0x7f4b98100d40 2024-04-23T10:37:36.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.788+0000 7f4b9d884640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4b840a3d20 0x7f4b840a61e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400abe0 tx=0x7f4b9400a2d0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:36.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:36.793+0000 7f4b8effd640 1 -- 172.21.15.69:0/1205309002 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4b8809e250 con 0x7f4b98100d40 2024-04-23T10:37:36.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:36 smithi167 ceph-mon[32940]: pgmap v335: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:37:36.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:36 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1878608870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:37:36.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:36 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3832085738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:37:36.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:36 smithi146 ceph-mon[32800]: pgmap v335: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-04-23T10:37:36.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:36 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1878608870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:37:36.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:36 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3832085738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-23T10:37:37.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.006+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1205309002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4b9810c710 con 0x7f4b98100d40 2024-04-23T10:37:37.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.011+0000 7f4b8effd640 1 -- 172.21.15.69:0/1205309002 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) ==== 161+0+0 (secure 0 0 0) 0x7f4b8809db50 con 0x7f4b98100d40 2024-04-23T10:37:37.011 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-23T10:37:37.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1205309002 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4b840a3d20 msgr2=0x7f4b840a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:37.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4b840a3d20 0x7f4b840a61e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400abe0 tx=0x7f4b9400a2d0 comp rx=0 tx=0).stop 2024-04-23T10:37:37.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1205309002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b98100d40 msgr2=0x7f4b98197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:37.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b98100d40 0x7f4b98197b70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009970 tx=0x7f4b88009d70 comp rx=0 tx=0).stop 2024-04-23T10:37:37.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1205309002 shutdown_connections 2024-04-23T10:37:37.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f4b840a3d20 0x7f4b840a61e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:37.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4b98100d40 0x7f4b98197b70 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:37.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b9810b060 0x7f4b9819bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:37.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 --2- 172.21.15.69:0/1205309002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b980684e0 0x7f4b98197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:37.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1205309002 >> 172.21.15.69:0/1205309002 conn(0x7f4b98076fe0 msgr2=0x7f4b981042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:37.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1205309002 shutdown_connections 2024-04-23T10:37:37.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.014+0000 7f4b9fae8640 1 -- 172.21.15.69:0/1205309002 wait complete. 2024-04-23T10:37:37.025 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-23T10:37:37.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.131+0000 7f8bc15c6640 1 -- 172.21.15.69:0/2005431764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc102b40 msgr2=0x7f8bbc106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:37.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.131+0000 7f8bc15c6640 1 --2- 172.21.15.69:0/2005431764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc102b40 0x7f8bbc106b80 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009900 tx=0x7f8ba402a410 comp rx=0 tx=0).stop 2024-04-23T10:37:37.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.131+0000 7f8bc15c6640 1 -- 172.21.15.69:0/2005431764 shutdown_connections 2024-04-23T10:37:37.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.131+0000 7f8bc15c6640 1 --2- 172.21.15.69:0/2005431764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc102b40 0x7f8bbc106b80 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.131+0000 7f8bc15c6640 1 --2- 172.21.15.69:0/2005431764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bbc107260 0x7f8bbc10ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.131+0000 7f8bc15c6640 1 --2- 172.21.15.69:0/2005431764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bbc102190 0x7f8bbc102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.131+0000 7f8bc15c6640 1 -- 172.21.15.69:0/2005431764 >> 172.21.15.69:0/2005431764 conn(0x7f8bbc0fd990 msgr2=0x7f8bbc0ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.131+0000 7f8bc15c6640 1 -- 172.21.15.69:0/2005431764 shutdown_connections 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.131+0000 7f8bc15c6640 1 -- 172.21.15.69:0/2005431764 wait complete. 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.132+0000 7f8bc15c6640 1 Processor -- start 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.132+0000 7f8bc15c6640 1 -- start start 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.132+0000 7f8bc15c6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc102190 0x7f8bbc074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.132+0000 7f8bc15c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bbc107260 0x7f8bbc074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.132+0000 7f8bc15c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bbc074cd0 0x7f8bbc1a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.132+0000 7f8bc15c6640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc1122e0 con 0x7f8bbc102190 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.132+0000 7f8bc15c6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc112160 con 0x7f8bbc074cd0 2024-04-23T10:37:37.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.132+0000 7f8bc15c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8bbc112460 con 0x7f8bbc107260 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.132+0000 7f8bbaffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc102190 0x7f8bbc074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.132+0000 7f8bbaffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc102190 0x7f8bbc074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56836/0 (socket says 172.21.15.69:56836) 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.132+0000 7f8bbaffd640 1 -- 172.21.15.69:0/1334275867 learned_addr learned my addr 172.21.15.69:0/1334275867 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bb27fc640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bbc107260 0x7f8bbc074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bbb7fe640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bbc074cd0 0x7f8bbc1a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bbaffd640 1 -- 172.21.15.69:0/1334275867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bbc107260 msgr2=0x7f8bbc074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bbaffd640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bbc107260 0x7f8bbc074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bbaffd640 1 -- 172.21.15.69:0/1334275867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bbc074cd0 msgr2=0x7f8bbc1a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bbaffd640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bbc074cd0 0x7f8bbc1a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bbaffd640 1 -- 172.21.15.69:0/1334275867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bbc1a70f0 con 0x7f8bbc102190 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bbb7fe640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bbc074cd0 0x7f8bbc1a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bbaffd640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc102190 0x7f8bbc074250 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00d950 tx=0x7f8bac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bb8ff9640 1 -- 172.21.15.69:0/1334275867 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac017030 con 0x7f8bbc102190 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bb8ff9640 1 -- 172.21.15.69:0/1334275867 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8bac004020 con 0x7f8bbc102190 2024-04-23T10:37:37.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bc15c6640 1 -- 172.21.15.69:0/1334275867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bbc1a73e0 con 0x7f8bbc102190 2024-04-23T10:37:37.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bb8ff9640 1 -- 172.21.15.69:0/1334275867 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac0047a0 con 0x7f8bbc102190 2024-04-23T10:37:37.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.133+0000 7f8bc15c6640 1 -- 172.21.15.69:0/1334275867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bbc1a7950 con 0x7f8bbc102190 2024-04-23T10:37:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.134+0000 7f8bc15c6640 1 -- 172.21.15.69:0/1334275867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bbc0691c0 con 0x7f8bbc102190 2024-04-23T10:37:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.135+0000 7f8bb8ff9640 1 -- 172.21.15.69:0/1334275867 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f8bac0041d0 con 0x7f8bbc102190 2024-04-23T10:37:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.136+0000 7f8bb8ff9640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ba80a3da0 0x7f8ba80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.136+0000 7f8bb27fc640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ba80a3da0 0x7f8ba80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.136+0000 7f8bb8ff9640 1 -- 172.21.15.69:0/1334275867 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8899+0+0 (secure 0 0 0) 0x7f8bac0d0a60 con 0x7f8bbc102190 2024-04-23T10:37:37.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.136+0000 7f8bb27fc640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ba80a3da0 0x7f8ba80a6260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4000c00 tx=0x7f8ba4005a20 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:37.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.139+0000 7f8bb8ff9640 1 -- 172.21.15.69:0/1334275867 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8bac09d000 con 0x7f8bbc102190 2024-04-23T10:37:37.332 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[67177]: ignoring --setuser ceph since I am not root 2024-04-23T10:37:37.332 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[67177]: ignoring --setgroup ceph since I am not root 2024-04-23T10:37:37.333 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mds[67181]: -- 172.21.15.167:0/3461070364 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556f8af55a40 con 0x556f8af28c00 2024-04-23T10:37:37.333 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[67177]: starting mds.f at 2024-04-23T10:37:37.333 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i[63901]: ignoring --setuser ceph since I am not root 2024-04-23T10:37:37.333 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i[63901]: ignoring --setgroup ceph since I am not root 2024-04-23T10:37:37.333 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mds[63905]: -- 172.21.15.167:0/2488350854 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557de70f3a40 con 0x557de70c6800 2024-04-23T10:37:37.333 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i[63901]: starting mds.i at 2024-04-23T10:37:37.333 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l[62979]: ignoring --setuser ceph since I am not root 2024-04-23T10:37:37.334 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l[62979]: ignoring --setgroup ceph since I am not root 2024-04-23T10:37:37.334 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mds[62983]: -- 172.21.15.167:0/3053590240 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55edba6c5a40 con 0x55edba698800 2024-04-23T10:37:37.334 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l[62979]: starting mds.l at 2024-04-23T10:37:37.334 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-c[63595]: ignoring --setuser ceph since I am not root 2024-04-23T10:37:37.334 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-c[63595]: ignoring --setgroup ceph since I am not root 2024-04-23T10:37:37.334 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mds[63599]: -- 172.21.15.167:0/3541746536 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef44507a40 con 0x55ef444da800 2024-04-23T10:37:37.334 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-c[63595]: starting mds.c at 2024-04-23T10:37:37.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:37.358+0000 7f8bc15c6640 1 -- 172.21.15.69:0/1334275867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8bbc10a490 con 0x7f8bbc102190 2024-04-23T10:37:37.428 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b[62372]: ignoring --setuser ceph since I am not root 2024-04-23T10:37:37.428 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b[62372]: ignoring --setgroup ceph since I am not root 2024-04-23T10:37:37.428 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mds[62376]: -- 172.21.15.146:0/2994251644 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5579dedb9a40 con 0x5579ded8cc00 2024-04-23T10:37:37.428 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b[62372]: starting mds.b at 2024-04-23T10:37:37.428 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e[61754]: ignoring --setuser ceph since I am not root 2024-04-23T10:37:37.428 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e[61754]: ignoring --setgroup ceph since I am not root 2024-04-23T10:37:37.428 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mds[61758]: -- 172.21.15.146:0/2069664314 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56067daf3a40 con 0x56067dac6800 2024-04-23T10:37:37.429 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e[61754]: starting mds.e at 2024-04-23T10:37:37.429 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h[62066]: ignoring --setuser ceph since I am not root 2024-04-23T10:37:37.429 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h[62066]: ignoring --setgroup ceph since I am not root 2024-04-23T10:37:37.429 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mds[62070]: -- 172.21.15.146:0/1268670120 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55df51bf9a40 con 0x55df51bcd000 2024-04-23T10:37:37.429 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h[62066]: starting mds.h at 2024-04-23T10:37:37.429 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k[61445]: ignoring --setuser ceph since I am not root 2024-04-23T10:37:37.429 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k[61445]: ignoring --setgroup ceph since I am not root 2024-04-23T10:37:37.430 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mds[61449]: -- 172.21.15.146:0/3469704511 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5593c59fda40 con 0x5593c59d0800 2024-04-23T10:37:37.430 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k[61445]: starting mds.k at 2024-04-23T10:37:37.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a[29589]: 2024-04-23T10:37:37.007+0000 7f6521f1e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T10:37:37.492 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g[68667]: ignoring --setuser ceph since I am not root 2024-04-23T10:37:37.492 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g[68667]: ignoring --setgroup ceph since I am not root 2024-04-23T10:37:37.492 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-mds[68671]: -- 172.21.15.69:0/2616134834 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe10b6ba40 con 0x55fe10b3f000 2024-04-23T10:37:37.492 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g[68667]: starting mds.g at 2024-04-23T10:37:37.492 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a[69027]: ignoring --setuser ceph since I am not root 2024-04-23T10:37:37.492 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a[69027]: ignoring --setgroup ceph since I am not root 2024-04-23T10:37:37.492 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-mds[69031]: -- 172.21.15.69:0/545069586 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c0bb2bfa40 con 0x55c0bb293000 2024-04-23T10:37:37.492 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a[69027]: starting mds.a at 2024-04-23T10:37:37.492 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a[69027]: 2024-04-23T10:37:37.057+0000 7fab67d14700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6840/0: (98) Address already in use 2024-04-23T10:37:37.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/4010308787' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:37:37.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1205309002' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-23T10:37:37.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mon[32940]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T10:37:37.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mon[32940]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T10:37:37.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1205309002' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-23T10:37:37.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mon[32940]: osdmap e101: 12 total, 12 up, 12 in 2024-04-23T10:37:37.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mon[32940]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-23T10:37:37.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:37 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1334275867' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T10:37:37.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/4010308787' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:37:37.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1205309002' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-23T10:37:37.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mon[32800]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T10:37:37.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mon[32800]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T10:37:37.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1205309002' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-23T10:37:37.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mon[32800]: osdmap e101: 12 total, 12 up, 12 in 2024-04-23T10:37:37.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mon[32800]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-23T10:37:37.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:37 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1334275867' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T10:37:37.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/4010308787' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-23T10:37:37.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1205309002' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-23T10:37:37.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-mon[29593]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-23T10:37:37.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-mon[29593]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-23T10:37:37.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1205309002' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-23T10:37:37.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-mon[29593]: osdmap e101: 12 total, 12 up, 12 in 2024-04-23T10:37:37.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-mon[29593]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-23T10:37:37.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:37 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1334275867' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-23T10:37:38.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.021+0000 7f8bb8ff9640 1 -- 172.21.15.69:0/1334275867 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) ==== 104+0+0 (secure 0 0 0) 0x7f8bac09c900 con 0x7f8bbc102190 2024-04-23T10:37:38.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.024+0000 7f8bc15c6640 1 -- 172.21.15.69:0/1334275867 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ba80a3da0 msgr2=0x7f8ba80a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:38.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.024+0000 7f8bc15c6640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ba80a3da0 0x7f8ba80a6260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4000c00 tx=0x7f8ba4005a20 comp rx=0 tx=0).stop 2024-04-23T10:37:38.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.024+0000 7f8bc15c6640 1 -- 172.21.15.69:0/1334275867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc102190 msgr2=0x7f8bbc074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:38.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.024+0000 7f8bc15c6640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc102190 0x7f8bbc074250 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00d950 tx=0x7f8bac00de10 comp rx=0 tx=0).stop 2024-04-23T10:37:38.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.025+0000 7f8bc15c6640 1 -- 172.21.15.69:0/1334275867 shutdown_connections 2024-04-23T10:37:38.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.025+0000 7f8bc15c6640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f8ba80a3da0 0x7f8ba80a6260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:38.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.025+0000 7f8bc15c6640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bbc074cd0 0x7f8bbc1a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:38.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.025+0000 7f8bc15c6640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bbc107260 0x7f8bbc074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:38.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.025+0000 7f8bc15c6640 1 --2- 172.21.15.69:0/1334275867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bbc102190 0x7f8bbc074250 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:38.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.025+0000 7f8bc15c6640 1 -- 172.21.15.69:0/1334275867 >> 172.21.15.69:0/1334275867 conn(0x7f8bbc0fd990 msgr2=0x7f8bbc0feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:38.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.025+0000 7f8bc15c6640 1 -- 172.21.15.69:0/1334275867 shutdown_connections 2024-04-23T10:37:38.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.025+0000 7f8bc15c6640 1 -- 172.21.15.69:0/1334275867 wait complete. 2024-04-23T10:37:38.041 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-23T10:37:38.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.151+0000 7f00790b4640 1 -- 172.21.15.69:0/990009938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0074101130 msgr2=0x7f0074101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:38.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.151+0000 7f00790b4640 1 --2- 172.21.15.69:0/990009938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0074101130 0x7f0074101590 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0068009900 tx=0x7f006802a3e0 comp rx=0 tx=0).stop 2024-04-23T10:37:38.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.151+0000 7f00790b4640 1 -- 172.21.15.69:0/990009938 shutdown_connections 2024-04-23T10:37:38.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.151+0000 7f00790b4640 1 --2- 172.21.15.69:0/990009938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0074101130 0x7f0074101590 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:38.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.151+0000 7f00790b4640 1 --2- 172.21.15.69:0/990009938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0074101ad0 0x7f007410dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:38.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.151+0000 7f00790b4640 1 --2- 172.21.15.69:0/990009938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0074105ea0 0x7f0074106280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:38.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.151+0000 7f00790b4640 1 -- 172.21.15.69:0/990009938 >> 172.21.15.69:0/990009938 conn(0x7f0074077e30 msgr2=0x7f0074078240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:38.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.151+0000 7f00790b4640 1 -- 172.21.15.69:0/990009938 shutdown_connections 2024-04-23T10:37:38.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.151+0000 7f00790b4640 1 -- 172.21.15.69:0/990009938 wait complete. 2024-04-23T10:37:38.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.151+0000 7f00790b4640 1 Processor -- start 2024-04-23T10:37:38.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f00790b4640 1 -- start start 2024-04-23T10:37:38.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f00790b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0074101130 0x7f007419e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:38.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f00790b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0074101ad0 0x7f007419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:38.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f00790b4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0074105ea0 0x7f00741986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:38.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f00790b4640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0074112470 con 0x7f0074105ea0 2024-04-23T10:37:38.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f00790b4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f00741122f0 con 0x7f0074101ad0 2024-04-23T10:37:38.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f00790b4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f00741125f0 con 0x7f0074101130 2024-04-23T10:37:38.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f007359e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0074105ea0 0x7f00741986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:38.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f007359e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0074105ea0 0x7f00741986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56848/0 (socket says 172.21.15.69:56848) 2024-04-23T10:37:38.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f007359e640 1 -- 172.21.15.69:0/3532917559 learned_addr learned my addr 172.21.15.69:0/3532917559 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:38.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f0072d9d640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0074101130 0x7f007419e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:38.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f007259c640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0074101ad0 0x7f007419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:38.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f007359e640 1 -- 172.21.15.69:0/3532917559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0074101130 msgr2=0x7f007419e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:38.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f007359e640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0074101130 0x7f007419e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f007359e640 1 -- 172.21.15.69:0/3532917559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0074101ad0 msgr2=0x7f007419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f007359e640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0074101ad0 0x7f007419eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f007359e640 1 -- 172.21.15.69:0/3532917559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0074198fb0 con 0x7f0074105ea0 2024-04-23T10:37:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f007259c640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0074101ad0 0x7f007419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:37:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.152+0000 7f007359e640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0074105ea0 0x7f00741986f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f006c00cce0 tx=0x7f006c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.153+0000 7f005bfff640 1 -- 172.21.15.69:0/3532917559 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c00f450 con 0x7f0074105ea0 2024-04-23T10:37:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.153+0000 7f005bfff640 1 -- 172.21.15.69:0/3532917559 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f006c00fac0 con 0x7f0074105ea0 2024-04-23T10:37:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.153+0000 7f00790b4640 1 -- 172.21.15.69:0/3532917559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00741992a0 con 0x7f0074105ea0 2024-04-23T10:37:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.153+0000 7f005bfff640 1 -- 172.21.15.69:0/3532917559 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c018be0 con 0x7f0074105ea0 2024-04-23T10:37:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.153+0000 7f00790b4640 1 -- 172.21.15.69:0/3532917559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00741a5560 con 0x7f0074105ea0 2024-04-23T10:37:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.154+0000 7f00790b4640 1 -- 172.21.15.69:0/3532917559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00741025f0 con 0x7f0074105ea0 2024-04-23T10:37:38.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.155+0000 7f005bfff640 1 -- 172.21.15.69:0/3532917559 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f006c00fc70 con 0x7f0074105ea0 2024-04-23T10:37:38.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.155+0000 7f005bfff640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f005c0a3d20 0x7f005c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:38.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.155+0000 7f0072d9d640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f005c0a3d20 0x7f005c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:38.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.155+0000 7f005bfff640 1 -- 172.21.15.69:0/3532917559 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8899+0+0 (secure 0 0 0) 0x7f006c0d1060 con 0x7f0074105ea0 2024-04-23T10:37:38.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.156+0000 7f0072d9d640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f005c0a3d20 0x7f005c0a61e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f006400bbc0 tx=0x7f006400b390 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:38.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.160+0000 7f005bfff640 1 -- 172.21.15.69:0/3532917559 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f006c014030 con 0x7f0074105ea0 2024-04-23T10:37:38.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:38.337+0000 7f00790b4640 1 -- 172.21.15.69:0/3532917559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f00741994d0 con 0x7f0074105ea0 2024-04-23T10:37:38.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: pgmap v337: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-23T10:37:38.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T10:37:38.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T10:37:38.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: Cluster is now healthy 2024-04-23T10:37:38.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/1334275867' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-23T10:37:38.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.69:6838/3948280168,v1:172.21.15.69:6840/3948280168] up:boot 2024-04-23T10:37:38.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.69:6839/2846219400,v1:172.21.15.69:6841/2846219400] up:boot 2024-04-23T10:37:38.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.146:6832/3626883518,v1:172.21.15.146:6833/3626883518] up:boot 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6832/3140989181,v1:172.21.15.167:6833/3140989181] up:boot 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6834/1034483316,v1:172.21.15.167:6835/1034483316] up:boot 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.146:6834/2203760931,v1:172.21.15.146:6835/2203760931] up:boot 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.146:6836/3229544558,v1:172.21.15.146:6837/3229544558] up:boot 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6836/1745322264,v1:172.21.15.167:6837/1745322264] up:boot 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.167:6838/286351948,v1:172.21.15.167:6839/286351948] up:boot 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: mds.? [v2:172.21.15.146:6838/3525254842,v1:172.21.15.146:6839/3525254842] up:boot 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: fsmap 12 up:standby 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T10:37:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:37:38.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T10:37:38.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T10:37:38.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T10:37:38.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T10:37:38.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T10:37:38.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T10:37:38.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:38 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3532917559' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T10:37:38.927 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: pgmap v337: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: Cluster is now healthy 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/1334275867' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.69:6838/3948280168,v1:172.21.15.69:6840/3948280168] up:boot 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.69:6839/2846219400,v1:172.21.15.69:6841/2846219400] up:boot 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.146:6832/3626883518,v1:172.21.15.146:6833/3626883518] up:boot 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6832/3140989181,v1:172.21.15.167:6833/3140989181] up:boot 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6834/1034483316,v1:172.21.15.167:6835/1034483316] up:boot 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.146:6834/2203760931,v1:172.21.15.146:6835/2203760931] up:boot 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.146:6836/3229544558,v1:172.21.15.146:6837/3229544558] up:boot 2024-04-23T10:37:38.928 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6836/1745322264,v1:172.21.15.167:6837/1745322264] up:boot 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.167:6838/286351948,v1:172.21.15.167:6839/286351948] up:boot 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: mds.? [v2:172.21.15.146:6838/3525254842,v1:172.21.15.146:6839/3525254842] up:boot 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: fsmap 12 up:standby 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T10:37:38.929 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:38 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3532917559' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T10:37:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: pgmap v337: 97 pgs: 97 active+clean; 105 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-23T10:37:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-23T10:37:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-23T10:37:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: Cluster is now healthy 2024-04-23T10:37:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/1334275867' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-23T10:37:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.69:6838/3948280168,v1:172.21.15.69:6840/3948280168] up:boot 2024-04-23T10:37:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.69:6839/2846219400,v1:172.21.15.69:6841/2846219400] up:boot 2024-04-23T10:37:38.992 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.146:6832/3626883518,v1:172.21.15.146:6833/3626883518] up:boot 2024-04-23T10:37:38.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6832/3140989181,v1:172.21.15.167:6833/3140989181] up:boot 2024-04-23T10:37:38.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6834/1034483316,v1:172.21.15.167:6835/1034483316] up:boot 2024-04-23T10:37:38.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.146:6834/2203760931,v1:172.21.15.146:6835/2203760931] up:boot 2024-04-23T10:37:38.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.146:6836/3229544558,v1:172.21.15.146:6837/3229544558] up:boot 2024-04-23T10:37:38.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6836/1745322264,v1:172.21.15.167:6837/1745322264] up:boot 2024-04-23T10:37:38.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.167:6838/286351948,v1:172.21.15.167:6839/286351948] up:boot 2024-04-23T10:37:38.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: mds.? [v2:172.21.15.146:6838/3525254842,v1:172.21.15.146:6839/3525254842] up:boot 2024-04-23T10:37:38.993 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: fsmap 12 up:standby 2024-04-23T10:37:38.994 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-23T10:37:38.994 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-23T10:37:38.994 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-23T10:37:38.994 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-23T10:37:38.994 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-23T10:37:38.994 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-23T10:37:38.994 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-23T10:37:38.994 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-23T10:37:38.994 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-23T10:37:38.994 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='mgr.24836 172.21.15.69:0/1279824309' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-23T10:37:38.995 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:38 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3532917559' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T10:37:39.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.023+0000 7f005bfff640 1 -- 172.21.15.69:0/3532917559 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) ==== 181+0+0 (secure 0 0 0) 0x7f006c09d580 con 0x7f0074105ea0 2024-04-23T10:37:39.023 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' removed 2024-04-23T10:37:39.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.026+0000 7f00790b4640 1 -- 172.21.15.69:0/3532917559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f005c0a3d20 msgr2=0x7f005c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:39.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.026+0000 7f00790b4640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f005c0a3d20 0x7f005c0a61e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f006400bbc0 tx=0x7f006400b390 comp rx=0 tx=0).stop 2024-04-23T10:37:39.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.026+0000 7f00790b4640 1 -- 172.21.15.69:0/3532917559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0074105ea0 msgr2=0x7f00741986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:39.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.026+0000 7f00790b4640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0074105ea0 0x7f00741986f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f006c00cce0 tx=0x7f006c00a620 comp rx=0 tx=0).stop 2024-04-23T10:37:39.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.026+0000 7f00790b4640 1 -- 172.21.15.69:0/3532917559 shutdown_connections 2024-04-23T10:37:39.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.026+0000 7f00790b4640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7f005c0a3d20 0x7f005c0a61e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:39.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.026+0000 7f00790b4640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0074105ea0 0x7f00741986f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:39.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.026+0000 7f00790b4640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0074101ad0 0x7f007419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:39.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.026+0000 7f00790b4640 1 --2- 172.21.15.69:0/3532917559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0074101130 0x7f007419e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:39.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.026+0000 7f00790b4640 1 -- 172.21.15.69:0/3532917559 >> 172.21.15.69:0/3532917559 conn(0x7f0074077e30 msgr2=0x7f00740fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:39.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.027+0000 7f00790b4640 1 -- 172.21.15.69:0/3532917559 shutdown_connections 2024-04-23T10:37:39.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.027+0000 7f00790b4640 1 -- 172.21.15.69:0/3532917559 wait complete. 2024-04-23T10:37:39.042 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-23T10:37:39.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 -- 172.21.15.69:0/2776716369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde44100af0 msgr2=0x7fde44100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 --2- 172.21.15.69:0/2776716369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde44100af0 0x7fde44100ed0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fde38009900 tx=0x7fde3802a410 comp rx=0 tx=0).stop 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 -- 172.21.15.69:0/2776716369 shutdown_connections 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 --2- 172.21.15.69:0/2776716369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde44105970 0x7fde4410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 --2- 172.21.15.69:0/2776716369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde441014a0 0x7fde44105240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 --2- 172.21.15.69:0/2776716369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde44100af0 0x7fde44100ed0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 -- 172.21.15.69:0/2776716369 >> 172.21.15.69:0/2776716369 conn(0x7fde440760e0 msgr2=0x7fde440764f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 -- 172.21.15.69:0/2776716369 shutdown_connections 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 -- 172.21.15.69:0/2776716369 wait complete. 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 Processor -- start 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 -- start start 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde44100af0 0x7fde44199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde44105970 0x7fde44199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde4419a140 0x7fde441a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fde441109e0 con 0x7fde4419a140 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fde44110860 con 0x7fde44100af0 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.154+0000 7fde4aca0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde44110b60 con 0x7fde44105970 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde4923d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde4419a140 0x7fde441a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde4923d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde4419a140 0x7fde441a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56864/0 (socket says 172.21.15.69:56864) 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde4923d640 1 -- 172.21.15.69:0/2284908141 learned_addr learned my addr 172.21.15.69:0/2284908141 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde48a3c640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde44100af0 0x7fde44199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde43fff640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde44105970 0x7fde44199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde4923d640 1 -- 172.21.15.69:0/2284908141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde44105970 msgr2=0x7fde44199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde4923d640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde44105970 0x7fde44199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde4923d640 1 -- 172.21.15.69:0/2284908141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde44100af0 msgr2=0x7fde44199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde4923d640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde44100af0 0x7fde44199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde4923d640 1 -- 172.21.15.69:0/2284908141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde441a4ec0 con 0x7fde4419a140 2024-04-23T10:37:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde4923d640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde4419a140 0x7fde441a46f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00cce0 tx=0x7fde3c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde41ffb640 1 -- 172.21.15.69:0/2284908141 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c00f450 con 0x7fde4419a140 2024-04-23T10:37:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde41ffb640 1 -- 172.21.15.69:0/2284908141 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde3c00fac0 con 0x7fde4419a140 2024-04-23T10:37:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde4aca0640 1 -- 172.21.15.69:0/2284908141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde441a51b0 con 0x7fde4419a140 2024-04-23T10:37:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde41ffb640 1 -- 172.21.15.69:0/2284908141 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c018be0 con 0x7fde4419a140 2024-04-23T10:37:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.155+0000 7fde4aca0640 1 -- 172.21.15.69:0/2284908141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde441a5700 con 0x7fde4419a140 2024-04-23T10:37:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.157+0000 7fde4aca0640 1 -- 172.21.15.69:0/2284908141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde440691c0 con 0x7fde4419a140 2024-04-23T10:37:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.157+0000 7fde41ffb640 1 -- 172.21.15.69:0/2284908141 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fde3c00fc70 con 0x7fde4419a140 2024-04-23T10:37:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.158+0000 7fde41ffb640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fde340a3da0 0x7fde340a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:37:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.158+0000 7fde48a3c640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fde340a3da0 0x7fde340a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:37:39.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.158+0000 7fde41ffb640 1 -- 172.21.15.69:0/2284908141 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8403+0+0 (secure 0 0 0) 0x7fde3c0d0e20 con 0x7fde4419a140 2024-04-23T10:37:39.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.158+0000 7fde48a3c640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fde340a3da0 0x7fde340a6260 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde38000c00 tx=0x7fde380095f0 comp rx=0 tx=0).ready entity=mgr.24836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:37:39.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.163+0000 7fde41ffb640 1 -- 172.21.15.69:0/2284908141 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fde3c014030 con 0x7fde4419a140 2024-04-23T10:37:39.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:39.341+0000 7fde4aca0640 1 -- 172.21.15.69:0/2284908141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fde441014a0 con 0x7fde4419a140 2024-04-23T10:37:40.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.028+0000 7fde41ffb640 1 -- 172.21.15.69:0/2284908141 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) ==== 169+0+0 (secure 0 0 0) 0x7fde3c09d530 con 0x7fde4419a140 2024-04-23T10:37:40.028 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' removed 2024-04-23T10:37:40.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 -- 172.21.15.69:0/2284908141 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fde340a3da0 msgr2=0x7fde340a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:40.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fde340a3da0 0x7fde340a6260 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde38000c00 tx=0x7fde380095f0 comp rx=0 tx=0).stop 2024-04-23T10:37:40.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 -- 172.21.15.69:0/2284908141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde4419a140 msgr2=0x7fde441a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:37:40.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde4419a140 0x7fde441a46f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00cce0 tx=0x7fde3c00a620 comp rx=0 tx=0).stop 2024-04-23T10:37:40.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 -- 172.21.15.69:0/2284908141 shutdown_connections 2024-04-23T10:37:40.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.69:6800/908508073,v1:172.21.15.69:6801/908508073] conn(0x7fde340a3da0 0x7fde340a6260 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:40.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde4419a140 0x7fde441a46f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:40.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde44105970 0x7fde44199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:40.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 --2- 172.21.15.69:0/2284908141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde44100af0 0x7fde44199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:37:40.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 -- 172.21.15.69:0/2284908141 >> 172.21.15.69:0/2284908141 conn(0x7fde440760e0 msgr2=0x7fde440ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:37:40.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 -- 172.21.15.69:0/2284908141 shutdown_connections 2024-04-23T10:37:40.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-23T10:37:40.031+0000 7fde4aca0640 1 -- 172.21.15.69:0/2284908141 wait complete. 2024-04-23T10:37:40.041 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T10:37:40.065 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T10:37:40.094 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T10:37:40.122 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-23T10:37:40.122 DEBUG:teuthology.orchestra.run.smithi069:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-23T10:37:40.137 DEBUG:teuthology.orchestra.run.smithi146:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-23T10:37:40.153 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-23T10:37:40.177 INFO:tasks.cephadm:Stopping all daemons... 2024-04-23T10:37:40.178 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-23T10:37:40.178 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.a 2024-04-23T10:37:40.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:40 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/3532917559' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T10:37:40.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:40 smithi167 ceph-mon[32940]: osdmap e102: 12 total, 12 up, 12 in 2024-04-23T10:37:40.332 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:40 smithi167 ceph-mon[32940]: from='client.? 172.21.15.69:0/2284908141' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T10:37:40.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:40 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/3532917559' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T10:37:40.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:40 smithi146 ceph-mon[32800]: osdmap e102: 12 total, 12 up, 12 in 2024-04-23T10:37:40.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:40 smithi146 ceph-mon[32800]: from='client.? 172.21.15.69:0/2284908141' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T10:37:40.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:40 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/3532917559' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-23T10:37:40.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:40 smithi069 ceph-mon[29593]: osdmap e102: 12 total, 12 up, 12 in 2024-04-23T10:37:40.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:40 smithi069 ceph-mon[29593]: from='client.? 172.21.15.69:0/2284908141' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-23T10:37:40.492 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:40 smithi069 systemd[1]: Stopping Ceph mon.a for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:37:40.909 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:40 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a[29589]: 2024-04-23T10:37:40.493+0000 7f6527729700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:37:40.909 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:40 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a[29589]: 2024-04-23T10:37:40.493+0000 7f6527729700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-23T10:37:40.909 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:40 smithi069 podman[88230]: 2024-04-23 10:37:40.616248883 +0000 UTC m=+0.255526355 container died ef0b3ec76fa3deeb524c29f1aa99aa76a261866d658507a91c4f03e3bd6485b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True) 2024-04-23T10:37:41.194 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:41 smithi069 podman[88230]: 2024-04-23 10:37:41.00239982 +0000 UTC m=+0.641677281 container cleanup ef0b3ec76fa3deeb524c29f1aa99aa76a261866d658507a91c4f03e3bd6485b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-23T10:37:41.194 INFO:journalctl@ceph.mon.a.smithi069.stdout:Apr 23 10:37:41 smithi069 bash[88230]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-a 2024-04-23T10:37:41.414 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.a.service' 2024-04-23T10:37:41.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:37:41.459 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-23T10:37:41.459 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-23T10:37:41.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.b 2024-04-23T10:37:41.774 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:41 smithi146 systemd[1]: Stopping Ceph mon.b for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:37:42.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:41 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-b[32796]: 2024-04-23T10:37:41.775+0000 7f282a20b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:37:42.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:41 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-b[32796]: 2024-04-23T10:37:41.775+0000 7f282a20b700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-23T10:37:42.178 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:41 smithi146 podman[67873]: 2024-04-23 10:37:41.949196112 +0000 UTC m=+0.295668893 container died 0deb56145c1a43381588369d507bad29879e99f00d31a42eeeb5ca1729c49558 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-b, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-23T10:37:42.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:42 smithi146 podman[67873]: 2024-04-23 10:37:42.450878843 +0000 UTC m=+0.797351633 container cleanup 0deb56145c1a43381588369d507bad29879e99f00d31a42eeeb5ca1729c49558 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:37:42.678 INFO:journalctl@ceph.mon.b.smithi146.stdout:Apr 23 10:37:42 smithi146 bash[67873]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-b 2024-04-23T10:37:42.888 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.b.service' 2024-04-23T10:37:42.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:37:42.931 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-23T10:37:42.931 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-23T10:37:42.932 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.c 2024-04-23T10:37:43.245 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:42 smithi167 systemd[1]: Stopping Ceph mon.c for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:37:43.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:43 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-c[32934]: 2024-04-23T10:37:43.247+0000 7f7868711700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:37:43.582 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:43 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-c[32934]: 2024-04-23T10:37:43.247+0000 7f7868711700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-23T10:37:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:43 smithi167 podman[69644]: 2024-04-23 10:37:43.441439166 +0000 UTC m=+0.307937995 container died c50689af9ecddcff9a8c4c961778e6e6b6ff717c8855c6e23d9de43edb61b851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-c, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-04-23T10:37:44.006 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:43 smithi167 podman[69644]: 2024-04-23 10:37:43.81475542 +0000 UTC m=+0.681254250 container cleanup c50689af9ecddcff9a8c4c961778e6e6b6ff717c8855c6e23d9de43edb61b851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-c, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:37:44.006 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:43 smithi167 bash[69644]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-c 2024-04-23T10:37:44.236 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.c.service' 2024-04-23T10:37:44.264 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:44 smithi167 podman[69658]: 2024-04-23 10:37:44.008353765 +0000 UTC m=+0.563355774 container remove c50689af9ecddcff9a8c4c961778e6e6b6ff717c8855c6e23d9de43edb61b851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:37:44.264 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:44 smithi167 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.c.service: Deactivated successfully. 2024-04-23T10:37:44.264 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:44 smithi167 systemd[1]: Stopped Ceph mon.c for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:37:44.264 INFO:journalctl@ceph.mon.c.smithi167.stdout:Apr 23 10:37:44 smithi167 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mon.c.service: Consumed 11.883s CPU time. 2024-04-23T10:37:44.298 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:37:44.298 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-23T10:37:44.298 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-23T10:37:44.298 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.x 2024-04-23T10:37:44.597 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:37:44 smithi069 systemd[1]: Stopping Ceph mgr.x for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:37:44.931 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:37:44 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x[29821]: 2024-04-23T10:37:44.598+0000 7f4ae724d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:37:44.931 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:37:44 smithi069 podman[88353]: 2024-04-23 10:37:44.630160578 +0000 UTC m=+0.139083750 container died 63ea1f36ea85f01ba27343e7c71ae56c34338df6c413b7ad9f0b61deded73508 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-23T10:37:45.241 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:37:45 smithi069 podman[88353]: 2024-04-23 10:37:45.032896759 +0000 UTC m=+0.541819931 container cleanup 63ea1f36ea85f01ba27343e7c71ae56c34338df6c413b7ad9f0b61deded73508 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-23T10:37:45.241 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:37:45 smithi069 bash[88353]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x 2024-04-23T10:37:45.687 INFO:journalctl@ceph.mgr.x.smithi069.stdout:Apr 23 10:37:45 smithi069 podman[88367]: 2024-04-23 10:37:45.426522559 +0000 UTC m=+0.793636075 container remove 63ea1f36ea85f01ba27343e7c71ae56c34338df6c413b7ad9f0b61deded73508 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:37:45.724 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.x.service' 2024-04-23T10:37:45.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:37:45.757 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-23T10:37:45.758 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-23T10:37:45.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.y 2024-04-23T10:37:46.090 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:37:45 smithi146 systemd[1]: Stopping Ceph mgr.y for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:37:46.387 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:37:46 smithi146 podman[67994]: 2024-04-23 10:37:46.092629722 +0000 UTC m=+0.130924478 container died 0677732d84785d1d15672de37ad6fb2c6aaca69e317129ebb24f7ba9eb3e9642 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-23T10:37:46.677 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:37:46 smithi146 podman[67994]: 2024-04-23 10:37:46.488953673 +0000 UTC m=+0.527248431 container cleanup 0677732d84785d1d15672de37ad6fb2c6aaca69e317129ebb24f7ba9eb3e9642 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-23T10:37:46.677 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Apr 23 10:37:46 smithi146 bash[67994]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-y 2024-04-23T10:37:46.967 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.y.service' 2024-04-23T10:37:47.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:37:47.001 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-23T10:37:47.001 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-23T10:37:47.001 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.z 2024-04-23T10:37:47.322 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:37:47 smithi167 systemd[1]: Stopping Ceph mgr.z for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:37:47.582 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:37:47 smithi167 podman[69766]: 2024-04-23 10:37:47.323995393 +0000 UTC m=+0.131376590 container died 0ea68b9ad7c2bf014a146dde1dfca84d3694abde443645264266bb4b18322fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:37:47.840 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:37:47 smithi167 podman[69766]: 2024-04-23 10:37:47.829360484 +0000 UTC m=+0.636741635 container cleanup 0ea68b9ad7c2bf014a146dde1dfca84d3694abde443645264266bb4b18322fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5) 2024-04-23T10:37:47.841 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Apr 23 10:37:47 smithi167 bash[69766]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mgr-z 2024-04-23T10:37:48.148 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mgr.z.service' 2024-04-23T10:37:48.185 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:37:48.185 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-23T10:37:48.186 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-23T10:37:48.186 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.0 2024-04-23T10:37:48.477 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:48 smithi069 systemd[1]: Stopping Ceph osd.0 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:37:48.742 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:48 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0[42126]: 2024-04-23T10:37:48.478+0000 7f7adb67b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:37:48.742 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:48 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0[42126]: 2024-04-23T10:37:48.478+0000 7f7adb67b700 -1 osd.0 103 *** Got signal Terminated *** 2024-04-23T10:37:48.742 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:48 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0[42126]: 2024-04-23T10:37:48.478+0000 7f7adb67b700 -1 osd.0 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:37:54.272 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:54 smithi069 podman[88474]: 2024-04-23 10:37:54.004507882 +0000 UTC m=+5.631740605 container died d8b45af83a55caca4e1c0507fc5d43cec64b48bf9c69050c5b13c75770710bd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:37:54.648 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:54 smithi069 podman[88474]: 2024-04-23 10:37:54.390202056 +0000 UTC m=+6.017434779 container cleanup d8b45af83a55caca4e1c0507fc5d43cec64b48bf9c69050c5b13c75770710bd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-23T10:37:54.648 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:54 smithi069 bash[88474]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0 2024-04-23T10:37:54.946 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:54 smithi069 podman[88493]: 2024-04-23 10:37:54.65002156 +0000 UTC m=+0.647944525 container remove d8b45af83a55caca4e1c0507fc5d43cec64b48bf9c69050c5b13c75770710bd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-23T10:37:55.241 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:54 smithi069 podman[88585]: 2024-04-23 10:37:54.851442075 +0000 UTC m=+0.018306052 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:37:55.242 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:54 smithi069 podman[88585]: 2024-04-23 10:37:54.972839547 +0000 UTC m=+0.139703541 container create 89c7eea95a83cc77d4ccf84d49510c16db3566c5fc873b115828c163a558cf21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-23T10:37:55.538 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:55 smithi069 podman[88585]: 2024-04-23 10:37:55.246487569 +0000 UTC m=+0.413351530 container init 89c7eea95a83cc77d4ccf84d49510c16db3566c5fc873b115828c163a558cf21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5) 2024-04-23T10:37:55.538 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:55 smithi069 podman[88585]: 2024-04-23 10:37:55.249739099 +0000 UTC m=+0.416603053 container start 89c7eea95a83cc77d4ccf84d49510c16db3566c5fc873b115828c163a558cf21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-23T10:37:55.538 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:55 smithi069 podman[88585]: 2024-04-23 10:37:55.32120184 +0000 UTC m=+0.488065785 container attach 89c7eea95a83cc77d4ccf84d49510c16db3566c5fc873b115828c163a558cf21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-23T10:37:55.821 INFO:journalctl@ceph.osd.0.smithi069.stdout:Apr 23 10:37:55 smithi069 podman[88585]: 2024-04-23 10:37:55.540538047 +0000 UTC m=+0.707402004 container died 89c7eea95a83cc77d4ccf84d49510c16db3566c5fc873b115828c163a558cf21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-23T10:37:56.159 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.0.service' 2024-04-23T10:37:56.196 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:37:56.196 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-23T10:37:56.196 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-23T10:37:56.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.1 2024-04-23T10:37:56.517 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:37:56 smithi146 systemd[1]: Stopping Ceph osd.1 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:37:56.927 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:37:56 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1[37368]: 2024-04-23T10:37:56.518+0000 7fc34e966700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:37:56.927 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:37:56 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1[37368]: 2024-04-23T10:37:56.518+0000 7fc34e966700 -1 osd.1 103 *** Got signal Terminated *** 2024-04-23T10:37:56.927 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:37:56 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1[37368]: 2024-04-23T10:37:56.518+0000 7fc34e966700 -1 osd.1 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:38:02.151 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:38:01 smithi146 podman[68129]: 2024-04-23 10:38:01.84691604 +0000 UTC m=+5.463413909 container died 071a456353b12badd5f2f731d5adce2257add15ea36c400c48c57bbc3ff233f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:38:02.427 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:38:02 smithi146 podman[68129]: 2024-04-23 10:38:02.269112297 +0000 UTC m=+5.885610163 container cleanup 071a456353b12badd5f2f731d5adce2257add15ea36c400c48c57bbc3ff233f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:38:02.428 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:38:02 smithi146 bash[68129]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1 2024-04-23T10:38:02.882 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:38:02 smithi146 podman[68147]: 2024-04-23 10:38:02.462001962 +0000 UTC m=+0.606741007 container remove 071a456353b12badd5f2f731d5adce2257add15ea36c400c48c57bbc3ff233f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-23T10:38:03.171 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:38:02 smithi146 podman[68238]: 2024-04-23 10:38:02.787719238 +0000 UTC m=+0.018196552 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:38:03.171 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:38:02 smithi146 podman[68238]: 2024-04-23 10:38:02.929562938 +0000 UTC m=+0.160040226 container create 6cdb366bd79e9c2589dc480ac11002d4732f7d265bf9f34e296c9a85de5aa62e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, ceph=True) 2024-04-23T10:38:03.427 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:38:03 smithi146 podman[68238]: 2024-04-23 10:38:03.173643196 +0000 UTC m=+0.404120484 container init 6cdb366bd79e9c2589dc480ac11002d4732f7d265bf9f34e296c9a85de5aa62e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:38:03.428 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:38:03 smithi146 podman[68238]: 2024-04-23 10:38:03.176849478 +0000 UTC m=+0.407326769 container start 6cdb366bd79e9c2589dc480ac11002d4732f7d265bf9f34e296c9a85de5aa62e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:38:03.428 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:38:03 smithi146 podman[68238]: 2024-04-23 10:38:03.298948765 +0000 UTC m=+0.529426057 container attach 6cdb366bd79e9c2589dc480ac11002d4732f7d265bf9f34e296c9a85de5aa62e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, ceph=True, GIT_CLEAN=True) 2024-04-23T10:38:03.766 INFO:journalctl@ceph.osd.1.smithi146.stdout:Apr 23 10:38:03 smithi146 podman[68238]: 2024-04-23 10:38:03.475095183 +0000 UTC m=+0.705572490 container died 6cdb366bd79e9c2589dc480ac11002d4732f7d265bf9f34e296c9a85de5aa62e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-23T10:38:04.099 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.1.service' 2024-04-23T10:38:04.137 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:38:04.138 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-23T10:38:04.138 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-23T10:38:04.138 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.2 2024-04-23T10:38:04.441 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:04 smithi167 systemd[1]: Stopping Ceph osd.2 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:38:04.832 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:04 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2[38099]: 2024-04-23T10:38:04.442+0000 7f9e1d505700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:38:04.832 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:04 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2[38099]: 2024-04-23T10:38:04.442+0000 7f9e1d505700 -1 osd.2 103 *** Got signal Terminated *** 2024-04-23T10:38:04.832 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:04 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2[38099]: 2024-04-23T10:38:04.442+0000 7f9e1d505700 -1 osd.2 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:38:10.285 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:10 smithi167 podman[69900]: 2024-04-23 10:38:09.999905577 +0000 UTC m=+5.670297255 container died 4cb46314dbec0d29a6da6e88df6089b18d6ae99a3e8c3a4ee069cb9a476da741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-23T10:38:10.576 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:10 smithi167 podman[69900]: 2024-04-23 10:38:10.376994977 +0000 UTC m=+6.047386657 container cleanup 4cb46314dbec0d29a6da6e88df6089b18d6ae99a3e8c3a4ee069cb9a476da741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-23T10:38:10.576 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:10 smithi167 bash[69900]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2 2024-04-23T10:38:10.832 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:10 smithi167 podman[69917]: 2024-04-23 10:38:10.57838518 +0000 UTC m=+0.581186193 container remove 4cb46314dbec0d29a6da6e88df6089b18d6ae99a3e8c3a4ee069cb9a476da741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-23T10:38:11.272 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:10 smithi167 podman[70004]: 2024-04-23 10:38:10.896122068 +0000 UTC m=+0.018034738 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:38:11.273 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:11 smithi167 podman[70004]: 2024-04-23 10:38:11.0294409 +0000 UTC m=+0.151353560 container create 99b5ac965b7c27567715d727f7db811c122f491a2f8c45d2c486dfb2ab7fb05c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:38:11.567 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:11 smithi167 podman[70004]: 2024-04-23 10:38:11.274399742 +0000 UTC m=+0.396312401 container init 99b5ac965b7c27567715d727f7db811c122f491a2f8c45d2c486dfb2ab7fb05c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-23T10:38:11.567 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:11 smithi167 podman[70004]: 2024-04-23 10:38:11.277889907 +0000 UTC m=+0.399802572 container start 99b5ac965b7c27567715d727f7db811c122f491a2f8c45d2c486dfb2ab7fb05c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-23T10:38:11.567 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:11 smithi167 podman[70004]: 2024-04-23 10:38:11.374628378 +0000 UTC m=+0.496541041 container attach 99b5ac965b7c27567715d727f7db811c122f491a2f8c45d2c486dfb2ab7fb05c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-23T10:38:11.832 INFO:journalctl@ceph.osd.2.smithi167.stdout:Apr 23 10:38:11 smithi167 podman[70004]: 2024-04-23 10:38:11.569390493 +0000 UTC m=+0.691303153 container died 99b5ac965b7c27567715d727f7db811c122f491a2f8c45d2c486dfb2ab7fb05c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-23T10:38:12.244 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.2.service' 2024-04-23T10:38:12.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:38:12.284 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-23T10:38:12.284 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-23T10:38:12.285 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.3 2024-04-23T10:38:12.710 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:12 smithi069 systemd[1]: Stopping Ceph osd.3 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:38:12.991 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:12 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3[48850]: 2024-04-23T10:38:12.743+0000 7f7fa7f55700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:38:12.991 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:12 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3[48850]: 2024-04-23T10:38:12.743+0000 7f7fa7f55700 -1 osd.3 103 *** Got signal Terminated *** 2024-04-23T10:38:12.992 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:12 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3[48850]: 2024-04-23T10:38:12.743+0000 7f7fa7f55700 -1 osd.3 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:38:15.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:14 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:14.864+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:15.565 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:15.200+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:15.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:15.566+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:16.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:15 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:15.816+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:16.561 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:16 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:16.207+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:16.739 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:16 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:16.389+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:16.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:16 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:16.563+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:16.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:16 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:16.740+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:17.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:16 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:16.836+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:17.516 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:17.185+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:17.741 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:17 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:17.343+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:17.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:17.517+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:17.991 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:17 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:17.742+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:18.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:17 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:17.804+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:18.518 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:18 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:18.207+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:18.568 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:18 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:18.314+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:18.568 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:18 smithi069 podman[88692]: 2024-04-23 10:38:18.268075846 +0000 UTC m=+5.791773763 container died 0aadaeb31c6eb30c71354d279958f7ccc8ff6d24a87763229087842f35247af8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:38:18.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:18 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:18.520+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:18.868 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:18 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:18.705+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:18.868 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:18 smithi069 podman[88692]: 2024-04-23 10:38:18.660799214 +0000 UTC m=+6.184497126 container cleanup 0aadaeb31c6eb30c71354d279958f7ccc8ff6d24a87763229087842f35247af8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:38:18.868 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:18 smithi069 bash[88692]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3 2024-04-23T10:38:19.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:18 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:18.835+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:19.184 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:18 smithi069 podman[88722]: 2024-04-23 10:38:18.870348417 +0000 UTC m=+0.602771231 container remove 0aadaeb31c6eb30c71354d279958f7ccc8ff6d24a87763229087842f35247af8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True) 2024-04-23T10:38:19.463 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:19 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:19.362+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:19.463 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:19 smithi069 podman[88813]: 2024-04-23 10:38:19.089541162 +0000 UTC m=+0.017802775 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:38:19.464 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:19 smithi069 podman[88813]: 2024-04-23 10:38:19.229742513 +0000 UTC m=+0.158004122 container create 236827801b4690ed43b31847e1585562ae69efb015c63be97082d3ceffb228e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-23T10:38:19.464 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:19 smithi069 podman[88813]: 2024-04-23 10:38:19.465478618 +0000 UTC m=+0.393740223 container init 236827801b4690ed43b31847e1585562ae69efb015c63be97082d3ceffb228e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:38:19.545 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:19 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:19.163+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:19.743 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:19 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:19.675+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:19.743 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:19 smithi069 podman[88813]: 2024-04-23 10:38:19.468916282 +0000 UTC m=+0.397177888 container start 236827801b4690ed43b31847e1585562ae69efb015c63be97082d3ceffb228e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:38:19.743 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:19 smithi069 podman[88813]: 2024-04-23 10:38:19.540507072 +0000 UTC m=+0.468768696 container attach 236827801b4690ed43b31847e1585562ae69efb015c63be97082d3ceffb228e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416) 2024-04-23T10:38:19.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:19 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:19.547+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:20.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:19 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:19.822+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:20.217 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 23 10:38:19 smithi069 podman[88813]: 2024-04-23 10:38:19.763926792 +0000 UTC m=+0.692188397 container died 236827801b4690ed43b31847e1585562ae69efb015c63be97082d3ceffb228e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:38:20.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:20 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:20.341+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:20.523 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:20 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:20.159+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:20.540 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.3.service' 2024-04-23T10:38:20.587 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:38:20.587 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-23T10:38:20.588 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-23T10:38:20.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.4 2024-04-23T10:38:20.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:20 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:20.524+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:20.903 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:20 smithi146 systemd[1]: Stopping Ceph osd.4 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:38:20.903 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:20 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:20.785+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:20.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:20 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:20.725+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:21.177 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:20 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4[44061]: 2024-04-23T10:38:20.904+0000 7efc7cbd5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:38:21.177 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:20 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4[44061]: 2024-04-23T10:38:20.904+0000 7efc7cbd5700 -1 osd.4 103 *** Got signal Terminated *** 2024-04-23T10:38:21.178 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:20 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4[44061]: 2024-04-23T10:38:20.904+0000 7efc7cbd5700 -1 osd.4 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:38:21.499 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:21 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:21.198+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:21.709 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:21 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:21.335+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:21.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:21 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:21.501+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:21.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:21 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:21.711+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:22.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:21 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:21.747+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:22.538 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:22 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:22.175+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:22.741 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:22 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:22.303+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:22.816 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:22 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:22.540+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:23.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:22 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:22.818+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:23.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:22 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:22.766+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:23.241 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:22 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:22.744+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:23.574 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:23 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:23.149+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:23.740 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:23 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:23.286+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:23.740 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:23 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:23.286+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:23.832 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:23 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:23.821+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:23.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:23 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:23.575+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:23.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:23 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:23.575+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.023822+0000 front 2024-04-23T10:38:00.023873+0000 (oldest deadline 2024-04-23T10:38:23.523882+0000) 2024-04-23T10:38:23.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:23 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:23.741+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:24.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:23 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:23.788+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:24.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:23 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:23.788+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:24.572 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:24 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:24.187+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:24.732 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:24 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:24.299+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:24.732 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:24 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:24.299+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:24.832 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:24 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:24.780+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:24.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:24 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:24.573+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:24.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:24 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:24.573+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.023822+0000 front 2024-04-23T10:38:00.023873+0000 (oldest deadline 2024-04-23T10:38:23.523882+0000) 2024-04-23T10:38:24.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:24 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:24.733+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:25.078 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:24 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:24.956+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:25.079 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:24 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:24.781+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:25.079 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:24 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:24.781+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:25.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:25 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:25.153+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:25.677 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:25 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4[44061]: 2024-04-23T10:38:25.552+0000 7efc791c9700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:59.331543+0000 front 2024-04-23T10:37:59.331571+0000 (oldest deadline 2024-04-23T10:38:25.231701+0000) 2024-04-23T10:38:25.714 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:25 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:25.266+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:25.714 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:25 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:25.266+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:25.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:25 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:25.715+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:25.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:25 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:25.715+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:26.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:25 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:25.749+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:26.082 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:25 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:25.603+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:26.082 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:25 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:25.603+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.023822+0000 front 2024-04-23T10:38:00.023873+0000 (oldest deadline 2024-04-23T10:38:23.523882+0000) 2024-04-23T10:38:26.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:25 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:25.958+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:26.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:25 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:25.830+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:26.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:25 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:25.830+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:26.571 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:26 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:26.175+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:26.572 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:26 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:26.175+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:26.677 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:26 smithi146 podman[68344]: 2024-04-23 10:38:26.410419265 +0000 UTC m=+5.625638546 container died 1cfb1d864e0cc13c422c41dc87b4f433426936dc9be4a7b86c40ccc418e786db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=) 2024-04-23T10:38:26.681 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:26.294+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:26.682 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:26.294+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:26.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:26 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:26.573+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:26.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:26 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:26.573+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.023822+0000 front 2024-04-23T10:38:00.023873+0000 (oldest deadline 2024-04-23T10:38:23.523882+0000) 2024-04-23T10:38:26.833 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:26 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:26.718+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:26.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:26.683+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:26.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:26.683+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:26.995 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:26 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:26.878+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:26.995 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:26 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:26.878+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:26.996 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:26 smithi146 podman[68344]: 2024-04-23 10:38:26.813498974 +0000 UTC m=+6.028718246 container cleanup 1cfb1d864e0cc13c422c41dc87b4f433426936dc9be4a7b86c40ccc418e786db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-23T10:38:26.996 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:26 smithi146 bash[68344]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4 2024-04-23T10:38:27.366 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:27 smithi146 podman[68372]: 2024-04-23 10:38:27.040207743 +0000 UTC m=+0.633382325 container remove 1cfb1d864e0cc13c422c41dc87b4f433426936dc9be4a7b86c40ccc418e786db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True) 2024-04-23T10:38:27.367 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:26 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:26.996+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:27.529 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:27 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:27.214+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:27.529 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:27 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:27.214+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:27.625 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:27 smithi146 podman[68458]: 2024-04-23 10:38:27.271394026 +0000 UTC m=+0.018578604 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:38:27.625 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:27 smithi146 podman[68458]: 2024-04-23 10:38:27.382593188 +0000 UTC m=+0.129777749 container create fd19c2681c77485c3bd09f99fe5f2bf715c90a94d367bba560228154fdeb3536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-23T10:38:27.694 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:27 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:27.309+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:27.694 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:27 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:27.309+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:27.832 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:27 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:27.676+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:27.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:27 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:27.530+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:27.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:27 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:27.530+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.023822+0000 front 2024-04-23T10:38:00.023873+0000 (oldest deadline 2024-04-23T10:38:23.523882+0000) 2024-04-23T10:38:27.881 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:27 smithi146 podman[68458]: 2024-04-23 10:38:27.62696246 +0000 UTC m=+0.374147024 container init fd19c2681c77485c3bd09f99fe5f2bf715c90a94d367bba560228154fdeb3536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:38:27.881 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:27 smithi146 podman[68458]: 2024-04-23 10:38:27.63039177 +0000 UTC m=+0.377576332 container start fd19c2681c77485c3bd09f99fe5f2bf715c90a94d367bba560228154fdeb3536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:38:27.881 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:27 smithi146 podman[68458]: 2024-04-23 10:38:27.72699516 +0000 UTC m=+0.474179746 container attach fd19c2681c77485c3bd09f99fe5f2bf715c90a94d367bba560228154fdeb3536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-23T10:38:27.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:27 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:27.695+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:27.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:27 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:27.695+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:28.177 INFO:journalctl@ceph.osd.4.smithi146.stdout:Apr 23 10:38:27 smithi146 podman[68458]: 2024-04-23 10:38:27.928856072 +0000 UTC m=+0.676040627 container died fd19c2681c77485c3bd09f99fe5f2bf715c90a94d367bba560228154fdeb3536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-23T10:38:28.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:28 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:28.031+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:28.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:27 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:27.882+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:28.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:27 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:27.882+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:28.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.4.service' 2024-04-23T10:38:28.559 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:28 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:28.225+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:28.560 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:28 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:28.225+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:28.585 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:38:28.585 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-23T10:38:28.586 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-23T10:38:28.586 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.5 2024-04-23T10:38:28.647 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:28 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:28.311+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:28.647 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:28 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:28.311+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:28.833 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:28 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:28.675+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:28.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:28 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:28.561+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:28.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:28 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:28.561+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.023822+0000 front 2024-04-23T10:38:00.023873+0000 (oldest deadline 2024-04-23T10:38:23.523882+0000) 2024-04-23T10:38:28.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:28 smithi167 systemd[1]: Stopping Ceph osd.5 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:38:28.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:28 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:28.648+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:28.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:28 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:28.648+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:29.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:29 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:29.041+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:29.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:28 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:28.853+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:29.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:28 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:28.853+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:29.228 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:28 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:28.860+0000 7f581c492700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:38:29.229 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:28 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:28.860+0000 7f581c492700 -1 osd.5 103 *** Got signal Terminated *** 2024-04-23T10:38:29.229 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:28 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:28.860+0000 7f581c492700 -1 osd.5 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:38:29.546 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:29 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:29.230+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:29.546 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:29 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:29.230+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:29.601 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:29 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:29.275+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:29.601 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:29 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:29.275+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:29.832 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:29 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:29.721+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:29.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:29 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:29.547+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:29.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:29 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:29.547+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.023822+0000 front 2024-04-23T10:38:00.023873+0000 (oldest deadline 2024-04-23T10:38:23.523882+0000) 2024-04-23T10:38:29.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:29 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:29.603+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:29.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:29 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:29.603+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:30.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:29 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:29.995+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:30.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:29 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:29.809+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:30.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:29 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:29.809+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:30.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:30 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:30.226+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:30.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:30 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:30.226+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:30.570 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:30 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:30.220+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:30.570 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:30 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:30.220+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:30.832 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:30 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:30.719+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:30.832 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:30 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:30.719+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:30.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:30 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:30.571+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:30.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:30 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:30.571+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.023822+0000 front 2024-04-23T10:38:00.023873+0000 (oldest deadline 2024-04-23T10:38:23.523882+0000) 2024-04-23T10:38:30.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:30 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:30.621+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:30.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:30 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:30.621+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:31.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:31 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:31.011+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:31.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:30 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:30.812+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:31.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:30 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:30.812+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:31.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:30 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:30.812+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:31.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:31 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:31.212+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:31.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:31 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:31.212+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:31.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:31 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:31.237+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:31.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:31 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:31.237+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:31.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:31 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:31.628+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:31.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:31 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:31.628+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:31.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:31 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:31.628+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:32.082 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:31 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:31.586+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:32.082 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:31 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:31.586+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.023822+0000 front 2024-04-23T10:38:00.023873+0000 (oldest deadline 2024-04-23T10:38:23.523882+0000) 2024-04-23T10:38:32.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:31 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:31.700+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:32.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:31 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:31.700+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:32.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:32 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:32.000+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:32.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:32 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:32.000+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:32.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:31 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:31.808+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:32.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:31 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:31.808+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:32.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:31 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:31.808+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:32.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:32 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:32.199+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:32.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:32 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:32.199+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:32.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:32 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:32.281+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:32.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:32 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:32.281+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:32.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:32 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:32.630+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:32.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:32 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:32.630+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:32.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:32 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:32.630+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:33.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:32 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:32.679+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:33.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:32 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:32.679+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:33.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:32 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:32.634+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:33.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:32 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:32.634+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.023822+0000 front 2024-04-23T10:38:00.023873+0000 (oldest deadline 2024-04-23T10:38:23.523882+0000) 2024-04-23T10:38:33.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:32 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:32.990+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:33.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:32 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:32.990+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:33.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:32 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:32.767+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:33.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:32 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:32.767+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:33.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:32 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:32.767+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:33.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:33 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:33.183+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:33.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:33 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:33.183+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:33.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:33 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:33.294+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:33.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:33 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:33.294+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:33.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:33 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:33.294+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:33.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:33 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:33.650+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:33.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:33 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:33.650+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:33.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:33 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:33.650+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:34.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:33 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:33.636+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:34.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:33 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:33.636+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:34.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:33 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:33.677+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:50.920863+0000 front 2024-04-23T10:37:50.920742+0000 (oldest deadline 2024-04-23T10:38:14.921113+0000) 2024-04-23T10:38:34.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:33 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:33.677+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.023822+0000 front 2024-04-23T10:38:00.023873+0000 (oldest deadline 2024-04-23T10:38:23.523882+0000) 2024-04-23T10:38:34.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:33 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5[44645]: 2024-04-23T10:38:33.677+0000 7f5814a7e700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.224849+0000 front 2024-04-23T10:38:08.224879+0000 (oldest deadline 2024-04-23T10:38:32.924982+0000) 2024-04-23T10:38:34.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:33 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:33.969+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:34.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:33 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:33.969+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:34.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:33 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:33.789+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:34.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:33 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:33.789+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:34.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:33 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:33.789+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:34.473 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:34 smithi167 podman[70122]: 2024-04-23 10:38:34.191977796 +0000 UTC m=+5.415379571 container died d1834549fc8bcf1ab52e7a24ebc3bd16ca54482a04516ccbf0793a55417cd97b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5, org.label-schema.build-date=20240416, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-23T10:38:34.473 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:34 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:34.261+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:34.473 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:34 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:34.261+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:34.474 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:34 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:34.261+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:34.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:34 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:34.206+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:34.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:34 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:34.206+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:34.832 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:34 smithi167 podman[70122]: 2024-04-23 10:38:34.565961893 +0000 UTC m=+5.789363683 container cleanup d1834549fc8bcf1ab52e7a24ebc3bd16ca54482a04516ccbf0793a55417cd97b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True) 2024-04-23T10:38:34.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:34 smithi167 bash[70122]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5 2024-04-23T10:38:34.833 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:34 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:34.619+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:34.833 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:34 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:34.619+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:34.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:34 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:34.691+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:34.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:34 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:34.691+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:34.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:34 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:34.691+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:35.166 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:34 smithi167 podman[70140]: 2024-04-23 10:38:34.867528667 +0000 UTC m=+0.674203142 container remove d1834549fc8bcf1ab52e7a24ebc3bd16ca54482a04516ccbf0793a55417cd97b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:38:35.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:34 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:34.936+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:35.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:34 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:34.936+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:35.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:34 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:34.760+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:35.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:34 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:34.760+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:35.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:34 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:34.760+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:35.486 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:35 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:35.223+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:35.486 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:35 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:35.223+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:35.486 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:35 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:35.223+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:35.487 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:35 smithi167 podman[70234]: 2024-04-23 10:38:35.168567708 +0000 UTC m=+0.092394662 container create 1f990ae9bc3c446cdfdd69fbb6da7479c8ed423fb1f9d94bc273316856ff9eab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2) 2024-04-23T10:38:35.487 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:35 smithi167 podman[70234]: 2024-04-23 10:38:35.094352219 +0000 UTC m=+0.018179141 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:38:35.487 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:35 smithi167 podman[70234]: 2024-04-23 10:38:35.396202781 +0000 UTC m=+0.320029694 container init 1f990ae9bc3c446cdfdd69fbb6da7479c8ed423fb1f9d94bc273316856ff9eab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-23T10:38:35.487 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:35 smithi167 podman[70234]: 2024-04-23 10:38:35.399488965 +0000 UTC m=+0.323315877 container start 1f990ae9bc3c446cdfdd69fbb6da7479c8ed423fb1f9d94bc273316856ff9eab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:38:35.487 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:35 smithi167 podman[70234]: 2024-04-23 10:38:35.488157339 +0000 UTC m=+0.411984267 container attach 1f990ae9bc3c446cdfdd69fbb6da7479c8ed423fb1f9d94bc273316856ff9eab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-23T10:38:35.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:35 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:35.157+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:35.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:35 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:35.157+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:35.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:35 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:35.157+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.955540+0000 front 2024-04-23T10:38:07.955570+0000 (oldest deadline 2024-04-23T10:38:34.955902+0000) 2024-04-23T10:38:35.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Apr 23 10:38:35 smithi167 podman[70234]: 2024-04-23 10:38:35.694256102 +0000 UTC m=+0.618083022 container died 1f990ae9bc3c446cdfdd69fbb6da7479c8ed423fb1f9d94bc273316856ff9eab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-04-23T10:38:35.833 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:35 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:35.617+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:35.833 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:35 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:35.617+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:35.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:35 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:35.741+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:35.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:35 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:35.741+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:35.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:35 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:35.741+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:36.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:35 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:35.927+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:36.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:35 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:35.927+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:36.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:35 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:35.780+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:36.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:35 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:35.780+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:36.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:35 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:35.780+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:36.265 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:36 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:36.222+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:36.265 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:36 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:36.222+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:36.265 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:36 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:36.222+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:36.292 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.5.service' 2024-04-23T10:38:36.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:38:36.332 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-23T10:38:36.332 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-23T10:38:36.332 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.6 2024-04-23T10:38:36.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:36 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:36.181+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:36.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:36 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:36.181+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:36.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:36 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:36.181+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.955540+0000 front 2024-04-23T10:38:07.955570+0000 (oldest deadline 2024-04-23T10:38:34.955902+0000) 2024-04-23T10:38:36.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:36 smithi069 systemd[1]: Stopping Ceph osd.6 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:38:36.992 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:36 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:36.630+0000 7f1d19b1f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:38:36.992 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:36 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:36.630+0000 7f1d19b1f700 -1 osd.6 103 *** Got signal Terminated *** 2024-04-23T10:38:36.992 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:36 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:36.630+0000 7f1d19b1f700 -1 osd.6 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:38:36.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:36 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:36.746+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:36.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:36 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:36.746+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:36.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:36 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:36.746+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:37.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:36 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:36.662+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:37.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:36 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:36.662+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:37.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:36 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:36.936+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:37.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:36 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:36.936+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:37.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:36 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:36.802+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:37.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:36 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:36.802+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:37.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:36 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:36.802+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:37.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:37.208+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:37.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:37.208+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:37.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:37.208+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.955540+0000 front 2024-04-23T10:38:07.955570+0000 (oldest deadline 2024-04-23T10:38:34.955902+0000) 2024-04-23T10:38:37.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:37.245+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:37.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:37.245+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:37.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:37.245+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:38.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:37.669+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:38.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:37 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:37.669+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:38.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:37.950+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:38.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:37.950+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:38.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:37.762+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:38.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:37.762+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:38.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:37 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:37.762+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:38.200 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:37.756+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:38.200 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:37.756+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:38.200 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:37 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:37.756+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:38.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:38 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:38.201+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:38.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:38 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:38.201+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:38.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:38 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:38.201+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.955540+0000 front 2024-04-23T10:38:07.955570+0000 (oldest deadline 2024-04-23T10:38:34.955902+0000) 2024-04-23T10:38:38.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:38 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:38.249+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:38.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:38 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:38.249+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:38.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:38 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:38.249+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:39.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:38 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:38.660+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:39.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:38 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:38.660+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:39.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:38 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:38.914+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:39.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:38 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:38.914+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:39.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:38 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:38.751+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:39.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:38 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:38.751+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:39.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:38 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:38.751+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:39.181 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:38 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:38.794+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:39.181 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:38 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:38.794+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:39.181 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:38 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:38.794+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:39.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:39 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:39.182+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:39.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:39 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:39.182+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:39.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:39 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:39.182+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.955540+0000 front 2024-04-23T10:38:07.955570+0000 (oldest deadline 2024-04-23T10:38:34.955902+0000) 2024-04-23T10:38:39.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:39 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:39.182+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:15.456719+0000 front 2024-04-23T10:38:15.456737+0000 (oldest deadline 2024-04-23T10:38:38.356879+0000) 2024-04-23T10:38:39.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:39 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:39.215+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:39.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:39 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:39.215+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:39.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:39 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:39.215+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:40.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:39 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:39.659+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:40.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:39 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:39.659+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:40.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:39 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:39.723+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:40.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:39 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:39.723+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:40.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:39 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:39.723+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:40.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:39 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:39.919+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:40.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:39 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:39.919+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:40.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:39 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:39.919+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.310051+0000 front 2024-04-23T10:38:16.309955+0000 (oldest deadline 2024-04-23T10:38:39.710426+0000) 2024-04-23T10:38:40.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:39 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:39.797+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:40.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:39 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:39.797+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:40.225 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:39 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:39.797+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:40.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:40 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:40.226+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:40.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:40 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:40.226+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:40.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:40 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:40.226+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.955540+0000 front 2024-04-23T10:38:07.955570+0000 (oldest deadline 2024-04-23T10:38:34.955902+0000) 2024-04-23T10:38:40.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:40 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:40.226+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:15.456719+0000 front 2024-04-23T10:38:15.456737+0000 (oldest deadline 2024-04-23T10:38:38.356879+0000) 2024-04-23T10:38:40.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:40 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:40.247+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:40.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:40 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:40.247+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:40.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:40 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:40.247+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:40.956 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:40 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:40.690+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:40.956 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:40 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:40.690+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:40.956 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:40 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:40.690+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:41.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:40 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:40.610+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:41.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:40 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:40.610+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:41.240 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:40 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:40.841+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:41.240 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:40 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:40.841+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:41.240 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:40 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:40.841+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:41.427 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:40 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:40.957+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:41.427 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:40 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:40.957+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:41.427 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:40 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:40.957+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.310051+0000 front 2024-04-23T10:38:16.309955+0000 (oldest deadline 2024-04-23T10:38:39.710426+0000) 2024-04-23T10:38:41.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:41 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:41.241+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.952256+0000 front 2024-04-23T10:37:52.952433+0000 (oldest deadline 2024-04-23T10:38:15.852409+0000) 2024-04-23T10:38:41.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:41 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:41.241+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.553687+0000 front 2024-04-23T10:38:00.553498+0000 (oldest deadline 2024-04-23T10:38:22.853359+0000) 2024-04-23T10:38:41.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:41 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:41.241+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.955540+0000 front 2024-04-23T10:38:07.955570+0000 (oldest deadline 2024-04-23T10:38:34.955902+0000) 2024-04-23T10:38:41.492 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:41 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6[55397]: 2024-04-23T10:38:41.241+0000 7f1d16113700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:15.456719+0000 front 2024-04-23T10:38:15.456737+0000 (oldest deadline 2024-04-23T10:38:38.356879+0000) 2024-04-23T10:38:41.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:41 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:41.221+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:41.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:41 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:41.221+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:41.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:41 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:41.221+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:42.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:41 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:41.661+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:42.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:41 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:41.661+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:42.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:41 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:41.661+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:42.101 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:41 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:41.814+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:42.101 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:41 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:41.814+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:42.101 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:41 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:41.814+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:42.101 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:41 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:41.814+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:42.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:41 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:41.707+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:42.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:41 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:41.707+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:42.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:41 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:41.707+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:42.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:41 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:41.909+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:42.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:41 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:41.909+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:42.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:41 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:41.909+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.310051+0000 front 2024-04-23T10:38:16.309955+0000 (oldest deadline 2024-04-23T10:38:39.710426+0000) 2024-04-23T10:38:42.405 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:42 smithi069 podman[88919]: 2024-04-23 10:38:42.102887478 +0000 UTC m=+5.577468483 container died 2d5639e4a259a85086e786747b192dcf8942bed5ce25ee8aeff721c9b1841299 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:38:42.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:42 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:42.234+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:42.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:42 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:42.234+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:42.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:42 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:42.234+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:42.742 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:42 smithi069 podman[88919]: 2024-04-23 10:38:42.50584723 +0000 UTC m=+5.980428251 container cleanup 2d5639e4a259a85086e786747b192dcf8942bed5ce25ee8aeff721c9b1841299 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:38:42.742 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:42 smithi069 bash[88919]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6 2024-04-23T10:38:43.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:42 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:42.687+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:43.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:42 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:42.687+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:43.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:42 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:42.687+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:43.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:42 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:42.894+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:43.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:42 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:42.894+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:43.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:42 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:42.894+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.310051+0000 front 2024-04-23T10:38:16.309955+0000 (oldest deadline 2024-04-23T10:38:39.710426+0000) 2024-04-23T10:38:43.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:42 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:42.748+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:43.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:42 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:42.748+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:43.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:42 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:42.748+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:43.179 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:42 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:42.748+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:43.185 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:42 smithi069 podman[88936]: 2024-04-23 10:38:42.765694047 +0000 UTC m=+0.663858922 container remove 2d5639e4a259a85086e786747b192dcf8942bed5ce25ee8aeff721c9b1841299 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_CLEAN=True, ceph=True) 2024-04-23T10:38:43.185 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:42 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:42.813+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:43.185 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:42 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:42.813+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:43.185 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:42 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:42.813+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:43.185 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:42 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:42.813+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:43.450 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:43 smithi069 podman[89028]: 2024-04-23 10:38:43.089539506 +0000 UTC m=+0.017833098 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:38:43.450 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:43 smithi069 podman[89028]: 2024-04-23 10:38:43.208110726 +0000 UTC m=+0.136404363 container create 3d4e250d0ed1f0592b62f00990b461248dba0a6d2b5cb8365d5f389b89b300e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-23T10:38:43.450 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:43 smithi069 podman[89028]: 2024-04-23 10:38:43.452278891 +0000 UTC m=+0.380572484 container init 3d4e250d0ed1f0592b62f00990b461248dba0a6d2b5cb8365d5f389b89b300e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD) 2024-04-23T10:38:43.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:43 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:43.199+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:43.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:43 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:43.199+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:43.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:43 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:43.199+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:43.742 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:43 smithi069 podman[89028]: 2024-04-23 10:38:43.455645385 +0000 UTC m=+0.383938981 container start 3d4e250d0ed1f0592b62f00990b461248dba0a6d2b5cb8365d5f389b89b300e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6-deactivate, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:38:43.742 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:43 smithi069 podman[89028]: 2024-04-23 10:38:43.552177993 +0000 UTC m=+0.480471586 container attach 3d4e250d0ed1f0592b62f00990b461248dba0a6d2b5cb8365d5f389b89b300e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:38:44.019 INFO:journalctl@ceph.osd.6.smithi069.stdout:Apr 23 10:38:43 smithi069 podman[89028]: 2024-04-23 10:38:43.748322448 +0000 UTC m=+0.676616048 container died 3d4e250d0ed1f0592b62f00990b461248dba0a6d2b5cb8365d5f389b89b300e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, ceph=True, org.label-schema.schema-version=1.0) 2024-04-23T10:38:44.020 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:43 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:43.815+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:44.020 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:43 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:43.815+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:44.020 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:43 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:43.815+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:44.020 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:43 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:43.815+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:44.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:43 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:43.695+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:44.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:43 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:43.695+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:44.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:43 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:43.695+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:44.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:43 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:43.905+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:44.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:43 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:43.905+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:44.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:43 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:43.905+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.310051+0000 front 2024-04-23T10:38:16.309955+0000 (oldest deadline 2024-04-23T10:38:39.710426+0000) 2024-04-23T10:38:44.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:43 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:43.735+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:44.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:43 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:43.735+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:44.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:43 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:43.736+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:44.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:43 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:43.736+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:44.365 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.6.service' 2024-04-23T10:38:44.404 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:38:44.405 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-23T10:38:44.405 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-23T10:38:44.405 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.7 2024-04-23T10:38:44.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:44 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:44.231+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:44.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:44 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:44.231+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:44.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:44 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:44.231+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:44.714 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:44 smithi146 systemd[1]: Stopping Ceph osd.7 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:38:45.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:44 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:44.744+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:45.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:44 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:44.744+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:45.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:44 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:44.744+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:45.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:44 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:44.750+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:45.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:44 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:44.750+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:45.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:44 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:44.750+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:45.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:44 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:44.750+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:45.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:44 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:44.716+0000 7f4ee447b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:38:45.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:44 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:44.716+0000 7f4ee447b700 -1 osd.7 103 *** Got signal Terminated *** 2024-04-23T10:38:45.179 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:44 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:44.716+0000 7f4ee447b700 -1 osd.7 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:38:45.179 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:44 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:44.945+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:45.179 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:44 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:44.945+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:45.179 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:44 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:44.945+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.310051+0000 front 2024-04-23T10:38:16.309955+0000 (oldest deadline 2024-04-23T10:38:39.710426+0000) 2024-04-23T10:38:45.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:44 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:44.844+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:45.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:44 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:44.844+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:45.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:44 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:44.844+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:45.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:44 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:44.844+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:45.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:45 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:45.271+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:45.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:45 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:45.271+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:45.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:45 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:45.271+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:46.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:45 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:45.761+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:46.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:45 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:45.761+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:46.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:45 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:45.761+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:46.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:45 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:45.913+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:46.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:45 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:45.913+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:46.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:45 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:45.913+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.310051+0000 front 2024-04-23T10:38:16.309955+0000 (oldest deadline 2024-04-23T10:38:39.710426+0000) 2024-04-23T10:38:46.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:45 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:45.750+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:46.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:45 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:45.750+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:46.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:45 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:45.750+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:46.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:45 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:45.750+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:46.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:45 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:45.861+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:46.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:45 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:45.861+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:46.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:45 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:45.861+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:46.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:45 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:45.861+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:46.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:46.304+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:46.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:46.304+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:46.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:46.304+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:47.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:46.768+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:47.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:46.768+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:47.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:46.768+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:47.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:46 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:46.768+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.036343+0000 front 2024-04-23T10:38:25.036310+0000 (oldest deadline 2024-04-23T10:38:46.636991+0000) 2024-04-23T10:38:47.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:46.789+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:47.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:46.789+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:47.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:46.789+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:47.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:46.789+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:47.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:46.957+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:47.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:46.957+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:47.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:46.957+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.310051+0000 front 2024-04-23T10:38:16.309955+0000 (oldest deadline 2024-04-23T10:38:39.710426+0000) 2024-04-23T10:38:47.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:46.957+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:20.811443+0000 front 2024-04-23T10:38:20.811423+0000 (oldest deadline 2024-04-23T10:38:46.711419+0000) 2024-04-23T10:38:47.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:46 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:46.856+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:47.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:46 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:46.856+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:47.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:46 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:46.856+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:47.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:46 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:46.856+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:47.361 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:47 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:47.280+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:47.361 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:47 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:47.280+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:47.361 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:47 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:47.280+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:47.361 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:47 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:47.280+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:48.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:47 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:47.741+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:48.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:47 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:47.741+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:48.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:47 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:47.741+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:48.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:47 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:47.741+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.036343+0000 front 2024-04-23T10:38:25.036310+0000 (oldest deadline 2024-04-23T10:38:46.636991+0000) 2024-04-23T10:38:48.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:47 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:47.980+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:48.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:47 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:47.980+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:48.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:47 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:47.980+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.310051+0000 front 2024-04-23T10:38:16.309955+0000 (oldest deadline 2024-04-23T10:38:39.710426+0000) 2024-04-23T10:38:48.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:47 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:47.980+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:20.811443+0000 front 2024-04-23T10:38:20.811423+0000 (oldest deadline 2024-04-23T10:38:46.711419+0000) 2024-04-23T10:38:48.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:47 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:47.815+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:48.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:47 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:47.815+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:48.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:47 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:47.815+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:48.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:47 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:47.815+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:48.179 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:47 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:47.815+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:48.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:47 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:47.897+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:48.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:47 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:47.897+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:48.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:47 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:47.897+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:48.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:47 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:47.897+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:48.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:48.288+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:48.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:48.288+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:48.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:48.288+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:48.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:48.288+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:49.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:48.755+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:49.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:48.755+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:49.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:48.755+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:49.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:48 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:48.755+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.036343+0000 front 2024-04-23T10:38:25.036310+0000 (oldest deadline 2024-04-23T10:38:46.636991+0000) 2024-04-23T10:38:49.177 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:48.965+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:57.706553+0000 front 2024-04-23T10:37:57.706512+0000 (oldest deadline 2024-04-23T10:38:24.707229+0000) 2024-04-23T10:38:49.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:48.965+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.808440+0000 front 2024-04-23T10:38:08.808482+0000 (oldest deadline 2024-04-23T10:38:31.108266+0000) 2024-04-23T10:38:49.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:48.965+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.310051+0000 front 2024-04-23T10:38:16.309955+0000 (oldest deadline 2024-04-23T10:38:39.710426+0000) 2024-04-23T10:38:49.178 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7[50579]: 2024-04-23T10:38:48.965+0000 7f4ee0a6f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:20.811443+0000 front 2024-04-23T10:38:20.811423+0000 (oldest deadline 2024-04-23T10:38:46.711419+0000) 2024-04-23T10:38:49.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:48.785+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:49.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:48.785+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:49.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:48.785+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:49.179 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:48.785+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:49.179 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:48 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:48.785+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:49.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:48 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:48.868+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:49.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:48 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:48.868+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:49.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:48 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:48.868+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:49.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:48 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:48.868+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:49.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:49 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:49.315+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:49.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:49 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:49.315+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:49.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:49 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:49.315+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:49.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:49 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:49.315+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:50.059 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:49 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:49.801+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:50.059 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:49 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:49.801+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:50.059 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:49 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:49.801+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:50.059 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:49 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:49.801+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:50.059 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:49 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:49.801+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:50.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:49 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:49.805+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:50.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:49 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:49.805+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:50.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:49 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:49.805+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:50.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:49 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:49.805+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.036343+0000 front 2024-04-23T10:38:25.036310+0000 (oldest deadline 2024-04-23T10:38:46.636991+0000) 2024-04-23T10:38:50.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:49 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:49.871+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:50.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:49 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:49.871+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:50.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:49 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:49.871+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:50.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:49 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:49.871+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:50.365 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:50 smithi146 podman[68563]: 2024-04-23 10:38:50.060561234 +0000 UTC m=+5.465282100 container died e3709b9987f96a94ed9fa5ac4e80df95dbbbabab09a50b992849209274a037d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:38:50.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:50 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:50.270+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:50.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:50 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:50.270+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:50.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:50 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:50.270+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:50.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:50 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:50.270+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:50.677 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:50 smithi146 podman[68563]: 2024-04-23 10:38:50.466127776 +0000 UTC m=+5.870848647 container cleanup e3709b9987f96a94ed9fa5ac4e80df95dbbbabab09a50b992849209274a037d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-23T10:38:50.678 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:50 smithi146 bash[68563]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7 2024-04-23T10:38:50.999 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:50 smithi146 podman[68581]: 2024-04-23 10:38:50.6837551 +0000 UTC m=+0.617998765 container remove e3709b9987f96a94ed9fa5ac4e80df95dbbbabab09a50b992849209274a037d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-23T10:38:50.999 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:50 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:50.761+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:50.999 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:50 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:50.761+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:50.999 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:50 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:50.761+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:51.000 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:50 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:50.761+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:51.000 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:50 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:50.761+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:51.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:50 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:50.828+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:51.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:50 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:50.828+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:51.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:50 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:50.828+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:51.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:50 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:50.828+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.036343+0000 front 2024-04-23T10:38:25.036310+0000 (oldest deadline 2024-04-23T10:38:46.636991+0000) 2024-04-23T10:38:51.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:50 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:50.842+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:51.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:50 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:50.842+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:51.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:50 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:50.842+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:51.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:50 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:50.842+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:51.285 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:51 smithi146 podman[68674]: 2024-04-23 10:38:51.001124204 +0000 UTC m=+0.113827313 container create 2d2a3ca69712b084495fd59745c51b7fc94b07cd7bba564cf376e86d2d96f07e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-23T10:38:51.286 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:51 smithi146 podman[68674]: 2024-04-23 10:38:50.90528248 +0000 UTC m=+0.017985613 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:38:51.286 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:51 smithi146 podman[68674]: 2024-04-23 10:38:51.204130122 +0000 UTC m=+0.316833233 container init 2d2a3ca69712b084495fd59745c51b7fc94b07cd7bba564cf376e86d2d96f07e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7-deactivate, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:38:51.286 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:51 smithi146 podman[68674]: 2024-04-23 10:38:51.207331371 +0000 UTC m=+0.320034481 container start 2d2a3ca69712b084495fd59745c51b7fc94b07cd7bba564cf376e86d2d96f07e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=) 2024-04-23T10:38:51.286 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:51 smithi146 podman[68674]: 2024-04-23 10:38:51.287426785 +0000 UTC m=+0.400129894 container attach 2d2a3ca69712b084495fd59745c51b7fc94b07cd7bba564cf376e86d2d96f07e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7-deactivate, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-23T10:38:51.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:51.304+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:51.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:51.304+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:51.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:51.304+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:51.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:51.304+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:51.677 INFO:journalctl@ceph.osd.7.smithi146.stdout:Apr 23 10:38:51 smithi146 podman[68674]: 2024-04-23 10:38:51.502735589 +0000 UTC m=+0.615438712 container died 2d2a3ca69712b084495fd59745c51b7fc94b07cd7bba564cf376e86d2d96f07e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-7-deactivate, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-23T10:38:52.090 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:51 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:51.787+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:52.090 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:51 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:51.787+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:52.090 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:51 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:51.787+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:52.090 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:51 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:51.787+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:52.090 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:51 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:51.787+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:52.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.7.service' 2024-04-23T10:38:52.155 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:38:52.155 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-23T10:38:52.155 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-23T10:38:52.155 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.8 2024-04-23T10:38:52.182 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:51.864+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:52.182 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:51.864+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:52.182 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:51.864+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:52.182 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:51 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:51.864+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.036343+0000 front 2024-04-23T10:38:25.036310+0000 (oldest deadline 2024-04-23T10:38:46.636991+0000) 2024-04-23T10:38:52.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:51 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:51.805+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:52.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:51 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:51.805+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:52.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:51 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:51.805+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:52.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:51 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:51.805+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:52.443 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:52 smithi167 systemd[1]: Stopping Ceph osd.8 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:38:52.443 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:52.320+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:52.443 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:52.320+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:52.444 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:52.320+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:52.444 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:52.320+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:52.832 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:52.444+0000 7f9a31d38700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:38:52.832 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:52.444+0000 7f9a31d38700 -1 osd.8 103 *** Got signal Terminated *** 2024-04-23T10:38:52.832 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:52.444+0000 7f9a31d38700 -1 osd.8 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:38:53.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:52 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:52.764+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:53.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:52 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:52.764+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:53.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:52 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:52.764+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:53.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:52 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:52.764+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:53.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:52 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:52.764+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:53.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:52.762+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:53.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:52.762+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:53.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:52.762+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:53.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:52 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:52.762+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:53.324 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:52.844+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:53.324 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:52.844+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:53.324 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:52.844+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:53.324 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:52 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:52.844+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.036343+0000 front 2024-04-23T10:38:25.036310+0000 (oldest deadline 2024-04-23T10:38:46.636991+0000) 2024-04-23T10:38:53.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:53 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:53.324+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:53.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:53 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:53.324+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:53.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:53 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:53.324+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:53.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:53 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:53.324+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:53.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:53.743+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:53.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:53.743+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:53.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:53.743+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:53.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:53 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:53.743+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:54.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:53 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:53.807+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:54.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:53 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:53.807+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:54.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:53 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:53.807+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:54.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:53 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:53.807+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:54.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:53 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:53.807+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:54.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:53 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:53.839+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:54.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:53 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:53.839+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:54.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:53 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:53.839+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:54.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:53 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:53.839+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.036343+0000 front 2024-04-23T10:38:25.036310+0000 (oldest deadline 2024-04-23T10:38:46.636991+0000) 2024-04-23T10:38:54.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:54 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:54.375+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:54.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:54 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:54.375+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:54.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:54 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:54.375+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:54.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:54 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:54.375+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:54.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:54 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:54.727+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:54.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:54 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:54.727+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:54.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:54 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:54.727+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:54.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:54 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:54.727+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:55.103 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:54 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:54.853+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:55.103 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:54 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:54.853+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:55.103 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:54 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:54.853+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:55.103 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:54 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:54.853+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:55.103 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:54 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:54.853+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:55.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:54 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:54.848+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:55.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:54 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:54.848+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:55.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:54 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:54.848+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:55.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:54 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:54.848+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.036343+0000 front 2024-04-23T10:38:25.036310+0000 (oldest deadline 2024-04-23T10:38:46.636991+0000) 2024-04-23T10:38:55.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:55 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:55.406+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:55.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:55 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:55.406+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:55.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:55 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:55.406+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:55.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:55 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:55.406+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:55.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:55 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:55.406+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:38:55.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:55 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:55.727+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:55.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:55 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:55.727+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:55.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:55 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:55.727+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:55.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:55 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:55.727+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:56.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:55 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:55.892+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:56.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:55 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:55.892+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:56.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:55 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:55.892+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:56.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:55 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:55.892+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:56.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:55 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:55.892+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:56.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:55 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:55.896+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:56.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:55 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:55.896+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:56.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:55 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:55.896+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:56.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:55 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:55.896+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.036343+0000 front 2024-04-23T10:38:25.036310+0000 (oldest deadline 2024-04-23T10:38:46.636991+0000) 2024-04-23T10:38:56.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:56 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:56.363+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:56.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:56 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:56.363+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:56.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:56 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:56.363+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:56.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:56 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:56.363+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:56.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:56 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:56.363+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:38:57.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:56 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:56.888+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:57.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:56 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:56.888+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:57.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:56 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:56.888+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:57.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:56 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:56.888+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:57.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:56 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:56.888+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:57.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:56 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:56.888+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:38:57.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:56 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:56.770+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:57.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:56 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:56.770+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:57.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:56 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:56.770+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:57.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:56 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:56.770+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:57.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:56 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:56.893+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:01.430642+0000 front 2024-04-23T10:38:01.430729+0000 (oldest deadline 2024-04-23T10:38:21.930797+0000) 2024-04-23T10:38:57.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:56 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:56.893+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:09.333657+0000 front 2024-04-23T10:38:09.333756+0000 (oldest deadline 2024-04-23T10:38:30.433909+0000) 2024-04-23T10:38:57.332 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:56 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:56.893+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.235528+0000 front 2024-04-23T10:38:16.235487+0000 (oldest deadline 2024-04-23T10:38:41.535348+0000) 2024-04-23T10:38:57.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:56 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8[51643]: 2024-04-23T10:38:56.893+0000 7f9a2a324700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.036343+0000 front 2024-04-23T10:38:25.036310+0000 (oldest deadline 2024-04-23T10:38:46.636991+0000) 2024-04-23T10:38:57.788 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:57 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:57.363+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:57.789 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:57 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:57.363+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:57.789 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:57 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:57.363+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:57.789 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:57 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:57.363+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:57.789 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:57 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:57.363+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:38:58.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:57 smithi167 podman[70349]: 2024-04-23 10:38:57.819815325 +0000 UTC m=+5.469223948 container died 6b3b918fb4f783d435646b92cf562ffc4a7bfe7b7cedbf95bce92877ab824f3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:38:58.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:57 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:57.878+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:58.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:57 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:57.878+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:58.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:57 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:57.878+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:58.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:57 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:57.878+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:58.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:57 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:57.878+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:58.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:57 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:57.878+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:38:58.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:57.796+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:58.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:57.796+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:58.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:57.796+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:58.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:57.796+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:58.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:57 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:57.796+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.657688+0000 front 2024-04-23T10:38:33.657671+0000 (oldest deadline 2024-04-23T10:38:57.157568+0000) 2024-04-23T10:38:58.351 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:58 smithi167 podman[70349]: 2024-04-23 10:38:58.187190127 +0000 UTC m=+5.836598756 container cleanup 6b3b918fb4f783d435646b92cf562ffc4a7bfe7b7cedbf95bce92877ab824f3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-23T10:38:58.351 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:58 smithi167 bash[70349]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8 2024-04-23T10:38:58.796 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:58 smithi167 podman[70367]: 2024-04-23 10:38:58.463801973 +0000 UTC m=+0.642556038 container remove 6b3b918fb4f783d435646b92cf562ffc4a7bfe7b7cedbf95bce92877ab824f3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-23T10:38:58.796 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:58 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:58.380+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:58.796 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:58 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:58.380+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:58.796 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:58 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:58.380+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:58.796 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:58 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:58.380+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:58.796 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:58 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:58.380+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:38:59.082 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:58 smithi167 podman[70461]: 2024-04-23 10:38:58.798016088 +0000 UTC m=+0.109651110 container create f7b729ba483d95df992e41831eb59316c6c08468e72f139d2638f0ad84db4a11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:38:59.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:58 smithi167 podman[70461]: 2024-04-23 10:38:58.70648284 +0000 UTC m=+0.018117876 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:38:59.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:59 smithi167 podman[70461]: 2024-04-23 10:38:59.034007622 +0000 UTC m=+0.345642644 container init f7b729ba483d95df992e41831eb59316c6c08468e72f139d2638f0ad84db4a11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-23T10:38:59.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:59 smithi167 podman[70461]: 2024-04-23 10:38:59.037185798 +0000 UTC m=+0.348820821 container start f7b729ba483d95df992e41831eb59316c6c08468e72f139d2638f0ad84db4a11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:38:59.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:58 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:58.883+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:38:59.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:58 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:58.883+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:38:59.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:58 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:58.883+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:38:59.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:58 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:58.883+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:38:59.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:58 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:58.883+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:38:59.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:58 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:58.883+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:38:59.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:58 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:58.763+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:59.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:58 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:58.763+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:59.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:58 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:58.763+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:59.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:58 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:58.763+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:59.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:58 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:58.763+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.657688+0000 front 2024-04-23T10:38:33.657671+0000 (oldest deadline 2024-04-23T10:38:57.157568+0000) 2024-04-23T10:38:59.350 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:59 smithi167 podman[70461]: 2024-04-23 10:38:59.168177933 +0000 UTC m=+0.479812958 container attach f7b729ba483d95df992e41831eb59316c6c08468e72f139d2638f0ad84db4a11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:38:59.350 INFO:journalctl@ceph.osd.8.smithi167.stdout:Apr 23 10:38:59 smithi167 podman[70461]: 2024-04-23 10:38:59.329097268 +0000 UTC m=+0.640732283 container died f7b729ba483d95df992e41831eb59316c6c08468e72f139d2638f0ad84db4a11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-23T10:38:59.611 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:59 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:59.415+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:38:59.611 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:59 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:59.415+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:38:59.611 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:59 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:59.415+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:38:59.611 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:59 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:59.415+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:38:59.612 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:38:59 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:38:59.415+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:38:59.913 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.8.service' 2024-04-23T10:38:59.991 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:38:59.991 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-23T10:38:59.991 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-23T10:38:59.992 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.9 2024-04-23T10:38:59.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:59 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:59.725+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:38:59.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:59 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:59.725+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:38:59.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:59 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:59.725+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:38:59.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:59 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:59.725+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:38:59.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:38:59 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:38:59.725+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.657688+0000 front 2024-04-23T10:38:33.657671+0000 (oldest deadline 2024-04-23T10:38:57.157568+0000) 2024-04-23T10:39:00.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:59 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:59.876+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:00.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:59 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:59.876+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:00.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:59 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:59.876+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:00.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:59 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:59.876+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:00.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:59 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:59.876+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:00.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:38:59 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:38:59.876+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:00.306 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:00 smithi069 systemd[1]: Stopping Ceph osd.9 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:00.681 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:00.307+0000 7f409fb10700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:00.681 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:00.307+0000 7f409fb10700 -1 osd.9 103 *** Got signal Terminated *** 2024-04-23T10:39:00.681 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:00.307+0000 7f409fb10700 -1 osd.9 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:39:00.681 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:00.682+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:39:00.682 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:00.682+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:39:00.682 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:00.682+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:39:00.682 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:00.682+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:39:00.682 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:00 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:00.682+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.657688+0000 front 2024-04-23T10:38:33.657671+0000 (oldest deadline 2024-04-23T10:38:57.157568+0000) 2024-04-23T10:39:00.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:00 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:00.461+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:00.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:00 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:00.461+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:00.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:00 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:00.461+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:00.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:00 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:00.461+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:00.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:00 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:00.461+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:01.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:00 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:00.903+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:01.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:00 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:00.903+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:01.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:00 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:00.903+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:01.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:00 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:00.903+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:01.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:00 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:00.903+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:01.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:00 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:00.903+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:01.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:01 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:01.438+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:01.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:01 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:01.438+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:01.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:01 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:01.438+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:01.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:01 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:01.438+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:01.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:01 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:01.438+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:01.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:01 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:01.717+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:39:01.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:01 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:01.717+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:39:01.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:01 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:01.717+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:39:01.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:01 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:01.717+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:39:01.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:01 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:01.717+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.657688+0000 front 2024-04-23T10:38:33.657671+0000 (oldest deadline 2024-04-23T10:38:57.157568+0000) 2024-04-23T10:39:02.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:01 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:01.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:02.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:01 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:01.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:02.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:01 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:01.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:02.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:01 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:01.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:02.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:01 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:01.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:02.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:01 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:01.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:02.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:02 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:02.466+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:02.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:02 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:02.466+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:02.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:02 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:02.466+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:02.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:02 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:02.466+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:02.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:02 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:02.466+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:02.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:02 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:02.466+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:03.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:02 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:02.754+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:39:03.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:02 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:02.754+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:39:03.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:02 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:02.754+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:39:03.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:02 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:02.754+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:39:03.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:02 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:02.754+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.657688+0000 front 2024-04-23T10:38:33.657671+0000 (oldest deadline 2024-04-23T10:38:57.157568+0000) 2024-04-23T10:39:03.427 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:02 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:02.971+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:03.427 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:02 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:02.971+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:03.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:02 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:02.971+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:03.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:02 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:02.971+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:03.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:02 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:02.971+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:03.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:02 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:02.971+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:03.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:02 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:02.971+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:36.352061+0000 front 2024-04-23T10:38:36.352023+0000 (oldest deadline 2024-04-23T10:39:02.251970+0000) 2024-04-23T10:39:03.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:03 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:03.484+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:03.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:03 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:03.484+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:03.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:03 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:03.484+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:03.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:03 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:03.484+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:03.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:03 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:03.484+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:03.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:03 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:03.484+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:03.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:03 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:03.721+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:39:03.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:03 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:03.721+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:39:03.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:03 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:03.721+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:39:03.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:03 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:03.721+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:39:03.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:03 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:03.721+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.657688+0000 front 2024-04-23T10:38:33.657671+0000 (oldest deadline 2024-04-23T10:38:57.157568+0000) 2024-04-23T10:39:03.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:03 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:03.721+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.658486+0000 front 2024-04-23T10:38:37.658511+0000 (oldest deadline 2024-04-23T10:39:03.558552+0000) 2024-04-23T10:39:04.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:03 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:03.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:04.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:03 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:03.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:04.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:03 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:03.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:04.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:03 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:03.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:04.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:03 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:03.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:04.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:03 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:03.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:04.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:03 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:03.922+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:36.352061+0000 front 2024-04-23T10:38:36.352023+0000 (oldest deadline 2024-04-23T10:39:02.251970+0000) 2024-04-23T10:39:04.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:04 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:04.522+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:04.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:04 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:04.522+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:04.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:04 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:04.522+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:04.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:04 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:04.522+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:04.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:04 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:04.522+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:04.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:04 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:04.522+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:05.170 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:04 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:04.917+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:05.170 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:04 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:04.917+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:05.170 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:04 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:04.917+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:05.170 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:04 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:04.917+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:05.170 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:04 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:04.917+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:05.170 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:04 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:04.917+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:05.170 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:04 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:04.917+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:36.352061+0000 front 2024-04-23T10:38:36.352023+0000 (oldest deadline 2024-04-23T10:39:02.251970+0000) 2024-04-23T10:39:05.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:04 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:04.755+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:53.050484+0000 front 2024-04-23T10:37:53.050509+0000 (oldest deadline 2024-04-23T10:38:15.950707+0000) 2024-04-23T10:39:05.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:04 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:04.755+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.052110+0000 front 2024-04-23T10:38:00.052024+0000 (oldest deadline 2024-04-23T10:38:25.351982+0000) 2024-04-23T10:39:05.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:04 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:04.755+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:08.853147+0000 front 2024-04-23T10:38:08.853069+0000 (oldest deadline 2024-04-23T10:38:31.152890+0000) 2024-04-23T10:39:05.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:04 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:04.755+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.354201+0000 front 2024-04-23T10:38:16.354111+0000 (oldest deadline 2024-04-23T10:38:41.054293+0000) 2024-04-23T10:39:05.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:04 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:04.755+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.657688+0000 front 2024-04-23T10:38:33.657671+0000 (oldest deadline 2024-04-23T10:38:57.157568+0000) 2024-04-23T10:39:05.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:04 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9[62467]: 2024-04-23T10:39:04.755+0000 7f40980fc700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.658486+0000 front 2024-04-23T10:38:37.658511+0000 (oldest deadline 2024-04-23T10:39:03.558552+0000) 2024-04-23T10:39:05.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:05.508+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:05.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:05.508+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:05.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:05.508+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:05.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:05.508+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:05.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:05.508+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:05.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:05 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:05.508+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:05.930 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:05 smithi069 podman[89133]: 2024-04-23 10:39:05.628955117 +0000 UTC m=+5.444924942 container died f357472248e6274c59f723acde5c19139e4815f776cd8183b57dc495950b1e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-23T10:39:05.930 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:05 smithi069 podman[89133]: 2024-04-23 10:39:05.93198901 +0000 UTC m=+5.747958824 container cleanup f357472248e6274c59f723acde5c19139e4815f776cd8183b57dc495950b1e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:39:06.241 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:05 smithi069 bash[89133]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9 2024-04-23T10:39:06.242 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:06 smithi069 podman[89150]: 2024-04-23 10:39:06.143848992 +0000 UTC m=+0.511204356 container remove f357472248e6274c59f723acde5c19139e4815f776cd8183b57dc495950b1e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-23T10:39:06.427 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:05 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:05.931+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:06.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:05 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:05.931+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:06.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:05 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:05.931+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:06.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:05 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:05.931+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:06.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:05 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:05.931+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:06.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:05 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:05.931+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:06.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:05 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:05.931+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:36.352061+0000 front 2024-04-23T10:38:36.352023+0000 (oldest deadline 2024-04-23T10:39:02.251970+0000) 2024-04-23T10:39:06.730 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:06 smithi069 podman[89243]: 2024-04-23 10:39:06.383435631 +0000 UTC m=+0.018090897 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:39:06.730 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:06 smithi069 podman[89243]: 2024-04-23 10:39:06.500568762 +0000 UTC m=+0.135224012 container create 6cbe089b26d1d8ec8e94680dd2f30df611ef4248548504cf89adf4cb6facb1f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9-deactivate, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-23T10:39:06.730 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:06 smithi069 podman[89243]: 2024-04-23 10:39:06.728482248 +0000 UTC m=+0.363137499 container init 6cbe089b26d1d8ec8e94680dd2f30df611ef4248548504cf89adf4cb6facb1f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-23T10:39:06.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:06.551+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:06.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:06.551+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:06.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:06.551+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:06.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:06.551+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:06.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:06.551+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:06.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:06.551+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:06.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:06 smithi069 podman[89243]: 2024-04-23 10:39:06.731839893 +0000 UTC m=+0.366495151 container start 6cbe089b26d1d8ec8e94680dd2f30df611ef4248548504cf89adf4cb6facb1f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-23T10:39:06.992 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:06 smithi069 podman[89243]: 2024-04-23 10:39:06.836686152 +0000 UTC m=+0.471341405 container attach 6cbe089b26d1d8ec8e94680dd2f30df611ef4248548504cf89adf4cb6facb1f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:39:07.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:06 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:06.912+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:07.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:06 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:06.912+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:07.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:06 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:06.912+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:07.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:06 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:06.912+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:07.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:06 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:06.912+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:07.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:06 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:06.912+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:07.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:06 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:06.912+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:36.352061+0000 front 2024-04-23T10:38:36.352023+0000 (oldest deadline 2024-04-23T10:39:02.251970+0000) 2024-04-23T10:39:07.293 INFO:journalctl@ceph.osd.9.smithi069.stdout:Apr 23 10:39:07 smithi069 podman[89243]: 2024-04-23 10:39:07.019269061 +0000 UTC m=+0.653924309 container died 6cbe089b26d1d8ec8e94680dd2f30df611ef4248548504cf89adf4cb6facb1f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-23T10:39:07.602 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.9.service' 2024-04-23T10:39:07.640 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:07.641 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-23T10:39:07.641 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-23T10:39:07.641 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.10 2024-04-23T10:39:07.928 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:07 smithi146 systemd[1]: Stopping Ceph osd.10 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:07.928 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:07 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:07.882+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:07.928 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:07 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:07.882+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:07.928 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:07 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:07.882+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:07.928 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:07 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:07.882+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:07.928 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:07 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:07.882+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:07.928 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:07 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:07.882+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:07.928 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:07 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:07.882+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:36.352061+0000 front 2024-04-23T10:38:36.352023+0000 (oldest deadline 2024-04-23T10:39:02.251970+0000) 2024-04-23T10:39:08.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:07 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:07.598+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:08.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:07 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:07.598+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:08.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:07 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:07.598+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:08.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:07 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:07.598+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:08.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:07 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:07.598+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:08.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:07 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:07.598+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:08.427 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:07 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:07.942+0000 7ffa89b4e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:08.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:07 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:07.942+0000 7ffa89b4e700 -1 osd.10 103 *** Got signal Terminated *** 2024-04-23T10:39:08.428 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:07 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:07.942+0000 7ffa89b4e700 -1 osd.10 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:39:09.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:08 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:08.627+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:09.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:08 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:08.627+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:09.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:08 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:08.627+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:09.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:08 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:08.627+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:09.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:08 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:08.627+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:09.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:08 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:08.627+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:09.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:08 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:08.865+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:09.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:08 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:08.865+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:09.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:08 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:08.865+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:09.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:08 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:08.865+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:09.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:08 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:08.865+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:09.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:08 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:08.865+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:09.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:08 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:08.865+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:36.352061+0000 front 2024-04-23T10:38:36.352023+0000 (oldest deadline 2024-04-23T10:39:02.251970+0000) 2024-04-23T10:39:10.042 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:09 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:09.600+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:10.042 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:09 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:09.600+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:10.042 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:09 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:09.600+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:10.042 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:09 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:09.600+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:10.042 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:09 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:09.600+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:10.042 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:09 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:09.600+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:10.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:09 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:09.884+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:10.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:09 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:09.884+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:10.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:09 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:09.884+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:10.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:09 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:09.884+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:10.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:09 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:09.884+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:10.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:09 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:09.884+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:10.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:09 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:09.884+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:36.352061+0000 front 2024-04-23T10:38:36.352023+0000 (oldest deadline 2024-04-23T10:39:02.251970+0000) 2024-04-23T10:39:11.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:10 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:10.616+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:11.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:10 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:10.616+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:11.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:10 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:10.616+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:11.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:10 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:10.616+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:11.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:10 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:10.616+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:11.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:10 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:10.616+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:11.177 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:10 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:10.893+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:11.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:10 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:10.893+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:11.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:10 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:10.893+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:11.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:10 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:10.893+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:11.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:10 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:10.893+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:11.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:10 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:10.893+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:11.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:10 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:10.893+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:36.352061+0000 front 2024-04-23T10:38:36.352023+0000 (oldest deadline 2024-04-23T10:39:02.251970+0000) 2024-04-23T10:39:12.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:11.586+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:12.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:11.586+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:12.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:11.586+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:12.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:11.586+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:12.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:11.586+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:12.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:11 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:11.586+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:12.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:11.895+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:12.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:11.895+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:12.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:11.895+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:12.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:11.895+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:12.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:11.895+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:12.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:11.895+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:12.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:11 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:11.895+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:36.352061+0000 front 2024-04-23T10:38:36.352023+0000 (oldest deadline 2024-04-23T10:39:02.251970+0000) 2024-04-23T10:39:13.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:12 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:12.614+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:13.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:12 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:12.614+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:13.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:12 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:12.614+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:13.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:12 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:12.614+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:13.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:12 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:12.614+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:13.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:12 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:12.614+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:13.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:12 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:12.614+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6820 osd.7 since back 2024-04-23T10:38:46.747755+0000 front 2024-04-23T10:38:46.747864+0000 (oldest deadline 2024-04-23T10:39:12.047612+0000) 2024-04-23T10:39:13.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:12 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:12.908+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:49.045058+0000 front 2024-04-23T10:37:49.045041+0000 (oldest deadline 2024-04-23T10:38:14.245491+0000) 2024-04-23T10:39:13.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:12 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:12.908+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:37:58.346401+0000 front 2024-04-23T10:37:58.346525+0000 (oldest deadline 2024-04-23T10:38:23.646593+0000) 2024-04-23T10:39:13.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:12 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:12.908+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:05.347594+0000 front 2024-04-23T10:38:05.347725+0000 (oldest deadline 2024-04-23T10:38:30.647658+0000) 2024-04-23T10:39:13.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:12 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:12.908+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-04-23T10:38:16.548813+0000 front 2024-04-23T10:38:16.548828+0000 (oldest deadline 2024-04-23T10:38:42.448937+0000) 2024-04-23T10:39:13.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:12 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:12.908+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:25.349851+0000 front 2024-04-23T10:38:25.349823+0000 (oldest deadline 2024-04-23T10:38:47.649905+0000) 2024-04-23T10:39:13.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:12 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:12.908+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:32.251657+0000 front 2024-04-23T10:38:32.251641+0000 (oldest deadline 2024-04-23T10:38:56.351422+0000) 2024-04-23T10:39:13.178 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:12 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10[57151]: 2024-04-23T10:39:12.908+0000 7ffa86142700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:36.352061+0000 front 2024-04-23T10:38:36.352023+0000 (oldest deadline 2024-04-23T10:39:02.251970+0000) 2024-04-23T10:39:13.675 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:13 smithi146 podman[68790]: 2024-04-23 10:39:13.371234358 +0000 UTC m=+5.532584421 container died 6eca31fa590fbe39df0521bacecd53e6f264c9e51cc0abb5d5c1424d386dfdeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux ) 2024-04-23T10:39:13.675 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:13 smithi146 podman[68790]: 2024-04-23 10:39:13.676957915 +0000 UTC m=+5.838307964 container cleanup 6eca31fa590fbe39df0521bacecd53e6f264c9e51cc0abb5d5c1424d386dfdeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:39:13.927 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:13 smithi146 bash[68790]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10 2024-04-23T10:39:13.927 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:13 smithi146 podman[68807]: 2024-04-23 10:39:13.89499658 +0000 UTC m=+0.525025517 container remove 6eca31fa590fbe39df0521bacecd53e6f264c9e51cc0abb5d5c1424d386dfdeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, ceph=True) 2024-04-23T10:39:14.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:13 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:13.635+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:14.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:13 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:13.635+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:14.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:13 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:13.635+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:14.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:13 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:13.635+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:14.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:13 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:13.635+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:14.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:13 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:13.635+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:14.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:13 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:13.635+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6820 osd.7 since back 2024-04-23T10:38:46.747755+0000 front 2024-04-23T10:38:46.747864+0000 (oldest deadline 2024-04-23T10:39:12.047612+0000) 2024-04-23T10:39:14.547 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:14 smithi146 podman[68900]: 2024-04-23 10:39:14.1220436 +0000 UTC m=+0.017973219 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:39:14.547 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:14 smithi146 podman[68900]: 2024-04-23 10:39:14.22058249 +0000 UTC m=+0.116512087 container create fc6e8248c109fe9ae70fd431bcaef3bd91708c1e77f7df8b30db78d2a4302ca3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-23T10:39:14.547 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:14 smithi146 podman[68900]: 2024-04-23 10:39:14.464708333 +0000 UTC m=+0.360637929 container init fc6e8248c109fe9ae70fd431bcaef3bd91708c1e77f7df8b30db78d2a4302ca3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-23T10:39:14.547 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:14 smithi146 podman[68900]: 2024-04-23 10:39:14.467916006 +0000 UTC m=+0.363845605 container start fc6e8248c109fe9ae70fd431bcaef3bd91708c1e77f7df8b30db78d2a4302ca3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:39:14.928 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:14 smithi146 podman[68900]: 2024-04-23 10:39:14.547855729 +0000 UTC m=+0.443785338 container attach fc6e8248c109fe9ae70fd431bcaef3bd91708c1e77f7df8b30db78d2a4302ca3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:39:14.928 INFO:journalctl@ceph.osd.10.smithi146.stdout:Apr 23 10:39:14 smithi146 podman[68900]: 2024-04-23 10:39:14.766181604 +0000 UTC m=+0.662111212 container died fc6e8248c109fe9ae70fd431bcaef3bd91708c1e77f7df8b30db78d2a4302ca3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-04-23T10:39:15.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:14 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:14.658+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:15.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:14 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:14.658+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:15.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:14 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:14.658+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:15.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:14 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:14.658+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:15.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:14 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:14.658+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:15.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:14 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:14.658+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:15.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:14 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:14.658+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6820 osd.7 since back 2024-04-23T10:38:46.747755+0000 front 2024-04-23T10:38:46.747864+0000 (oldest deadline 2024-04-23T10:39:12.047612+0000) 2024-04-23T10:39:15.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.10.service' 2024-04-23T10:39:15.434 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:15.434 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-23T10:39:15.434 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-23T10:39:15.435 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.11 2024-04-23T10:39:15.749 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:15 smithi167 systemd[1]: Stopping Ceph osd.11 for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:15.750 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:15.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:15.750 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:15.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:15.750 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:15.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:15.750 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:15.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:15.750 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:15.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:15.750 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:15.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:15.750 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:15.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6820 osd.7 since back 2024-04-23T10:38:46.747755+0000 front 2024-04-23T10:38:46.747864+0000 (oldest deadline 2024-04-23T10:39:12.047612+0000) 2024-04-23T10:39:15.750 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:15.750+0000 7fe34ee8b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:15.751 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:15.750+0000 7fe34ee8b700 -1 osd.11 103 *** Got signal Terminated *** 2024-04-23T10:39:16.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:15 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:15.750+0000 7fe34ee8b700 -1 osd.11 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-23T10:39:17.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:16 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:16.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:17.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:16 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:16.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:17.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:16 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:16.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:17.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:16 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:16.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:17.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:16 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:16.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:17.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:16 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:16.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:17.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:16 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:16.610+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6820 osd.7 since back 2024-04-23T10:38:46.747755+0000 front 2024-04-23T10:38:46.747864+0000 (oldest deadline 2024-04-23T10:39:12.047612+0000) 2024-04-23T10:39:17.984 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:17.604+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:17.984 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:17.604+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:17.984 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:17.604+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:17.985 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:17.604+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:17.985 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:17.604+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:17.985 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:17.604+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:17.985 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:17 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:17.604+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6820 osd.7 since back 2024-04-23T10:38:46.747755+0000 front 2024-04-23T10:38:46.747864+0000 (oldest deadline 2024-04-23T10:39:12.047612+0000) 2024-04-23T10:39:19.082 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:18 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:18.633+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:19.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:18 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:18.633+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:19.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:18 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:18.633+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:19.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:18 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:18.633+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:19.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:18 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:18.633+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:19.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:18 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:18.633+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:19.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:18 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:18.633+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6820 osd.7 since back 2024-04-23T10:38:46.747755+0000 front 2024-04-23T10:38:46.747864+0000 (oldest deadline 2024-04-23T10:39:12.047612+0000) 2024-04-23T10:39:20.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:19 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:19.587+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:20.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:19 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:19.587+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:20.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:19 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:19.587+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:20.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:19 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:19.587+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:20.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:19 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:19.587+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:20.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:19 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:19.587+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:20.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:19 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:19.587+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6820 osd.7 since back 2024-04-23T10:38:46.747755+0000 front 2024-04-23T10:38:46.747864+0000 (oldest deadline 2024-04-23T10:39:12.047612+0000) 2024-04-23T10:39:20.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:19 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:19.587+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2024-04-23T10:38:54.948623+0000 front 2024-04-23T10:38:54.948644+0000 (oldest deadline 2024-04-23T10:39:19.048605+0000) 2024-04-23T10:39:21.065 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:20 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:20.584+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-04-23T10:37:52.738362+0000 front 2024-04-23T10:37:52.738300+0000 (oldest deadline 2024-04-23T10:38:15.038330+0000) 2024-04-23T10:39:21.065 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:20 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:20.584+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-04-23T10:38:00.840276+0000 front 2024-04-23T10:38:00.840295+0000 (oldest deadline 2024-04-23T10:38:26.140280+0000) 2024-04-23T10:39:21.065 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:20 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:20.584+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-04-23T10:38:07.841108+0000 front 2024-04-23T10:38:07.841325+0000 (oldest deadline 2024-04-23T10:38:33.141210+0000) 2024-04-23T10:39:21.065 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:20 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:20.584+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6812 osd.4 since back 2024-04-23T10:38:21.243265+0000 front 2024-04-23T10:38:21.243247+0000 (oldest deadline 2024-04-23T10:38:47.143335+0000) 2024-04-23T10:39:21.065 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:20 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:20.584+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-04-23T10:38:33.545037+0000 front 2024-04-23T10:38:33.544953+0000 (oldest deadline 2024-04-23T10:38:55.245042+0000) 2024-04-23T10:39:21.065 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:20 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:20.584+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-04-23T10:38:37.546101+0000 front 2024-04-23T10:38:37.546031+0000 (oldest deadline 2024-04-23T10:39:02.245883+0000) 2024-04-23T10:39:21.065 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:20 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:20.584+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.146:6820 osd.7 since back 2024-04-23T10:38:46.747755+0000 front 2024-04-23T10:38:46.747864+0000 (oldest deadline 2024-04-23T10:39:12.047612+0000) 2024-04-23T10:39:21.065 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:20 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11[58259]: 2024-04-23T10:39:20.584+0000 7fe34b47f700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2024-04-23T10:38:54.948623+0000 front 2024-04-23T10:38:54.948644+0000 (oldest deadline 2024-04-23T10:39:19.048605+0000) 2024-04-23T10:39:21.332 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:21 smithi167 podman[70578]: 2024-04-23 10:39:21.066626539 +0000 UTC m=+5.433197523 container died f6f76d953fbc37b1523dad72b9f33489378664435efe72eb878ef4077855e4e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-23T10:39:21.708 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:21 smithi167 podman[70578]: 2024-04-23 10:39:21.417322484 +0000 UTC m=+5.783893456 container cleanup f6f76d953fbc37b1523dad72b9f33489378664435efe72eb878ef4077855e4e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-23T10:39:21.708 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:21 smithi167 bash[70578]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11 2024-04-23T10:39:22.034 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:21 smithi167 podman[70607]: 2024-04-23 10:39:21.710403881 +0000 UTC m=+0.641258305 container remove f6f76d953fbc37b1523dad72b9f33489378664435efe72eb878ef4077855e4e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-23T10:39:22.295 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:22 smithi167 podman[70697]: 2024-04-23 10:39:22.036445226 +0000 UTC m=+0.115284978 container create b94829e7f19817506a4bee26dc27175be89bc8b6749d7a2c5b86a8bc1d66aace (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416) 2024-04-23T10:39:22.295 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:22 smithi167 podman[70697]: 2024-04-23 10:39:21.93931656 +0000 UTC m=+0.018156278 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-23T10:39:22.295 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:22 smithi167 podman[70697]: 2024-04-23 10:39:22.222137264 +0000 UTC m=+0.300976977 container init b94829e7f19817506a4bee26dc27175be89bc8b6749d7a2c5b86a8bc1d66aace (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-04-23T10:39:22.295 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:22 smithi167 podman[70697]: 2024-04-23 10:39:22.225314452 +0000 UTC m=+0.304154167 container start b94829e7f19817506a4bee26dc27175be89bc8b6749d7a2c5b86a8bc1d66aace (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-23T10:39:22.295 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:22 smithi167 podman[70697]: 2024-04-23 10:39:22.297070171 +0000 UTC m=+0.375909893 container attach b94829e7f19817506a4bee26dc27175be89bc8b6749d7a2c5b86a8bc1d66aace (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5) 2024-04-23T10:39:22.582 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:22 smithi167 podman[70697]: 2024-04-23 10:39:22.515365757 +0000 UTC m=+0.594205461 container died b94829e7f19817506a4bee26dc27175be89bc8b6749d7a2c5b86a8bc1d66aace (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:39:23.041 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.11.service' 2024-04-23T10:39:23.063 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:23 smithi167 podman[70723]: 2024-04-23 10:39:23.025499444 +0000 UTC m=+0.504456918 container remove b94829e7f19817506a4bee26dc27175be89bc8b6749d7a2c5b86a8bc1d66aace (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-23T10:39:23.063 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:23 smithi167 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.11.service: Deactivated successfully. 2024-04-23T10:39:23.063 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:23 smithi167 systemd[1]: Stopped Ceph osd.11 for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:39:23.064 INFO:journalctl@ceph.osd.11.smithi167.stdout:Apr 23 10:39:23 smithi167 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@osd.11.service: Consumed 20.195s CPU time. 2024-04-23T10:39:23.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:23.078 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-23T10:39:23.078 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-23T10:39:23.078 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.a 2024-04-23T10:39:23.398 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:39:23 smithi069 systemd[1]: Stopping Ceph mds.a for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:23.741 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:39:23 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a[69027]: 2024-04-23T10:39:23.399+0000 7fab65d10700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:23.742 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:39:23 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a[69027]: 2024-04-23T10:39:23.399+0000 7fab65d10700 -1 mds.a *** got signal Terminated *** 2024-04-23T10:39:25.364 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:39:25 smithi069 podman[89375]: 2024-04-23 10:39:25.071042518 +0000 UTC m=+1.797411098 container died 04975c6805ae28906e8682a68ace24b647301b8ec90cf81ae1425ed607763f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:39:25.364 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:39:25 smithi069 podman[89375]: 2024-04-23 10:39:25.366379262 +0000 UTC m=+2.092747842 container cleanup 04975c6805ae28906e8682a68ace24b647301b8ec90cf81ae1425ed607763f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-23T10:39:25.716 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:39:25 smithi069 bash[89375]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a 2024-04-23T10:39:25.716 INFO:journalctl@ceph.mds.a.smithi069.stdout:Apr 23 10:39:25 smithi069 podman[89389]: 2024-04-23 10:39:25.600924954 +0000 UTC m=+0.525768572 container remove 04975c6805ae28906e8682a68ace24b647301b8ec90cf81ae1425ed607763f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-23T10:39:25.738 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.a.service' 2024-04-23T10:39:25.771 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:25.772 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-23T10:39:25.772 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-23T10:39:25.772 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.d 2024-04-23T10:39:25.992 INFO:journalctl@ceph.mds.d.smithi069.stdout:Apr 23 10:39:25 smithi069 systemd[1]: Stopping Ceph mds.d for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:26.492 INFO:journalctl@ceph.mds.d.smithi069.stdout:Apr 23 10:39:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-d[68060]: 2024-04-23T10:39:26.094+0000 7f9f070ae700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:26.492 INFO:journalctl@ceph.mds.d.smithi069.stdout:Apr 23 10:39:26 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-d[68060]: 2024-04-23T10:39:26.094+0000 7f9f070ae700 -1 mds.d *** got signal Terminated *** 2024-04-23T10:39:30.101 INFO:journalctl@ceph.mds.d.smithi069.stdout:Apr 23 10:39:29 smithi069 podman[89498]: 2024-04-23 10:39:29.833858262 +0000 UTC m=+3.837197511 container died 58820d4574a22f166e941d57db9d071d1c372f44d8bcc5b67543458ac63f2228 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-23T10:39:30.352 INFO:journalctl@ceph.mds.d.smithi069.stdout:Apr 23 10:39:30 smithi069 podman[89498]: 2024-04-23 10:39:30.103130462 +0000 UTC m=+4.106469710 container cleanup 58820d4574a22f166e941d57db9d071d1c372f44d8bcc5b67543458ac63f2228 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416) 2024-04-23T10:39:30.352 INFO:journalctl@ceph.mds.d.smithi069.stdout:Apr 23 10:39:30 smithi069 bash[89498]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-d 2024-04-23T10:39:30.484 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.d.service' 2024-04-23T10:39:30.516 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:30.516 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-23T10:39:30.516 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-23T10:39:30.517 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.g 2024-04-23T10:39:30.741 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:39:30 smithi069 systemd[1]: Stopping Ceph mds.g for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:31.242 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:39:30 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g[68667]: 2024-04-23T10:39:30.847+0000 7ffb1fc3f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:31.242 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:39:30 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g[68667]: 2024-04-23T10:39:30.847+0000 7ffb1fc3f700 -1 mds.g *** got signal Terminated *** 2024-04-23T10:39:33.396 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:39:33 smithi069 podman[89619]: 2024-04-23 10:39:33.076651059 +0000 UTC m=+2.347643700 container died 2558f26a2e85daa45a091bfbb6a1c9483419b03658bac6846e6a9bcb327e82b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-23T10:39:33.396 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:39:33 smithi069 podman[89619]: 2024-04-23 10:39:33.39832104 +0000 UTC m=+2.669313680 container cleanup 2558f26a2e85daa45a091bfbb6a1c9483419b03658bac6846e6a9bcb327e82b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:39:33.741 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:39:33 smithi069 bash[89619]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g 2024-04-23T10:39:33.741 INFO:journalctl@ceph.mds.g.smithi069.stdout:Apr 23 10:39:33 smithi069 podman[89633]: 2024-04-23 10:39:33.549452727 +0000 UTC m=+0.470594196 container remove 2558f26a2e85daa45a091bfbb6a1c9483419b03658bac6846e6a9bcb327e82b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-g, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:39:33.766 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.g.service' 2024-04-23T10:39:33.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:33.797 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-23T10:39:33.797 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-23T10:39:33.797 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.j 2024-04-23T10:39:34.133 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:39:33 smithi069 systemd[1]: Stopping Ceph mds.j for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:34.491 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:39:34 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-j[67672]: 2024-04-23T10:39:34.134+0000 7fc68211d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:34.492 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:39:34 smithi069 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-j[67672]: 2024-04-23T10:39:34.134+0000 7fc68211d700 -1 mds.j *** got signal Terminated *** 2024-04-23T10:39:38.492 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:39:38 smithi069 podman[89739]: 2024-04-23 10:39:38.141081771 +0000 UTC m=+4.117897050 container died b4575144dc0565b588b5287d30d3ea77a8542cc59b92bd38378ee777f7c6b48d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-j, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-23T10:39:38.752 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:39:38 smithi069 podman[89739]: 2024-04-23 10:39:38.584867669 +0000 UTC m=+4.561682943 container cleanup b4575144dc0565b588b5287d30d3ea77a8542cc59b92bd38378ee777f7c6b48d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-23T10:39:38.752 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:39:38 smithi069 bash[89739]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-j 2024-04-23T10:39:38.752 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:39:38 smithi069 podman[89753]: 2024-04-23 10:39:38.752290504 +0000 UTC m=+0.606037493 container remove b4575144dc0565b588b5287d30d3ea77a8542cc59b92bd38378ee777f7c6b48d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-j, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:39:39.000 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.j.service' 2024-04-23T10:39:39.020 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:39:39 smithi069 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.j.service: Deactivated successfully. 2024-04-23T10:39:39.020 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:39:39 smithi069 systemd[1]: Stopped Ceph mds.j for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:39:39.020 INFO:journalctl@ceph.mds.j.smithi069.stdout:Apr 23 10:39:39 smithi069 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.070s CPU time. 2024-04-23T10:39:39.031 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:39.031 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-23T10:39:39.031 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-23T10:39:39.031 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.b 2024-04-23T10:39:39.350 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:39:39 smithi146 systemd[1]: Stopping Ceph mds.b for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:39.677 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:39:39 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b[62372]: 2024-04-23T10:39:39.351+0000 7f7a3d032700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:39.677 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:39:39 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b[62372]: 2024-04-23T10:39:39.351+0000 7f7a3d032700 -1 mds.b *** got signal Terminated *** 2024-04-23T10:39:41.376 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:39:41 smithi146 podman[69005]: 2024-04-23 10:39:41.095188568 +0000 UTC m=+1.856398570 container died 322631e4854245c6184afe59420dfa5f22fbf9ce4f00c7bce914296a83f5e758 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-23T10:39:41.677 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:39:41 smithi146 podman[69005]: 2024-04-23 10:39:41.476949356 +0000 UTC m=+2.238159367 container cleanup 322631e4854245c6184afe59420dfa5f22fbf9ce4f00c7bce914296a83f5e758 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:39:41.677 INFO:journalctl@ceph.mds.b.smithi146.stdout:Apr 23 10:39:41 smithi146 bash[69005]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-b 2024-04-23T10:39:41.849 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.b.service' 2024-04-23T10:39:41.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:41.883 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-23T10:39:41.883 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-23T10:39:41.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.e 2024-04-23T10:39:42.427 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:39:41 smithi146 systemd[1]: Stopping Ceph mds.e for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:42.427 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:39:42 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e[61754]: 2024-04-23T10:39:42.197+0000 7f0af0443700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:42.427 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:39:42 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e[61754]: 2024-04-23T10:39:42.197+0000 7f0af0443700 -1 mds.e *** got signal Terminated *** 2024-04-23T10:39:45.404 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:39:45 smithi146 podman[69137]: 2024-04-23 10:39:45.086457708 +0000 UTC m=+2.987854214 container died b35ec06be20e1d82705247a89928f38ef27ff3ad755c5b46fa17d82b923710ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True) 2024-04-23T10:39:45.404 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:39:45 smithi146 podman[69137]: 2024-04-23 10:39:45.405965289 +0000 UTC m=+3.307361794 container cleanup b35ec06be20e1d82705247a89928f38ef27ff3ad755c5b46fa17d82b923710ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416) 2024-04-23T10:39:45.677 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:39:45 smithi146 bash[69137]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e 2024-04-23T10:39:45.677 INFO:journalctl@ceph.mds.e.smithi146.stdout:Apr 23 10:39:45 smithi146 podman[69152]: 2024-04-23 10:39:45.582070372 +0000 UTC m=+0.488650766 container remove b35ec06be20e1d82705247a89928f38ef27ff3ad755c5b46fa17d82b923710ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, ceph=True) 2024-04-23T10:39:45.836 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.e.service' 2024-04-23T10:39:45.869 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:45.869 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-23T10:39:45.869 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-23T10:39:45.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.h 2024-04-23T10:39:46.177 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:39:45 smithi146 systemd[1]: Stopping Ceph mds.h for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:46.677 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:39:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h[62066]: 2024-04-23T10:39:46.200+0000 7f2a79083700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:46.677 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:39:46 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h[62066]: 2024-04-23T10:39:46.200+0000 7f2a79083700 -1 mds.h *** got signal Terminated *** 2024-04-23T10:39:49.366 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:39:49 smithi146 podman[69259]: 2024-04-23 10:39:49.082395133 +0000 UTC m=+2.994084258 container died 9bad60ebc270b44a055f27253e3b7e945bcd1ea2607f30bf562a3e18939a8335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-23T10:39:49.677 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:39:49 smithi146 podman[69259]: 2024-04-23 10:39:49.467282455 +0000 UTC m=+3.378971586 container cleanup 9bad60ebc270b44a055f27253e3b7e945bcd1ea2607f30bf562a3e18939a8335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD) 2024-04-23T10:39:49.677 INFO:journalctl@ceph.mds.h.smithi146.stdout:Apr 23 10:39:49 smithi146 bash[69259]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-h 2024-04-23T10:39:49.817 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.h.service' 2024-04-23T10:39:49.848 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:49.848 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-23T10:39:49.848 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-23T10:39:49.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.k 2024-04-23T10:39:50.382 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:39:49 smithi146 systemd[1]: Stopping Ceph mds.k for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:50.382 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:39:50 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k[61445]: 2024-04-23T10:39:50.179+0000 7f0ea3d8d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:50.382 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:39:50 smithi146 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k[61445]: 2024-04-23T10:39:50.179+0000 7f0ea3d8d700 -1 mds.k *** got signal Terminated *** 2024-04-23T10:39:53.353 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:39:53 smithi146 podman[69381]: 2024-04-23 10:39:53.079355521 +0000 UTC m=+3.005359695 container died a4269f1a8f158a08c3732ebe0b65d5711bbf6ae803f0dd50805622dcbb352f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-23T10:39:53.677 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:39:53 smithi146 podman[69381]: 2024-04-23 10:39:53.438084504 +0000 UTC m=+3.364088686 container cleanup a4269f1a8f158a08c3732ebe0b65d5711bbf6ae803f0dd50805622dcbb352f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-23T10:39:53.677 INFO:journalctl@ceph.mds.k.smithi146.stdout:Apr 23 10:39:53 smithi146 bash[69381]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-k 2024-04-23T10:39:53.870 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.k.service' 2024-04-23T10:39:53.901 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:53.901 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-23T10:39:53.901 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-23T10:39:53.901 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.c 2024-04-23T10:39:54.332 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:39:53 smithi167 systemd[1]: Stopping Ceph mds.c for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:54.589 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:39:54 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-c[63595]: 2024-04-23T10:39:54.375+0000 7fdc29acf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:54.589 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:39:54 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-c[63595]: 2024-04-23T10:39:54.375+0000 7fdc29acf700 -1 mds.c *** got signal Terminated *** 2024-04-23T10:39:57.351 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:39:57 smithi167 podman[70804]: 2024-04-23 10:39:57.091160763 +0000 UTC m=+2.998101734 container died e331412a22cbd0281ff374715e1de3ae43af6b8db5f17acbb06d79c720f6651c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-c, ceph=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-23T10:39:57.626 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:39:57 smithi167 podman[70804]: 2024-04-23 10:39:57.434902475 +0000 UTC m=+3.341843445 container cleanup e331412a22cbd0281ff374715e1de3ae43af6b8db5f17acbb06d79c720f6651c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-23T10:39:57.626 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:39:57 smithi167 bash[70804]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-c 2024-04-23T10:39:57.864 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.c.service' 2024-04-23T10:39:57.885 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:39:57 smithi167 podman[70830]: 2024-04-23 10:39:57.628044479 +0000 UTC m=+0.530794162 container remove e331412a22cbd0281ff374715e1de3ae43af6b8db5f17acbb06d79c720f6651c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-c, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-23T10:39:57.885 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:39:57 smithi167 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.c.service: Deactivated successfully. 2024-04-23T10:39:57.885 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:39:57 smithi167 systemd[1]: Stopped Ceph mds.c for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:39:57.885 INFO:journalctl@ceph.mds.c.smithi167.stdout:Apr 23 10:39:57 smithi167 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.c.service: Consumed 1min 4.913s CPU time. 2024-04-23T10:39:57.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:39:57.899 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-23T10:39:57.899 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-23T10:39:57.899 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.f 2024-04-23T10:39:58.213 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:39:57 smithi167 systemd[1]: Stopping Ceph mds.f for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:39:58.582 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:39:58 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[67177]: 2024-04-23T10:39:58.214+0000 7f3d01041700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:39:58.582 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:39:58 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f[67177]: 2024-04-23T10:39:58.214+0000 7f3d01041700 -1 mds.f *** got signal Terminated *** 2024-04-23T10:40:01.333 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:40:01 smithi167 podman[70941]: 2024-04-23 10:40:01.083050647 +0000 UTC m=+2.967326515 container died 1d2d8b4331da08a715182ece9e5f559d38157ee1f35323585d2c603705f6e666 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-23T10:40:01.589 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:40:01 smithi167 podman[70941]: 2024-04-23 10:40:01.414296824 +0000 UTC m=+3.298572692 container cleanup 1d2d8b4331da08a715182ece9e5f559d38157ee1f35323585d2c603705f6e666 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-23T10:40:01.589 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:40:01 smithi167 bash[70941]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f 2024-04-23T10:40:01.838 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.f.service' 2024-04-23T10:40:01.859 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:40:01 smithi167 podman[70956]: 2024-04-23 10:40:01.591279816 +0000 UTC m=+0.504276997 container remove 1d2d8b4331da08a715182ece9e5f559d38157ee1f35323585d2c603705f6e666 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-f, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2) 2024-04-23T10:40:01.859 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:40:01 smithi167 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.f.service: Deactivated successfully. 2024-04-23T10:40:01.859 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:40:01 smithi167 systemd[1]: Stopped Ceph mds.f for ac4c3a2c-0159-11ef-bc93-c7b262605968. 2024-04-23T10:40:01.859 INFO:journalctl@ceph.mds.f.smithi167.stdout:Apr 23 10:40:01 smithi167 systemd[1]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.f.service: Consumed 5.552s CPU time. 2024-04-23T10:40:01.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:40:01.871 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-23T10:40:01.872 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-23T10:40:01.872 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.i 2024-04-23T10:40:02.185 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:40:01 smithi167 systemd[1]: Stopping Ceph mds.i for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:40:02.582 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:40:02 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i[63901]: 2024-04-23T10:40:02.186+0000 7f1bf3437700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:40:02.582 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:40:02 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i[63901]: 2024-04-23T10:40:02.186+0000 7f1bf3437700 -1 mds.i *** got signal Terminated *** 2024-04-23T10:40:05.333 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:40:05 smithi167 podman[71063]: 2024-04-23 10:40:05.086970742 +0000 UTC m=+3.000061273 container died 7c5cf81471dae89bf147492a46581eb53032634e197c9def206d1a3d8d58f6f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-23T10:40:05.678 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:40:05 smithi167 podman[71063]: 2024-04-23 10:40:05.471054999 +0000 UTC m=+3.384145529 container cleanup 7c5cf81471dae89bf147492a46581eb53032634e197c9def206d1a3d8d58f6f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-23T10:40:05.679 INFO:journalctl@ceph.mds.i.smithi167.stdout:Apr 23 10:40:05 smithi167 bash[71063]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-i 2024-04-23T10:40:05.807 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.i.service' 2024-04-23T10:40:05.838 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:40:05.839 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-23T10:40:05.839 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-23T10:40:05.839 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.l 2024-04-23T10:40:06.082 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:40:05 smithi167 systemd[1]: Stopping Ceph mds.l for ac4c3a2c-0159-11ef-bc93-c7b262605968... 2024-04-23T10:40:06.582 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:40:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l[62979]: 2024-04-23T10:40:06.182+0000 7efdf9130700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-23T10:40:06.582 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:40:06 smithi167 ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l[62979]: 2024-04-23T10:40:06.182+0000 7efdf9130700 -1 mds.l *** got signal Terminated *** 2024-04-23T10:40:09.399 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:40:09 smithi167 podman[71181]: 2024-04-23 10:40:09.094387607 +0000 UTC m=+3.034384184 container died bdebef762c537a51e2cbc970b2b9a2fa9a6e280ad3f9ff181528c6d0e731ec3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-23T10:40:09.699 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:40:09 smithi167 podman[71181]: 2024-04-23 10:40:09.484039277 +0000 UTC m=+3.424035901 container cleanup bdebef762c537a51e2cbc970b2b9a2fa9a6e280ad3f9ff181528c6d0e731ec3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416) 2024-04-23T10:40:09.699 INFO:journalctl@ceph.mds.l.smithi167.stdout:Apr 23 10:40:09 smithi167 bash[71181]: ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968-mds-l 2024-04-23T10:40:09.836 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ac4c3a2c-0159-11ef-bc93-c7b262605968@mds.l.service' 2024-04-23T10:40:09.866 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-23T10:40:09.866 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-23T10:40:09.867 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-23T10:40:10.059 INFO:teuthology.orchestra.run.smithi069.stdout:Deleting cluster with fsid: ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:40:12.493 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-23T10:40:12.685 INFO:teuthology.orchestra.run.smithi146.stdout:Deleting cluster with fsid: ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:40:15.147 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-23T10:40:15.336 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:40:17.572 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T10:40:17.604 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T10:40:17.637 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-23T10:40:17.662 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-23T10:40:17.665 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517/remote/smithi069/crash 2024-04-23T10:40:17.666 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/crash -- . 2024-04-23T10:40:17.694 INFO:teuthology.orchestra.run.smithi069.stderr:tar: /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-23T10:40:17.694 INFO:teuthology.orchestra.run.smithi069.stderr:tar: Error is not recoverable: exiting now 2024-04-23T10:40:17.696 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517/remote/smithi146/crash 2024-04-23T10:40:17.697 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/crash -- . 2024-04-23T10:40:17.739 INFO:teuthology.orchestra.run.smithi146.stderr:tar: /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-23T10:40:17.739 INFO:teuthology.orchestra.run.smithi146.stderr:tar: Error is not recoverable: exiting now 2024-04-23T10:40:17.742 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517/remote/smithi167/crash 2024-04-23T10:40:17.749 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/crash -- . 2024-04-23T10:40:17.785 INFO:teuthology.orchestra.run.smithi167.stderr:tar: /var/lib/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-23T10:40:17.785 INFO:teuthology.orchestra.run.smithi167.stderr:tar: Error is not recoverable: exiting now 2024-04-23T10:40:17.786 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-23T10:40:17.787 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-23T10:40:17.821 INFO:tasks.cephadm:Compressing logs... 2024-04-23T10:40:17.821 DEBUG:teuthology.orchestra.run.smithi069:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T10:40:17.864 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T10:40:17.867 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T10:40:17.887 INFO:teuthology.orchestra.run.smithi069.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-23T10:40:17.887 INFO:teuthology.orchestra.run.smithi069.stderr:: No such file or directory 2024-04-23T10:40:17.887 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.log 2024-04-23T10:40:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-23T10:40:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.g.log 2024-04-23T10:40:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.j.log 2024-04-23T10:40:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-23T10:40:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.g.log: /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-23T10:40:17.896 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mgr.x.log 2024-04-23T10:40:17.896 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mon.a.log 2024-04-23T10:40:17.896 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mgr.x.log: 87.3% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-23T10:40:17.896 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.6.log 2024-04-23T10:40:17.896 INFO:teuthology.orchestra.run.smithi069.stderr: 90.3%/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mon.a.log: -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-23T10:40:17.896 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-23T10:40:17.896 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.6.log: 94.5% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.j.log.gz 2024-04-23T10:40:17.896 INFO:teuthology.orchestra.run.smithi069.stderr: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:: No such file or directory 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.log 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.f.log 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.log: /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.c.log 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mon.c.log 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.5.log: /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mgr.z.log 2024-04-23T10:40:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.i.log 2024-04-23T10:40:17.898 INFO:teuthology.orchestra.run.smithi167.stderr: 87.3% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-23T10:40:17.898 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mgr.z.log: 90.5% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-23T10:40:17.899 INFO:teuthology.orchestra.run.smithi146.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory /var/log/ceph/cephadm.log 2024-04-23T10:40:17.899 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-04-23T10:40:17.899 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.log 2024-04-23T10:40:17.899 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-23T10:40:17.899 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.7.log 2024-04-23T10:40:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.b.log 2024-04-23T10:40:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.7.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-23T10:40:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-23T10:40:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-23T10:40:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.b.log: /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mgr.y.log 2024-04-23T10:40:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.h.log 2024-04-23T10:40:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mgr.y.log: 87.3% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.log.gzgzip 2024-04-23T10:40:17.904 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.10.log 2024-04-23T10:40:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.h.log: 90.5% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-23T10:40:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-23T10:40:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.e.log 2024-04-23T10:40:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.cephadm.log: 84.0% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-23T10:40:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-23T10:40:17.906 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.e.log: 91.8% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mgr.y.log.gz 2024-04-23T10:40:17.906 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mon.b.log 2024-04-23T10:40:17.907 INFO:teuthology.orchestra.run.smithi167.stderr: 91.9% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mgr.z.log.gz 2024-04-23T10:40:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-23T10:40:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.11.log 2024-04-23T10:40:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.8.log 2024-04-23T10:40:17.908 INFO:teuthology.orchestra.run.smithi167.stderr: 83.9% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-23T10:40:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-23T10:40:17.911 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.a.log 2024-04-23T10:40:17.911 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-23T10:40:17.911 INFO:teuthology.orchestra.run.smithi069.stderr: 84.3% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-23T10:40:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-23T10:40:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.k.log 2024-04-23T10:40:17.921 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.l.log 2024-04-23T10:40:17.924 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.d.log 2024-04-23T10:40:17.938 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.9.log 2024-04-23T10:40:17.938 INFO:teuthology.orchestra.run.smithi069.stderr: 91.0% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-23T10:40:17.948 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-23T10:40:17.955 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.d.log: /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.9.log: 94.5% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.d.log.gz 2024-04-23T10:40:18.248 INFO:teuthology.orchestra.run.smithi069.stderr: 90.2% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mgr.x.log.gz 2024-04-23T10:40:18.294 INFO:teuthology.orchestra.run.smithi069.stderr: 94.8% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.a.log.gz 2024-04-23T10:40:18.382 INFO:teuthology.orchestra.run.smithi167.stderr: 92.0% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mon.c.log.gz 2024-04-23T10:40:18.409 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mon.b.log: /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.k.log: 92.1% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mon.b.log.gz 2024-04-23T10:40:18.454 INFO:teuthology.orchestra.run.smithi069.stderr: 94.9% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.g.log.gz 2024-04-23T10:40:18.636 INFO:teuthology.orchestra.run.smithi146.stderr: 95.0% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.k.log.gz 2024-04-23T10:40:18.857 INFO:teuthology.orchestra.run.smithi069.stderr: 90.4% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mon.a.log.gz 2024-04-23T10:40:19.532 INFO:teuthology.orchestra.run.smithi167.stderr: 94.8% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.f.log.gz 2024-04-23T10:40:20.187 INFO:teuthology.orchestra.run.smithi146.stderr: 95.5% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.b.log.gz 2024-04-23T10:40:21.305 INFO:teuthology.orchestra.run.smithi069.stderr: 92.2% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.9.log.gz 2024-04-23T10:40:21.905 INFO:teuthology.orchestra.run.smithi146.stderr: 93.9% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.h.log.gz 2024-04-23T10:40:21.993 INFO:teuthology.orchestra.run.smithi069.stderr: 91.2% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.6.log.gz 2024-04-23T10:40:22.016 INFO:teuthology.orchestra.run.smithi146.stderr: 91.7% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-23T10:40:22.172 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-23T10:40:22.310 INFO:teuthology.orchestra.run.smithi069.stderr: 91.6% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-23T10:40:22.805 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.11.log.gz 2024-04-23T10:40:22.918 INFO:teuthology.orchestra.run.smithi146.stderr: 91.7% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.10.log.gz 2024-04-23T10:40:23.125 INFO:teuthology.orchestra.run.smithi069.stderr: 92.0% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-23T10:40:23.127 INFO:teuthology.orchestra.run.smithi069.stderr: 2024-04-23T10:40:23.127 INFO:teuthology.orchestra.run.smithi069.stderr:real 0m5.250s 2024-04-23T10:40:23.127 INFO:teuthology.orchestra.run.smithi069.stderr:user 0m18.784s 2024-04-23T10:40:23.127 INFO:teuthology.orchestra.run.smithi069.stderr:sys 0m0.639s 2024-04-23T10:40:23.509 INFO:teuthology.orchestra.run.smithi167.stderr: 92.0% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.8.log.gz 2024-04-23T10:40:23.566 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.7.log.gz 2024-04-23T10:40:23.595 INFO:teuthology.orchestra.run.smithi146.stderr: 93.6% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.e.log.gz 2024-04-23T10:40:23.597 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-04-23T10:40:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m5.716s 2024-04-23T10:40:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m30.857s 2024-04-23T10:40:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m0.949s 2024-04-23T10:40:23.677 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-23T10:40:23.932 INFO:teuthology.orchestra.run.smithi167.stderr: 91.9% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-23T10:40:24.972 INFO:teuthology.orchestra.run.smithi167.stderr: 93.7% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.l.log.gz 2024-04-23T10:40:33.247 INFO:teuthology.orchestra.run.smithi167.stderr: 93.2% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.i.log.gz 2024-04-23T10:40:40.635 INFO:teuthology.orchestra.run.smithi167.stderr: 93.3% -- replaced with /var/log/ceph/ac4c3a2c-0159-11ef-bc93-c7b262605968/ceph-mds.c.log.gz 2024-04-23T10:40:40.637 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-04-23T10:40:40.637 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m22.756s 2024-04-23T10:40:40.637 INFO:teuthology.orchestra.run.smithi167.stderr:user 1m7.087s 2024-04-23T10:40:40.637 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m1.953s 2024-04-23T10:40:40.637 INFO:tasks.cephadm:Archiving logs... 2024-04-23T10:40:40.637 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517/remote/smithi069/log 2024-04-23T10:40:40.639 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T10:40:43.488 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517/remote/smithi146/log 2024-04-23T10:40:43.489 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T10:40:47.061 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517/remote/smithi167/log 2024-04-23T10:40:47.062 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T10:40:55.544 INFO:tasks.cephadm:Removing cluster... 2024-04-23T10:40:55.544 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 --force 2024-04-23T10:40:55.736 INFO:teuthology.orchestra.run.smithi069.stdout:Deleting cluster with fsid: ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:40:56.067 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 --force 2024-04-23T10:40:56.259 INFO:teuthology.orchestra.run.smithi146.stdout:Deleting cluster with fsid: ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:40:56.547 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ac4c3a2c-0159-11ef-bc93-c7b262605968 --force 2024-04-23T10:40:56.736 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: ac4c3a2c-0159-11ef-bc93-c7b262605968 2024-04-23T10:40:57.059 INFO:tasks.cephadm:Removing cephadm ... 2024-04-23T10:40:57.059 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-23T10:40:57.078 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-23T10:40:57.094 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-23T10:40:57.109 INFO:tasks.cephadm:Teardown complete 2024-04-23T10:40:57.110 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-23T10:40:57.121 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-23T10:40:57.121 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T10:40:57.124 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T10:40:57.136 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T10:40:57.245 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-23T10:40:57.255 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-23T10:40:57.255 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:40:57.258 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:40:57.260 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:40:57.272 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2024-04-23T10:40:57.272 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-04-23T10:40:57.274 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-04-23T10:40:57.277 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T10:40:57.277 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-04-23T10:40:57.277 INFO:teuthology.orchestra.run.smithi146.stdout:^- hv01.front.sepia.ceph.com 2 6 377 3 +1740us[+1740us] +/- 590ms 2024-04-23T10:40:57.277 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv02.front.sepia.ceph.com 3 6 377 0 +163us[ +164us] +/- 55ms 2024-04-23T10:40:57.277 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 -196us[ -195us] +/- 69ms 2024-04-23T10:40:57.277 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:40:57.279 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T10:40:57.279 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-04-23T10:40:57.279 INFO:teuthology.orchestra.run.smithi167.stdout:^- hv01.front.sepia.ceph.com 2 6 377 1 +1737us[+1737us] +/- 590ms 2024-04-23T10:40:57.279 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv02.front.sepia.ceph.com 3 6 377 1 +154us[ +154us] +/- 55ms 2024-04-23T10:40:57.279 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -192us[ -193us] +/- 69ms 2024-04-23T10:40:57.279 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:40:57.280 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T10:40:57.280 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2024-04-23T10:40:57.280 INFO:teuthology.orchestra.run.smithi069.stdout:^- hv01.front.sepia.ceph.com 2 6 377 3 +1738us[+1738us] +/- 590ms 2024-04-23T10:40:57.280 INFO:teuthology.orchestra.run.smithi069.stdout:^* hv02.front.sepia.ceph.com 3 6 377 3 +181us[ +187us] +/- 55ms 2024-04-23T10:40:57.280 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -198us[ -198us] +/- 69ms 2024-04-23T10:40:57.280 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T10:40:57.280 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-23T10:40:57.291 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-23T10:40:57.291 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-23T10:40:57.301 DEBUG:teuthology.orchestra.run.smithi069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T10:40:57.395 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T10:40:57.460 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T10:40:57.523 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T10:40:57.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:40:57.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T10:40:57.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:40:57.578 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T10:40:57.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:40:57.604 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-23T10:40:57.615 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-23T10:40:57.626 INFO:teuthology.task.internal:Duration was 2436.246517 seconds 2024-04-23T10:40:57.626 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-23T10:40:57.636 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-23T10:40:57.636 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T10:40:57.639 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T10:40:57.641 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T10:40:57.673 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T10:40:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T10:40:57.680 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T10:40:58.028 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-23T10:40:58.029 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2024-04-23T10:40:58.029 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T10:40:58.088 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2024-04-23T10:40:58.089 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T10:40:58.115 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-04-23T10:40:58.116 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T10:40:58.140 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-23T10:40:58.140 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T10:40:58.142 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T10:40:58.159 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T10:40:58.205 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-23T10:40:58.205 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T10:40:58.208 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T10:40:58.224 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T10:40:58.590 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-23T10:40:58.602 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-23T10:40:58.602 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T10:40:58.625 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T10:40:58.648 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T10:40:58.672 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-23T10:40:58.683 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:40:58.685 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:40:58.690 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:40:58.704 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2024-04-23T10:40:58.710 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2024-04-23T10:40:58.734 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-04-23T10:40:58.769 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:40:58.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:40:58.782 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:40:58.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:40:58.796 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:40:58.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:40:58.823 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-23T10:40:58.835 INFO:teuthology.task.internal:Transferring archived files... 2024-04-23T10:40:58.835 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517/remote/smithi069 2024-04-23T10:40:58.836 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T10:40:58.875 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517/remote/smithi146 2024-04-23T10:40:58.875 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T10:40:58.908 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669517/remote/smithi167 2024-04-23T10:40:58.909 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T10:40:58.942 INFO:teuthology.task.internal:Removing archive directory... 2024-04-23T10:40:58.942 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T10:40:58.945 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T10:40:58.947 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T10:40:58.992 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-23T10:40:59.004 INFO:teuthology.task.internal:Not uploading archives. 2024-04-23T10:40:59.004 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-23T10:40:59.015 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-23T10:40:59.015 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T10:40:59.017 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T10:40:59.020 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T10:40:59.029 INFO:teuthology.orchestra.run.smithi069.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 10:40 /home/ubuntu/cephtest 2024-04-23T10:40:59.031 INFO:teuthology.orchestra.run.smithi146.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 10:40 /home/ubuntu/cephtest 2024-04-23T10:40:59.046 INFO:teuthology.orchestra.run.smithi167.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 10:40 /home/ubuntu/cephtest 2024-04-23T10:40:59.047 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-23T10:40:59.059 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-23T10:40:59.086 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 2436.2465167045593 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-04-23T10:40:59.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T10:40:59.168 INFO:teuthology.run:pass